-- Logs begin at Wed 2022-07-20 10:01:33 UTC, end at Wed 2022-07-20 11:52:36 UTC. -- Jul 20 10:34:29.305427 n-d-846219-10 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 10:34:29.314691 n-d-846219-10 devstack@n-api.service[110548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 10:34:29 2022] *** Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: nodename: n-d-846219-10 Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: machine: x86_64 Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: clock source: unix Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: pcre jit disabled Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: detected number of CPU cores: 4 Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: current working directory: / Jul 20 10:34:29.316682 n-d-846219-10 devstack@n-api.service[110548]: detected binary path: /usr/bin/uwsgi-core Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: your processes number limit is 47680 Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: your memory page size is 4096 bytes Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: detected max file descriptor number: 2048 Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: lock engine: pthread robust mutexes Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: thunder lock: enabled Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 10:34:29.317272 n-d-846219-10 devstack@n-api.service[110548]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 10:34:29.361767 n-d-846219-10 devstack@n-api.service[110548]: Python main interpreter initialized at 0x5559fccac9c0 Jul 20 10:34:29.361767 n-d-846219-10 devstack@n-api.service[110548]: python threads support enabled Jul 20 10:34:29.361767 n-d-846219-10 devstack@n-api.service[110548]: your server socket listen backlog is limited to 100 connections Jul 20 10:34:29.361767 n-d-846219-10 devstack@n-api.service[110548]: your mercy for graceful operations on workers is 90 seconds Jul 20 10:34:29.362358 n-d-846219-10 devstack@n-api.service[110548]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 10:34:29.362358 n-d-846219-10 devstack@n-api.service[110548]: *** Operational MODE: preforking *** Jul 20 10:34:29.362520 n-d-846219-10 devstack@n-api.service[110548]: *** uWSGI is running in multiple interpreter mode *** Jul 20 10:34:29.362520 n-d-846219-10 devstack@n-api.service[110548]: spawned uWSGI master process (pid: 110548) Jul 20 10:34:29.362606 n-d-846219-10 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 10:34:29.363936 n-d-846219-10 devstack@n-api.service[110548]: spawned uWSGI worker 1 (pid: 110549, cores: 1) Jul 20 10:34:29.363936 n-d-846219-10 devstack@n-api.service[110548]: spawned uWSGI worker 2 (pid: 110550, cores: 1) Jul 20 10:34:29.363936 n-d-846219-10 devstack@n-api.service[110548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 10:34:30.039419 n-d-846219-10 devstack@n-api.service[110549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 10:34:30.040145 n-d-846219-10 devstack@n-api.service[110550]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 10:34:31.182267 n-d-846219-10 devstack@n-api.service[110549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:34:31.182267 n-d-846219-10 devstack@n-api.service[110549]: from cryptography.utils import int_from_bytes Jul 20 10:34:31.182825 n-d-846219-10 devstack@n-api.service[110549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:34:31.182825 n-d-846219-10 devstack@n-api.service[110549]: from cryptography.utils import int_from_bytes Jul 20 10:34:31.185675 n-d-846219-10 devstack@n-api.service[110550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:34:31.185675 n-d-846219-10 devstack@n-api.service[110550]: from cryptography.utils import int_from_bytes Jul 20 10:34:31.186121 n-d-846219-10 devstack@n-api.service[110550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:34:31.186121 n-d-846219-10 devstack@n-api.service[110550]: from cryptography.utils import int_from_bytes Jul 20 10:34:33.683932 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 10:34:33.684535 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 10:34:33.684717 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 10:34:33.685079 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 10:34:33.685332 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 10:34:33.685521 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 10:34:33.685877 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.685961 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 10:34:33.686050 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.686321 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 10:34:33.686418 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.686641 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.686799 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 10:34:33.686964 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.687062 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 10:34:33.687305 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.687484 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.687630 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.687817 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.687958 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.688151 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.688272 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.688475 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.688576 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.688809 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.688917 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.689126 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.689234 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.689443 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.689588 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.689730 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.689878 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690040 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690132 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690332 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690420 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690645 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690742 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.690966 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.691070 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.691290 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.691411 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.691622 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.691792 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.693256 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.693355 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.693512 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.693652 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.693789 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.693915 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694052 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694052 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694295 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694295 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694550 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694688 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694819 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.694933 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695065 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695216 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695345 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695469 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695582 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695718 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695858 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.695984 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696108 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696231 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696364 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696489 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696619 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696746 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696868 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.696991 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697129 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697256 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697389 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697531 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697681 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697821 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.697930 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698034 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698168 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698374 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698533 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698664 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698848 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.698989 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.699160 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.699328 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.699510 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.699762 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.699891 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.700196 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.700333 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.700510 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.700646 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.700821 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.700950 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.701144 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.701276 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.701451 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.701591 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.701756 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.701886 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702020 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702145 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702303 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702435 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702624 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702772 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.702946 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703083 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703292 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703422 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703570 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703700 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703825 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.703951 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.704082 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.704213 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.704395 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.704530 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.704704 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.704846 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705011 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705156 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705292 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705430 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705556 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705681 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.705884 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.706023 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.706192 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.706319 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.706496 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.706627 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.706801 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707018 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707147 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707309 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707435 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707558 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707739 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.707876 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708048 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708173 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708431 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708568 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708694 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708832 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.708988 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.709131 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.709289 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.709417 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.709611 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.709739 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.709933 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.710061 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.710239 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.710373 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.710558 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.710694 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.710878 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711016 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711196 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711341 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711505 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711635 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711812 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.711952 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.712131 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.712260 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.712464 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.712601 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.712769 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.712915 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.713050 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.713205 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.713355 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.713677 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.713895 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714083 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714281 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714457 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714586 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714716 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714841 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.714964 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715087 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715299 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715428 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715554 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715689 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715814 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.715937 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.716075 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.716229 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.716389 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.716526 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.716701 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.716831 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717009 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717140 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717325 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717454 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717635 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717777 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.717946 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.718075 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.718259 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.718395 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.718610 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.718760 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.718886 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719009 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719189 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719321 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719499 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719639 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719802 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.719940 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.720120 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.720257 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.720424 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.720561 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.720728 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.720857 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721037 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721172 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721340 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721477 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721644 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721782 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.721960 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.722090 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.722265 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.722404 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.722567 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.722696 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.722884 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723020 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723201 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723339 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723511 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723655 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723827 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.723957 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.724133 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.724272 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.724438 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.724575 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.724739 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.724868 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725044 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725181 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725347 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725477 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725650 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725787 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.725952 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726081 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726256 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726385 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726552 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726682 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726863 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.726991 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.727189 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.727314 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.727503 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.727631 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.727808 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.727938 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.728113 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.728252 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.728430 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.728568 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.729356 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.729531 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.729694 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.729839 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.730020 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.730194 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.730336 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.730465 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.730714 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.730902 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.731046 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:34:33.731208 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.731398 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.731537 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.731758 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.731916 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.732061 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.732276 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.732405 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.732597 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.732736 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.732940 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.733085 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.733276 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.733405 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.733593 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.733722 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.733909 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.734046 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.734227 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.734355 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.734556 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.734694 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.734874 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.735088 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.735260 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.735398 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.735523 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.735647 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.735872 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736023 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736193 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736330 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736516 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736645 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736827 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.736964 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.737148 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.737276 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.737504 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.737641 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.737813 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.737941 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.738135 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.738265 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.738457 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.738586 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.738768 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.738906 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.739080 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.739272 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.739484 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.739612 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.739750 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.739883 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740042 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740171 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740351 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740486 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740667 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740798 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.740977 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.741105 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.741284 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.741422 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.741592 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.741728 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.741901 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742028 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742207 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742350 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742540 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742668 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742854 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.742982 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.743207 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.743353 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.743488 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.743611 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.743795 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.743923 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.744104 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.744242 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.744457 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.745276 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.745458 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.745653 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.745791 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.745980 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.746111 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.746338 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.746468 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.746662 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.746801 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.746989 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.747118 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.747339 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.747480 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.747659 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.747797 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.747977 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.748113 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.748295 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.748426 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.748614 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.748753 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.748926 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749057 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749238 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749369 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749588 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749734 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749861 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.749985 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.750141 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.750278 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.750451 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.750581 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.750755 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.750885 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.751078 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.751292 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.751434 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.751562 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.751709 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.751847 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752033 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752163 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752338 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752468 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752642 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752774 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.752956 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.753084 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.753267 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.753396 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.753578 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.753700 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.753891 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754029 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754200 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754334 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754522 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754650 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754833 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.754970 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.755143 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.755295 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.755498 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.755625 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.755818 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.755961 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.756121 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.756250 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.756443 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.756572 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.756762 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.756906 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757081 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757201 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757386 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757514 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757695 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757870 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.757998 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.758122 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.758293 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.758422 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.758626 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.758763 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.758897 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.759022 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.759208 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.759353 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.759515 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.759668 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.759864 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.760016 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.760148 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.760301 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.760554 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.760685 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.760880 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761017 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761193 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761336 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761498 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761634 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761803 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.761933 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.762192 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.762329 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.762502 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.762698 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.762834 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.763009 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.763137 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.763384 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.763528 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.763751 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.763882 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764040 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764170 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764349 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764479 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764657 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764788 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.764969 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.765106 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.765282 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.765412 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.765592 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.765722 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.765902 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766041 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766211 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766342 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766531 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766661 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766841 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.766980 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.767194 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.767319 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.767502 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.767626 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.767816 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.767957 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.768176 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.768313 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.768438 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.768562 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.768755 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.768901 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.769049 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.769178 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.769370 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.769504 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.769686 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.769816 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770032 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770161 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770311 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770440 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770621 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770745 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.770929 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.771056 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.771259 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.771389 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.771570 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.771704 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.771884 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772061 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772203 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772329 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772486 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772617 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772796 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.772925 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.773110 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.773248 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.773419 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.773563 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.773739 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.773897 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774048 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774189 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774359 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774487 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774683 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774820 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.774971 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.775116 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.775317 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.775461 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.775670 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.775800 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.775984 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.776227 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.776358 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.776551 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.776690 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.776878 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777015 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777189 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777320 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777497 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777634 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777801 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.777942 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.778106 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.778235 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.778415 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.778554 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.778727 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.778866 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779035 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779190 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779368 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779500 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779672 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779812 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.779985 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780203 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780333 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780457 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780581 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780719 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780869 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.780999 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.781179 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.781308 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.781501 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.781641 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.781808 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.781937 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.782114 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.782242 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.782430 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.782565 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.782734 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.782864 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783035 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783223 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783444 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783585 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783723 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783848 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.783972 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.784102 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.784237 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.784363 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.784543 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.784701 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.784882 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.785048 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.785255 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.785453 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.785640 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.785813 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.785965 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.786175 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.786363 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.786520 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.786717 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.786904 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787067 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787233 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787375 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787502 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787615 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787769 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.787942 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.788238 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.788401 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.788557 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.788745 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.788899 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.789081 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.789237 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.789375 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.789580 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.789785 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.789924 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.790096 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.790383 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.790561 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.790723 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.790864 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.791049 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.791796 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.792004 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.792173 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.792173 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.792440 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.792645 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.792840 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.793021 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.793207 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.793207 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.793500 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.793656 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.793656 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.794020 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.794182 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.794354 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.794523 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.794523 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.794897 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795063 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795270 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795465 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795619 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795765 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795962 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.795962 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.796286 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.796433 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.796641 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.796803 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.797009 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.797171 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.797308 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.797480 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.797637 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.798070 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.798279 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.798469 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.798469 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.798762 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.798959 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.799111 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.799336 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.799525 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.799723 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.799888 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.800083 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.800237 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.800555 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.800753 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.800907 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.801092 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.801266 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.801428 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.801580 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.801789 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.801944 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.802119 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.802273 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.802404 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.802613 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.802794 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.802967 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.803130 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.803399 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.803597 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.803780 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.803951 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804083 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804211 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804336 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804460 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804599 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804726 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804859 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.804992 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805118 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805254 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805254 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805491 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805623 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805749 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.805881 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806015 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806141 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806267 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806391 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806515 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806515 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806767 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.806989 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.807627 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.807753 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.807867 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.807991 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808131 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808254 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808380 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808503 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808626 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808626 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808871 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.808994 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809118 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809241 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809364 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809498 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809623 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809751 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.809883 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810009 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810133 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810270 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810396 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810535 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810734 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.810876 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811000 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811134 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811328 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811456 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811580 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811704 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811836 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.811968 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812092 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812216 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812340 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812465 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812598 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812723 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812848 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.812971 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813102 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813234 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813449 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813579 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813704 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813828 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.813953 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814077 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814210 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814343 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814468 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814592 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814715 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814849 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.814974 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815088 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815212 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815340 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815464 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815602 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815745 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815871 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.815996 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816120 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816244 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816389 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816515 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816651 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816778 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.816901 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.817091 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.817235 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.817406 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.817536 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.817708 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.817839 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818017 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818148 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818319 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818441 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818623 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818761 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.818924 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819063 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819253 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819397 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819556 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819685 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819858 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.819993 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.820157 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.820295 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.820457 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.820587 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.820769 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.820948 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.821106 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.821255 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.821445 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.821612 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.821757 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.821896 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.822048 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.822187 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.822326 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.822475 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.822613 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.823547 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.823712 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.823851 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.823851 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824118 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824260 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824411 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824552 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824693 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824831 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824983 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.824983 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.825254 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.825394 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.825540 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.825695 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.825849 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.825849 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.826124 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.826267 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.826408 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.826561 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.826728 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.826872 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827013 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827153 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827318 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827475 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827612 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827761 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.827983 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.828147 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.828291 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.828475 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.828619 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.828760 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.828901 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829043 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829202 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829352 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829500 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829638 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829774 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.829909 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830061 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830203 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830342 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830484 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830636 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830777 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.830933 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831070 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831241 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831382 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831519 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831673 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831827 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.831971 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832126 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832267 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832403 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832540 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832699 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832836 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.832983 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.833120 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.833258 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.833416 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.833561 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.833702 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.833853 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834004 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834149 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834300 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834444 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834588 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834728 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.834865 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.835010 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.835160 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.835444 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.835585 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.835742 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.835882 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836032 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836181 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836322 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836462 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836616 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836758 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.836913 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837049 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837185 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837320 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837456 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837593 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837742 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.837880 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.838016 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.838629 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.838629 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.838912 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.838912 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.839233 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.839367 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.839489 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.839610 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.839736 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.839896 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840039 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840181 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840319 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840457 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840457 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840729 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840866 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840998 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.840998 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.841322 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.841583 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.841789 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.841932 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842070 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842217 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842372 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842531 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842670 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842807 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.842952 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843090 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843261 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843261 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843546 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843690 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843823 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.843970 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.844141 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.844302 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.844444 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.844585 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.844724 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.844875 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.845036 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.845180 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.845342 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.845557 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.845708 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.845852 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846005 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846144 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846279 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846279 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846529 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846693 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846837 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.846957 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.847090 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.847290 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.847440 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.847649 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.847796 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.847950 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.848107 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.848251 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.848392 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.848529 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.848669 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.848883 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849030 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849186 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849330 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849471 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849622 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849781 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.849931 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850075 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850218 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850358 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850500 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850654 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850808 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.850951 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.851093 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.851421 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.851675 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.851870 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852012 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852150 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852292 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852437 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852592 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852731 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.852869 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.853007 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.853143 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.853278 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.853429 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.853567 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.854250 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.854514 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.854654 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.854792 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.854945 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.855098 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.855346 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.855489 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.855693 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.855859 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856001 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856143 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856283 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856424 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856564 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856715 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.856858 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857000 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857161 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857308 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857443 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857594 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857732 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.857868 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858014 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858151 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858291 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858438 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858577 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858718 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.858859 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859009 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859151 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859424 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859569 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859709 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859860 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.859997 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.860150 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.860286 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.860424 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.860561 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.860711 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.860850 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861011 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861149 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861300 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861437 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861573 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861711 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.861867 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862007 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862152 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862297 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862451 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862593 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862734 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.862896 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.863041 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.863247 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.863385 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.863546 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.863686 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.863826 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864008 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864159 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864312 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864462 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864608 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864747 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.864899 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865052 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865194 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865356 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865497 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865640 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865779 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.865917 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866068 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866208 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866381 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866533 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866676 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866827 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.866976 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.867124 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.867296 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.867458 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.867602 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.867747 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.867903 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.868047 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.868210 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.868354 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.868539 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.868687 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.868839 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.869033 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.869180 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.869323 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.869527 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.870180 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.870317 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.870620 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.870767 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.870906 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.871043 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.871257 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.871401 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.871570 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.871718 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.871900 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.872112 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.872280 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.872416 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.872547 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.872727 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.872858 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873011 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873171 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873312 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873450 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873588 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873726 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.873883 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.874018 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.874146 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.874384 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.874585 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.874746 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.874897 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.875048 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.875244 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.875384 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.875566 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.875743 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.875907 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.876051 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.876202 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.876357 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.876494 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.876790 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.876950 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.877089 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.877238 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.877394 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.877602 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.877762 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.877904 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878057 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878193 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878343 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878513 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878654 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878782 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.878952 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.879149 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.879369 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.879526 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.879678 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.879817 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.879966 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880100 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880240 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880399 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880541 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880681 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880826 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.880967 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.881141 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.881406 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.881616 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.881763 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.881901 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882040 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882174 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882313 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882450 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882588 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882735 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.882886 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883049 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883227 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883369 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883546 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883692 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883835 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.883989 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.884138 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.884277 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.884415 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.884551 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.884699 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.884846 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.885852 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.886220 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.886368 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.886509 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.886670 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.886670 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.886948 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.887091 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.887314 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.887454 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.887620 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.887762 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.887762 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888021 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888163 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888319 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888469 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888607 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888745 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.888882 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889018 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889166 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889302 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889441 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889578 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889771 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.889928 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.890084 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.890235 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.890431 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.890577 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.890716 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.891036 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.891276 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.891429 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.891578 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.891790 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.891945 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.892100 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.892293 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.892439 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.892588 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.892727 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.892866 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893018 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893156 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893308 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893445 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893585 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893735 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.893890 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894033 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894177 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894330 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894472 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894626 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894771 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.894920 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.895100 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.895294 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.895434 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.895593 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.895843 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.895999 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.896138 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.896305 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.896452 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.896615 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.896760 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.896950 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.897098 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.897281 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.897432 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.897586 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.897734 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.897901 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898046 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898186 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898338 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898492 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898635 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898779 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.898923 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.899094 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.899297 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.899440 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.899592 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.899735 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.899876 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.900017 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.900170 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.900313 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.900464 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.900614 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.901262 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.901522 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.901725 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.901893 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.902044 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.902176 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.902389 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.902542 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.902720 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.902866 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903032 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903242 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903383 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903540 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903684 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903828 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.903958 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.904108 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.904244 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.904399 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.904545 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.904689 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.904864 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905010 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905184 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905341 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905484 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905626 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905791 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.905936 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906101 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906245 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906400 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906542 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906685 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906824 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.906979 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.907131 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.907326 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.907463 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.907672 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.907821 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.907976 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.908114 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.908279 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.908546 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.908696 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.908875 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909035 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909179 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909323 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909524 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909667 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909818 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.909956 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.910122 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.910269 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.910424 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.910568 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.910724 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.911009 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.911159 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.911397 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.911539 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.911683 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.911945 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912099 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912256 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912396 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912535 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912673 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912830 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.912977 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913117 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913257 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913396 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913552 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913703 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913857 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.913995 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.914140 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.914281 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.914431 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.914575 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.914719 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.914861 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915033 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915271 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915432 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915578 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915715 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915853 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.915990 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.916140 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.916429 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.916569 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.916706 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.916843 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.916972 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.917190 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.917343 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.917488 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.917644 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.917788 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.917931 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918082 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918223 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918360 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918509 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918676 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918837 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.918990 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.919135 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.919366 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.919515 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.919660 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.919822 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920045 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920199 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920337 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920476 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920656 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920817 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.920959 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.921099 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.921310 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.921449 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.921599 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.921737 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.921875 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.922081 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.922228 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.922370 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.922523 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.922665 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.923075 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.923277 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.923418 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.923556 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.923712 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.923851 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924005 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924146 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924326 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924495 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924636 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924775 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.924911 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925065 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925211 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925364 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925505 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925660 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925813 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.925968 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.926119 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.926305 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.926448 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.926636 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.926784 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.926937 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.927076 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.927275 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.927418 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.927563 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.927704 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.927843 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928084 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928230 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928385 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928538 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928677 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928814 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.928965 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929103 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929239 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929376 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929512 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929661 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929818 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.929959 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930101 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930241 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930391 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930533 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930687 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930825 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.930974 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.931114 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.931291 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.931450 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.931594 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.931734 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.932382 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.932507 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.932634 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.932774 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.932903 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.933139 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.933287 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.933429 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.933566 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.933735 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.933880 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934089 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934238 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934382 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934518 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934670 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934822 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.934975 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.935119 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.935324 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.935480 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.935625 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.935765 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.935902 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936067 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936213 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936401 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936550 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936691 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936834 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.936985 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.937127 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.937281 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.937426 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.937596 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.937744 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.937907 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938065 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938217 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938357 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938495 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938633 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938817 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.938979 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.939124 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.939357 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.939516 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.939657 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.939795 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.939941 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.940079 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.940216 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.940365 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.940516 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.940664 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.940917 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941057 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941195 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941332 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941467 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941614 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941764 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.941917 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942056 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942195 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942333 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942480 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942613 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942736 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.942914 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.943061 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.943336 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.943523 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.943698 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.943840 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.943990 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944115 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944272 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944412 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944550 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944689 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944836 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.944971 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945099 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945213 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945369 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945500 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945687 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945838 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.945989 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.946128 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.946314 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.946463 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.946648 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.946816 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.946968 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.947104 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.947311 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.947503 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.947676 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.948325 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.948482 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 10:34:33.948623 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.948988 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.949308 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.949641 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.950033 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.950486 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.950806 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.951116 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:34:33.951395 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 10:34:34.012456 n-d-846219-10 devstack@n-api.service[110549]: INFO dbcounter [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Registered counter for database nova_api Jul 20 10:34:34.015285 n-d-846219-10 devstack@n-api.service[110550]: INFO dbcounter [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Registered counter for database nova_api Jul 20 10:34:34.128517 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_db.sqlalchemy.engines [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.130432 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.135499 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writer thread running {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.137118 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writer thread running {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.193986 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.context [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=110549) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 10:34:34.195379 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.context [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=110550) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 10:34:34.198483 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_concurrency.lockutils [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:34:34.199927 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:34:34.200373 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_concurrency.lockutils [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:34:34.201182 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_concurrency.lockutils [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:34:34.201495 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:34:34.202305 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:34:34.203311 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_concurrency.lockutils [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:34:34.204459 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:34:34.205326 n-d-846219-10 devstack@n-api.service[110549]: INFO dbcounter [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Registered counter for database nova_cell0 Jul 20 10:34:34.206569 n-d-846219-10 devstack@n-api.service[110550]: INFO dbcounter [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Registered counter for database nova_cell0 Jul 20 10:34:34.209808 n-d-846219-10 devstack@n-api.service[110549]: INFO dbcounter [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Registered counter for database nova_cell1 Jul 20 10:34:34.210850 n-d-846219-10 devstack@n-api.service[110550]: INFO dbcounter [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Registered counter for database nova_cell1 Jul 20 10:34:34.219437 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_db.sqlalchemy.engines [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.220889 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.222213 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_db.sqlalchemy.engines [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.224487 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.226594 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writer thread running {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.227880 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writer thread running {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.370171 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writer thread running {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.373197 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writer thread running {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.382949 n-d-846219-10 devstack@n-api.service[110550]: INFO dbcounter [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Registered counter for database nova_cell0 Jul 20 10:34:34.386537 n-d-846219-10 devstack@n-api.service[110549]: INFO dbcounter [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Registered counter for database nova_cell0 Jul 20 10:34:34.392713 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_db.sqlalchemy.engines [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.396469 n-d-846219-10 devstack@n-api.service[110549]: DEBUG oslo_db.sqlalchemy.engines [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:34:34.397517 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writer thread running {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.401148 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writer thread running {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:34:34.748827 n-d-846219-10 devstack@n-api.service[110550]: WARNING keystonemiddleware.auth_token [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:34:34.756266 n-d-846219-10 devstack@n-api.service[110550]: WARNING keystonemiddleware.auth_token [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:34:34.785750 n-d-846219-10 devstack@n-api.service[110549]: WARNING keystonemiddleware.auth_token [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:34:34.793878 n-d-846219-10 devstack@n-api.service[110549]: WARNING keystonemiddleware.auth_token [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:34:35.102966 n-d-846219-10 devstack@n-api.service[110550]: WARNING keystonemiddleware.auth_token [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:34:35.109302 n-d-846219-10 devstack@n-api.service[110550]: WARNING keystonemiddleware.auth_token [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:34:35.114622 n-d-846219-10 devstack@n-api.service[110550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559fccac9c0 pid: 110550 (default app) Jul 20 10:34:35.116764 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:34:35.117953 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Jul 20 10:34:35.118368 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Wed Jul 20 10:34:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:34:35.140093 n-d-846219-10 devstack@n-api.service[110549]: WARNING keystonemiddleware.auth_token [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:34:35.146254 n-d-846219-10 devstack@n-api.service[110549]: WARNING keystonemiddleware.auth_token [None req-266f8503-1d37-493e-a89a-07ff61fcfc21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:34:35.152029 n-d-846219-10 devstack@n-api.service[110549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559fccac9c0 pid: 110549 (default app) Jul 20 10:35:53.873859 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:35:53.874924 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 20 10:35:53.875360 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:35:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:35:53.888193 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_api:SELECT=3 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:53.889322 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_cell0:SELECT=3 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:53.890179 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_cell1:SELECT=3 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:53.891339 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:54.783734 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-e29ad172-69c1-4cee-8d48-f63821f8b453 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:35:54.815494 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-e29ad172-69c1-4cee-8d48-f63821f8b453 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933300 Jul 20 10:35:54.816397 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 10:35:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:35:57.121421 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:35:57.122679 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-cc4750fb-35ca-4604-a86c-e9e4fae956af None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005142 Jul 20 10:35:57.127564 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:35:57 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:35:57.607261 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-df841d43-2136-434f-9df7-28bb8100c02a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:35:57.626284 n-d-846219-10 devstack@n-api.service[110549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:35:57.626284 n-d-846219-10 devstack@n-api.service[110549]: warnings.warn(msg) Jul 20 10:35:57.657360 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-df841d43-2136-434f-9df7-28bb8100c02a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.527755 Jul 20 10:35:57.665953 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:35:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:35:57.672758 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_api:SELECT=3 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:57.674372 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_cell0:SELECT=3 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:57.675353 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_cell1:SELECT=3 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:57.676274 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:35:57.887579 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-71eb6ddf-c899-4bcb-9e00-23fe07a8a7e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:35:57.890037 n-d-846219-10 devstack@n-api.service[110550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:35:57.890037 n-d-846219-10 devstack@n-api.service[110550]: warnings.warn(msg) Jul 20 10:35:57.959991 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-71eb6ddf-c899-4bcb-9e00-23fe07a8a7e7 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292645 Jul 20 10:35:57.960758 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 10:35:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:00.313758 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-df841d43-2136-434f-9df7-28bb8100c02a admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:00.314785 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-df841d43-2136-434f-9df7-28bb8100c02a admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 20 10:36:00.321636 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:01.103942 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-11e91a2f-1060-4042-be81-3ecbfbbfefb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "ram": 512, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:01.140816 n-d-846219-10 devstack@n-api.service[110550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:36:01.140816 n-d-846219-10 devstack@n-api.service[110550]: warnings.warn(msg) Jul 20 10:36:01.162142 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-11e91a2f-1060-4042-be81-3ecbfbbfefb4 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.838403 Jul 20 10:36:01.163075 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:01.176187 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-c7940a05-0afe-4ca7-b480-6d3a2173d9c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:01.177680 n-d-846219-10 devstack@n-api.service[110549]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:36:01.177680 n-d-846219-10 devstack@n-api.service[110549]: warnings.warn(msg) Jul 20 10:36:01.212160 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-c7940a05-0afe-4ca7-b480-6d3a2173d9c9 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039798 Jul 20 10:36:01.212746 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 10:36:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:03.838950 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-11e91a2f-1060-4042-be81-3ecbfbbfefb4 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:03.839956 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-11e91a2f-1060-4042-be81-3ecbfbbfefb4 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 20 10:36:03.840469 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:04.334033 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-530d6c04-5340-4bb2-b824-6f209661147c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 10, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:04.355604 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-530d6c04-5340-4bb2-b824-6f209661147c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505921 Jul 20 10:36:04.356978 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:04.369829 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-848a775f-3748-42b4-a8c2-19802cbbc365 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:04.397728 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-848a775f-3748-42b4-a8c2-19802cbbc365 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032512 Jul 20 10:36:04.399304 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 10:36:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:36:06.858643 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-530d6c04-5340-4bb2-b824-6f209661147c admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:06.859749 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-530d6c04-5340-4bb2-b824-6f209661147c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jul 20 10:36:06.860285 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:07.302764 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-358ee409-1f4d-4007-8fb1-32189dfd4892 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "swap": 0, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:07.324349 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-358ee409-1f4d-4007-8fb1-32189dfd4892 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457710 Jul 20 10:36:07.325145 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 10:36:07.339664 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-8622895b-1054-4cdf-9d91-d4c918c6869f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:07.369097 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-8622895b-1054-4cdf-9d91-d4c918c6869f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033842 Jul 20 10:36:07.369957 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 10:36:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:10.125056 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-358ee409-1f4d-4007-8fb1-32189dfd4892 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:10.126101 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-358ee409-1f4d-4007-8fb1-32189dfd4892 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 20 10:36:10.127040 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:10.807715 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-fe38b280-92e8-4c22-87bb-b8967432df1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:10.828891 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-fe38b280-92e8-4c22-87bb-b8967432df1b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.695437 Jul 20 10:36:10.837969 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:10.842935 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-78643195-49dc-4714-bf1f-5f658db8bc13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:10.896958 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-78643195-49dc-4714-bf1f-5f658db8bc13 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057617 Jul 20 10:36:10.897823 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1335 bytes} [Wed Jul 20 10:36:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:13.788710 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-fe38b280-92e8-4c22-87bb-b8967432df1b admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:13.794146 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-fe38b280-92e8-4c22-87bb-b8967432df1b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003920 Jul 20 10:36:13.795931 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:14.708222 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-54527dca-f997-4fa6-8c8c-14495f86d4b3 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:14.734431 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-54527dca-f997-4fa6-8c8c-14495f86d4b3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.931622 Jul 20 10:36:14.751833 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 10:36:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:36:17.537116 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-fe38b280-92e8-4c22-87bb-b8967432df1b admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:17.538138 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-fe38b280-92e8-4c22-87bb-b8967432df1b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 10:36:17.538545 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:18.066036 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-9b890f45-acb8-43b8-99ad-e9a4f1a01044 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:18.085429 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-9b890f45-acb8-43b8-99ad-e9a4f1a01044 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.540011 Jul 20 10:36:18.087096 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:18.103786 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-1e3d6411-ce54-43e2-85a6-3c723d64a667 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:18.139129 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-1e3d6411-ce54-43e2-85a6-3c723d64a667 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043402 Jul 20 10:36:18.140445 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 10:36:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:20.582148 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-9b890f45-acb8-43b8-99ad-e9a4f1a01044 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:20.583208 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-9b890f45-acb8-43b8-99ad-e9a4f1a01044 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jul 20 10:36:20.583642 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:21.129685 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-ae1bdc8e-d0b8-4524-b263-04f7c70da367 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:21.150023 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-ae1bdc8e-d0b8-4524-b263-04f7c70da367 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.558931 Jul 20 10:36:21.150648 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:21.163541 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-aeddaab1-630d-4155-affc-35743656def1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:21.196789 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-aeddaab1-630d-4155-affc-35743656def1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036911 Jul 20 10:36:21.197728 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 10:36:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:23.672598 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-ae1bdc8e-d0b8-4524-b263-04f7c70da367 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:23.674656 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-ae1bdc8e-d0b8-4524-b263-04f7c70da367 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002646 Jul 20 10:36:23.675799 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:36:24.158301 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-454026c1-2d5d-485f-889c-ebfddd93fff1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "vcpus": 2, "swap": 0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:24.179954 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-454026c1-2d5d-485f-889c-ebfddd93fff1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.497473 Jul 20 10:36:24.181419 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:24.193637 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-626a8c45-bc5b-428b-b4ac-19d9bbb49446 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:24.198642 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:36:24.220127 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-626a8c45-bc5b-428b-b4ac-19d9bbb49446 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030057 Jul 20 10:36:24.220635 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 10:36:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:36:26.621567 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-454026c1-2d5d-485f-889c-ebfddd93fff1 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:26.623331 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-454026c1-2d5d-485f-889c-ebfddd93fff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002638 Jul 20 10:36:26.624012 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:27.100401 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-29d02cbf-8e81-48b8-8080-fc5f7fb06345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "ram": 8192, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:27.122306 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-29d02cbf-8e81-48b8-8080-fc5f7fb06345 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491647 Jul 20 10:36:27.130229 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:27.136151 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-a07edcc9-4ead-4b2b-85e6-f66fbfe921d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:27.161690 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-a07edcc9-4ead-4b2b-85e6-f66fbfe921d6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030199 Jul 20 10:36:27.175200 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 10:36:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:36:29.660018 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-29d02cbf-8e81-48b8-8080-fc5f7fb06345 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:29.661685 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-29d02cbf-8e81-48b8-8080-fc5f7fb06345 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jul 20 10:36:29.662083 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:30.230480 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-5ca11186-400f-481e-a018-4838555b1ecd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:30.235348 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:36:30.251881 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-5ca11186-400f-481e-a018-4838555b1ecd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.582134 Jul 20 10:36:30.252432 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1282 bytes} [Wed Jul 20 10:36:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:36:30.265121 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-68aba827-7c62-4e1c-98de-7abcd1fc3b32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:36:30.289505 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-68aba827-7c62-4e1c-98de-7abcd1fc3b32 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028193 Jul 20 10:36:30.290119 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1332 bytes} [Wed Jul 20 10:36:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:36:54.236348 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-5ca11186-400f-481e-a018-4838555b1ecd admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:54.237345 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-5ca11186-400f-481e-a018-4838555b1ecd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 10:36:54.237738 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:54.252050 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:36:54.674116 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-a1f67163-3d88-4510-b48e-0b35bd938024 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:54.696182 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-a1f67163-3d88-4510-b48e-0b35bd938024 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.450818 Jul 20 10:36:54.697135 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 10:36:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:36:55.829905 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-5ca11186-400f-481e-a018-4838555b1ecd admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:55.831540 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-5ca11186-400f-481e-a018-4838555b1ecd admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Jul 20 10:36:55.831964 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:36:56.412983 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-68cbca45-de9a-470f-87ca-d41d6e997bcd admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:56.419286 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.wsgi [None req-68cbca45-de9a-470f-87ca-d41d6e997bcd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-68cbca45-de9a-470f-87ca-d41d6e997bcd admin admin] Request method failure captured: Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Accept: application/json Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Accept-Encoding: gzip, deflate Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Connection: keep-alive Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Content-Length: 0 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Host: 10.222.0.79 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Openstack-Api-Version: compute 2.90 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: Openstack-System-Scope: None Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: User-Agent: python-novaclient Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Auth-Token: gAAAAABi19rH3jUXDevTjoiJKeakH8eqNJ-xaY5YEU1w4m4ctBN5xSkNou9K82JwOf-VOXzvb8HwPlD0AlDg3htF1fi4a4zhMQpKta0GgE4evB05zamoBvkp_kFa9ZyiHwOkZqLl0XPV5IKBexi7Tz4g_jaLzb-IB575R6W99IlUOkNyZHksAf4 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Domain-Id: None Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Domain-Name: None Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Identity-Status: Confirmed Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Is-Admin-Project: True Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Domain-Id: default Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Domain-Name: Default Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Name: admin Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Role: reader,admin,member Jul 20 10:36:56.422609 n-d-846219-10 devstack@n-api.service[110549]: X-Roles: reader,admin,member Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_349d7fb018154cc3952db498820c8ab1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant: admin Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant-Name: admin Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-User: admin Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-User-Domain-Id: default Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-User-Domain-Name: Default Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-User-Id: aa993b165ff74de986a29005302d9225 Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: X-User-Name: admin Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: method: > Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: exception: Flavor 42 could not be found. Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: action_args: {'id': '42'} Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:36:56.424329 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:56.425397 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.426804 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-68cbca45-de9a-470f-87ca-d41d6e997bcd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:36:56.427866 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-68cbca45-de9a-470f-87ca-d41d6e997bcd admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402954 Jul 20 10:36:56.427866 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:36:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:36:56.434600 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-2a6832b6-9496-49c0-8947-3548bcb65a0f admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:56.455933 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-2a6832b6-9496-49c0-8947-3548bcb65a0f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025433 Jul 20 10:36:56.456961 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:36:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:36:56.470768 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-5ce5e093-521f-458d-8437-ff0f4793f949 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:56.492700 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-5ce5e093-521f-458d-8437-ff0f4793f949 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025486 Jul 20 10:36:56.493265 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:36:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:36:56.503578 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-f47f6299-df39-4f75-af67-d2844bbdb4de admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:56.509396 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.wsgi [None req-f47f6299-df39-4f75-af67-d2844bbdb4de admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-f47f6299-df39-4f75-af67-d2844bbdb4de admin admin] Request method failure captured: Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Accept: application/json Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Accept-Encoding: gzip, deflate Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Connection: keep-alive Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Content-Length: 0 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Host: 10.222.0.79 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Openstack-Api-Version: compute 2.90 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: Openstack-System-Scope: None Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: User-Agent: python-novaclient Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Auth-Token: gAAAAABi19rH3jUXDevTjoiJKeakH8eqNJ-xaY5YEU1w4m4ctBN5xSkNou9K82JwOf-VOXzvb8HwPlD0AlDg3htF1fi4a4zhMQpKta0GgE4evB05zamoBvkp_kFa9ZyiHwOkZqLl0XPV5IKBexi7Tz4g_jaLzb-IB575R6W99IlUOkNyZHksAf4 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Domain-Id: None Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Domain-Name: None Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Identity-Status: Confirmed Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Is-Admin-Project: True Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Domain-Id: default Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Domain-Name: Default Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Name: admin Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Role: reader,admin,member Jul 20 10:36:56.512741 n-d-846219-10 devstack@n-api.service[110550]: X-Roles: reader,admin,member Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_349d7fb018154cc3952db498820c8ab1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant: admin Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant-Name: admin Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-User: admin Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-User-Domain-Id: default Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-User-Domain-Name: Default Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-User-Id: aa993b165ff74de986a29005302d9225 Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: X-User-Name: admin Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: method: > Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: exception: Flavor 42 could not be found. Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: action_args: {'id': '42'} Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:36:56.514309 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:56.515910 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:56.517103 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-f47f6299-df39-4f75-af67-d2844bbdb4de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:36:56.518094 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-f47f6299-df39-4f75-af67-d2844bbdb4de admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014115 Jul 20 10:36:56.518094 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:36:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:36:57.500282 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-5ce5e093-521f-458d-8437-ff0f4793f949 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:57.501505 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-5ce5e093-521f-458d-8437-ff0f4793f949 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 20 10:36:57.501837 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:58.031862 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-c4c8b3ec-f4e8-4d9e-b358-58b7a01c0c6f admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:58.037811 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.wsgi [None req-c4c8b3ec-f4e8-4d9e-b358-58b7a01c0c6f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-c4c8b3ec-f4e8-4d9e-b358-58b7a01c0c6f admin admin] Request method failure captured: Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Accept: application/json Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Accept-Encoding: gzip, deflate Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Connection: keep-alive Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Content-Length: 0 Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Host: 10.222.0.79 Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Openstack-Api-Version: compute 2.90 Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: Openstack-System-Scope: None Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: User-Agent: python-novaclient Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Auth-Token: gAAAAABi19rJObbi4rt97Pv5MLASjEwLTD3mVaLZOZUTN6hUtL6ja9liK-9XVZydTfjAUogdPx3DlVCDElv5hBRM7rTTnZ9ummJjOsdh7dJjp0C_fqqKrdv2mzfG9OTrAj3Kgqv6AyJieFWX10zKmb4_z4Z5cPR-F5gaC4Yex3Wom_ezgVMl_Fc Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Domain-Id: None Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Domain-Name: None Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Identity-Status: Confirmed Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Is-Admin-Project: True Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Domain-Id: default Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Domain-Name: Default Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Name: admin Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Role: reader,admin,member Jul 20 10:36:58.039363 n-d-846219-10 devstack@n-api.service[110550]: X-Roles: reader,admin,member Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_349d7fb018154cc3952db498820c8ab1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant: admin Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant-Name: admin Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-User: admin Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-User-Domain-Id: default Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-User-Domain-Name: Default Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-User-Id: aa993b165ff74de986a29005302d9225 Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: X-User-Name: admin Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: method: > Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: exception: Flavor 84 could not be found. Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: action_args: {'id': '84'} Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:36:58.041723 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:58.042595 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.043663 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-c4c8b3ec-f4e8-4d9e-b358-58b7a01c0c6f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:36:58.044638 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-c4c8b3ec-f4e8-4d9e-b358-58b7a01c0c6f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401245 Jul 20 10:36:58.044638 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:36:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:36:58.051407 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-9b82817b-2d6d-48d6-a00a-04de04bed354 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:58.073255 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-9b82817b-2d6d-48d6-a00a-04de04bed354 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025658 Jul 20 10:36:58.076625 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:36:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:36:58.086493 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-0b317d8c-2973-4b97-ba92-475352c58d8f admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:58.100341 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-0b317d8c-2973-4b97-ba92-475352c58d8f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017419 Jul 20 10:36:58.100890 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:36:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:36:58.111283 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-90c9d117-5f18-4996-ad4d-58b915e8b70c admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:58.116657 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.wsgi [None req-90c9d117-5f18-4996-ad4d-58b915e8b70c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-90c9d117-5f18-4996-ad4d-58b915e8b70c admin admin] Request method failure captured: Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Accept: application/json Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Accept-Encoding: gzip, deflate Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Connection: keep-alive Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Content-Length: 0 Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Host: 10.222.0.79 Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Openstack-Api-Version: compute 2.90 Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: Openstack-System-Scope: None Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: User-Agent: python-novaclient Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Auth-Token: gAAAAABi19rJObbi4rt97Pv5MLASjEwLTD3mVaLZOZUTN6hUtL6ja9liK-9XVZydTfjAUogdPx3DlVCDElv5hBRM7rTTnZ9ummJjOsdh7dJjp0C_fqqKrdv2mzfG9OTrAj3Kgqv6AyJieFWX10zKmb4_z4Z5cPR-F5gaC4Yex3Wom_ezgVMl_Fc Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Domain-Id: None Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Domain-Name: None Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Identity-Status: Confirmed Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Is-Admin-Project: True Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Domain-Id: default Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Domain-Name: Default Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Name: admin Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Role: reader,admin,member Jul 20 10:36:58.118144 n-d-846219-10 devstack@n-api.service[110549]: X-Roles: reader,admin,member Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_349d7fb018154cc3952db498820c8ab1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant: admin Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant-Name: admin Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-User: admin Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-User-Domain-Id: default Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-User-Domain-Name: Default Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-User-Id: aa993b165ff74de986a29005302d9225 Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: X-User-Name: admin Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: method: > Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: exception: Flavor 84 could not be found. Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: action_args: {'id': '84'} Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:36:58.120497 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:58.121410 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:58.122678 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-90c9d117-5f18-4996-ad4d-58b915e8b70c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:36:58.123991 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-90c9d117-5f18-4996-ad4d-58b915e8b70c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013334 Jul 20 10:36:58.123991 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:36:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:36:59.125835 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-0b317d8c-2973-4b97-ba92-475352c58d8f admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:59.126832 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-0b317d8c-2973-4b97-ba92-475352c58d8f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 20 10:36:59.127258 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:36:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:36:59.693075 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-8fdc44ca-6c6e-44b1-879b-4326fb2298f9 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:59.700011 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.wsgi [None req-8fdc44ca-6c6e-44b1-879b-4326fb2298f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-8fdc44ca-6c6e-44b1-879b-4326fb2298f9 admin admin] Request method failure captured: Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Accept: application/json Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Accept-Encoding: gzip, deflate Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Connection: keep-alive Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Content-Length: 0 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Host: 10.222.0.79 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Openstack-Api-Version: compute 2.90 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: Openstack-System-Scope: None Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: User-Agent: python-novaclient Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Auth-Token: gAAAAABi19rLDsXXf2G9o9lReb2AeZYKwC8gRXa3gVXfKoAZuI9CaaPCHRQE_saqv3BLx_sSnZGqEcnrR5KlFHJx15EJSJaqxt5y_nc8Ll23nQG8oXC2gH70lW4mnkzOGHF2PUsxrUQPVetm0ZMqUTJhlFBxlLqnJnzL3FK5lmj0ASZnXmLYe38 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Domain-Id: None Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Domain-Name: None Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Identity-Status: Confirmed Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Is-Admin-Project: True Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Domain-Id: default Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Domain-Name: Default Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Project-Name: admin Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Role: reader,admin,member Jul 20 10:36:59.701797 n-d-846219-10 devstack@n-api.service[110549]: X-Roles: reader,admin,member Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_349d7fb018154cc3952db498820c8ab1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant: admin Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-Tenant-Name: admin Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-User: admin Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-User-Domain-Id: default Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-User-Domain-Name: Default Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-User-Id: aa993b165ff74de986a29005302d9225 Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: X-User-Name: admin Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: method: > Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: exception: Flavor 451 could not be found. Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: action_args: {'id': '451'} Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:36:59.704015 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:59.705550 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.707477 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-8fdc44ca-6c6e-44b1-879b-4326fb2298f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:36:59.709791 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-8fdc44ca-6c6e-44b1-879b-4326fb2298f9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.434288 Jul 20 10:36:59.709791 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:36:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:36:59.714754 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-5dd39afa-0cab-4b11-a0b9-7e85c4c66686 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:59.729708 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-5dd39afa-0cab-4b11-a0b9-7e85c4c66686 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019791 Jul 20 10:36:59.730277 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:36:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:36:59.740104 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:59.755314 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018706 Jul 20 10:36:59.755933 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:36:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:36:59.766281 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-3fa0d012-4fdc-4263-b726-6710a80e1683 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:36:59.771815 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.wsgi [None req-3fa0d012-4fdc-4263-b726-6710a80e1683 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-3fa0d012-4fdc-4263-b726-6710a80e1683 admin admin] Request method failure captured: Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Accept: application/json Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Accept-Encoding: gzip, deflate Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Connection: keep-alive Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Content-Length: 0 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Host: 10.222.0.79 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Openstack-Api-Version: compute 2.90 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: Openstack-System-Scope: None Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: User-Agent: python-novaclient Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Auth-Token: gAAAAABi19rLDsXXf2G9o9lReb2AeZYKwC8gRXa3gVXfKoAZuI9CaaPCHRQE_saqv3BLx_sSnZGqEcnrR5KlFHJx15EJSJaqxt5y_nc8Ll23nQG8oXC2gH70lW4mnkzOGHF2PUsxrUQPVetm0ZMqUTJhlFBxlLqnJnzL3FK5lmj0ASZnXmLYe38 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Domain-Id: None Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Domain-Name: None Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Identity-Status: Confirmed Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Is-Admin-Project: True Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Domain-Id: default Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Domain-Name: Default Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Project-Name: admin Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Role: reader,admin,member Jul 20 10:36:59.773285 n-d-846219-10 devstack@n-api.service[110550]: X-Roles: reader,admin,member Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_349d7fb018154cc3952db498820c8ab1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/349d7fb018154cc3952db498820c8ab1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant: admin Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant-Id: 349d7fb018154cc3952db498820c8ab1 Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-Tenant-Name: admin Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-User: admin Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-User-Domain-Id: default Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-User-Domain-Name: Default Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-User-Id: aa993b165ff74de986a29005302d9225 Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: X-User-Name: admin Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: method: > Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: exception: Flavor 451 could not be found. Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: action_args: {'id': '451'} Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:36:59.774784 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:59.776715 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: ERROR nova.api.openstack.wsgi Jul 20 10:36:59.777909 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-3fa0d012-4fdc-4263-b726-6710a80e1683 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110550) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:36:59.780317 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-3fa0d012-4fdc-4263-b726-6710a80e1683 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012130 Jul 20 10:36:59.780317 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:36:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:37:00.771062 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:37:00.772094 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 20 10:37:00.772508 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:37:01.317578 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-63b62141-6e73-4b66-a743-4b5af03f0b1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:37:01.339101 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-63b62141-6e73-4b66-a743-4b5af03f0b1b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.424861 Jul 20 10:37:01.339682 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 10:37:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:37:02.399100 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:37:02.400268 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 20 10:37:02.400703 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:37:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:37:03.014136 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-c3a0d929-083e-4ba8-ac40-6805f0f710c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:37:03.032986 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-c3a0d929-083e-4ba8-ac40-6805f0f710c1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.492814 Jul 20 10:37:03.033529 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 10:37:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:37:04.116963 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:37:04.117975 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 20 10:37:04.118378 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:37:04.818904 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-d2b92170-56f2-4326-95fe-d631e28ee367 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:37:04.839246 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-d2b92170-56f2-4326-95fe-d631e28ee367 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.580051 Jul 20 10:37:04.840350 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 10:37:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 10:37:05.885503 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:37:05.886628 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Jul 20 10:37:05.887030 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:37:06.482397 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-5e6cd060-4324-4511-aa0f-0c54ceb221c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:37:06.501339 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-5e6cd060-4324-4511-aa0f-0c54ceb221c3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.469808 Jul 20 10:37:06.501956 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Wed Jul 20 10:37:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:37:07.508155 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:37:07.509165 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 20 10:37:07.510156 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:37:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:37:08.062681 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-b438aa99-7083-42a5-b315-5d21eaef85bf admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:37:08.082074 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-b438aa99-7083-42a5-b315-5d21eaef85bf admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.432441 Jul 20 10:37:08.082618 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Wed Jul 20 10:37:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:38:04.730630 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:38:04.731717 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-23733107-dc01-4bd9-847b-b099f1dfef5e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 20 10:38:04.732140 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 930 bytes} [Wed Jul 20 10:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:38:04.743095 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:38:05.209696 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-5095c347-a5a5-4c77-adaf-ec0b1b2d6744 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:38:05.234242 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-5095c347-a5a5-4c77-adaf-ec0b1b2d6744 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.495352 Jul 20 10:38:05.234949 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 10:38:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:38:05.256925 n-d-846219-10 devstack@n-api.service[110549]: DEBUG dbcounter [-] [110549] Writing DB stats nova_api:SELECT=14 {{(pid=110549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:38:05.260847 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-81fd40fa-8a05-4436-821e-b80623791cea admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:38:05.269412 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-81fd40fa-8a05-4436-821e-b80623791cea admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013943 Jul 20 10:38:05.269977 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1282 bytes} [Wed Jul 20 10:38:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:38:05.283926 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-c054ced3-d6bc-41d5-9678-3368a5b36838 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:38:05.293053 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-c054ced3-d6bc-41d5-9678-3368a5b36838 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014166 Jul 20 10:38:05.293614 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1285 bytes} [Wed Jul 20 10:38:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:38:05.307418 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-38398950-ff9c-4298-be72-f1f49e454a56 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:38:05.316536 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-38398950-ff9c-4298-be72-f1f49e454a56 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013611 Jul 20 10:38:05.317109 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1285 bytes} [Wed Jul 20 10:38:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:38:05.329322 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-7b65d156-bd27-4573-aacd-266970e3bcc3 admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:38:05.338052 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-7b65d156-bd27-4573-aacd-266970e3bcc3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012254 Jul 20 10:38:05.338618 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1282 bytes} [Wed Jul 20 10:38:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:43:48.121661 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-38398950-ff9c-4298-be72-f1f49e454a56 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:43:48.122665 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-38398950-ff9c-4298-be72-f1f49e454a56 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 20 10:43:48.123073 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:43:48.264096 n-d-846219-10 devstack@n-api.service[110550]: DEBUG dbcounter [-] [110550] Writing DB stats nova_api:SELECT=6 {{(pid=110550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:43:48.417810 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-003d5f8a-22b2-4725-8456-5ddc295f23eb admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:43:48.419056 n-d-846219-10 devstack@n-api.service[110550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:43:48.419056 n-d-846219-10 devstack@n-api.service[110550]: warnings.warn(msg) Jul 20 10:43:48.420290 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-003d5f8a-22b2-4725-8456-5ddc295f23eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:43:48.420729 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-003d5f8a-22b2-4725-8456-5ddc295f23eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:43:48.421523 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-003d5f8a-22b2-4725-8456-5ddc295f23eb admin admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:43:48.421991 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-003d5f8a-22b2-4725-8456-5ddc295f23eb admin admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:43:48.462719 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-003d5f8a-22b2-4725-8456-5ddc295f23eb admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.200075 Jul 20 10:43:48.463307 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:43:48 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:43:49.295298 n-d-846219-10 devstack@n-api.service[110549]: DEBUG nova.api.openstack.wsgi [None req-38398950-ff9c-4298-be72-f1f49e454a56 admin admin] Calling method '>' {{(pid=110549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:43:49.296307 n-d-846219-10 devstack@n-api.service[110549]: INFO nova.api.openstack.requestlog [None req-38398950-ff9c-4298-be72-f1f49e454a56 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 10:43:49.296704 n-d-846219-10 devstack@n-api.service[110549]: [pid: 110549|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Wed Jul 20 10:43:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:43:49.490962 n-d-846219-10 devstack@n-api.service[110550]: DEBUG nova.api.openstack.wsgi [None req-0fa39976-ef7a-4989-b8b7-1c10609ac0ca admin admin] Calling method '>' {{(pid=110550) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:43:49.492146 n-d-846219-10 devstack@n-api.service[110550]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:43:49.492146 n-d-846219-10 devstack@n-api.service[110550]: warnings.warn(msg) Jul 20 10:43:49.493315 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-0fa39976-ef7a-4989-b8b7-1c10609ac0ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:43:49.493751 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-0fa39976-ef7a-4989-b8b7-1c10609ac0ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:43:49.494534 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-0fa39976-ef7a-4989-b8b7-1c10609ac0ca admin admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:43:49.494991 n-d-846219-10 devstack@n-api.service[110550]: DEBUG oslo_concurrency.lockutils [None req-0fa39976-ef7a-4989-b8b7-1c10609ac0ca admin admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110550) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:43:49.517724 n-d-846219-10 devstack@n-api.service[110550]: INFO nova.api.openstack.requestlog [None req-0fa39976-ef7a-4989-b8b7-1c10609ac0ca admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.079191 Jul 20 10:43:49.518273 n-d-846219-10 devstack@n-api.service[110550]: [pid: 110550|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:43:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:44:34.099420 n-d-846219-10 devstack@n-api.service[110548]: Wed Jul 20 10:44:34 2022 - graceful shutdown triggered... Jul 20 10:44:34.099561 n-d-846219-10 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 10:44:34.100542 n-d-846219-10 devstack@n-api.service[110549]: Gracefully killing worker 1 (pid: 110549)... Jul 20 10:44:34.100995 n-d-846219-10 devstack@n-api.service[110550]: Gracefully killing worker 2 (pid: 110550)... Jul 20 10:44:35.101500 n-d-846219-10 devstack@n-api.service[110548]: worker 1 buried after 1 seconds Jul 20 10:44:35.101500 n-d-846219-10 devstack@n-api.service[110548]: worker 2 buried after 1 seconds Jul 20 10:44:35.101500 n-d-846219-10 devstack@n-api.service[110548]: goodbye to uWSGI. Jul 20 10:44:35.103133 n-d-846219-10 systemd[1]: devstack@n-api.service: Succeeded. Jul 20 10:44:35.103775 n-d-846219-10 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 10:44:35.106597 n-d-846219-10 systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 10:44:35.121140 n-d-846219-10 devstack@n-api.service[125872]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 10:44:35 2022] *** Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: nodename: n-d-846219-10 Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: machine: x86_64 Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: clock source: unix Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: pcre jit disabled Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: detected number of CPU cores: 4 Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: current working directory: / Jul 20 10:44:35.136871 n-d-846219-10 devstack@n-api.service[125872]: detected binary path: /usr/bin/uwsgi-core Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: your processes number limit is 47680 Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: your memory page size is 4096 bytes Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: detected max file descriptor number: 2048 Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: lock engine: pthread robust mutexes Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: thunder lock: enabled Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 10:44:35.137660 n-d-846219-10 devstack@n-api.service[125872]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 10:44:35.182934 n-d-846219-10 devstack@n-api.service[125872]: Python main interpreter initialized at 0x5598c1ddc9c0 Jul 20 10:44:35.182934 n-d-846219-10 devstack@n-api.service[125872]: python threads support enabled Jul 20 10:44:35.182934 n-d-846219-10 devstack@n-api.service[125872]: your server socket listen backlog is limited to 100 connections Jul 20 10:44:35.182934 n-d-846219-10 devstack@n-api.service[125872]: your mercy for graceful operations on workers is 90 seconds Jul 20 10:44:35.183399 n-d-846219-10 devstack@n-api.service[125872]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 10:44:35.183399 n-d-846219-10 devstack@n-api.service[125872]: *** Operational MODE: preforking *** Jul 20 10:44:35.183680 n-d-846219-10 devstack@n-api.service[125872]: *** uWSGI is running in multiple interpreter mode *** Jul 20 10:44:35.183680 n-d-846219-10 devstack@n-api.service[125872]: spawned uWSGI master process (pid: 125872) Jul 20 10:44:35.183880 n-d-846219-10 systemd[1]: Started Devstack devstack@n-api.service. Jul 20 10:44:35.184489 n-d-846219-10 devstack@n-api.service[125872]: spawned uWSGI worker 1 (pid: 125885, cores: 1) Jul 20 10:44:35.185026 n-d-846219-10 devstack@n-api.service[125872]: spawned uWSGI worker 2 (pid: 125886, cores: 1) Jul 20 10:44:35.185345 n-d-846219-10 devstack@n-api.service[125872]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 10:44:35.859364 n-d-846219-10 devstack@n-api.service[125886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 10:44:35.882261 n-d-846219-10 devstack@n-api.service[125885]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 10:44:37.084865 n-d-846219-10 devstack@n-api.service[125886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:44:37.084865 n-d-846219-10 devstack@n-api.service[125886]: from cryptography.utils import int_from_bytes Jul 20 10:44:37.085521 n-d-846219-10 devstack@n-api.service[125886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:44:37.085521 n-d-846219-10 devstack@n-api.service[125886]: from cryptography.utils import int_from_bytes Jul 20 10:44:37.102096 n-d-846219-10 devstack@n-api.service[125885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:44:37.102096 n-d-846219-10 devstack@n-api.service[125885]: from cryptography.utils import int_from_bytes Jul 20 10:44:37.102731 n-d-846219-10 devstack@n-api.service[125885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 10:44:37.102731 n-d-846219-10 devstack@n-api.service[125885]: from cryptography.utils import int_from_bytes Jul 20 10:44:39.468884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 10:44:39.468884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 10:44:39.469681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 10:44:39.469681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 10:44:39.470043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 10:44:39.470314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.470643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.470967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.471318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.471648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.471960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.472285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.472608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.472937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.473199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.473518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.473847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.474178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.474490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.474872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.475124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.475475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.475800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.476102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.476629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.478440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.478440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.478440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.478440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.478999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.478999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.479483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.479483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.479803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.480117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.481124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.481124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.481124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.481539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.481858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.482169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.482674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.484596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.484596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.484596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.485691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.485691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.485691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.486318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.486318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.486745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.486951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.487192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.487491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.487997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.488173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.488355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.488656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.489130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.489408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.489648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.489811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.490970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.490970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.490970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.490970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.491704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.491704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.491990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.492286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.492593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.492901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.493224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.493543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.493867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.494177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.494498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.494908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.495163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.496538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.496538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.496538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.497167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.497167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.497167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.497863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.497863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.498169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.498461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.499312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.500113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.500113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.500963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.500963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.500963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.501404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.501567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.501775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.502081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.502388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.502699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.503008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.503350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.503662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.503971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.504291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.504629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.504887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.505214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.505537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.505847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.506157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.506466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.506783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.507108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.507447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.507758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.508089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.508401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.508767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.509035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.509345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.509655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.509978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.510283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.510612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.510960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.511454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.511725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.511973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.512222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.512422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.512731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.513036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.513343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.513655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.513969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.514431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.515872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.515872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.515872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.515872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.516612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.516612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.516983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.516983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.517402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.517620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.517951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.518271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.518586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.518921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.519274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.519593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.519911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.520264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.520540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.520967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.521259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.521565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.522007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.522263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.522500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.522739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.523021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.523360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.523707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.524056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.524375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.524704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.525031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.525342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.525653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.525970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.526297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.526297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.526297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.526297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.526297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.528542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.528542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.528542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.528845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.529092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.529409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.530255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.530694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.531413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.531413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.531726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.532007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.532230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.532542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.533805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.533805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.533805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.533805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.534913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.534913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.534913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.535494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.535494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.535674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.535934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.536240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.536558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.536879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.537191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.537518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.537839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.538147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.538701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.538886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.539040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.539401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.539716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.540031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.540347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.540664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.540983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.541300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.541616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.541956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.542298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.542602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.542925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.543275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.543600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.543908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.544220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.544533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.544844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.545152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.545523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.546339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.546648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.546962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.547294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.547604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.547929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.548242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.548546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.548851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.549166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.549505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.549813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.550158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.550562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.550811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.551138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.551476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.551795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.552110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.552426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.552739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.553052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.553375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.553695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.554013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.554323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.554645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.555082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.555306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 10:44:39.555306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 10:44:39.556123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.556123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.556451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 10:44:39.556618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.556758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 10:44:39.556899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.557046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 10:44:39.557188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.557326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.557440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.557550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.558172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.558284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.558372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.558456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.558539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.558539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.558751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.558840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.558923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.559007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.559007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.559157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.559278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.559364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.559597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.559688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.559873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.559979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.560193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.560286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.560521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846219-10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.560613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.560831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.560930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.561666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.561810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.562006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.562249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.562411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.562828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.562968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.563060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.563213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.563320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.563566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.563737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.563886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.564053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.564206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.564362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.564521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.564780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.564934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.565031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.565144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.565575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.565711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.565889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.565984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.566197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.566290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.566507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.566599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.566839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.566938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.567152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.567264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.567527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.567630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846219-10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.567840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.567942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.568161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.568262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.568476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.568733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.568826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.569076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.569192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.569390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.569535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.569715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.569850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.570029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.570217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.570359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.570548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.570644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.570861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.571003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.571223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.571332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.571553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.571655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.571876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.572037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.572214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.572314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.572476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.572626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.572786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.572925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.573094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.573185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.573413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.573499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.573720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.573856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.574344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.574468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.574594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.574711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.574901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.575123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.575305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.575439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.575439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.575706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.575841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.575972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.576168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.576168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.576399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.576492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.576585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.576756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.577507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.578416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.578416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.578703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.578834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.578978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.579117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.579269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.579411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.579573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.579711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.579854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.579991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.580128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.580265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.580401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.580537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.580679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.580808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.580949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.581078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.581206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.581334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.581334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.581595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.581731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.581860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.582224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.582413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.582413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.582685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.582815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.582955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.582955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.583398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.583546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.583687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.583687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.583929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.584064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.584207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.584339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.584558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.584744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.584886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.585016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.585266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.585400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.585576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.585718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.585848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.585975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.586104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.586310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.586451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.586594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.586791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.586942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.587075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.587247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.587425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.587557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.587687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.587815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.587952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.588096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.588223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.588345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.588482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.588620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.588749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.588877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.589013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.589142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.589277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.589414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.589544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.589680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.589823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.589960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.590097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.590234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.590364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.590491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.590634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.590764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.590892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.591029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.591200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.591344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.591475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.591586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.591726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.591853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.592070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.592213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.592909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.593594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.594197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.594344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.594474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.594609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.594737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.594874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.595087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.595260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.595504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.595647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.595778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.595953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.596099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.596263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.596395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.596532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.596662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.596797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.596937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.597074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.597210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.597340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.597475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.597604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.597746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.597883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.598020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.598158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.598295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.598563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.598748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.598884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.599024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.599183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.599316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.599459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.599598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.599736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.599866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.599995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.600125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.600263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.600393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.600521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.600650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.600786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.600905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.600905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.601123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.601240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.601240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.601455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.601592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.601725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.601837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.601956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.602084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.602213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.602356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.602498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 10:44:39.602635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.602764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.602900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.603928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.604070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.604235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.604398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.604532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.605267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.605391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.605763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.605763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.606947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.607283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.607456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.607595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.607818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.608852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.609898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.609898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.610150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.610284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.610284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.610647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.610802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.610964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.611975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.612259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.612259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.612575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.612712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.612869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.613031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.613164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.613408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.613783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.613929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.614076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.614342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.614515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.614661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.614914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.615245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.615385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.615573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.615890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.616034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.616203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.616519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.616651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.616841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.617169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.617371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.617543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.617738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.617873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.618061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.618284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.618420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.618539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.618656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.618931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.619502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.619792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.620051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.620279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.620481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.620481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.620882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.621085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.621286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.621527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.621726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.621939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.622155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.622358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.622559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.622745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.622951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.623141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.623371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.624482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.624699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.624918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.625134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.625354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.625354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.625735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.625956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.626306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.626468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.626658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.626658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.627954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.628112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.628262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.628419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.628582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.628739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.628899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.629039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.629039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.629366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.629613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.629766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.629913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.630920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.631059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.631059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.631336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.631503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.631706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.631869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.632938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.633086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.633228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.633432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.633432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.633717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.633871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.634800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.635207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.635207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.635452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.635612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.635745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.635894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.636857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.637931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.638918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.639258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.639553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.640990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.641966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.642946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.643999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.644219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.644311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.644529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.644621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.644850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.644940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.645179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.645338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.645485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.645646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.645800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.645947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.646107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.646201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.646421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.646563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.646729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.647009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.647102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.647393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.647538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.647702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.647794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.648021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.648113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.648347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.648451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.648818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.649052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.649270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.649539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.649724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.649878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.650963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.651135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.651354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.651354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.651710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.651868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.652016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.652182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.652342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.652489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.652646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.652805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.653019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.653303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.653463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.653615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.653829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.653996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.654153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.654325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.654548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.654702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.656530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.656709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.656881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.657996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.658145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.658294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.658456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.658608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.658608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.659443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.659599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.659754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.659915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.660067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.660239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.660385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.660544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.660759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.660992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.661166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.661385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.661604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.661823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.662044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.662328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.662512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.662736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.662891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.663054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.663245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.663400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.663678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.663842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.664059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.664211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.664359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.664505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.664744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.664897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.665042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.665342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.665497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.665652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.665795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.665795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.666174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.666482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.666647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.666812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.667026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.667215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.667369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.667516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.667516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.667937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.668150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.668366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.668593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.668813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.669019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.669240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.669447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.669612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.669768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.669916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.670087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.670237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.670461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.672039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.672224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.672396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.672572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.672736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.672898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.673117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.673284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.673435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.673697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.673846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.673846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.674170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.674377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.674552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.674855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.675963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.676884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.677046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.677255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.677414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.677574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.677574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.677853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.678872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.679250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.679403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.679613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.679884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.680885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.681955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.682935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.683939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.684913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.685911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.686080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.686348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.686914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.687980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.688916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.689916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.690951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.691041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.691158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.691277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.691486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.691715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.691809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.692137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.692265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.692466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.692778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.692879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.693082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.693359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.693465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.693699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.693901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.694014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.694325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.694422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.694640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.694989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.695104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.695336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.695598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.695908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.696115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.696247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.696571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.696664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.696916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.697139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.697300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.697554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.697774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.697943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.698087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.698289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.698429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.698566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.698769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.698915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.699088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.699306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.699467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.699718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.699936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.700104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.700234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.700385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.700523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.700679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.700922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.701078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.701237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.701391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.701525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.701914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.702653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.702653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.702927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.703921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.704198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.704345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.704491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.704636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.704780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.704916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.705105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.705397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.705540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.705714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.705913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.706041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.706351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.706497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.706670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.706966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.707147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.707427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.707616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.707767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.707956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.708152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.708304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.708473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.708630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.708783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.708970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.709113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.709296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.709548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.709704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.709924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.710111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.710261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.710540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.710683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.710883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.711133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.711365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.711531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.711706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.711852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.711995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.712146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.712338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.712494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.712647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.712809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.712968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.713113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.713335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.713483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.713646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.713848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.714009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.714232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.714469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.714644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.714836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.714991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.715262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.715445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.715592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.715762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.716048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.716196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.716355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.716626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.716788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.717016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.717166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.717843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.718143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.718593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.718755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.718871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.719925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.720349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.720909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.721272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.721931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.722453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.722961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.723714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.724353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.724921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.725490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.726114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.726598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.726919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.727903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.728977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.729959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.730985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.731919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.732794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.733610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.733707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.733801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.733888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.733968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.734930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.735946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.736099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.765897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.772947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.773733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.774627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.775646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.777312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.779843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.781704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.783373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.785351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.786911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.787791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.788893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.789709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.790547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.791710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.792276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.792572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.792914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.793249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.793582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.793910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.794241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.794587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.794902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.795240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.796397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.796397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.796713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.797056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.797398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.797711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.798038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.798354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.798945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.799331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.799658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.799989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.800318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.800642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.800954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.801284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.801596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.801912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.802299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.802544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.802856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.803189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.803517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.803832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.804139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.804454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.804763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.805106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.805417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.805728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.806039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.806354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.806664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.806972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.807309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.807621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.807938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.808245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.808559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.808867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.809186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.809494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.809807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.810161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.810497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.810810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.811711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.812207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.812535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.813007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.813190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.813514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.813873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.814198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.814794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.815138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.815764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.816115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.816453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.816768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.817084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.817398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.817730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.818046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.818361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.818677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.818997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.819345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.819661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.819974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.820289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.820602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.820920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.821232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.821543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.821855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.822175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.822620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.822996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.823255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.823504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.823831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.824147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.824464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.824787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.825097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.825413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.825749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.826068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.826377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.827045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.827406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.827729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.828051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.828367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.828697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.829023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.829340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.829667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.829981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.830316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.830665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.830999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.831365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.831679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.831990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.832296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.832609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.832939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.833251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.833560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.833868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.834180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.834494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.834802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.835116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.835452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.835767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.836073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.836380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.836679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.836984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.837292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.837599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.837910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.838215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.838521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.838826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.839133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.839543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.839883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.840221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.840546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.840872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.841188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.841513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.841829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.842154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.842509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.842955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.843287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.843642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.843961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.844278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.844600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.844927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.845226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.845541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.845874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.846210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.846522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.846853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.847194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.847529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.847851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.848168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.848506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.848854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.849140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.849459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.849775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.850090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.850408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.850724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.851042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.851912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.851912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.852448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.852448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.852652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.852990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.853305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.853791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.853984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.854337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.854666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.854985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.855333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.855644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 10:44:39.855893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 10:44:39.896861 n-d-846219-10 devstack@n-api.service[125885]: INFO dbcounter [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Registered counter for database nova_api Jul 20 10:44:39.919206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_db.sqlalchemy.engines [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:39.927079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writer thread running {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:39.987150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.context [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=125885) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 10:44:39.991148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:44:39.992772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:44:39.993562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:44:39.995566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:44:39.997542 n-d-846219-10 devstack@n-api.service[125885]: INFO dbcounter [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Registered counter for database nova_cell0 Jul 20 10:44:40.002127 n-d-846219-10 devstack@n-api.service[125885]: INFO dbcounter [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Registered counter for database nova_cell1 Jul 20 10:44:40.009558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_db.sqlalchemy.engines [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.011961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_db.sqlalchemy.engines [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.017699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writer thread running {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.019776 n-d-846219-10 devstack@n-api.service[125886]: INFO dbcounter [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Registered counter for database nova_api Jul 20 10:44:40.040498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_db.sqlalchemy.engines [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.047479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writer thread running {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.105762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.context [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=125886) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 10:44:40.109927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:44:40.111534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:44:40.112354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:44:40.114342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:44:40.116444 n-d-846219-10 devstack@n-api.service[125886]: INFO dbcounter [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Registered counter for database nova_cell0 Jul 20 10:44:40.120673 n-d-846219-10 devstack@n-api.service[125886]: INFO dbcounter [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Registered counter for database nova_cell1 Jul 20 10:44:40.128633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_db.sqlalchemy.engines [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.131043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_db.sqlalchemy.engines [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.138037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writer thread running {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.140027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writer thread running {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.167050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writer thread running {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.175776 n-d-846219-10 devstack@n-api.service[125885]: INFO dbcounter [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Registered counter for database nova_cell0 Jul 20 10:44:40.182782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_db.sqlalchemy.engines [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.188534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writer thread running {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.298203 n-d-846219-10 devstack@n-api.service[125886]: INFO dbcounter [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Registered counter for database nova_cell0 Jul 20 10:44:40.303535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_db.sqlalchemy.engines [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 10:44:40.311755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writer thread running {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 10:44:40.532082 n-d-846219-10 devstack@n-api.service[125885]: WARNING keystonemiddleware.auth_token [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:44:40.540076 n-d-846219-10 devstack@n-api.service[125885]: WARNING keystonemiddleware.auth_token [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:44:40.656637 n-d-846219-10 devstack@n-api.service[125886]: WARNING keystonemiddleware.auth_token [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:44:40.663900 n-d-846219-10 devstack@n-api.service[125886]: WARNING keystonemiddleware.auth_token [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:44:40.887224 n-d-846219-10 devstack@n-api.service[125885]: WARNING keystonemiddleware.auth_token [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:44:40.894434 n-d-846219-10 devstack@n-api.service[125885]: WARNING keystonemiddleware.auth_token [None req-7128c75c-622f-4c7b-a004-315e393f7e3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:44:40.902094 n-d-846219-10 devstack@n-api.service[125885]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5598c1ddc9c0 pid: 125885 (default app) Jul 20 10:44:41.009598 n-d-846219-10 devstack@n-api.service[125886]: WARNING keystonemiddleware.auth_token [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 10:44:41.016150 n-d-846219-10 devstack@n-api.service[125886]: WARNING keystonemiddleware.auth_token [None req-aa47bba6-e8ef-4daf-9473-1517b1ef1094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 10:44:41.022292 n-d-846219-10 devstack@n-api.service[125886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598c1ddc9c0 pid: 125886 (default app) Jul 20 10:45:28.638761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:28.640052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:28.641253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:28.642142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:29.382679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:29.383843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:29.385239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:29.385828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:30.245986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69a13f87-858b-4768-9139-07cb80b8d5c6 tempest-InstanceUsageAuditLogTestJSON-119546931 tempest-InstanceUsageAuditLogTestJSON-119546931-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:30.247566 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:30.247566 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:30.267984 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69a13f87-858b-4768-9139-07cb80b8d5c6 tempest-InstanceUsageAuditLogTestJSON-119546931 tempest-InstanceUsageAuditLogTestJSON-119546931-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 10:45:28" status: 200 len: 318 microversion: 2.1 time: 1.635845 Jul 20 10:45:30.268572 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1/1] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 10:45:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2010%3A45%3A28 => generated 318 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:30.282040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-470cb5cb-ff52-4022-a19d-3e8536548380 tempest-InstanceUsageAuditLogTestJSON-119546931 tempest-InstanceUsageAuditLogTestJSON-119546931-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:30.285036 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:30.285036 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:30.315476 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-470cb5cb-ff52-4022-a19d-3e8536548380 tempest-InstanceUsageAuditLogTestJSON-119546931 tempest-InstanceUsageAuditLogTestJSON-119546931-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.037238 Jul 20 10:45:30.316334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2/2] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 10:45:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:31.080736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e67ec10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.082860 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.082860 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.089491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=125886) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 10:45:31.090315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.090752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.130745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.131229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.145538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.145993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.153017 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7c556f5-7492-4a71-bf1a-922c113f5d6e tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 1.778737 Jul 20 10:45:31.153576 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1/3] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:31.170901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e604dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.171755 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.171755 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.172931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.173392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.191386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.192065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.204704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.205314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.212521 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86e81ede-951f-454b-82f6-f5e742cc3d7d tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.049662 Jul 20 10:45:31.213617 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:31.227825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e53fa60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.228919 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.228919 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.230338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.230856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.251292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.252079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.267582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.268952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.275990 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e585f3b3-aab8-4274-b7aa-8912808ad92b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.051778 Jul 20 10:45:31.276861 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:31.287449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72856040-7fbb-428f-b7c2-a5a9052b5c73 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e53fca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.288659 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.288659 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.290012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72856040-7fbb-428f-b7c2-a5a9052b5c73 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.290519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72856040-7fbb-428f-b7c2-a5a9052b5c73 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.313195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72856040-7fbb-428f-b7c2-a5a9052b5c73 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.314098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72856040-7fbb-428f-b7c2-a5a9052b5c73 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.325309 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72856040-7fbb-428f-b7c2-a5a9052b5c73 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.041602 Jul 20 10:45:31.326470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 4/6] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:31.340642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fe5f39a-faf5-4a5b-a886-c87ad97616a1 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e5a5c10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.341895 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.341895 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.343977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe5f39a-faf5-4a5b-a886-c87ad97616a1 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.344584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe5f39a-faf5-4a5b-a886-c87ad97616a1 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.364454 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fe5f39a-faf5-4a5b-a886-c87ad97616a1 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.028016 Jul 20 10:45:31.365055 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 5/7] 10.222.0.79 () {58 vars in 1178 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:31.387809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e53ff70>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.389230 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.389230 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.390468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.390903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.409267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.410067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.426712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.427146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.434086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7643ff3c-35b2-43ee-8481-dc03d1b14ec2 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.061785 Jul 20 10:45:31.434685 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 6/8] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:31.445139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-273c3084-d2a7-413a-8081-a9346d9825ae tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e53fb80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.447329 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.447329 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.449118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-273c3084-d2a7-413a-8081-a9346d9825ae tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.449918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-273c3084-d2a7-413a-8081-a9346d9825ae tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.469147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-273c3084-d2a7-413a-8081-a9346d9825ae tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.469662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-273c3084-d2a7-413a-8081-a9346d9825ae tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.480178 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-273c3084-d2a7-413a-8081-a9346d9825ae tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.038933 Jul 20 10:45:31.493771 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 7/9] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:31.500316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-53fe299b-62c6-4163-8dee-018b07e35629 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e53f820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.501174 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.501174 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.502867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53fe299b-62c6-4163-8dee-018b07e35629 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.503365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53fe299b-62c6-4163-8dee-018b07e35629 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.520328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53fe299b-62c6-4163-8dee-018b07e35629 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.520786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53fe299b-62c6-4163-8dee-018b07e35629 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.527807 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-53fe299b-62c6-4163-8dee-018b07e35629 tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.035074 Jul 20 10:45:31.531371 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 8/10] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:31.545862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Calling method '.version_select at 0x7f2c4e604dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.546695 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.546695 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:31.547948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.548400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.564476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.565068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.577948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.578555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.585206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-435a3fe3-cc14-4f64-a0b5-67a249dc0b9b tempest-HypervisorAdminTestJSON-1405919118 tempest-HypervisorAdminTestJSON-1405919118-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:45:31.586483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.587023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.588074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.588600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.598040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.rpcapi [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 10:45:31.599047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] Releasing lock "compute-rpcapi-router" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:45:31.652938 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b01ee6ca-11c2-4d2e-b3c5-337c701a26d8 None None] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.112671 Jul 20 10:45:31.653573 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 9/11] 10.222.0.79 () {58 vars in 1172 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:31.749683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Calling method '.version_select at 0x7f2c4e60fe50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:31.751351 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:31.751351 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:31.762625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=125885) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 20 10:45:31.763708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.764439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.802247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.802681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.819326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:31.820087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:31.828251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f024bb2d-3755-4efd-8eba-845f546b2d4c tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.849610 Jul 20 10:45:31.829597 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3/12] 10.222.0.79 () {60 vars in 1207 bytes} [Wed Jul 20 10:45:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:45:32.300598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56959a51-dee9-4056-815c-3f4d52244e6c tempest-AZAdminNegativeTestJSON-1173762897 tempest-AZAdminNegativeTestJSON-1173762897-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:32.301577 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:32.301577 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:32.302396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56959a51-dee9-4056-815c-3f4d52244e6c tempest-AZAdminNegativeTestJSON-1173762897 tempest-AZAdminNegativeTestJSON-1173762897-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '0c76c90ab2f04a06841ce038a628f03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d869d31f09844aaab3cae3fedb04996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56959a51-dee9-4056-815c-3f4d52244e6c tempest-AZAdminNegativeTestJSON-1173762897 tempest-AZAdminNegativeTestJSON-1173762897-project] Request method failure captured: Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zHaHHMxJ5UwFkfq4i0-juc97aXzrJ-MkunILxmIjfLM3LkMmHwV9YtJkAyHntIDCJc3FU8SbhQ1-SYCT3cmgqfj-s-6Z4EY5htE-OIvcRYrYxHs6EwYQW99CO97Gq9YZiMiBKE2T9Ya6481m9ct_NXwvxtmzrJ0eBq8HoAyagpsZM Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4d869d31f09844aaab3cae3fedb04996 Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1173762897 Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:45:32.305467 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4d869d31f09844aaab3cae3fedb04996", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4d869d31f09844aaab3cae3fedb04996"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4d869d31f09844aaab3cae3fedb04996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4d869d31f09844aaab3cae3fedb04996"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AZAdminNegativeTestJSON-1173762897 Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4d869d31f09844aaab3cae3fedb04996 Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1173762897 Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AZAdminNegativeTestJSON-1173762897-project Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 0c76c90ab2f04a06841ce038a628f03f Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AZAdminNegativeTestJSON-1173762897-project Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 10:45:32.306764 n-d-846219-10 devstack@n-api.service[125886]: action_args: {} Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:32.307636 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:32.308747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56959a51-dee9-4056-815c-3f4d52244e6c tempest-AZAdminNegativeTestJSON-1173762897 tempest-AZAdminNegativeTestJSON-1173762897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:32.310175 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56959a51-dee9-4056-815c-3f4d52244e6c tempest-AZAdminNegativeTestJSON-1173762897 tempest-AZAdminNegativeTestJSON-1173762897-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.616347 Jul 20 10:45:32.310175 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 10/13] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 619 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:45:32.314320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d827355-c898-4936-8160-ddaa2f8990e2 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1778280431"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:32.333916 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:32.333916 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:32.335001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-8d827355-c898-4936-8160-ddaa2f8990e2 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Generated uuid 589a2bfd-d994-4782-a134-410c4f2fcc3b for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:32.421439 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d827355-c898-4936-8160-ddaa2f8990e2 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.111475 Jul 20 10:45:32.431557 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 11/14] 10.222.0.79 () {62 vars in 1204 bytes} [Wed Jul 20 10:45:32 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:32.437677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98fae84e-948f-4095-9f9c-5231c966467e tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1803853186"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:32.535456 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:32.535456 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:32.552231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '.version_select at 0x7f2c4e55c4c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:32.556192 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:32.556192 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:32.559688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:32.561763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:32.590160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:32.591583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:32.593581 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98fae84e-948f-4095-9f9c-5231c966467e tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.160748 Jul 20 10:45:32.594203 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 12/15] 10.222.0.79 () {62 vars in 1209 bytes} [Wed Jul 20 10:45:32 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:32.605080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:32.606247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:32.614504 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cad8258b-a1b4-4b2a-9411-3209cd2122af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.783486 Jul 20 10:45:32.615504 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 4/16] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 10:45:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:32.620694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0bb68f56-d301-4915-ac70-199063fe2899 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:32.622156 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:32.622156 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:32.645354 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0bb68f56-d301-4915-ac70-199063fe2899 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.027978 Jul 20 10:45:32.647580 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 5/17] 10.222.0.79 () {60 vars in 1189 bytes} [Wed Jul 20 10:45:32 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:32.658406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e22c033b-9d27-4bc7-96a3-cd20c0f9afc0 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:32.660260 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:32.660260 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:32.689550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e22c033b-9d27-4bc7-96a3-cd20c0f9afc0 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:32.690006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e22c033b-9d27-4bc7-96a3-cd20c0f9afc0 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:33.120145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2db13a98-1cf6-41fb-a756-82bd9d25632b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:33.122185 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:33.122185 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:33.124784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db13a98-1cf6-41fb-a756-82bd9d25632b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:33.125520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db13a98-1cf6-41fb-a756-82bd9d25632b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:33.126660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db13a98-1cf6-41fb-a756-82bd9d25632b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:33.127383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db13a98-1cf6-41fb-a756-82bd9d25632b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:33.184718 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2db13a98-1cf6-41fb-a756-82bd9d25632b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.588695 Jul 20 10:45:33.191421 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 13/18] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:45:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:34.813844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01735e5a-8839-41fb-b3b6-1c1a3d83c754 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2000020489", "id": 364443938, "os-flavor-access:is_public": "False"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:34.815775 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:34.815775 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:34.815966 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e22c033b-9d27-4bc7-96a3-cd20c0f9afc0 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 2.161838 Jul 20 10:45:34.817197 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 6/19] 10.222.0.79 () {62 vars in 1231 bytes} [Wed Jul 20 10:45:32 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:34.836521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2961a81-72de-4f87-8e9b-4ec53086cdd9 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:34.838267 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:34.838267 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:34.848209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2961a81-72de-4f87-8e9b-4ec53086cdd9 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:34.848753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2961a81-72de-4f87-8e9b-4ec53086cdd9 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:34.875114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01735e5a-8839-41fb-b3b6-1c1a3d83c754 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.556448 Jul 20 10:45:34.881063 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 14/20] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:34 2022] POST /compute/v2.1/flavors => generated 436 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:34.887428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8726f3a9-a342-45c7-828a-ac7fdc8650c2 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:34.888643 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:34.888643 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:34.990324 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2961a81-72de-4f87-8e9b-4ec53086cdd9 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.159205 Jul 20 10:45:34.997329 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 7/21] 10.222.0.79 () {62 vars in 1231 bytes} [Wed Jul 20 10:45:34 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:35.002637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7706c2c-c3c2-486b-98ad-a8ddf49a2cc5 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:35.003447 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.003447 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.041085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7706c2c-c3c2-486b-98ad-a8ddf49a2cc5 tempest-AggregatesAdminTestV241-390425146 tempest-AggregatesAdminTestV241-390425146-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.042393 Jul 20 10:45:35.043484 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 8/22] 10.222.0.79 () {60 vars in 1192 bytes} [Wed Jul 20 10:45:34 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:35.058213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-29af71f8-a127-46f1-a324-14bf8240cae2 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1140216863"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.080958 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.080958 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.082426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-29af71f8-a127-46f1-a324-14bf8240cae2 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid ef76c434-ecf0-419e-9f22-e96d13fcb96e for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:35.133461 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-29af71f8-a127-46f1-a324-14bf8240cae2 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078467 Jul 20 10:45:35.134727 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 9/23] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:35.160638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-14f1cf88-4dea-4ed3-944a-5ba617f67322 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.162107 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.162107 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.179523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14f1cf88-4dea-4ed3-944a-5ba617f67322 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:35.179971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14f1cf88-4dea-4ed3-944a-5ba617f67322 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:35.352270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-14f1cf88-4dea-4ed3-944a-5ba617f67322 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 243 microversion: 2.1 time: 0.208691 Jul 20 10:45:35.353383 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 10/24] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 243 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:35.365919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.367312 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.367312 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.379698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:35.381499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:35.418012 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-846219-10. Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 40 Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:35.438204 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: {"add_host": {"host": "n-h2-846219-10"}} Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:35.439396 n-d-846219-10 devstack@n-api.service[125885]: exception: Aggregate 2 already has host n-h2-846219-10. Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-846219-10'}}} Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result.read() Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 10:45:35.440164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-846219-10-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 10:45:35.441504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 10:45:35.442534 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 10:45:35.443560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result.read() Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-846219-10-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 10, 45, 35, 399604), 'updated_at': None, 'host': 'n-h2-846219-10', 'aggregate_id': 2}] Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:35.445109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-846219-10. Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.446097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-846219-10. Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:35.447451 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:35.448408 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-846219-10. Jul 20 10:45:35.448408 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:35.448408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-846219-10. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:35.448408 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4749e502-7cef-4025-88fd-5aacd8d7cf30 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 96 microversion: 2.1 time: 0.078492 Jul 20 10:45:35.448408 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 11/25] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 96 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 20 10:45:35.451415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5feaaff4-f73a-4e0c-bfbc-8dd8bd882983 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.453803 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.453803 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.462647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5feaaff4-f73a-4e0c-bfbc-8dd8bd882983 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:35.463098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5feaaff4-f73a-4e0c-bfbc-8dd8bd882983 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:35.589128 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5feaaff4-f73a-4e0c-bfbc-8dd8bd882983 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.141349 Jul 20 10:45:35.591748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 12/26] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:35.600945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba67d77d-bb5f-4145-92b5-b139480ebec0 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:35.601713 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.601713 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.627341 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba67d77d-bb5f-4145-92b5-b139480ebec0 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.029881 Jul 20 10:45:35.628429 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 13/27] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:35 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 10:45:35.640801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-06dfbaa2-1d01-4e30-a997-baa5e3b4ad68 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-489930405"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.642302 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.642302 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:35.643235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-06dfbaa2-1d01-4e30-a997-baa5e3b4ad68 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid b6865549-a1eb-4879-9e3d-60ed0acef3f4 for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:35.666631 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-06dfbaa2-1d01-4e30-a997-baa5e3b4ad68 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.031320 Jul 20 10:45:35.667248 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 14/28] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:35.729450 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8726f3a9-a342-45c7-828a-ac7fdc8650c2 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/364443938/action" status: 200 len: 96 microversion: 2.1 time: 0.845789 Jul 20 10:45:35.736545 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 15/29] 10.222.0.79 () {60 vars in 1196 bytes} [Wed Jul 20 10:45:34 2022] POST /compute/v2.1/flavors/364443938/action => generated 96 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 10:45:35.740157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-34a8fba1-8157-4a8b-9912-08f3cff57ff2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1353361070", "name": "tempest-test_aggregate-498348730"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.757872 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.757872 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:35.758957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-34a8fba1-8157-4a8b-9912-08f3cff57ff2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid 87be132b-ab03-4fb0-b1c3-e864f437e582 for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:35.789047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-34a8fba1-8157-4a8b-9912-08f3cff57ff2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.052529 Jul 20 10:45:35.790089 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 16/30] 10.222.0.79 () {60 vars in 1164 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:35.797729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62b345e1-7c81-43dd-9a67-510a78752288 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:35.799222 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:35.799222 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:36.067947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dc62c3d5-9f92-4101-b531-f7e514b3b6ab tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.072130 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.072130 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.074564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dc62c3d5-9f92-4101-b531-f7e514b3b6ab tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '65a3fd82615d4f53a92fb66b39e45b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffde4d7f1c47497281d75664619fcd7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dc62c3d5-9f92-4101-b531-f7e514b3b6ab tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Request method failure captured: Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 40 Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zISKTF_CG4W44T3sRU3L1RT6KlTfhL-0Yz4pcxrHpJ0gcCXC9Whv-QFLA6l0yfWcGNzB70iMaGYYGjNL2rnp-iF_xeJc_JqEPSEyQ8wkvqQUAqs7r9mAbIRypwoLeDdPFUalWl3gnejnN0ZZAsPpenQeBV4zY9023LeoijJap38fI Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:36.079222 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ffde4d7f1c47497281d75664619fcd7e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 65a3fd82615d4f53a92fb66b39e45b3f Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: {"add_host": {"host": "n-h2-846219-10"}} Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:36.080635 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-846219-10'}}} Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:36.081931 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 20 10:45:36.083288 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.085889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dc62c3d5-9f92-4101-b531-f7e514b3b6ab tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.085889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dc62c3d5-9f92-4101-b531-f7e514b3b6ab tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.406691 Jul 20 10:45:36.085889 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 15/31] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 408 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:45:36.087712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7ebe4866-47e6-4526-9733-210d68ea2774 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:36.088544 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.088544 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.107796 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7ebe4866-47e6-4526-9733-210d68ea2774 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.024336 Jul 20 10:45:36.109390 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 16/32] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:45:36 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:36.113911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50b10b83-2793-4100-ae54-27c0ede43041 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:36.115014 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.115014 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.145482 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50b10b83-2793-4100-ae54-27c0ede43041 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.034688 Jul 20 10:45:36.146897 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 17/33] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:36 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:45:36.151916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d9e7ed5-f0b8-4681-9e7a-04bf86f449d9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.153557 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.153557 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.165008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d9e7ed5-f0b8-4681-9e7a-04bf86f449d9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:36.165573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d9e7ed5-f0b8-4681-9e7a-04bf86f449d9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:36.365841 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3d9e7ed5-f0b8-4681-9e7a-04bf86f449d9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 0.217910 Jul 20 10:45:36.366957 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 18/34] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:36.371915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c15b74b-bd0f-4485-9571-0a621f6c32b5 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2114474208"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.374708 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.374708 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.375645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-0c15b74b-bd0f-4485-9571-0a621f6c32b5 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid 6d647188-b635-4279-971e-386247a45b7c for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:36.398466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c15b74b-bd0f-4485-9571-0a621f6c32b5 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.030208 Jul 20 10:45:36.399528 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 19/35] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:36.412364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1837110018"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.413664 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.413664 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.426543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:36.427542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:36.441725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:36.442637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:36.454292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1837110018 could not be found. Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 58 Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:36.457215 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: {"add_host": {"host": "tempest-nonexist_host-1837110018"}} Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:36.458494 n-d-846219-10 devstack@n-api.service[125885]: exception: Compute host tempest-nonexist_host-1837110018 could not be found. Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1837110018'}}} Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1837110018' is not mapped to any cell Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.459307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 20 10:45:36.461239 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1837110018 could not be found. Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1837110018 could not be found. Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.462287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1837110018 could not be found. Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1837110018 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4779b50-b49c-474a-b560-f0a3705ad31a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.052072 Jul 20 10:45:36.463821 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 20/36] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:45:36.468802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf45881f-b394-4c89-90c6-b82d167036c2 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:36.469790 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.469790 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.498094 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf45881f-b394-4c89-90c6-b82d167036c2 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.033589 Jul 20 10:45:36.498990 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 21/37] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:36 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 20 10:45:36.507560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88c1afed-4440-4940-b82d-e432d26621c6 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88c1afed-4440-4940-b82d-e432d26621c6 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 283 Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:36.531046 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:36.532415 n-d-846219-10 devstack@n-api.service[125885]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 10:45:36.532956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:45:36.533504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:45:36.534398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:45:36.535366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 10:45:36.535366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.535366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88c1afed-4440-4940-b82d-e432d26621c6 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.535366 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-88c1afed-4440-4940-b82d-e432d26621c6 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.028777 Jul 20 10:45:36.535607 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 22/38] 10.222.0.79 () {60 vars in 1164 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 10:45:36.545742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49bf141b-daf5-409c-a344-f157778a9203 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49bf141b-daf5-409c-a344-f157778a9203 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 27 Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:36.548457 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: {"aggregate": {"name": ""}} Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:36.549608 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '' Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.550307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 10:45:36.552545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.553532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49bf141b-daf5-409c-a344-f157778a9203 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.553532 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49bf141b-daf5-409c-a344-f157778a9203 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008815 Jul 20 10:45:36.553532 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 23/39] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:45:36.564253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c3502d6-45e1-4d58-8909-c58f0bf446b1 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1958688325"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.566503 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.566503 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.567833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7c3502d6-45e1-4d58-8909-c58f0bf446b1 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '65a3fd82615d4f53a92fb66b39e45b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffde4d7f1c47497281d75664619fcd7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c3502d6-45e1-4d58-8909-c58f0bf446b1 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Request method failure captured: Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 60 Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zISKTF_CG4W44T3sRU3L1RT6KlTfhL-0Yz4pcxrHpJ0gcCXC9Whv-QFLA6l0yfWcGNzB70iMaGYYGjNL2rnp-iF_xeJc_JqEPSEyQ8wkvqQUAqs7r9mAbIRypwoLeDdPFUalWl3gnejnN0ZZAsPpenQeBV4zY9023LeoijJap38fI Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:36.570137 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ffde4d7f1c47497281d75664619fcd7e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 65a3fd82615d4f53a92fb66b39e45b3f Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: {"aggregate": {"name": "tempest-test_aggregate-1958688325"}} Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:36.571521 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1958688325'}}} Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:36.572365 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:36.573257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 20 10:45:36.574198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.576752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c3502d6-45e1-4d58-8909-c58f0bf446b1 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.577992 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7c3502d6-45e1-4d58-8909-c58f0bf446b1 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021738 Jul 20 10:45:36.579494 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 24/40] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:36.588826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af595dfa-e451-4b96-84bd-4fe0b24d558f tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1439882933"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.591942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-af595dfa-e451-4b96-84bd-4fe0b24d558f tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid 9978d47c-735d-437b-ac73-7ae858671dd3 for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:36.601562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:36.608445 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-62b345e1-7c81-43dd-9a67-510a78752288 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project e8d228fe32dc4537be970b132b4f9d98 combination. Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62b345e1-7c81-43dd-9a67-510a78752288 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Request method failure captured: Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/flavors/364443938/action HTTP/1.1 Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 67 Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zLmf5XCn7mkU71nPr4AXvIra4V-7cJ-Ms4TnESyrou9XklsEb8P2eZJk_CTNWOWkZ9UYM2FKi7x_hz_GnQrzUwrYsnkm_C86juo0Ra6F4BN4wl1zWeAkSmA7SC6UuHTYMVD5kO9h-DcvfucnjkGFTqoh2YrtvFoWGEngJFtHJIrRQ Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ec5886a441f64f2a87bf6eb8cbd2d3f9 Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:45:36.629769 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec5886a441f64f2a87bf6eb8cbd2d3f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ec5886a441f64f2a87bf6eb8cbd2d3f9 Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: dbe91ab39c9b4a75bcab3821ade257c0 Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: {"addTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} Jul 20 10:45:36.631115 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: exception: Flavor access already exists for flavor 15 and project e8d228fe32dc4537be970b132b4f9d98 combination. Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '364443938', 'body': {'addTenantAccess': {'tenant': 'e8d228fe32dc4537be970b132b4f9d98'}}} Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result.read() Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 10:45:36.631912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-e8d228fe32dc4537be970b132b4f9d98' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 10:45:36.632930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 10:45:36.634055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 10:45:36.635317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result.read() Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-e8d228fe32dc4537be970b132b4f9d98' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 10, 45, 36, 602499), 'updated_at': None, 'flavor_id': 15, 'project_id': 'e8d228fe32dc4537be970b132b4f9d98'}] Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.637731 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project e8d228fe32dc4537be970b132b4f9d98 combination. Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.640863 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project e8d228fe32dc4537be970b132b4f9d98 combination. Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:36.645691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:36.648627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project e8d228fe32dc4537be970b132b4f9d98 combination. Jul 20 10:45:36.648627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.648627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62b345e1-7c81-43dd-9a67-510a78752288 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project e8d228fe32dc4537be970b132b4f9d98 combination. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.648627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62b345e1-7c81-43dd-9a67-510a78752288 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/364443938/action" status: 409 len: 152 microversion: 2.1 time: 0.839179 Jul 20 10:45:36.648627 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 17/41] 10.222.0.79 () {60 vars in 1196 bytes} [Wed Jul 20 10:45:35 2022] POST /compute/v2.1/flavors/364443938/action => generated 152 bytes in 841 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:45:36.649930 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af595dfa-e451-4b96-84bd-4fe0b24d558f tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055057 Jul 20 10:45:36.649930 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 25/42] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:36.651235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd9b348b-82a2-4b24-ac1f-347ce4293220 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.652450 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.652450 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:36.657772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b6a8ce1-3004-4396-93f8-8dc768cdf20b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1439882933"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.658562 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.658562 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.659477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-6b6a8ce1-3004-4396-93f8-8dc768cdf20b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid 46ab8154-f95f-44de-9d4e-d9305bbbbd27 for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:36.671416 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-6b6a8ce1-3004-4396-93f8-8dc768cdf20b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1439882933 already exists. Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b6a8ce1-3004-4396-93f8-8dc768cdf20b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 60 Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:36.673498 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: {"aggregate": {"name": "tempest-test_aggregate-1439882933"}} Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:36.674847 n-d-846219-10 devstack@n-api.service[125885]: exception: Aggregate tempest-test_aggregate-1439882933 already exists. Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1439882933'}}} Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 20 10:45:36.675525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1439882933 already exists. Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:36.676548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1439882933 already exists. Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1439882933 already exists. Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b6a8ce1-3004-4396-93f8-8dc768cdf20b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1439882933 already exists. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:36.677513 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b6a8ce1-3004-4396-93f8-8dc768cdf20b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.023070 Jul 20 10:45:36.678227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 26/43] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 25 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:45:36.683894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49efc251-12a7-4e14-a3df-7182e984172c tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:36.684675 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.684675 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.708593 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49efc251-12a7-4e14-a3df-7182e984172c tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.028658 Jul 20 10:45:36.709206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 27/44] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:36 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:45:36.721199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8965114f-fd57-4179-9596-45c8ded2893b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1029049160"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:36.722759 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:36.722759 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:36.723826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-8965114f-fd57-4179-9596-45c8ded2893b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid 7cfd2913-02b0-4948-b5c5-3384d3958c2a for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:36.752787 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8965114f-fd57-4179-9596-45c8ded2893b tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035289 Jul 20 10:45:36.760140 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 28/45] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:37.217758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-823473549", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "availability_zone": "tempest-test_az-1353361070"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:37.250066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:37.250516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:37.251341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:37.251777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:37.444845 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bd9b348b-82a2-4b24-ac1f-347ce4293220 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/364443938/action" status: 200 len: 21 microversion: 2.1 time: 0.807888 Jul 20 10:45:37.445552 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 18/46] 10.222.0.79 () {60 vars in 1196 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/flavors/364443938/action => generated 21 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:37.458089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9e26399-4823-4b50-bd59-1624ae8c7e5a tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:37.459320 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:37.459320 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:37.460424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d9e26399-4823-4b50-bd59-1624ae8c7e5a tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '65a3fd82615d4f53a92fb66b39e45b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffde4d7f1c47497281d75664619fcd7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9e26399-4823-4b50-bd59-1624ae8c7e5a tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Request method failure captured: Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zISKTF_CG4W44T3sRU3L1RT6KlTfhL-0Yz4pcxrHpJ0gcCXC9Whv-QFLA6l0yfWcGNzB70iMaGYYGjNL2rnp-iF_xeJc_JqEPSEyQ8wkvqQUAqs7r9mAbIRypwoLeDdPFUalWl3gnejnN0ZZAsPpenQeBV4zY9023LeoijJap38fI Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:45:37.462803 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ffde4d7f1c47497281d75664619fcd7e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 65a3fd82615d4f53a92fb66b39e45b3f Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 10:45:37.464744 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '7'} Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:37.465702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 20 10:45:37.466840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:37.469255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9e26399-4823-4b50-bd59-1624ae8c7e5a tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:37.470310 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d9e26399-4823-4b50-bd59-1624ae8c7e5a tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.016867 Jul 20 10:45:37.471070 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 19/47] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:37.738381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97f707ef-345e-4e20-84c0-2b53dde79e57 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1195195598", "id": 1832594011, "os-flavor-access:is_public": "False"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:37.741760 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:37.741760 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:37.764486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97f707ef-345e-4e20-84c0-2b53dde79e57 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.292140 Jul 20 10:45:37.765615 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 20/48] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:37 2022] POST /compute/v2.1/flavors => generated 431 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:37.771641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d34a3ea0-f496-4561-a167-b8a536d92a8c tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:37.772696 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:37.772696 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:37.798961 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d34a3ea0-f496-4561-a167-b8a536d92a8c tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/364443938" status: 202 len: 0 microversion: 2.1 time: 0.031964 Jul 20 10:45:37.799838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 21/49] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:45:37 2022] DELETE /compute/v2.1/flavors/364443938 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:37.805169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-148dc1fc-8cc5-4a42-9a6b-8eb36bae65cb tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:37.837696 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-148dc1fc-8cc5-4a42-9a6b-8eb36bae65cb tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036517 Jul 20 10:45:37.838394 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 22/50] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:37 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:45:37.844755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e4f48fd-7d77-4e62-9767-6acd8b6657c3 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "96f48a87bea843749616f5ba1036bda8"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:37.846276 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:37.846276 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:38.349396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:45:38.536620 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e4f48fd-7d77-4e62-9767-6acd8b6657c3 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1832594011/action" status: 200 len: 97 microversion: 2.1 time: 0.695183 Jul 20 10:45:38.537630 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 23/51] 10.222.0.79 () {60 vars in 1199 bytes} [Wed Jul 20 10:45:37 2022] POST /compute/v2.1/flavors/1832594011/action => generated 97 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:38.554444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84bf8c16-166c-477b-944d-355b1fa14453 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:38.611201 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84bf8c16-166c-477b-944d-355b1fa14453 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063077 Jul 20 10:45:38.612828 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 24/52] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:38.621669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-374840e2-7e53-482d-9aec-8d4d9f5fd795 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:38.624184 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:38.624184 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:38.641245 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-374840e2-7e53-482d-9aec-8d4d9f5fd795 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-374840e2-7e53-482d-9aec-8d4d9f5fd795 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:45:38.646502 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: exception: Aggregate -1 could not be found. Jul 20 10:45:38.647871 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '-1'} Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 10:45:38.648483 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:38.649378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:38.650365 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:38.650365 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:38.650365 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:38.650365 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:38.650365 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 10:45:38.650365 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:38.652322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-374840e2-7e53-482d-9aec-8d4d9f5fd795 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:38.653456 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-374840e2-7e53-482d-9aec-8d4d9f5fd795 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039049 Jul 20 10:45:38.659294 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 25/53] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:45:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:45:38.674592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:45:38.675031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:45:38.675548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:45:38.675963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:45:38.676522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:45:38.691015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:38.691765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:38.692737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:38.693339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:38.731202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Getting quotas for project 7fd2c3ca2ac64585b32cb3fea94f6127. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:45:38.742003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Getting quotas for user dc843169b8a742b28d9a94c86a8abebd and project 7fd2c3ca2ac64585b32cb3fea94f6127. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:45:38.756315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:45:38.759073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:45:38.819909 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e71029c9-29ff-4a8f-90e8-772a975db0a0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.058741 Jul 20 10:45:38.820668 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 29/54] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:45:38.832772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5b1b11ea-939c-4644-90e8-584547f13eef tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1446059344", "id": 1609655458, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:38.834337 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:38.834337 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:38.872052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5b1b11ea-939c-4644-90e8-584547f13eef tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.043934 Jul 20 10:45:38.874548 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 30/55] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:38 2022] POST /compute/v2.1/flavors => generated 438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:38.882014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ad851dc-2a50-448c-87c1-1c073f854ecd tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1295463709"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:38.883474 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:38.883474 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:38.884431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-4ad851dc-2a50-448c-87c1-1c073f854ecd tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid fd79d9dc-d082-4884-b387-a77ff41777b0 for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:45:38.913147 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ad851dc-2a50-448c-87c1-1c073f854ecd tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037226 Jul 20 10:45:38.913760 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 31/56] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:45:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:38.920589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f550a729-ad32-4319-89c3-7d48b678440b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:38.921468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f550a729-ad32-4319-89c3-7d48b678440b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:39.018584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7680ed3f-7987-4da4-9e9f-5fb3f40ced0f tempest-FlavorsAccessTestJSON-25760477 tempest-FlavorsAccessTestJSON-25760477-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.023460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f550a729-ad32-4319-89c3-7d48b678440b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:39.043952 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f550a729-ad32-4319-89c3-7d48b678440b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1242 microversion: 2.1 time: 0.128461 Jul 20 10:45:39.045906 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 32/57] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:38 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:39.055600 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7680ed3f-7987-4da4-9e9f-5fb3f40ced0f tempest-FlavorsAccessTestJSON-25760477 tempest-FlavorsAccessTestJSON-25760477-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5840 microversion: 2.1 time: 0.390622 Jul 20 10:45:39.055703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba9e6810-caf0-4ec2-a41d-005262b8886e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.055703 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.055703 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.062751 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 26/58] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:38 2022] GET /compute/v2.1/flavors/detail => generated 5840 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:39.068122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7c7e912-b5f8-40f2-93c7-ab4f57ad2f32 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.068945 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.068945 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:39.069792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7c7e912-b5f8-40f2-93c7-ab4f57ad2f32 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '65a3fd82615d4f53a92fb66b39e45b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffde4d7f1c47497281d75664619fcd7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7c7e912-b5f8-40f2-93c7-ab4f57ad2f32 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Request method failure captured: Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zISKTF_CG4W44T3sRU3L1RT6KlTfhL-0Yz4pcxrHpJ0gcCXC9Whv-QFLA6l0yfWcGNzB70iMaGYYGjNL2rnp-iF_xeJc_JqEPSEyQ8wkvqQUAqs7r9mAbIRypwoLeDdPFUalWl3gnejnN0ZZAsPpenQeBV4zY9023LeoijJap38fI Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:45:39.072272 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ffde4d7f1c47497281d75664619fcd7e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 65a3fd82615d4f53a92fb66b39e45b3f Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 10:45:39.073317 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '8'} Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:39.073898 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.074810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7c7e912-b5f8-40f2-93c7-ab4f57ad2f32 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:39.076379 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7c7e912-b5f8-40f2-93c7-ab4f57ad2f32 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.009867 Jul 20 10:45:39.076501 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ba9e6810-caf0-4ec2-a41d-005262b8886e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba9e6810-caf0-4ec2-a41d-005262b8886e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Request method failure captured: Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/flavors/1609655458/os-flavor-access HTTP/1.1 Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zLmf5XCn7mkU71nPr4AXvIra4V-7cJ-Ms4TnESyrou9XklsEb8P2eZJk_CTNWOWkZ9UYM2FKi7x_hz_GnQrzUwrYsnkm_C86juo0Ra6F4BN4wl1zWeAkSmA7SC6UuHTYMVD5kO9h-DcvfucnjkGFTqoh2YrtvFoWGEngJFtHJIrRQ Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ec5886a441f64f2a87bf6eb8cbd2d3f9 Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:39.078320 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec5886a441f64f2a87bf6eb8cbd2d3f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ec5886a441f64f2a87bf6eb8cbd2d3f9 Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: dbe91ab39c9b4a75bcab3821ade257c0 Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: exception: Access list not available for public flavors. Jul 20 10:45:39.080917 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'flavor_id': '1609655458'} Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 20 10:45:39.082277 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.084484 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 27/59] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:39.084607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba9e6810-caf0-4ec2-a41d-005262b8886e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:39.084607 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba9e6810-caf0-4ec2-a41d-005262b8886e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1609655458/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.031443 Jul 20 10:45:39.084607 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 33/60] 10.222.0.79 () {58 vars in 1208 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/flavors/1609655458/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:45:39.086738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d6d5e8f5-8117-48d0-96cc-daf9296eb50f tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.086738 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.086738 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.087116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e7041fd-d34c-494d-9a7f-067d82598ba7 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "96f48a87bea843749616f5ba1036bda8"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:39.087813 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.087813 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:39.112892 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d6d5e8f5-8117-48d0-96cc-daf9296eb50f tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.031421 Jul 20 10:45:39.113715 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 34/61] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:39 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:45:39.118488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ce7a673-afd5-4726-b806-0b0330c81ea1 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.119884 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.119884 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.149799 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ce7a673-afd5-4726-b806-0b0330c81ea1 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1609655458" status: 202 len: 0 microversion: 2.1 time: 0.035150 Jul 20 10:45:39.150781 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 35/62] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:45:39 2022] DELETE /compute/v2.1/flavors/1609655458 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:39.156712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8efac22-4ccf-4487-bfa8-35b5e922346a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.157583 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.157583 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.168011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b8efac22-4ccf-4487-bfa8-35b5e922346a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8efac22-4ccf-4487-bfa8-35b5e922346a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:39.170548 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: exception: Aggregate -1 could not be found. Jul 20 10:45:39.171825 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '-1'} Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.172544 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 20 10:45:39.173823 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.176031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8efac22-4ccf-4487-bfa8-35b5e922346a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:39.177051 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b8efac22-4ccf-4487-bfa8-35b5e922346a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024846 Jul 20 10:45:39.177758 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 36/63] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:45:39.186171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7720953-1afb-45d6-84b2-6e404d561886 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.218352 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7720953-1afb-45d6-84b2-6e404d561886 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039408 Jul 20 10:45:39.218947 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 37/64] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:39.228410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d872a999-1cb9-484b-b5a0-8c710f3f2334 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.229398 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.229398 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.230514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d872a999-1cb9-484b-b5a0-8c710f3f2334 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '65a3fd82615d4f53a92fb66b39e45b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffde4d7f1c47497281d75664619fcd7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d872a999-1cb9-484b-b5a0-8c710f3f2334 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Request method failure captured: Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zISKTF_CG4W44T3sRU3L1RT6KlTfhL-0Yz4pcxrHpJ0gcCXC9Whv-QFLA6l0yfWcGNzB70iMaGYYGjNL2rnp-iF_xeJc_JqEPSEyQ8wkvqQUAqs7r9mAbIRypwoLeDdPFUalWl3gnejnN0ZZAsPpenQeBV4zY9023LeoijJap38fI Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:39.233080 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ffde4d7f1c47497281d75664619fcd7e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 65a3fd82615d4f53a92fb66b39e45b3f Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 10:45:39.234393 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:39.235243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 20 10:45:39.236264 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.237915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d872a999-1cb9-484b-b5a0-8c710f3f2334 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:39.238749 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d872a999-1cb9-484b-b5a0-8c710f3f2334 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018500 Jul 20 10:45:39.239348 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 38/65] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:39.243754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de9ae1bc-26f7-47d8-984a-25c403c01d4d tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1043715953", "id": 1229985951, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:39.245328 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.245328 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.263331 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de9ae1bc-26f7-47d8-984a-25c403c01d4d tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.022830 Jul 20 10:45:39.263936 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 39/66] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:39 2022] POST /compute/v2.1/flavors => generated 439 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:39.748465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73268518-a137-4db7-b280-98263fbc76b8 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:39.749880 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.749880 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:39.751100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-73268518-a137-4db7-b280-98263fbc76b8 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f9eb212c234e4cf6abafd2315d88d5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d228fe32dc4537be970b132b4f9d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73268518-a137-4db7-b280-98263fbc76b8 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Request method failure captured: Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/flavors/1229985951/action HTTP/1.1 Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 67 Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zI42K3rI5mJZYLUgo_K7EhETNWfeOlomFs0KWcyYwkuqctTsdEhT83AyJSj7HDo4WZDtoGoRNrOOmHKb8zQvMKLrBptFIFF3b4KiCR5b5ZPNyjHLgpOxL6rLIIRCvQViaippKoY5cbxYACjEZ9orSkhK2dkul7kwBc3apEypl2HrU Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e8d228fe32dc4537be970b132b4f9d98 Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-567813949 Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:39.759487 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e8d228fe32dc4537be970b132b4f9d98", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8d228fe32dc4537be970b132b4f9d98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8d228fe32dc4537be970b132b4f9d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e8d228fe32dc4537be970b132b4f9d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-567813949 Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e8d228fe32dc4537be970b132b4f9d98 Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-567813949 Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsAccessNegativeTestJSON-567813949-project Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f9eb212c234e4cf6abafd2315d88d5dc Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-567813949-project Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: {"addTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} Jul 20 10:45:39.760634 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1229985951', 'body': {'addTenantAccess': {'tenant': 'e8d228fe32dc4537be970b132b4f9d98'}}} Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:39.761254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 20 10:45:39.762176 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:39.763798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73268518-a137-4db7-b280-98263fbc76b8 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:39.763798 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73268518-a137-4db7-b280-98263fbc76b8 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] 10.222.0.79 "POST /compute/v2.1/flavors/1229985951/action" status: 403 len: 130 microversion: 2.1 time: 0.492028 Jul 20 10:45:39.764734 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 40/67] 10.222.0.79 () {60 vars in 1199 bytes} [Wed Jul 20 10:45:39 2022] POST /compute/v2.1/flavors/1229985951/action => generated 130 bytes in 494 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:45:39.775270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a9b7a318-5e45-4e88-83b9-916ed17823db tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.801284 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a9b7a318-5e45-4e88-83b9-916ed17823db tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1229985951" status: 202 len: 0 microversion: 2.1 time: 0.031143 Jul 20 10:45:39.802244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 41/68] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:45:39 2022] DELETE /compute/v2.1/flavors/1229985951 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:39.813217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d0e88fb-b859-49c3-aae6-b0b74ac36ae8 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.834698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d0e88fb-b859-49c3-aae6-b0b74ac36ae8 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025691 Jul 20 10:45:39.843953 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 42/69] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:45:39.847105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:39.867004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34a1cdbe-c827-4d59-9988-554d4a52692b tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-867008385", "id": 1067276572, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:39.880086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e7041fd-d34c-494d-9a7f-067d82598ba7 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1832594011/action" status: 200 len: 21 microversion: 2.1 time: 0.799015 Jul 20 10:45:39.881367 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 28/70] 10.222.0.79 () {60 vars in 1199 bytes} [Wed Jul 20 10:45:39 2022] POST /compute/v2.1/flavors/1832594011/action => generated 21 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:39.892224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f3139222-96b8-43c1-8bce-c9533fd50c78 tempest-FlavorsAccessTestJSON-25760477 tempest-FlavorsAccessTestJSON-25760477-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.902412 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-34a1cdbe-c827-4d59-9988-554d4a52692b tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.046440 Jul 20 10:45:39.903008 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 43/71] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:39 2022] POST /compute/v2.1/flavors => generated 438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:39.922118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05b74c71-7475-4eb6-b124-aff637a25784 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:39.937167 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f3139222-96b8-43c1-8bce-c9533fd50c78 tempest-FlavorsAccessTestJSON-25760477 tempest-FlavorsAccessTestJSON-25760477-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049896 Jul 20 10:45:39.937885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 29/72] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:39.955257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e8a9b2c3-b3a7-4ca1-a612-afc505404bc5 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:39.956188 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:39.956188 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:39.981096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e8a9b2c3-b3a7-4ca1-a612-afc505404bc5 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1832594011" status: 202 len: 0 microversion: 2.1 time: 0.030625 Jul 20 10:45:39.985733 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 30/73] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:45:39 2022] DELETE /compute/v2.1/flavors/1832594011 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:40.367162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1951150083", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:40.491456 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05b74c71-7475-4eb6-b124-aff637a25784 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1067276572/action" status: 200 len: 97 microversion: 2.1 time: 0.576699 Jul 20 10:45:40.492345 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 44/74] 10.222.0.79 () {60 vars in 1199 bytes} [Wed Jul 20 10:45:39 2022] POST /compute/v2.1/flavors/1067276572/action => generated 97 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 10:45:40.497787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9ae6c54e-5076-4c80-b456-a6f7d51a698d tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:40.526833 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9ae6c54e-5076-4c80-b456-a6f7d51a698d tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033063 Jul 20 10:45:40.528059 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 45/75] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:40.536464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:40.537587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:40.549607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:40.550525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:40.551780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:40.552377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:40.722798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:40.744278 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e7774b7-1ebd-4f73-b4ca-afe871b0de91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1290 microversion: 2.1 time: 0.213808 Jul 20 10:45:40.745312 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 46/76] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:40 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1290 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:40.958710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:45:41.096830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Calling method '.version_select at 0x7f2c4c74d820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:41.098605 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.098605 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:41.104747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.105238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.131044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.131760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.148508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.149141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.162947 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3241b2e7-91d7-4fb1-aad6-da5b7b97133f tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.416162 Jul 20 10:45:41.163598 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 47/77] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 10:45:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:41.174512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c78b1c3-3aeb-4dd4-8515-4d6d36324c11 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:41.176324 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.176324 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:41.177487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1c78b1c3-3aeb-4dd4-8515-4d6d36324c11 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f9eb212c234e4cf6abafd2315d88d5dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d228fe32dc4537be970b132b4f9d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c78b1c3-3aeb-4dd4-8515-4d6d36324c11 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Request method failure captured: Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/flavors/1067276572/action HTTP/1.1 Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 70 Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zI42K3rI5mJZYLUgo_K7EhETNWfeOlomFs0KWcyYwkuqctTsdEhT83AyJSj7HDo4WZDtoGoRNrOOmHKb8zQvMKLrBptFIFF3b4KiCR5b5ZPNyjHLgpOxL6rLIIRCvQViaippKoY5cbxYACjEZ9orSkhK2dkul7kwBc3apEypl2HrU Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e8d228fe32dc4537be970b132b4f9d98 Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-567813949 Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:41.179375 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e8d228fe32dc4537be970b132b4f9d98", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8d228fe32dc4537be970b132b4f9d98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e8d228fe32dc4537be970b132b4f9d98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e8d228fe32dc4537be970b132b4f9d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-567813949 Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e8d228fe32dc4537be970b132b4f9d98 Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-567813949 Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsAccessNegativeTestJSON-567813949-project Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f9eb212c234e4cf6abafd2315d88d5dc Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-567813949-project Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: {"removeTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} Jul 20 10:45:41.181510 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1067276572', 'body': {'removeTenantAccess': {'tenant': 'e8d228fe32dc4537be970b132b4f9d98'}}} Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can( Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:41.182674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 20 10:45:41.186267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:41.188823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c78b1c3-3aeb-4dd4-8515-4d6d36324c11 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:41.188823 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1c78b1c3-3aeb-4dd4-8515-4d6d36324c11 tempest-FlavorsAccessNegativeTestJSON-567813949 tempest-FlavorsAccessNegativeTestJSON-567813949-project] 10.222.0.79 "POST /compute/v2.1/flavors/1067276572/action" status: 403 len: 133 microversion: 2.1 time: 0.015983 Jul 20 10:45:41.188823 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 48/78] 10.222.0.79 () {60 vars in 1199 bytes} [Wed Jul 20 10:45:41 2022] POST /compute/v2.1/flavors/1067276572/action => generated 133 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:41.195500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7202316-9c62-4dd2-9509-3fed3c0bc914 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-634637623", "id": 1319015468, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:41.199560 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.199560 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:41.224622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=10,nova_api:INSERT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:41.242448 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7202316-9c62-4dd2-9509-3fed3c0bc914 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.059862 Jul 20 10:45:41.243550 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 49/79] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:41 2022] POST /compute/v2.1/flavors => generated 430 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:41.282377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:45:41.283026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:45:41.283819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:45:41.284537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:45:41.285181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:45:41.303335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.304168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.305223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.305868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.340222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Getting quotas for project a6ee2b02dd884f3781a101b8517f4d9a. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:45:41.349723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Getting quotas for user 9f107a581f6143c395d2480776b9193c and project a6ee2b02dd884f3781a101b8517f4d9a. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:45:41.363910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:45:41.367241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:45:41.437971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01aca4d0-256e-441d-96d5-f63681b81d0b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.452816 Jul 20 10:45:41.444069 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 31/80] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:45:41.444680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ceefd0f3-a800-4073-9974-d160de92cdb4 tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Calling method '.version_select at 0x7f2c4c1e6310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:41.445582 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.445582 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:41.447473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceefd0f3-a800-4073-9974-d160de92cdb4 tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.447939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceefd0f3-a800-4073-9974-d160de92cdb4 tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.463962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceefd0f3-a800-4073-9974-d160de92cdb4 tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:41.464426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceefd0f3-a800-4073-9974-d160de92cdb4 tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:41.474728 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ceefd0f3-a800-4073-9974-d160de92cdb4 tempest-HypervisorAdminV228Test-1892443101 tempest-HypervisorAdminV228Test-1892443101-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.034435 Jul 20 10:45:41.475451 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 32/81] 10.222.0.79 () {60 vars in 1192 bytes} [Wed Jul 20 10:45:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:41.480145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d066641c-6e76-4114-a323-2fc012d75e1e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e8d228fe32dc4537be970b132b4f9d98"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:41.481492 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.481492 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:41.528110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f45407af-3f84-4f1d-8070-183790527c6c tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-319783953", "id": 2051036186, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:41.596796 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f45407af-3f84-4f1d-8070-183790527c6c tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.351565 Jul 20 10:45:41.612737 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 50/82] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:45:41 2022] POST /compute/v2.1/flavors => generated 470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:45:41.627673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5d4e0fe-c353-4485-8445-a4f3cbbdea3e tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:41.629575 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.629575 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:41.658637 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5d4e0fe-c353-4485-8445-a4f3cbbdea3e tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1319015468/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.043581 Jul 20 10:45:41.661146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 51/83] 10.222.0.79 () {58 vars in 1208 bytes} [Wed Jul 20 10:45:41 2022] GET /compute/v2.1/flavors/1319015468/os-flavor-access => generated 21 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:41.672365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13ff6204-c7cb-49b6-a558-b32f05181c82 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:41.673476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13ff6204-c7cb-49b6-a558-b32f05181c82 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:41.845760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13ff6204-c7cb-49b6-a558-b32f05181c82 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:41.862213 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13ff6204-c7cb-49b6-a558-b32f05181c82 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1219 microversion: 2.1 time: 0.199172 Jul 20 10:45:41.864050 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 52/84] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:41 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1219 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:41.885596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61e63265-15a8-4a0d-b154-a93b8f30571f tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:41.892794 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:41.892794 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:42.317984 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61e63265-15a8-4a0d-b154-a93b8f30571f tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/2051036186/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.451493 Jul 20 10:45:42.323317 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 53/85] 10.222.0.79 () {62 vars in 1264 bytes} [Wed Jul 20 10:45:41 2022] POST /compute/v2.1/flavors/2051036186/os-extra_specs => generated 62 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:42.334453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a78d0301-6092-4ffa-bf9d-ab5c9b0ca8cb tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:42.335291 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:42.335291 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:42.359055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a78d0301-6092-4ffa-bf9d-ab5c9b0ca8cb tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1319015468" status: 202 len: 0 microversion: 2.1 time: 0.033538 Jul 20 10:45:42.364203 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 54/86] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:45:42 2022] DELETE /compute/v2.1/flavors/1319015468 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:42.371657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:42.373094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:42.383087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:42.384529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:42.385750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:42.386282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:42.524883 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d066641c-6e76-4114-a323-2fc012d75e1e tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1067276572/action" status: 200 len: 21 microversion: 2.1 time: 1.048239 Jul 20 10:45:42.531447 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 33/87] 10.222.0.79 () {60 vars in 1199 bytes} [Wed Jul 20 10:45:41 2022] POST /compute/v2.1/flavors/1067276572/action => generated 21 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:42.618275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:42.634909 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-000b8ada-c95d-4aad-bc52-655bb40e408f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1296 microversion: 2.1 time: 0.263693 Jul 20 10:45:42.635776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 55/88] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:42 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1296 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:42.649411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19046fc5-17e4-4f8e-be68-220fbec37d26 tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:42.650389 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:42.650389 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:42.727268 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19046fc5-17e4-4f8e-be68-220fbec37d26 tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2051036186" status: 202 len: 0 microversion: 2.86 time: 0.086539 Jul 20 10:45:42.730110 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 56/89] 10.222.0.79 () {60 vars in 1201 bytes} [Wed Jul 20 10:45:42 2022] DELETE /compute/v2.1/flavors/2051036186 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:45:42.751267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-48ca0387-7297-44ea-b8c7-61fd4f9e1117 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:42.804374 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-48ca0387-7297-44ea-b8c7-61fd4f9e1117 tempest-FlavorsAccessTestJSON-1047884439 tempest-FlavorsAccessTestJSON-1047884439-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072824 Jul 20 10:45:42.811870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 57/90] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:42.827052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e47f9a4-4547-462f-b152-d314285b6c45 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:42.872733 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e47f9a4-4547-462f-b152-d314285b6c45 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1067276572" status: 202 len: 0 microversion: 2.1 time: 0.058770 Jul 20 10:45:42.873962 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 58/91] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:45:42 2022] DELETE /compute/v2.1/flavors/1067276572 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:42.883659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69faa0d3-1764-4b57-b070-71c0d4005963 tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:42.952554 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69faa0d3-1764-4b57-b070-71c0d4005963 tempest-FlavorMetadataValidation-1899115519 tempest-FlavorMetadataValidation-1899115519-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.076456 Jul 20 10:45:42.964553 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 59/92] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 10:45:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:45:42.976498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-540b69b4-bb44-4c68-8440-a08f9155dc61 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:43.030958 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-540b69b4-bb44-4c68-8440-a08f9155dc61 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060683 Jul 20 10:45:43.032626 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 60/93] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:43.038034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:43.039231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:43.052905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.053841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.055656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.056551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.131084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3014927e-a80a-4aa8-b668-65034a326739 tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:43.136220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3014927e-a80a-4aa8-b668-65034a326739 tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.136626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3014927e-a80a-4aa8-b668-65034a326739 tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.141358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3014927e-a80a-4aa8-b668-65034a326739 tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.144386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3014927e-a80a-4aa8-b668-65034a326739 tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.204710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:43.221492 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1f39bdb-7cc8-4134-b508-78814a010604 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1223 microversion: 2.1 time: 0.187392 Jul 20 10:45:43.225079 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 61/94] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:43 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:43.230488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6a61511a-9cda-4c51-9cab-21eef1e389bf tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-239248930", "id": 595774975, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:43.280146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3014927e-a80a-4aa8-b668-65034a326739 tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.741030 Jul 20 10:45:43.284663 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 34/95] 10.222.0.79 () {58 vars in 1163 bytes} [Wed Jul 20 10:45:42 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:43.300437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56c088be-94b7-4337-9c2c-7d5e6c41079e tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:43.301400 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:43.301400 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:43.302827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56c088be-94b7-4337-9c2c-7d5e6c41079e tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.303891 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:43.303891 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:43.305934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56c088be-94b7-4337-9c2c-7d5e6c41079e tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.307270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56c088be-94b7-4337-9c2c-7d5e6c41079e tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.307959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56c088be-94b7-4337-9c2c-7d5e6c41079e tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.348184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6a61511a-9cda-4c51-9cab-21eef1e389bf tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.119753 Jul 20 10:45:43.350980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 62/96] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:43.375319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-11773cc7-5366-4fac-8d50-c71d448e2492 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3f1c8fe929e140b2945251a1f200475e"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:43.380806 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:43.380806 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:43.396491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56c088be-94b7-4337-9c2c-7d5e6c41079e tempest-AZAdminV2TestJSON-1234661636 tempest-AZAdminV2TestJSON-1234661636-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 704 microversion: 2.1 time: 0.100975 Jul 20 10:45:43.397346 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 35/97] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 10:45:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 704 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:43.678378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:43.686836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:43.735421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.737179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:43.738495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:43.739131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:44.350885 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-11773cc7-5366-4fac-8d50-c71d448e2492 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] HTTP exception thrown: Flavor access not found for 22 / 3f1c8fe929e140b2945251a1f200475e combination. Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-11773cc7-5366-4fac-8d50-c71d448e2492 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Request method failure captured: Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/flavors/595774975/action HTTP/1.1 Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 70 Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zLmf5XCn7mkU71nPr4AXvIra4V-7cJ-Ms4TnESyrou9XklsEb8P2eZJk_CTNWOWkZ9UYM2FKi7x_hz_GnQrzUwrYsnkm_C86juo0Ra6F4BN4wl1zWeAkSmA7SC6UuHTYMVD5kO9h-DcvfucnjkGFTqoh2YrtvFoWGEngJFtHJIrRQ Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ec5886a441f64f2a87bf6eb8cbd2d3f9 Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:45:44.372311 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ec5886a441f64f2a87bf6eb8cbd2d3f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ec5886a441f64f2a87bf6eb8cbd2d3f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ec5886a441f64f2a87bf6eb8cbd2d3f9 Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758 Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: dbe91ab39c9b4a75bcab3821ade257c0 Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: {"removeTenantAccess": {"tenant": "3f1c8fe929e140b2945251a1f200475e"}} Jul 20 10:45:44.373597 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: exception: Flavor access not found for 22 / 3f1c8fe929e140b2945251a1f200475e combination. Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '595774975', 'body': {'removeTenantAccess': {'tenant': '3f1c8fe929e140b2945251a1f200475e'}}} Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 20 10:45:44.374234 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 3f1c8fe929e140b2945251a1f200475e combination. Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 3f1c8fe929e140b2945251a1f200475e combination. Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:44.375843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 3f1c8fe929e140b2945251a1f200475e combination. Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:44.378182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-11773cc7-5366-4fac-8d50-c71d448e2492 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Returning 404 to user: Flavor access not found for 22 / 3f1c8fe929e140b2945251a1f200475e combination. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:44.379727 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-11773cc7-5366-4fac-8d50-c71d448e2492 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/595774975/action" status: 404 len: 124 microversion: 2.1 time: 1.020904 Jul 20 10:45:44.383903 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 63/98] 10.222.0.79 () {60 vars in 1196 bytes} [Wed Jul 20 10:45:43 2022] POST /compute/v2.1/flavors/595774975/action => generated 124 bytes in 1027 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:44.408943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:44.409841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:44.437902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:44.438680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:44.448018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:44.449495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:44.665498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:44.675729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bbf6c496-884e-4e6d-b69f-43dd10113092 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1279 microversion: 2.1 time: 0.288687 Jul 20 10:45:44.675729 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 64/99] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:44 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:44.690919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a15762e5-78b8-4f6e-9961-ca3424782dda tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:44.692127 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:44.692127 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:44.732767 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a15762e5-78b8-4f6e-9961-ca3424782dda tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/595774975" status: 202 len: 0 microversion: 2.1 time: 0.045414 Jul 20 10:45:44.736739 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 65/100] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:45:44 2022] DELETE /compute/v2.1/flavors/595774975 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:44.745298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c7849df4-1214-422e-9880-70dead5be1e8 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:44.790320 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c7849df4-1214-422e-9880-70dead5be1e8 tempest-FlavorsAccessNegativeTestJSON-1195364758 tempest-FlavorsAccessNegativeTestJSON-1195364758-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050267 Jul 20 10:45:44.803399 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 66/101] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:44.858085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:44.890519 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-997725c6-b6c4-4e60-98aa-487bb46aa5a9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 1.239211 Jul 20 10:45:44.905919 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 36/102] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:43 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:45.692503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:45.694074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:45.704874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:45.706579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:45.707669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:45.710463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:45.918679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:45.922506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:45.956110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:45.957096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:45.961538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:45.963381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:45.965321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:45.977246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ced552e9-20d4-4528-81d0-555340b0d238 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1277 microversion: 2.1 time: 0.288592 Jul 20 10:45:45.980484 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 67/103] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:45 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:47.003776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:47.004585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:47.046279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:47.047631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:47.053508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:47.057154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:47.210534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:47.223588 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78d1a3ff-fb2b-44b7-93b9-3a63e263f2e8 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 1.313583 Jul 20 10:45:47.228656 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 37/104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:45 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:47.341937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:47.354594 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6daa6ff8-6efb-46dc-a1ab-3ea90eb5c688 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1277 microversion: 2.1 time: 0.359331 Jul 20 10:45:47.355784 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 68/105] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:46 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1277 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:45:48.249638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:48.259768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:48.286670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:48.289584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:48.292071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:48.293162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:48.383063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:48.383802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:48.396924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:48.399102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:48.400537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:48.402736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:48.705635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:48.733637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:48.741914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-76f77fb8-7f4c-4b2e-9de9-4b342ab62d97 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1277 microversion: 2.1 time: 0.368306 Jul 20 10:45:48.760962 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 69/106] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:48 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:45:48.913258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:48.922468 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aace089f-0b98-4f12-bf28-f4a2ac31fe4a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.677451 Jul 20 10:45:48.923091 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 38/107] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:48 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:49.760229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:49.761548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:49.773410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:49.775369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:49.776320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:49.776757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:49.921203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:49.932751 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4f767e8-a6bb-484b-bd36-3d10e7f95669 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1277 microversion: 2.1 time: 0.172371 Jul 20 10:45:49.945285 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 39/108] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:49 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:49.954070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:49.956052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:49.972040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:49.972490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:49.973414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:49.973731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:50.001669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-62dcb3c6-9ab8-46bf-a25a-afe1d3e93cf2 req-c5b7a6f0-f547-4c2d-9dae-27fd27f2d294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fec40f4-bb0e-40f1-a1fd-35ea10379155", "tag": "27217952-0251-4114-92ed-2d0430db8ce6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:50.026405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-62dcb3c6-9ab8-46bf-a25a-afe1d3e93cf2 req-c5b7a6f0-f547-4c2d-9dae-27fd27f2d294 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:50.039898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-62dcb3c6-9ab8-46bf-a25a-afe1d3e93cf2 req-c5b7a6f0-f547-4c2d-9dae-27fd27f2d294 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:50.121592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-62dcb3c6-9ab8-46bf-a25a-afe1d3e93cf2 req-c5b7a6f0-f547-4c2d-9dae-27fd27f2d294 service nova] Creating event network-changed:27217952-0251-4114-92ed-2d0430db8ce6 for instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 on n-h2-846219-10 Jul 20 10:45:50.126141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-62dcb3c6-9ab8-46bf-a25a-afe1d3e93cf2 req-c5b7a6f0-f547-4c2d-9dae-27fd27f2d294 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:45:50.144763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:50.149222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:50.155492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:50.157453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:50.211122 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.rpcapi [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 10:45:50.212136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] Releasing lock "compute-rpcapi-router" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:45:50.266129 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-380d98a1-d41d-4a36-a8fa-5a467cc94f97 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586594 Jul 20 10:45:50.266744 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 70/109] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:50.460789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:50.476114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffcec9e9-237e-44d6-b7c0-43d51f60943a tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.527981 Jul 20 10:45:50.480060 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 40/110] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:49 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:50.952706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:50.953696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:50.980601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:50.981344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:50.992456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:50.993077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:51.343404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:51.359290 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9745449-465a-4f82-82f3-d99cb806742b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.410778 Jul 20 10:45:51.373697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 71/111] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:50 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:51.504378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:51.504985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:51.517682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:51.523580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:51.526306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:51.529398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:51.535977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:51.847001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:51.858170 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98f5c4ef-eec3-49eb-802e-9ad756cbe786 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.355492 Jul 20 10:45:51.873031 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 41/112] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:51 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:52.380650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:52.381318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:52.384720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=18 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:52.402744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:52.403266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:52.410274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:52.410731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:52.482723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:52.884984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:52.885613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:52.907098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:52.907599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:52.913562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:52.914046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:52.993842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:53.006624 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4966370c-a4ac-4489-88fd-1bfca5ceb55b tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.630041 Jul 20 10:45:53.009894 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 72/113] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:52 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:53.351363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:53.363469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:53.367962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:53.401099 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-28729b43-b336-40a3-b410-00508668c9e1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.521894 Jul 20 10:45:53.401916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 42/114] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:52 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:54.025898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:54.026505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:54.042897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:54.043372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:54.044887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:54.045278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:54.092138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5b59d2bd-cd73-4aaa-b770-49994fe9ec6c req-fdb967dc-bd2a-4999-8463-b3735ba0a37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce08e02c-a024-4c26-9f5c-c31f77250a04", "tag": "5ae8f5cc-0235-4254-b993-46d5617c9c27"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:54.119441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5b59d2bd-cd73-4aaa-b770-49994fe9ec6c req-fdb967dc-bd2a-4999-8463-b3735ba0a37a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:54.121515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5b59d2bd-cd73-4aaa-b770-49994fe9ec6c req-fdb967dc-bd2a-4999-8463-b3735ba0a37a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:54.210335 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5b59d2bd-cd73-4aaa-b770-49994fe9ec6c req-fdb967dc-bd2a-4999-8463-b3735ba0a37a service nova] Creating event network-changed:5ae8f5cc-0235-4254-b993-46d5617c9c27 for instance ce08e02c-a024-4c26-9f5c-c31f77250a04 on n-h1-846219-10 Jul 20 10:45:54.220764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5b59d2bd-cd73-4aaa-b770-49994fe9ec6c req-fdb967dc-bd2a-4999-8463-b3735ba0a37a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131962 Jul 20 10:45:54.222230 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 43/115] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:54.426309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:54.436162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c196c617-f2bd-47b3-9bc2-c0de6b7dd5e3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.413997 Jul 20 10:45:54.467560 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 73/116] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:54 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:54.480159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:54.483672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:54.505147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:54.505720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:54.506899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:54.510653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:54.698985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:54.708533 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0c9899e-cf96-4fd7-8c5c-fb173affe8b1 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.243631 Jul 20 10:45:54.709865 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 74/117] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:54 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:55.087103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b272819-0a8c-430f-98bf-4565c8d2e5f6 tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] Calling method '.version_select at 0x7f2c4c0a0550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:55.088912 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:55.088912 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:55.137381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b272819-0a8c-430f-98bf-4565c8d2e5f6 tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.773651 Jul 20 10:45:55.141389 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 44/118] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 10:45:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:55.150474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e288226-b886-4186-9010-831cc25f5aaf tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4c5f6310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:55.174656 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:55.174656 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:55.301427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=13,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:55.474032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:55.474873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:55.488703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:55.489648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:55.490764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:55.493148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:55.774429 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e288226-b886-4186-9010-831cc25f5aaf tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.627956 Jul 20 10:45:55.776149 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 75/119] 10.222.0.79 () {60 vars in 1205 bytes} [Wed Jul 20 10:45:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:55.807341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:55.817456 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04bcdec0-58b8-4c50-bc93-d31d8ab69c96 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.347870 Jul 20 10:45:55.824427 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 45/120] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:55 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:55.838282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:55.843656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:55.854266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:55.857989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:55.860729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:55.862829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:56.234749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:56.246481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b3ccaff9-d048-4d43-956b-74d8707eed05 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.417972 Jul 20 10:45:56.256172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51dbd068-d138-4ccb-967b-240ca1b82368 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-514479027", "ram": 512, "vcpus": 1, "disk": 10, "id": 218879629, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:56.258966 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:56.258966 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:56.259558 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 46/121] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:55 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:56.265599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c579d64b-38f1-484b-8219-14c99818dabf tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] Calling method '.version_select at 0x7f2c3fe479d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:56.266737 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:56.266737 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:56.290679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c579d64b-38f1-484b-8219-14c99818dabf tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.029094 Jul 20 10:45:56.299417 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 47/122] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 10:45:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:56.306003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-af1e2f59-2e0c-4ce1-8a1b-3e0785eb5b00 tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3ff23ee0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:56.308695 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:56.308695 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:56.312108 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51dbd068-d138-4ccb-967b-240ca1b82368 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.533633 Jul 20 10:45:56.323319 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 76/123] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:55 2022] POST /compute/v2.1/flavors => generated 412 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:56.330022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-48253a7e-2113-4190-ad5f-2a8ab2894092 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:56.332884 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:56.332884 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:56.393648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-48253a7e-2113-4190-ad5f-2a8ab2894092 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065379 Jul 20 10:45:56.400556 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 77/124] 10.222.0.79 () {60 vars in 1220 bytes} [Wed Jul 20 10:45:56 2022] POST /compute/v2.1/flavors/218879629/os-extra_specs => generated 66 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:56.614596 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-af1e2f59-2e0c-4ce1-8a1b-3e0785eb5b00 tempest-QuotaClassesAdminTestJSON-1083894362 tempest-QuotaClassesAdminTestJSON-1083894362-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.313495 Jul 20 10:45:56.615594 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 48/125] 10.222.0.79 () {60 vars in 1205 bytes} [Wed Jul 20 10:45:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:56.839093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:56.842725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:56.854081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:56.855934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:56.857972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:56.859668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:57.065361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf645da4-6ec3-44b4-81fa-8fea17f22222 tempest-FlavorsExtraSpecsTestJSON-475688505 tempest-FlavorsExtraSpecsTestJSON-475688505-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.088017 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf645da4-6ec3-44b4-81fa-8fea17f22222 tempest-FlavorsExtraSpecsTestJSON-475688505 tempest-FlavorsExtraSpecsTestJSON-475688505-project] 10.222.0.79 "GET /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.686140 Jul 20 10:45:57.088885 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 78/126] 10.222.0.79 () {58 vars in 1199 bytes} [Wed Jul 20 10:45:56 2022] GET /compute/v2.1/flavors/218879629/os-extra_specs => generated 66 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.104134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-377a9c7a-399f-49bb-b47f-9cfbe74ba999 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:57.166617 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-377a9c7a-399f-49bb-b47f-9cfbe74ba999 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.066986 Jul 20 10:45:57.178338 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 79/127] 10.222.0.79 () {60 vars in 1220 bytes} [Wed Jul 20 10:45:57 2022] POST /compute/v2.1/flavors/218879629/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.192921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03e75a1f-aa47-4fe6-8eb6-8231a65ccf14 tempest-FlavorsExtraSpecsTestJSON-475688505 tempest-FlavorsExtraSpecsTestJSON-475688505-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.212391 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03e75a1f-aa47-4fe6-8eb6-8231a65ccf14 tempest-FlavorsExtraSpecsTestJSON-475688505 tempest-FlavorsExtraSpecsTestJSON-475688505-project] 10.222.0.79 "GET /compute/v2.1/flavors/218879629/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.032696 Jul 20 10:45:57.213202 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 80/128] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:45:57 2022] GET /compute/v2.1/flavors/218879629/os-extra_specs/hw:numa_nodes => generated 22 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.224694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59c40bc6-2d58-4c62-8e9e-b0b00a50d989 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:57.268512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59c40bc6-2d58-4c62-8e9e-b0b00a50d989 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048202 Jul 20 10:45:57.269573 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 81/129] 10.222.0.79 () {60 vars in 1220 bytes} [Wed Jul 20 10:45:57 2022] POST /compute/v2.1/flavors/218879629/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 10:45:57.288590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.289893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:57.306936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:57.307712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:57.310281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:57.312602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:57.335832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:57.350168 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0fbddc0b-8d9d-4b24-b654-df383fb38072 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.515722 Jul 20 10:45:57.363011 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 49/130] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:56 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:57.377745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6aa1097d-ddd0-42a9-91c3-bc77eeb3681d tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.397578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=12 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:57.428542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6aa1097d-ddd0-42a9-91c3-bc77eeb3681d tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064276 Jul 20 10:45:57.431921 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 50/131] 10.222.0.79 () {58 vars in 1199 bytes} [Wed Jul 20 10:45:57 2022] GET /compute/v2.1/flavors/218879629/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.454174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b73f37c-b7c6-4658-8dd9-c5b569d06132 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:57.457881 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:57.457881 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:57.552342 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b73f37c-b7c6-4658-8dd9-c5b569d06132 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/218879629/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.113081 Jul 20 10:45:57.554111 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 51/132] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:45:57 2022] PUT /compute/v2.1/flavors/218879629/os-extra_specs/hw:numa_nodes => generated 22 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.564032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ada6c225-8be8-41c2-b72e-7b01fa237bd3 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.592131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ada6c225-8be8-41c2-b72e-7b01fa237bd3 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031628 Jul 20 10:45:57.593408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 52/133] 10.222.0.79 () {58 vars in 1199 bytes} [Wed Jul 20 10:45:57 2022] GET /compute/v2.1/flavors/218879629/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.605470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f3d40bb-7899-428d-a839-edc3a7cafd93 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.608075 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:57.608075 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:57.661356 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f3d40bb-7899-428d-a839-edc3a7cafd93 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/218879629/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.062955 Jul 20 10:45:57.666361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:57.677861 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 53/134] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 10:45:57 2022] DELETE /compute/v2.1/flavors/218879629/os-extra_specs/hw:numa_nodes => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:45:57.678887 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-689b94f4-d6bb-4499-8a87-300c45235dd0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.408016 Jul 20 10:45:57.684081 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 82/135] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:57 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:57.694450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c40633f-217d-4b5f-b70f-a358da53d182 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.731049 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c40633f-217d-4b5f-b70f-a358da53d182 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/218879629/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.040816 Jul 20 10:45:57.732770 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 54/136] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 10:45:57 2022] DELETE /compute/v2.1/flavors/218879629/os-extra_specs/hw:cpu_policy => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:45:57.740116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-76df00a5-4cc6-4554-8a71-1314d2d7428e tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.761244 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-76df00a5-4cc6-4554-8a71-1314d2d7428e tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/218879629/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021929 Jul 20 10:45:57.765828 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 83/137] 10.222.0.79 () {58 vars in 1199 bytes} [Wed Jul 20 10:45:57 2022] GET /compute/v2.1/flavors/218879629/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:45:57.781667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf2bb1a6-cbba-414f-b473-b473237961da tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.785301 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:57.785301 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:57.808038 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf2bb1a6-cbba-414f-b473-b473237961da tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/218879629" status: 202 len: 0 microversion: 2.1 time: 0.034872 Jul 20 10:45:57.817132 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 55/138] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:45:57 2022] DELETE /compute/v2.1/flavors/218879629 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:57.824409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dcf29f8-b72b-45ea-a2c7-c60d1bf67876 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:57.877232 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4dcf29f8-b72b-45ea-a2c7-c60d1bf67876 tempest-FlavorsExtraSpecsTestJSON-30524029 tempest-FlavorsExtraSpecsTestJSON-30524029-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056620 Jul 20 10:45:57.879002 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 84/139] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:58.396647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:58.399397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:58.419777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=10,nova_api:INSERT=13,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:45:58.434086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:58.437064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:58.440567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:58.442418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:58.643027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96bdf977-2ec5-42f6-8321-98f2e400f681 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1293890712", "id": 168689030, "os-flavor-access:is_public": "True"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:58.646767 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:58.646767 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:58.718908 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96bdf977-2ec5-42f6-8321-98f2e400f681 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.652102 Jul 20 10:45:58.721837 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 56/140] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:58 2022] POST /compute/v2.1/flavors => generated 427 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:58.723670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:58.736290 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-46cfc5bf-3800-4492-bac0-21f075d674a9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.364645 Jul 20 10:45:58.737264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:58.738039 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 85/141] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:58 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:45:58.744579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0ebd20d-cdb6-4957-9671-c32af18ad118 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:58.746125 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:58.746125 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:58.747472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:45:58.772038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:58.772494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:58.773272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:58.773759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:58.777751 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0ebd20d-cdb6-4957-9671-c32af18ad118 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/168689030" status: 202 len: 0 microversion: 2.1 time: 0.036967 Jul 20 10:45:58.779608 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 86/142] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:45:58 2022] DELETE /compute/v2.1/flavors/168689030 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:58.795081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa345588-6d42-4289-8e9c-24e6c51806f8 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:58.820407 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa345588-6d42-4289-8e9c-24e6c51806f8 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028665 Jul 20 10:45:58.824035 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 87/143] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:45:58.842711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e98c5f86-69c8-4ce5-8617-281416b10b03 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1918007494", "id": 9700307, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:58.844162 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:58.844162 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:58.882124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e98c5f86-69c8-4ce5-8617-281416b10b03 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.044029 Jul 20 10:45:58.884088 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 88/144] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:58.998445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:59.009072 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2f2d915-38de-417e-86b2-30a6e6f3401b tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.281765 Jul 20 10:45:59.010460 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 57/145] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:45:58 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:59.026956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e091079-6a37-46fb-9168-a02adb76a23e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.061291 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e091079-6a37-46fb-9168-a02adb76a23e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5389 microversion: 2.1 time: 0.038802 Jul 20 10:45:59.062647 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 58/146] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/detail => generated 5389 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:59.081344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ca8fbd4f-88e3-4c13-ba2c-d521dc8da12e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.083493 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:59.083493 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:59.109850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ca8fbd4f-88e3-4c13-ba2c-d521dc8da12e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/9700307" status: 202 len: 0 microversion: 2.1 time: 0.032242 Jul 20 10:45:59.116685 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 59/147] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:45:59 2022] DELETE /compute/v2.1/flavors/9700307 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:59.123109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00d2076e-55f8-4376-8790-1e856ab273bb tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.148322 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-00d2076e-55f8-4376-8790-1e856ab273bb tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029256 Jul 20 10:45:59.160311 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 60/148] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:59.172801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-742d9bd8-ecdd-4da7-974a-ac4810899a43 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-558908711", "id": 634936097, "os-flavor-access:is_public": "True"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:59.174508 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:59.174508 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:59.204889 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-742d9bd8-ecdd-4da7-974a-ac4810899a43 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.042054 Jul 20 10:45:59.206440 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 61/149] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:59 2022] POST /compute/v2.1/flavors => generated 425 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:59.222846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-70a8c21b-2914-4997-9f7a-fa098fcc6e9e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.246925 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-70a8c21b-2914-4997-9f7a-fa098fcc6e9e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/634936097" status: 202 len: 0 microversion: 2.1 time: 0.030577 Jul 20 10:45:59.247913 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 62/150] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:45:59 2022] DELETE /compute/v2.1/flavors/634936097 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:59.256862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f9cb6d8-b8e4-47bf-95f2-56069e3c07cb tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.277743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0f9cb6d8-b8e4-47bf-95f2-56069e3c07cb tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024854 Jul 20 10:45:59.281355 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 63/151] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:45:59.298545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-333230d5-261e-45f9-b7fd-70ff8e1bb4ca tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-668145732", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:59.349923 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-333230d5-261e-45f9-b7fd-70ff8e1bb4ca tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.053477 Jul 20 10:45:59.352531 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 64/152] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:59 2022] POST /compute/v2.1/flavors => generated 506 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:59.368637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fbc5d618-b573-4acc-ac56-abd6168cb7f6 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.393500 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fbc5d618-b573-4acc-ac56-abd6168cb7f6 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/82ce8ac8-d0be-4328-b434-7562d05e0256" status: 202 len: 0 microversion: 2.1 time: 0.031686 Jul 20 10:45:59.397666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c227b6f4-dd97-4dde-807a-b2d542ab562c tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Calling method '.version_select at 0x7f2c4c74dee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.398426 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 65/153] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:45:59 2022] DELETE /compute/v2.1/flavors/82ce8ac8-d0be-4328-b434-7562d05e0256 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:59.399518 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:59.399518 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:59.401078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c227b6f4-dd97-4dde-807a-b2d542ab562c tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f278e111c0e449a690a19b75e1d37ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1d607e8448489881af12b74dfde34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:59.404716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-627f3dc7-6a84-4d84-a4b9-a2a1c40e45b1 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c227b6f4-dd97-4dde-807a-b2d542ab562c tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Request method failure captured: Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zjT1KE96afEZ_pg9Z39v2mO6lGQAuSMzVT4efa_eceTJJOz53sXxxhuULz9IYQy1JAgTtVpRtKFOZJFX14OOUJLEnwJefjcE7aW5m7Vi_-t9mHOvNu0bV3_TBPDiBgwyQuTXEbqkhQskeED2VeA1v78AG9bDp6um7HfTvBVWD71w0 Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:59.405959 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2c1d607e8448489881af12b74dfde34f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f278e111c0e449a690a19b75e1d37ff6 Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 10:45:59.407253 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:59.408052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 20 10:45:59.409177 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.411926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c227b6f4-dd97-4dde-807a-b2d542ab562c tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:59.413156 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c227b6f4-dd97-4dde-807a-b2d542ab562c tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.527969 Jul 20 10:45:59.418811 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 89/154] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 10:45:58 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 531 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:59.424566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b873252d-c820-4d73-9225-2b0f4710bb02 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Calling method '.version_select at 0x7f2c4c5c7f70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.425877 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:59.425877 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:59.427472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b873252d-c820-4d73-9225-2b0f4710bb02 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f278e111c0e449a690a19b75e1d37ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1d607e8448489881af12b74dfde34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b873252d-c820-4d73-9225-2b0f4710bb02 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Request method failure captured: Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zjT1KE96afEZ_pg9Z39v2mO6lGQAuSMzVT4efa_eceTJJOz53sXxxhuULz9IYQy1JAgTtVpRtKFOZJFX14OOUJLEnwJefjcE7aW5m7Vi_-t9mHOvNu0bV3_TBPDiBgwyQuTXEbqkhQskeED2VeA1v78AG9bDp6um7HfTvBVWD71w0 Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:59.429501 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2c1d607e8448489881af12b74dfde34f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f278e111c0e449a690a19b75e1d37ff6 Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 10:45:59.430699 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:59.431454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 20 10:45:59.432467 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.434893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b873252d-c820-4d73-9225-2b0f4710bb02 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:59.436339 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b873252d-c820-4d73-9225-2b0f4710bb02 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015931 Jul 20 10:45:59.441499 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 90/155] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:59.448339 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-627f3dc7-6a84-4d84-a4b9-a2a1c40e45b1 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048695 Jul 20 10:45:59.449527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ec8541b-5904-4613-b320-e466a2bb2f57 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Calling method '.version_select at 0x7f2c4c711b80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.451516 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:59.451516 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:45:59.452746 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 66/156] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:59.453526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ec8541b-5904-4613-b320-e466a2bb2f57 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f278e111c0e449a690a19b75e1d37ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1d607e8448489881af12b74dfde34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ec8541b-5904-4613-b320-e466a2bb2f57 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Request method failure captured: Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zjT1KE96afEZ_pg9Z39v2mO6lGQAuSMzVT4efa_eceTJJOz53sXxxhuULz9IYQy1JAgTtVpRtKFOZJFX14OOUJLEnwJefjcE7aW5m7Vi_-t9mHOvNu0bV3_TBPDiBgwyQuTXEbqkhQskeED2VeA1v78AG9bDp6um7HfTvBVWD71w0 Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:45:59.455608 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2c1d607e8448489881af12b74dfde34f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f278e111c0e449a690a19b75e1d37ff6 Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 10:45:59.456812 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:45:59.457542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 20 10:45:59.458594 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:45:59.460232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ec8541b-5904-4613-b320-e466a2bb2f57 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:45:59.467129 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ec8541b-5904-4613-b320-e466a2bb2f57 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.015834 Jul 20 10:45:59.467129 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 91/157] 10.222.0.79 () {58 vars in 1178 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:45:59.483669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69621d5b-6efa-4e58-89b8-98cbf35fe6b1 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-514489093", "id": "a63c0099-3022-49db-8d9e-49e3c7b96195", "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:59.521474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69621d5b-6efa-4e58-89b8-98cbf35fe6b1 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.051574 Jul 20 10:45:59.522976 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 92/158] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:59 2022] POST /compute/v2.1/flavors => generated 506 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:45:59.534885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d5c1af3-4f86-47ae-972d-ffe4fecd7735 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.567788 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d5c1af3-4f86-47ae-972d-ffe4fecd7735 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/a63c0099-3022-49db-8d9e-49e3c7b96195" status: 202 len: 0 microversion: 2.1 time: 0.035380 Jul 20 10:45:59.568440 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 93/159] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:45:59 2022] DELETE /compute/v2.1/flavors/a63c0099-3022-49db-8d9e-49e3c7b96195 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:45:59.579429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de030b7f-2827-4b04-967d-7f4e0fcb0a61 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.605184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de030b7f-2827-4b04-967d-7f4e0fcb0a61 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030154 Jul 20 10:45:59.606113 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 94/160] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:45:59.627407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b39a715d-d201-488f-a83a-c62eacac73bc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-127086091", "id": 2133811316, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:45:59.650574 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b39a715d-d201-488f-a83a-c62eacac73bc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.029881 Jul 20 10:45:59.651875 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 95/161] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:45:59 2022] POST /compute/v2.1/flavors => generated 413 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:59.662034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89caf2bd-1c8c-4173-ae91-d6de7d84e0c6 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.670663 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89caf2bd-1c8c-4173-ae91-d6de7d84e0c6 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/2133811316" status: 200 len: 413 microversion: 2.1 time: 0.012127 Jul 20 10:45:59.677225 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 96/162] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/2133811316 => generated 413 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:45:59.956747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Calling method '.version_select at 0x7f2c3fe94a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:45:59.958285 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:45:59.958285 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:45:59.960350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:59.962090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:45:59.982300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:45:59.982977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.000621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.001454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.014895 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c08e0489-1b57-46ef-90be-334fbc6b9fd7 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.543959 Jul 20 10:46:00.016389 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 67/163] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.021462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.022557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:00.031726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.032501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.034124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.034789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.054275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09a0ee88-205e-4b0e-ae93-6d40418c69ef tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.099871 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09a0ee88-205e-4b0e-ae93-6d40418c69ef tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.421111 Jul 20 10:46:00.101362 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 97/164] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:45:59 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:00.108138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f1e46dab-207e-45ec-9e6a-e06dcabcefd7 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Calling method '.version_select at 0x7f2c4c5b7f70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.108940 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.108940 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:00.110041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f1e46dab-207e-45ec-9e6a-e06dcabcefd7 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f278e111c0e449a690a19b75e1d37ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1d607e8448489881af12b74dfde34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f1e46dab-207e-45ec-9e6a-e06dcabcefd7 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Request method failure captured: Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zjT1KE96afEZ_pg9Z39v2mO6lGQAuSMzVT4efa_eceTJJOz53sXxxhuULz9IYQy1JAgTtVpRtKFOZJFX14OOUJLEnwJefjcE7aW5m7Vi_-t9mHOvNu0bV3_TBPDiBgwyQuTXEbqkhQskeED2VeA1v78AG9bDp6um7HfTvBVWD71w0 Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:00.112838 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2c1d607e8448489881af12b74dfde34f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f278e111c0e449a690a19b75e1d37ff6 Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1'} Jul 20 10:46:00.114285 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:00.115138 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 20 10:46:00.116521 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.117395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f1e46dab-207e-45ec-9e6a-e06dcabcefd7 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:00.117395 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f1e46dab-207e-45ec-9e6a-e06dcabcefd7 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011905 Jul 20 10:46:00.117395 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 98/165] 10.222.0.79 () {58 vars in 1172 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:00.123200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.124920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:00.134384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.135346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.136303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.137088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.197545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:00.203450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:00.213422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-984c27d1-58a6-44ee-ac40-d28ea251bc72 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.195837 Jul 20 10:46:00.214331 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 68/166] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:00.226118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fc4f54d-396f-455e-afea-ebeae2bf4cfc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.226871 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.226871 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:00.245609 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fc4f54d-396f-455e-afea-ebeae2bf4cfc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2133811316" status: 202 len: 0 microversion: 2.1 time: 0.030303 Jul 20 10:46:00.248109 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 69/167] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:46:00 2022] DELETE /compute/v2.1/flavors/2133811316 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:00.255078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5471b3f-621d-4323-9361-488c7b0703a4 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Calling method '.version_select at 0x7f2c4c17fdc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.256160 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.256160 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:00.257347 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c5471b3f-621d-4323-9361-488c7b0703a4 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] HTTP exception thrown: Hypervisor with ID 'f1bead15-3ecf-4bda-b5ba-19a345147f09' could not be found. Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5471b3f-621d-4323-9361-488c7b0703a4 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Request method failure captured: Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hypervisors/f1bead15-3ecf-4bda-b5ba-19a345147f09/uptime HTTP/1.1 Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zmcqtxoME9I94qVcAw0B16wxs_QR_o9UhIg3u5eM_4xXDXNGmraTt5G0ZqjEnZXS0Y4PDBj41fCD5TS3bCvqYmug5oBC9y42LWFaAxJL-zIX_bhi70g8rzcXZYR-kfNBd_MvwmdoUGikSKv3d198s0FjsmYgAw2EijkpZjaqf9ShM Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 840bc134980442d5ad15b89d3fcb9ff3 Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-693108748 Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:00.275268 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_840bc134980442d5ad15b89d3fcb9ff3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/840bc134980442d5ad15b89d3fcb9ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/840bc134980442d5ad15b89d3fcb9ff3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/840bc134980442d5ad15b89d3fcb9ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-693108748 Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 840bc134980442d5ad15b89d3fcb9ff3 Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-693108748 Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: b2ef42df43ea4bcea4731e0e5dae1bb2 Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: exception: Hypervisor with ID 'f1bead15-3ecf-4bda-b5ba-19a345147f09' could not be found. Jul 20 10:46:00.276457 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f1bead15-3ecf-4bda-b5ba-19a345147f09'} Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f1bead15-3ecf-4bda-b5ba-19a345147f09' Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 10:46:00.277121 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f1bead15-3ecf-4bda-b5ba-19a345147f09' could not be found. Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.278493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f1bead15-3ecf-4bda-b5ba-19a345147f09' could not be found. Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5471b3f-621d-4323-9361-488c7b0703a4 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Returning 404 to user: Hypervisor with ID 'f1bead15-3ecf-4bda-b5ba-19a345147f09' could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5471b3f-621d-4323-9361-488c7b0703a4 tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/f1bead15-3ecf-4bda-b5ba-19a345147f09/uptime" status: 404 len: 123 microversion: 2.1 time: 0.027030 Jul 20 10:46:00.281602 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 70/168] 10.222.0.79 () {58 vars in 1277 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/os-hypervisors/f1bead15-3ecf-4bda-b5ba-19a345147f09/uptime => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:00.335834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:00.345121 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-526fd618-3d6c-49f2-bc53-60b645fd5937 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.227935 Jul 20 10:46:00.355728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 99/169] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:00.363185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-98ce3c3d-7f82-443c-b2f6-fb9df74a57cc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.389753 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-98ce3c3d-7f82-443c-b2f6-fb9df74a57cc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031702 Jul 20 10:46:00.390938 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 100/170] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:00.409437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Calling method '.version_select at 0x7f2c4c5f6d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.413099 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.413099 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:00.417776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.417776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.436782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.437374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.449010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:00.449651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:00.466183 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e2c3b95-b1ce-4b39-9cb9-c01278ee260a tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.073170 Jul 20 10:46:00.467330 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 101/171] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.472302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c11cecce-90f8-40bb-ae49-0404a8a8ae16 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1863460868", "id": 1002041971, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:00.473883 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.473883 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:00.493020 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c11cecce-90f8-40bb-ae49-0404a8a8ae16 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.023878 Jul 20 10:46:00.494193 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 102/172] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:00 2022] POST /compute/v2.1/flavors => generated 430 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.500033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63c54f4e-7157-49eb-8ac9-95de41dd0bc5 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Calling method '.version_select at 0x7f2c4c5b79d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.501095 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.501095 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:00.505028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-63c54f4e-7157-49eb-8ac9-95de41dd0bc5 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f278e111c0e449a690a19b75e1d37ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c1d607e8448489881af12b74dfde34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63c54f4e-7157-49eb-8ac9-95de41dd0bc5 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Request method failure captured: Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zjT1KE96afEZ_pg9Z39v2mO6lGQAuSMzVT4efa_eceTJJOz53sXxxhuULz9IYQy1JAgTtVpRtKFOZJFX14OOUJLEnwJefjcE7aW5m7Vi_-t9mHOvNu0bV3_TBPDiBgwyQuTXEbqkhQskeED2VeA1v78AG9bDp6um7HfTvBVWD71w0 Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:00.507145 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2c1d607e8448489881af12b74dfde34f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2c1d607e8448489881af12b74dfde34f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 2c1d607e8448489881af12b74dfde34f Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019 Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f278e111c0e449a690a19b75e1d37ff6 Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1623191019-project Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1'} Jul 20 10:46:00.508360 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:00.509065 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 20 10:46:00.510160 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.513456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63c54f4e-7157-49eb-8ac9-95de41dd0bc5 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:00.516285 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-63c54f4e-7157-49eb-8ac9-95de41dd0bc5 tempest-HypervisorAdminNegativeTestJSON-1623191019 tempest-HypervisorAdminNegativeTestJSON-1623191019-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.019113 Jul 20 10:46:00.518343 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 103/173] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:00.526887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-086b542f-13c4-4c51-a05f-07d76435f48d tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "1002041971"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:00.539728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-086b542f-13c4-4c51-a05f-07d76435f48d tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] HTTP exception thrown: Flavor 1002041971 could not be found. Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-086b542f-13c4-4c51-a05f-07d76435f48d tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] Request method failure captured: Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 107 Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zisEerwCTyln54mkA-XqyEsHTUSiaqHnEpRsk1TlZEq6PzpMiSvsKb0Gx0qCKuDdxzX3PrjP-Ox6alWYrF9pQOsocuHPysyszJ6yBD3PIuFUzUOOO-1bMVHZ8EuL7-2CwWVo_6st1OcDbwKiIFwrW9BEfpKGvX2uUcSxH_qn_ThbU Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 1f40c76a96874feb8f0ca65a3dcba52a Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsAdminTestJSON-2060242085 Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:00.542821 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1f40c76a96874feb8f0ca65a3dcba52a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1f40c76a96874feb8f0ca65a3dcba52a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1f40c76a96874feb8f0ca65a3dcba52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1f40c76a96874feb8f0ca65a3dcba52a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsAdminTestJSON-2060242085 Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 1f40c76a96874feb8f0ca65a3dcba52a Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2060242085 Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsAdminTestJSON-2060242085-project Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 1fd0fdf653124dd7b7132f0a6ba8a053 Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsAdminTestJSON-2060242085-project Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "test", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "1002041971"}} Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:00.544346 n-d-846219-10 devstack@n-api.service[125885]: exception: Flavor 1002041971 could not be found. Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '1002041971'}}} Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1002041971 could not be found. Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.545242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1002041971 could not be found. Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.546316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.549052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.549052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:00.549052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:00.549052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1002041971 could not be found. Jul 20 10:46:00.549052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.551653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-086b542f-13c4-4c51-a05f-07d76435f48d tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] Returning 400 to user: Flavor 1002041971 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:00.553548 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-086b542f-13c4-4c51-a05f-07d76435f48d tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.033983 Jul 20 10:46:00.555227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 104/174] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:00 2022] POST /compute/v2.1/servers => generated 81 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:46:00.563362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43980256-4925-4d1f-a061-38b20e08226b tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Calling method '.version_select at 0x7f2c4cc62670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.566075 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-43980256-4925-4d1f-a061-38b20e08226b tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] HTTP exception thrown: Hypervisor with ID 'fe390df8-ba78-4c0a-88d0-592bfbf187ab' could not be found. Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43980256-4925-4d1f-a061-38b20e08226b tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Request method failure captured: Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/fe390df8-ba78-4c0a-88d0-592bfbf187ab HTTP/1.1 Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zmcqtxoME9I94qVcAw0B16wxs_QR_o9UhIg3u5eM_4xXDXNGmraTt5G0ZqjEnZXS0Y4PDBj41fCD5TS3bCvqYmug5oBC9y42LWFaAxJL-zIX_bhi70g8rzcXZYR-kfNBd_MvwmdoUGikSKv3d198s0FjsmYgAw2EijkpZjaqf9ShM Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 840bc134980442d5ad15b89d3fcb9ff3 Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-693108748 Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:00.570548 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_840bc134980442d5ad15b89d3fcb9ff3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/840bc134980442d5ad15b89d3fcb9ff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/840bc134980442d5ad15b89d3fcb9ff3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/840bc134980442d5ad15b89d3fcb9ff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-693108748 Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 840bc134980442d5ad15b89d3fcb9ff3 Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-693108748 Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b2ef42df43ea4bcea4731e0e5dae1bb2 Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: exception: Hypervisor with ID 'fe390df8-ba78-4c0a-88d0-592bfbf187ab' could not be found. Jul 20 10:46:00.571890 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fe390df8-ba78-4c0a-88d0-592bfbf187ab'} Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fe390df8-ba78-4c0a-88d0-592bfbf187ab' Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 20 10:46:00.572533 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:46:00.573623 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fe390df8-ba78-4c0a-88d0-592bfbf187ab' could not be found. Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fe390df8-ba78-4c0a-88d0-592bfbf187ab' could not be found. Jul 20 10:46:00.574792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:00.579695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43980256-4925-4d1f-a061-38b20e08226b tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] Returning 404 to user: Hypervisor with ID 'fe390df8-ba78-4c0a-88d0-592bfbf187ab' could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:00.580903 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43980256-4925-4d1f-a061-38b20e08226b tempest-HypervisorAdminNegativeTestJSON-693108748 tempest-HypervisorAdminNegativeTestJSON-693108748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/fe390df8-ba78-4c0a-88d0-592bfbf187ab" status: 404 len: 123 microversion: 2.1 time: 0.023982 Jul 20 10:46:00.582607 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 105/175] 10.222.0.79 () {58 vars in 1256 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/os-hypervisors/fe390df8-ba78-4c0a-88d0-592bfbf187ab => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:00.590578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-304523c2-2017-4e81-ba81-6a47a9d47f6e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.592703 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.592703 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:00.624101 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-304523c2-2017-4e81-ba81-6a47a9d47f6e tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1002041971" status: 202 len: 0 microversion: 2.1 time: 0.039886 Jul 20 10:46:00.626018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 106/176] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:46:00 2022] DELETE /compute/v2.1/flavors/1002041971 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:00.635851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09beea7d-9210-4d97-9426-4d4d61293d93 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.663632 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09beea7d-9210-4d97-9426-4d4d61293d93 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032321 Jul 20 10:46:00.664370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 107/177] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:00.683950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-448948f4-d56f-4eb5-bc53-ce5f73bce79c tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-255371356", "id": 827644389, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:00.714296 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-448948f4-d56f-4eb5-bc53-ce5f73bce79c tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.034237 Jul 20 10:46:00.715446 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 108/178] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:00 2022] POST /compute/v2.1/flavors => generated 411 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:00.726188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bbc2d99c-0fd5-420c-92e0-cf563618655f tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-354858735", "id": 395254219, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:00.749371 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bbc2d99c-0fd5-420c-92e0-cf563618655f tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.026914 Jul 20 10:46:00.751989 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 109/179] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:00 2022] POST /compute/v2.1/flavors => generated 410 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:00.765087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7865a25d-3572-4235-a749-278e8579d0dc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.785894 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7865a25d-3572-4235-a749-278e8579d0dc tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.026660 Jul 20 10:46:00.787567 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 110/180] 10.222.0.79 () {58 vars in 1168 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.802559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b423784d-e51d-4e69-8d22-e11deb0ce327 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.822889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b8d5a71-d339-4da8-8a7b-65076286bf3e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-674171997", "ram": 512, "vcpus": 1, "disk": 10, "id": 1282374537, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:00.823456 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b423784d-e51d-4e69-8d22-e11deb0ce327 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.024883 Jul 20 10:46:00.824936 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 111/181] 10.222.0.79 () {58 vars in 1176 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.836508 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:00.836508 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:00.845724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce11830e-9570-42b6-945a-15d5e52b93f3 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.868670 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce11830e-9570-42b6-945a-15d5e52b93f3 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.025800 Jul 20 10:46:00.868670 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 112/182] 10.222.0.79 () {58 vars in 1170 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.881305 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b8d5a71-d339-4da8-8a7b-65076286bf3e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.602809 Jul 20 10:46:00.882388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e342c9a6-feb5-415e-ba3c-baaa2917bf3b tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.884523 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 71/183] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:00.905484 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e342c9a6-feb5-415e-ba3c-baaa2917bf3b tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.034766 Jul 20 10:46:00.906082 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 113/184] 10.222.0.79 () {58 vars in 1168 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:00.918952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a71d03ce-7fcb-4d3a-8c15-fa0cf9f19766 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.939268 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a71d03ce-7fcb-4d3a-8c15-fa0cf9f19766 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5796 microversion: 2.1 time: 0.023669 Jul 20 10:46:00.947616 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 114/185] 10.222.0.79 () {58 vars in 1168 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5796 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:00.955485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a8df4a5-1ce6-4ada-8127-1c609a179b28 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:00.977249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3a8df4a5-1ce6-4ada-8127-1c609a179b28 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5796 microversion: 2.1 time: 0.025551 Jul 20 10:46:00.977948 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 115/186] 10.222.0.79 () {58 vars in 1174 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5796 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:00.993678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38e72617-8d9a-4053-b5af-6dad9363841b tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.015224 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38e72617-8d9a-4053-b5af-6dad9363841b tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5796 microversion: 2.1 time: 0.026167 Jul 20 10:46:01.016242 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 116/187] 10.222.0.79 () {58 vars in 1172 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5796 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.033465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-063b9893-b2e4-4134-9ede-f47d0a2e4bf8 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.054237 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-063b9893-b2e4-4134-9ede-f47d0a2e4bf8 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5796 microversion: 2.1 time: 0.026953 Jul 20 10:46:01.055201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 117/188] 10.222.0.79 () {58 vars in 1168 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5796 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.070616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e01ac809-9ca7-48a3-91de-c7d3c980f2f9 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.091363 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e01ac809-9ca7-48a3-91de-c7d3c980f2f9 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/395254219" status: 202 len: 0 microversion: 2.1 time: 0.024053 Jul 20 10:46:01.092360 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 118/189] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/395254219 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:01.100718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da151d2f-f3c5-4ee5-9a03-872ec44da526 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.122734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da151d2f-f3c5-4ee5-9a03-872ec44da526 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.025918 Jul 20 10:46:01.123083 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 119/190] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:01.139212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3da01ccf-e3a4-4d74-b12a-9ae6b6bd30d8 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.157704 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3da01ccf-e3a4-4d74-b12a-9ae6b6bd30d8 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/827644389" status: 202 len: 0 microversion: 2.1 time: 0.023751 Jul 20 10:46:01.159069 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 120/191] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/827644389 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:46:01.168262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58b3ad84-d4ac-4ddd-bd02-3b100d2c1e86 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.191155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58b3ad84-d4ac-4ddd-bd02-3b100d2c1e86 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.026344 Jul 20 10:46:01.192541 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 121/192] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.209378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c3a81d0-ace3-44e5-b996-4bf9cbeae4c2 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-740275404", "id": 17489387, "os-flavor-access:is_public": "False"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.214825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=15,nova_api:INSERT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:01.228656 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c3a81d0-ace3-44e5-b996-4bf9cbeae4c2 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.022870 Jul 20 10:46:01.229253 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 122/193] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:01.239596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.240208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:01.246427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:01.247448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:01.248216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:01.248651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:01.306892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7d404bc-b480-4c05-a7bd-402541a13cf3 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.318100 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c7d404bc-b480-4c05-a7bd-402541a13cf3 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] HTTP exception thrown: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7d404bc-b480-4c05-a7bd-402541a13cf3 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Request method failure captured: Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/flavors/1282374537/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zlRUbNlw4NsOTz6otL_AAXDjMoK_Cr5pfgLXdbRphhg9IxgIqvKFLe-1SbXsPPoC7AcDSnC69UDHjQ8D6jjDzbSMk-RAG9cs7QmUec8pERvQJHmDj9hq6w3z79GU8cwr1rA0O3m0XgHslXe2UHBGIku1lLgmjpk6eoFfRkam06vYU Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:01.319984 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8d9fbb441214c70a5e848ef9065ca25", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6c84f6ee067d42279a7e22e29b2c7193 Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:01.321354 n-d-846219-10 devstack@n-api.service[125886]: exception: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'flavor_id': '1282374537', 'id': 'hw:cpu_thread_policy'} Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.322173 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.323726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.325642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7d404bc-b480-4c05-a7bd-402541a13cf3 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Returning 404 to user: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.326868 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7d404bc-b480-4c05-a7bd-402541a13cf3 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] 10.222.0.79 "GET /compute/v2.1/flavors/1282374537/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.436792 Jul 20 10:46:01.331827 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 72/194] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:46:00 2022] GET /compute/v2.1/flavors/1282374537/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:46:01.336732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c511bf11-d4ee-48e8-aeb9-834fcc6f5815 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.343405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=72,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=17,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:01.359549 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c511bf11-d4ee-48e8-aeb9-834fcc6f5815 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.026382 Jul 20 10:46:01.369864 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 73/195] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.375292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-895fed64-f8c1-45bd-9a25-43081ee6a6bd tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.376541 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.376541 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:01.377393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-895fed64-f8c1-45bd-9a25-43081ee6a6bd tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '6c84f6ee067d42279a7e22e29b2c7193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d9fbb441214c70a5e848ef9065ca25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-895fed64-f8c1-45bd-9a25-43081ee6a6bd tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Request method failure captured: Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/flavors/1282374537/os-extra_specs HTTP/1.1 Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 66 Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zlRUbNlw4NsOTz6otL_AAXDjMoK_Cr5pfgLXdbRphhg9IxgIqvKFLe-1SbXsPPoC7AcDSnC69UDHjQ8D6jjDzbSMk-RAG9cs7QmUec8pERvQJHmDj9hq6w3z79GU8cwr1rA0O3m0XgHslXe2UHBGIku1lLgmjpk6eoFfRkam06vYU Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:01.378969 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8d9fbb441214c70a5e848ef9065ca25", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6c84f6ee067d42279a7e22e29b2c7193 Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 20 10:46:01.380265 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'flavor_id': '1282374537', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:01.382449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 20 10:46:01.383711 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.385284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-895fed64-f8c1-45bd-9a25-43081ee6a6bd tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.385284 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-895fed64-f8c1-45bd-9a25-43081ee6a6bd tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] 10.222.0.79 "POST /compute/v2.1/flavors/1282374537/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.009571 Jul 20 10:46:01.385284 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 74/196] 10.222.0.79 () {60 vars in 1223 bytes} [Wed Jul 20 10:46:01 2022] POST /compute/v2.1/flavors/1282374537/os-extra_specs => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:01.391983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.392595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:01.399986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:01.400432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:01.401211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:01.401645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:01.414651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:01.425537 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a31b4d5-4f0a-4320-a19d-b313041e7fe3 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.189618 Jul 20 10:46:01.426648 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 123/197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.432306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa4dab0b-d82e-4941-a168-777162ff1460 tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.457273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa4dab0b-d82e-4941-a168-777162ff1460 tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.029171 Jul 20 10:46:01.458197 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 124/198] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.463996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-449ad87e-0397-4c2b-93fb-f8a1a0e77723 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.465573 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.465573 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:01.509652 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-449ad87e-0397-4c2b-93fb-f8a1a0e77723 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1282374537/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.050185 Jul 20 10:46:01.513819 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 125/199] 10.222.0.79 () {60 vars in 1223 bytes} [Wed Jul 20 10:46:01 2022] POST /compute/v2.1/flavors/1282374537/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:46:01.529583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a40a1fca-a674-42cd-9f79-233d7159d92c tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.530398 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.530398 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:01.561919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a40a1fca-a674-42cd-9f79-233d7159d92c tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/17489387" status: 202 len: 0 microversion: 2.1 time: 0.045600 Jul 20 10:46:01.562759 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 126/200] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/17489387 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:01.570103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23ed2f8b-2ed8-42e8-b060-d0f92224f58e tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.570871 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.570871 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:01.571874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-23ed2f8b-2ed8-42e8-b060-d0f92224f58e tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '6c84f6ee067d42279a7e22e29b2c7193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d9fbb441214c70a5e848ef9065ca25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23ed2f8b-2ed8-42e8-b060-d0f92224f58e tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Request method failure captured: Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zlRUbNlw4NsOTz6otL_AAXDjMoK_Cr5pfgLXdbRphhg9IxgIqvKFLe-1SbXsPPoC7AcDSnC69UDHjQ8D6jjDzbSMk-RAG9cs7QmUec8pERvQJHmDj9hq6w3z79GU8cwr1rA0O3m0XgHslXe2UHBGIku1lLgmjpk6eoFfRkam06vYU Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:01.573810 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8d9fbb441214c70a5e848ef9065ca25", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 6c84f6ee067d42279a7e22e29b2c7193 Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:01.575876 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'flavor_id': '1282374537', 'id': 'hw:numa_nodes'} Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:01.576548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.577583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23ed2f8b-2ed8-42e8-b060-d0f92224f58e tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.578470 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-23ed2f8b-2ed8-42e8-b060-d0f92224f58e tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] 10.222.0.79 "DELETE /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012418 Jul 20 10:46:01.581527 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 127/201] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:01.586959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ef3fc31-0c76-47ac-947f-850233a4ad61 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.596078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:01.606616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-59a1e53d-f853-417a-b214-24129dec3feb tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.218436 Jul 20 10:46:01.613756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 75/202] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.620708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ef3fc31-0c76-47ac-947f-850233a4ad61 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.037931 Jul 20 10:46:01.621751 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 128/203] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.626642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33fb54d9-117e-4cab-a1f8-a6f21d89a45f tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.628472 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.628472 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:01.648166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f0f6e52-3ab1-42fc-9dcb-428582b6b2a7 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-982072008", "id": 703580895, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.651238 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.651238 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:01.665522 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33fb54d9-117e-4cab-a1f8-a6f21d89a45f tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1282374537/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047723 Jul 20 10:46:01.666299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 76/204] 10.222.0.79 () {60 vars in 1223 bytes} [Wed Jul 20 10:46:01 2022] POST /compute/v2.1/flavors/1282374537/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:46:01.678271 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5f0f6e52-3ab1-42fc-9dcb-428582b6b2a7 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.033911 Jul 20 10:46:01.678878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 129/205] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:01.685450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e2a73fe-90d0-489c-9e62-2cfefe2da89f tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.686755 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.686755 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:01.689462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1e2a73fe-90d0-489c-9e62-2cfefe2da89f tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '6c84f6ee067d42279a7e22e29b2c7193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d9fbb441214c70a5e848ef9065ca25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e2a73fe-90d0-489c-9e62-2cfefe2da89f tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Request method failure captured: Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 22 Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zlRUbNlw4NsOTz6otL_AAXDjMoK_Cr5pfgLXdbRphhg9IxgIqvKFLe-1SbXsPPoC7AcDSnC69UDHjQ8D6jjDzbSMk-RAG9cs7QmUec8pERvQJHmDj9hq6w3z79GU8cwr1rA0O3m0XgHslXe2UHBGIku1lLgmjpk6eoFfRkam06vYU Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:01.693770 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8d9fbb441214c70a5e848ef9065ca25", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8d9fbb441214c70a5e848ef9065ca25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f8d9fbb441214c70a5e848ef9065ca25 Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6c84f6ee067d42279a7e22e29b2c7193 Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: {"hw:numa_nodes": "1"} Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:01.695078 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'flavor_id': '1282374537', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:01.696000 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 20 10:46:01.697101 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.700913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e2a73fe-90d0-489c-9e62-2cfefe2da89f tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.702952 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e2a73fe-90d0-489c-9e62-2cfefe2da89f tempest-FlavorsExtraSpecsNegativeTestJSON-521709592 tempest-FlavorsExtraSpecsNegativeTestJSON-521709592-project] 10.222.0.79 "PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027012 Jul 20 10:46:01.704847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2ebdd92-1516-4d01-aaae-8de2f9f27b38 tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.706596 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 77/206] 10.222.0.79 () {60 vars in 1264 bytes} [Wed Jul 20 10:46:01 2022] PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:01.717434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80430bb6-e897-42e4-a41d-76da43e39c1e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.720106 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.720106 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:01.738736 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-80430bb6-e897-42e4-a41d-76da43e39c1e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] HTTP exception thrown: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80430bb6-e897-42e4-a41d-76da43e39c1e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Request method failure captured: Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/flavors/1282374537/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zoHhiCxBei9iUGbFWSKyvZDQhkDhXe2m3E7UM3pC8tYXmyGqyIhv6Qw9JyZQ2G1uc4umZR0TKV0OH_Fc4wrUUU9mCRpdzY6OgQvMlIIzdKE9WCzP1EPeHOx9BuhZkk1N1zZwmJxeq-KRp4jGxEUaftM776y94GlG4ARjDb2PHDWzI Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd9e0a10936b4b6db73e1c0ecf58808f Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:01.740084 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd9e0a10936b4b6db73e1c0ecf58808f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd9e0a10936b4b6db73e1c0ecf58808f Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8f14c82588264376ab0d095338140b72 Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:01.741408 n-d-846219-10 devstack@n-api.service[125886]: exception: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'flavor_id': '1282374537', 'id': 'hw:cpu_thread_policy'} Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.742189 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80430bb6-e897-42e4-a41d-76da43e39c1e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Returning 404 to user: Flavor 1282374537 has no extra specs with key hw:cpu_thread_policy. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80430bb6-e897-42e4-a41d-76da43e39c1e tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1282374537/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.028607 Jul 20 10:46:01.744023 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 78/207] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/1282374537/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:01.755826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd8c6468-c627-47b0-be72-90072c025f22 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.758776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-dd8c6468-c627-47b0-be72-90072c025f22 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd8c6468-c627-47b0-be72-90072c025f22 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Request method failure captured: Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 27 Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zoHhiCxBei9iUGbFWSKyvZDQhkDhXe2m3E7UM3pC8tYXmyGqyIhv6Qw9JyZQ2G1uc4umZR0TKV0OH_Fc4wrUUU9mCRpdzY6OgQvMlIIzdKE9WCzP1EPeHOx9BuhZkk1N1zZwmJxeq-KRp4jGxEUaftM776y94GlG4ARjDb2PHDWzI Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd9e0a10936b4b6db73e1c0ecf58808f Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:01.760280 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd9e0a10936b4b6db73e1c0ecf58808f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd9e0a10936b4b6db73e1c0ecf58808f Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8f14c82588264376ab0d095338140b72 Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: {"hw:cpu_policy": "shared"} Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:01.761684 n-d-846219-10 devstack@n-api.service[125886]: exception: Request body and URI mismatch Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'flavor_id': '1282374537', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.762705 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.764596 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:01.764596 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:01.764596 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 20 10:46:01.764596 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.767110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd8c6468-c627-47b0-be72-90072c025f22 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.771118 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dd8c6468-c627-47b0-be72-90072c025f22 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016155 Jul 20 10:46:01.776735 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2ebdd92-1516-4d01-aaae-8de2f9f27b38 tempest-FlavorsAdminTestJSON-2060242085 tempest-FlavorsAdminTestJSON-2060242085-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5796 microversion: 2.1 time: 0.083265 Jul 20 10:46:01.776735 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 130/209] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5796 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.776961 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 79/209] 10.222.0.79 () {60 vars in 1264 bytes} [Wed Jul 20 10:46:01 2022] PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 20 10:46:01.787816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e8b4b76-b151-4d5d-afe8-f098a50d34c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:01.788038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc28cc75-c837-4588-afdc-b10ef58a3c11 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.788794 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:01.788794 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e8b4b76-b151-4d5d-afe8-f098a50d34c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Request method failure captured: Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 49 Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zoHhiCxBei9iUGbFWSKyvZDQhkDhXe2m3E7UM3pC8tYXmyGqyIhv6Qw9JyZQ2G1uc4umZR0TKV0OH_Fc4wrUUU9mCRpdzY6OgQvMlIIzdKE9WCzP1EPeHOx9BuhZkk1N1zZwmJxeq-KRp4jGxEUaftM776y94GlG4ARjDb2PHDWzI Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd9e0a10936b4b6db73e1c0ecf58808f Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:01.790891 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd9e0a10936b4b6db73e1c0ecf58808f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd9e0a10936b4b6db73e1c0ecf58808f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd9e0a10936b4b6db73e1c0ecf58808f Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8f14c82588264376ab0d095338140b72 Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 20 10:46:01.792252 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'flavor_id': '1282374537', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance: Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 20 10:46:01.793040 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.795007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e8b4b76-b151-4d5d-afe8-f098a50d34c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:01.796317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e8b4b76-b151-4d5d-afe8-f098a50d34c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011894 Jul 20 10:46:01.801721 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 131/210] 10.222.0.79 () {60 vars in 1264 bytes} [Wed Jul 20 10:46:01 2022] PUT /compute/v2.1/flavors/1282374537/os-extra_specs/hw:numa_nodes => generated 117 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:46:01.812780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8f9016d-e774-41c7-8b54-84574efaa1ef tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.816087 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc28cc75-c837-4588-afdc-b10ef58a3c11 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/703580895" status: 202 len: 0 microversion: 2.1 time: 0.031613 Jul 20 10:46:01.819541 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 80/211] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/703580895 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:01.832464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ae410ff1-f67c-4a66-acd2-34df8a82eea2 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.856685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8f9016d-e774-41c7-8b54-84574efaa1ef tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1282374537" status: 202 len: 0 microversion: 2.1 time: 0.054342 Jul 20 10:46:01.857751 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 132/212] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:46:01 2022] DELETE /compute/v2.1/flavors/1282374537 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:01.861086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ae410ff1-f67c-4a66-acd2-34df8a82eea2 tempest-FlavorsAdminTestJSON-258404821 tempest-FlavorsAdminTestJSON-258404821-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.034357 Jul 20 10:46:01.861408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 81/213] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:01.884698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9818d398-2d77-421c-8ddf-41ac8c7dcf57 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:01.907542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9818d398-2d77-421c-8ddf-41ac8c7dcf57 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549 tempest-FlavorsExtraSpecsNegativeTestJSON-1591306549-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033419 Jul 20 10:46:01.908137 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 82/214] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:02.445427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:02.447020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:02.455081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:02.455767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:02.456548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:02.456983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:02.609008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:02.618664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce17c55b-9fa6-424c-84eb-6b425ef5f722 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.178296 Jul 20 10:46:02.629914 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 133/215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:02 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:02.641675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:02.643046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:02.651262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:02.652065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:02.653826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:02.654591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:02.861852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:02.874903 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1847cf91-81aa-4d53-a132-f0ffd4856c91 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.238447 Jul 20 10:46:02.877097 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 83/216] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:02 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:03.636710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:03.638567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:03.648815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:03.648815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:03.648815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:03.648815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:03.808905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:03.819660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc56fcc2-c52b-4a91-8ddb-df2ebb591a23 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.187057 Jul 20 10:46:03.820231 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 134/217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:03 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:03.895321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:03.896151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:03.910172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:03.911791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:03.913302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:03.915513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:04.092823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1042551860", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:04.165973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:04.202561 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a56e4b90-87ba-4062-9209-b01a48546e2d tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.312189 Jul 20 10:46:04.203518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:46:04.221461 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 135/218] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:03 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:04.603104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:04.603836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:04.604651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:04.605213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:04.606046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:04.617533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:04.618585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:04.619805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:04.620243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:04.649341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Getting quotas for project 88b1bf8c8a5a41e286cab7c9dd11fee8. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:46:04.657093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Getting quotas for user 9508a7f7cd4243a99f2653fbfdacc7dc and project 88b1bf8c8a5a41e286cab7c9dd11fee8. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:46:04.671473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:46:04.674838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:46:04.733649 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2998dbc7-b744-4abb-a85f-ae51a8398db6 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083322 Jul 20 10:46:04.743082 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 84/219] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 10:46:04.752300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-292b0c57-4f12-4454-8697-4423961dd716 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:04.753316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-292b0c57-4f12-4454-8697-4423961dd716 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:04.858242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-292b0c57-4f12-4454-8697-4423961dd716 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:04.879545 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-292b0c57-4f12-4454-8697-4423961dd716 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1223 microversion: 2.1 time: 0.134430 Jul 20 10:46:04.880950 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 85/220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:04 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:04.896745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:04.896745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:04.909793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:04.910386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:04.911183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:04.911701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:04.944223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3aae3db4-55d8-4dc1-99ff-8cd2a9c3bdcf tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2006692693", "id": 1076178123, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:04.945920 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:04.945920 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:04.979592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3aae3db4-55d8-4dc1-99ff-8cd2a9c3bdcf tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.412305 Jul 20 10:46:04.994059 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 136/221] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:46:04 2022] POST /compute/v2.1/flavors => generated 468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 10:46:05.085493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:05.108101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0de6d3d7-abd4-4826-9a7a-01e9f0d56d16 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.223202 Jul 20 10:46:05.111988 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 86/222] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:04 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:05.222862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.224417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:05.233702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:05.234386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:05.235422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:05.236067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:05.476196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:05.485413 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-534b0cbe-d190-4727-af67-83937e308cf9 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.267753 Jul 20 10:46:05.494027 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 87/223] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:05 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:05.603488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9027b08d-e606-48a5-aa5f-657e6a43fc66 tempest-FlavorsV261TestJSON-362752941 tempest-FlavorsV261TestJSON-362752941-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.621601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9027b08d-e606-48a5-aa5f-657e6a43fc66 tempest-FlavorsV261TestJSON-362752941 tempest-FlavorsV261TestJSON-362752941-project] 10.222.0.79 "GET /compute/v2.1/flavors/1076178123" status: 200 len: 468 microversion: 2.61 time: 0.616737 Jul 20 10:46:05.622758 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 137/224] 10.222.0.79 () {60 vars in 1198 bytes} [Wed Jul 20 10:46:04 2022] GET /compute/v2.1/flavors/1076178123 => generated 468 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:05.634150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c045c97-4ca9-4325-aa3e-128dd0aef772 tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4ea45310>, body: {"flavor": {"description": "new"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:05.659744 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:05.659744 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:05.714423 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c045c97-4ca9-4325-aa3e-128dd0aef772 tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1076178123" status: 200 len: 469 microversion: 2.61 time: 0.084117 Jul 20 10:46:05.715011 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 88/225] 10.222.0.79 () {62 vars in 1218 bytes} [Wed Jul 20 10:46:05 2022] PUT /compute/v2.1/flavors/1076178123 => generated 469 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:05.728776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-002bbd98-650e-4565-a3b7-6d6038878084 tempest-FlavorsV261TestJSON-362752941 tempest-FlavorsV261TestJSON-362752941-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.771873 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-002bbd98-650e-4565-a3b7-6d6038878084 tempest-FlavorsV261TestJSON-362752941 tempest-FlavorsV261TestJSON-362752941-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.046731 Jul 20 10:46:05.773257 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 138/226] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 10:46:05 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:05.791325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-73c8c21f-7111-461c-aba8-9671baf40110 tempest-FlavorsV261TestJSON-362752941 tempest-FlavorsV261TestJSON-362752941-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.818315 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-73c8c21f-7111-461c-aba8-9671baf40110 tempest-FlavorsV261TestJSON-362752941 tempest-FlavorsV261TestJSON-362752941-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.031459 Jul 20 10:46:05.819900 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 89/227] 10.222.0.79 () {60 vars in 1165 bytes} [Wed Jul 20 10:46:05 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:05.834237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44eeff3b-850e-447d-b1d7-f8512a3d114e tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.835387 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:05.835387 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:05.840329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:05.864457 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44eeff3b-850e-447d-b1d7-f8512a3d114e tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1076178123" status: 202 len: 0 microversion: 2.61 time: 0.034169 Jul 20 10:46:05.865201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 139/228] 10.222.0.79 () {60 vars in 1201 bytes} [Wed Jul 20 10:46:05 2022] DELETE /compute/v2.1/flavors/1076178123 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 10:46:05.875418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7ef1300b-d2f3-4f09-b593-bf6aa34a4a97 tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.901837 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7ef1300b-d2f3-4f09-b593-bf6aa34a4a97 tempest-FlavorsV261TestJSON-1802848701 tempest-FlavorsV261TestJSON-1802848701-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.031477 Jul 20 10:46:05.903758 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 140/229] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 10:46:05 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:46:05.921748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:05.922493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:05.929285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:05.929871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:05.931128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:05.931842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:06.016848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:06.026883 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0943a1dc-e8da-4c46-b72c-d92b723718c0 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1297 microversion: 2.1 time: 0.109662 Jul 20 10:46:06.028594 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 141/230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:05 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:06.085319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-bcb16944-30a8-43dd-bfb8-da35c0a60bee req-581dab0a-c566-46d9-a9f8-7c3d0ee06658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fec40f4-bb0e-40f1-a1fd-35ea10379155", "name": "network-vif-plugged", "status": "completed", "tag": "27217952-0251-4114-92ed-2d0430db8ce6"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:06.108544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-bcb16944-30a8-43dd-bfb8-da35c0a60bee req-581dab0a-c566-46d9-a9f8-7c3d0ee06658 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:06.109160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-bcb16944-30a8-43dd-bfb8-da35c0a60bee req-581dab0a-c566-46d9-a9f8-7c3d0ee06658 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:06.123640 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-bcb16944-30a8-43dd-bfb8-da35c0a60bee req-581dab0a-c566-46d9-a9f8-7c3d0ee06658 service nova] Creating event network-vif-plugged:27217952-0251-4114-92ed-2d0430db8ce6 for instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 on n-h2-846219-10 Jul 20 10:46:06.128595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:06.129415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:06.131431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-bcb16944-30a8-43dd-bfb8-da35c0a60bee req-581dab0a-c566-46d9-a9f8-7c3d0ee06658 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277715 Jul 20 10:46:06.132900 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 90/231] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:06.146712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:06.147238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:06.151202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:06.151722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:06.503455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:06.504325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:06.521964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:06.523891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:06.526448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:06.527039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:06.779135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:06.788598 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1a85113-2c9a-4af4-ba77-53451ff5264c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.665967 Jul 20 10:46:06.789652 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 142/232] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:06 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:06.915468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:06.928227 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9d3eed3-dc51-4f3d-a273-6836fec8aadc tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.428900 Jul 20 10:46:06.938419 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 91/233] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:06 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:07.050989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:07.052641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:07.061333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:07.062276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:07.064276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:07.065577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:07.168104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:07.185209 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-276b7a3e-72dc-4091-ae73-a7b6b9802de9 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1303 microversion: 2.1 time: 0.137849 Jul 20 10:46:07.186668 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 143/234] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:07 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:07.807863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:07.808476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:07.820570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:07.821070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:07.827455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:07.828496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:07.952052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:07.953017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:07.966104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:07.967016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:07.969966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:07.971645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:08.037997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:08.048772 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1962e8ef-1c7a-4ce2-a178-32d29137aafe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.245434 Jul 20 10:46:08.049912 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 92/235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:07 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:08.159683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ba9c85b1-5e82-473b-9025-f8fc5811d373 req-6603b5c6-62b2-4a80-a542-35b46ebe041c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce08e02c-a024-4c26-9f5c-c31f77250a04", "name": "network-vif-plugged", "status": "completed", "tag": "5ae8f5cc-0235-4254-b993-46d5617c9c27"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:08.171444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ba9c85b1-5e82-473b-9025-f8fc5811d373 req-6603b5c6-62b2-4a80-a542-35b46ebe041c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:08.172132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ba9c85b1-5e82-473b-9025-f8fc5811d373 req-6603b5c6-62b2-4a80-a542-35b46ebe041c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:08.190448 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ba9c85b1-5e82-473b-9025-f8fc5811d373 req-6603b5c6-62b2-4a80-a542-35b46ebe041c service nova] Creating event network-vif-plugged:5ae8f5cc-0235-4254-b993-46d5617c9c27 for instance ce08e02c-a024-4c26-9f5c-c31f77250a04 on n-h1-846219-10 Jul 20 10:46:08.193367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:08.203894 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df735042-fb19-444e-b30c-ed9530c35ee2 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1338 microversion: 2.1 time: 0.260489 Jul 20 10:46:08.204659 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 144/236] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:07 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1338 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:08.207656 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ba9c85b1-5e82-473b-9025-f8fc5811d373 req-6603b5c6-62b2-4a80-a542-35b46ebe041c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049073 Jul 20 10:46:08.209576 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 93/237] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:08.222290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:08.223078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:08.232620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:08.233298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:08.234992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:08.235620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:08.554285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:08.567035 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ecbcf7f9-a1fb-4408-b7d8-c394fc7874da tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1345 microversion: 2.1 time: 0.352081 Jul 20 10:46:08.568585 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 94/238] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:08 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1345 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:08.621034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f56ee689-9812-444e-ae44-5c96ba030d21 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4c761700>, body: {"quota_set": {"ram": "5120"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:08.732012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2e599938-3033-48b9-8644-f33a0fc1a05b req-c96b8aec-be48-48db-b8f4-0930598f259c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccedb4a1-b3db-4e61-abe1-f45ea05f29d4", "tag": "1f47d5cd-c6d7-4c02-9d62-3a4f9c38031e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:08.745019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2e599938-3033-48b9-8644-f33a0fc1a05b req-c96b8aec-be48-48db-b8f4-0930598f259c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:08.745886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2e599938-3033-48b9-8644-f33a0fc1a05b req-c96b8aec-be48-48db-b8f4-0930598f259c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:08.766377 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2e599938-3033-48b9-8644-f33a0fc1a05b req-c96b8aec-be48-48db-b8f4-0930598f259c service nova] Creating event network-changed:1f47d5cd-c6d7-4c02-9d62-3a4f9c38031e for instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 on n-h2-846219-10 Jul 20 10:46:08.775686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2e599938-3033-48b9-8644-f33a0fc1a05b req-c96b8aec-be48-48db-b8f4-0930598f259c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049038 Jul 20 10:46:08.776901 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 95/239] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:09.062924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56ee689-9812-444e-ae44-5c96ba030d21 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.064956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56ee689-9812-444e-ae44-5c96ba030d21 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.066020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56ee689-9812-444e-ae44-5c96ba030d21 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.066667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56ee689-9812-444e-ae44-5c96ba030d21 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.068905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.069826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:09.081377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.082221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.083215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.083845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.147099 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f56ee689-9812-444e-ae44-5c96ba030d21 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33" status: 200 len: 148 microversion: 2.57 time: 0.941029 Jul 20 10:46:09.148252 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 145/240] 10.222.0.79 () {62 vars in 1302 bytes} [Wed Jul 20 10:46:08 2022] PUT /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33 => generated 148 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:09.159571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d6919669-bfbe-4518-8a33-3cf447b3ddd9 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Calling method '.version_select at 0x7f2c4c6f8160>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.258973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:09.267481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c1ca374-8a30-4f54-a895-ed2563750bcb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.204616 Jul 20 10:46:09.278895 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 96/241] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:09.537241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6919669-bfbe-4518-8a33-3cf447b3ddd9 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.538571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6919669-bfbe-4518-8a33-3cf447b3ddd9 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.540191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6919669-bfbe-4518-8a33-3cf447b3ddd9 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.541098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6919669-bfbe-4518-8a33-3cf447b3ddd9 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.544321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Calling method '.version_select at 0x7f2c3fe389d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.545470 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:09.545470 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:09.546953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.548013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.565000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.565778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.570031 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d6919669-bfbe-4518-8a33-3cf447b3ddd9 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33/detail" status: 200 len: 463 microversion: 2.57 time: 0.414989 Jul 20 10:46:09.570857 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 146/242] 10.222.0.79 () {60 vars in 1303 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33/detail => generated 463 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:09.581521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.582288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.583222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.583845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:09.586439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:09.591940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.592396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.593178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.593617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.593849 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f103d09-dd6c-4940-bc4b-329b803cf0f3 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.313159 Jul 20 10:46:09.595128 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 97/243] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:09.599938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.600950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:09.610499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.611420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.612433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.613129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.829556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:09.830266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:09.839204 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f36f3629-59c3-4e7a-83d1-d1de3aabd5b3 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1488 microversion: 2.1 time: 0.260254 Jul 20 10:46:09.848115 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2ff53937-a6b6-43a5-9125-a626726ad838 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1345 microversion: 2.1 time: 0.251443 Jul 20 10:46:09.849224 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 98/244] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:09.856582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 147/245] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1488 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:09.871774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Calling method '.version_select at 0x7f2c3fe94a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.873600 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:09.873600 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:09.875419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.876117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.904925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.905467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.943928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.944349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.951486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3c43b7f-8f39-4ba1-8c0e-69020c0f98b6 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-846219-10/servers" status: 200 len: 276 microversion: 2.1 time: 0.087693 Jul 20 10:46:09.952217 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 99/246] 10.222.0.79 () {58 vars in 1214 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/os-hypervisors/n-h2-846219-10/servers => generated 276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:09.963438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:09.964163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:09.970647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.971403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:09.971886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:09.972363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.131727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Calling method '.version_select at 0x7f2c4c5cc700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.133830 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:10.133830 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:10.134724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.135199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.140160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:10.152750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.154526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.198809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.199271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.209609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=81,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=9 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:10.214707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.215161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.242241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.242726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.250479 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c548bb67-2384-471b-9a71-4d3912a5d950 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.392435 Jul 20 10:46:10.251055 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 148/247] 10.222.0.79 () {60 vars in 1242 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:10.256284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4c549b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:10.295876 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-06fd2e70-a1a1-4a70-bede-d9665b626634 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1641 microversion: 2.1 time: 0.336335 Jul 20 10:46:10.306926 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 100/248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:09 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1641 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:10.312504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Calling method '.version_select at 0x7f2c3ff5d550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.313331 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:10.313331 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:10.314511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.314955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.336174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.336868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.351145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.351930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.360396 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fcbd53bc-52ba-43c2-8cc8-352787d6c4da tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.051912 Jul 20 10:46:10.361308 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 101/249] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:10.372476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Calling method '.version_select at 0x7f2c3fe57430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.374427 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:10.374427 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:10.375863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.376514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.395786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.396323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.421503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.422265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.436157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.436967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.460191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.460690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.468463 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-10a643f2-c7be-40fd-89ad-a6d1bd651359 tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.105890 Jul 20 10:46:10.469253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 102/250] 10.222.0.79 () {60 vars in 1221 bytes} [Wed Jul 20 10:46:10 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:10.474176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.474854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:10.478188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=89,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:10.482241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.482680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.483502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.483924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.660083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:10.668744 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6cab1255-e769-48fb-85dc-d5d5f2d23571 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1319 microversion: 2.1 time: 0.198437 Jul 20 10:46:10.669847 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 103/251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:10 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:10.674101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.675059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.676929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.678393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.691628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.692863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:10.703658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.704475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.706152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.707057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.725375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.725964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.726812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.727615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.745927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:46:10.822552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1309376e-fcc1-4138-9fe2-e421658479ce tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33?user_id=aaf972ea4d6f44d2a14dbc7bd2d09528" status: 200 len: 148 microversion: 2.57 time: 0.570011 Jul 20 10:46:10.823240 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 149/252] 10.222.0.79 () {62 vars in 1383 bytes} [Wed Jul 20 10:46:10 2022] PUT /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33?user_id=aaf972ea4d6f44d2a14dbc7bd2d09528 => generated 148 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:10.829381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb5f4a73-bbc2-42e5-9e0d-6af7e27891a4 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Calling method '.version_select at 0x7f2c4cc62670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.830552 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:10.830552 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:10.833621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5f4a73-bbc2-42e5-9e0d-6af7e27891a4 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.834086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5f4a73-bbc2-42e5-9e0d-6af7e27891a4 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.859133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5f4a73-bbc2-42e5-9e0d-6af7e27891a4 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.859621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5f4a73-bbc2-42e5-9e0d-6af7e27891a4 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.866964 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb5f4a73-bbc2-42e5-9e0d-6af7e27891a4 tempest-HypervisorAdminUnderV252Test-776528454 tempest-HypervisorAdminUnderV252Test-776528454-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-846219-10/search" status: 200 len: 105 microversion: 2.1 time: 0.042277 Jul 20 10:46:10.869537 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 150/253] 10.222.0.79 () {58 vars in 1211 bytes} [Wed Jul 20 10:46:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-846219-10/search => generated 105 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:10.875933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-759e4fb6-8466-49db-8d31-5504ff260eeb tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Calling method '.version_select at 0x7f2c4c506820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:10.877151 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:10.877151 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:10.878603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759e4fb6-8466-49db-8d31-5504ff260eeb tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.879046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759e4fb6-8466-49db-8d31-5504ff260eeb tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.897677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759e4fb6-8466-49db-8d31-5504ff260eeb tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:10.898120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759e4fb6-8466-49db-8d31-5504ff260eeb tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:10.906342 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-759e4fb6-8466-49db-8d31-5504ff260eeb tempest-HypervisorAdminV253TestBase-885475178 tempest-HypervisorAdminV253TestBase-885475178-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/db6f79b6-d2eb-4be8-92da-6d0eb318a904" status: 200 len: 794 microversion: 2.53 time: 0.035666 Jul 20 10:46:10.907355 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 151/254] 10.222.0.79 () {60 vars in 1297 bytes} [Wed Jul 20 10:46:10 2022] GET /compute/v2.1/os-hypervisors/db6f79b6-d2eb-4be8-92da-6d0eb318a904 => generated 794 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:10.911913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8adf54a1-1999-4471-8ff6-a32bc6f664d1 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] Calling method '.version_select at 0x7f2c4c4d1940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:11.081655 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bcc8b56a-d8cc-445c-9332-1d3e8022ce6c tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 204 len: 0 microversion: 2.1 time: 0.402610 Jul 20 10:46:11.086848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 104/255] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:46:10 2022] DELETE /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:46:11.094076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:11.095056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:11.102491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:11.102956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:11.104346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:11.105099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:11.272080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:11.280844 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1345 microversion: 2.1 time: 0.192715 Jul 20 10:46:11.291143 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 105/256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:11 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:11.292859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:11.294674 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e87cf22-cca9-43db-a279-d6aba5598c09 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002181 Jul 20 10:46:11.295501 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 106/257] 10.222.0.79 () {56 vars in 885 bytes} [Wed Jul 20 10:46:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 10:46:11.306940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:11.308277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:11.315352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:11.316045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:11.317383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:11.318033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:11.502729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:11.515623 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c83f389-498d-4471-9d47-16a41ea73b17 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1494 microversion: 2.1 time: 0.218199 Jul 20 10:46:11.517547 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 107/258] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:11 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1494 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:11.519427 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8adf54a1-1999-4471-8ff6-a32bc6f664d1 tempest-QuotasAdminTestV257-14138284 tempest-QuotasAdminTestV257-14138284-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33?user_id=aaf972ea4d6f44d2a14dbc7bd2d09528" status: 200 len: 190 microversion: 2.57 time: 0.608596 Jul 20 10:46:11.520032 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 152/259] 10.222.0.79 () {60 vars in 1363 bytes} [Wed Jul 20 10:46:10 2022] GET /compute/v2.1/os-quota-sets/38bcecc88442488c8d1722e5cad1fc33?user_id=aaf972ea4d6f44d2a14dbc7bd2d09528 => generated 190 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:46:11.687456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:11.688077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:11.703824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:11.704300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:11.705320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:11.705695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:11.895991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:11.907650 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e047611-8e62-4ce9-8f05-089bf5b73d78 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1469 microversion: 2.1 time: 0.224959 Jul 20 10:46:11.908546 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 108/260] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:11 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:12.236147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-775738732", "block_migration": true, "disk_over_commit": false}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:12.238621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:12.253099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:12.254219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:12.256011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:12.256540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:12.301100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:12.301851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:12.318029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:12.321086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:12.324381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:12.325345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:12.864717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:12.874377 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b3e09d6-1955-4ead-8339-64e6ec3edc2d tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1345 microversion: 2.1 time: 0.578766 Jul 20 10:46:12.884557 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 109/261] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:12 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1345 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:12.891015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:12.892168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:12.899701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:12.900260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:12.901129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:12.901782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:13.229872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lazy-loading 'flavor' on Instance uuid ce08e02c-a024-4c26-9f5c-c31f77250a04 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:46:13.329101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Going to try to live migrate instance to tempest-host-775738732 {{(pid=125885) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:46:13.345715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] HTTP exception thrown: Compute host tempest-host-775738732 could not be found. Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Request method failure captured: Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04/action HTTP/1.1 Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 106 Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zT0mp2xo6L-dxfHAmjUF03IjFbwWs4KkXwk1-y75jsvlCZfPmgA2ncoKnU22SYCchOjsQIir9LUpSbWcWZp17b0d6_JjZ7luAl_LNCSCKqkiDwUFCP4ZzGvsUirYxKfvtH4oUxJXygyZg5VeBGlo3wP9C5fTaXMPP0518r1SbSIMs Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5b57fc0e940d4dad87b784860095a1bc Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-LiveMigrationNegativeTest-9403671 Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:13.350361 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5b57fc0e940d4dad87b784860095a1bc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b57fc0e940d4dad87b784860095a1bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b57fc0e940d4dad87b784860095a1bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5b57fc0e940d4dad87b784860095a1bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-LiveMigrationNegativeTest-9403671 Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5b57fc0e940d4dad87b784860095a1bc Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-9403671 Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-LiveMigrationNegativeTest-9403671-project-admin Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: caebf0dbb63b4822b4c279651ba21aa8 Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-LiveMigrationNegativeTest-9403671-project-admin Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: {"os-migrateLive": {"host": "tempest-host-775738732", "block_migration": true, "disk_over_commit": false}} Jul 20 10:46:13.351536 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: exception: Compute host tempest-host-775738732 could not be found. Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ce08e02c-a024-4c26-9f5c-c31f77250a04', 'body': {'os-migrateLive': {'host': 'tempest-host-775738732', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:13.352167 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-775738732 could not be found. Jul 20 10:46:13.353134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-775738732 could not be found. Jul 20 10:46:13.354104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-775738732 could not be found. Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Returning 400 to user: Compute host tempest-host-775738732 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3d289061-58b7-433d-b288-96c78b8cf030 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04/action" status: 400 len: 99 microversion: 2.1 time: 1.428093 Jul 20 10:46:13.356988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 153/262] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Jul 20 10:46:11 2022] POST /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04/action => generated 99 bytes in 1429 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:46:13.369091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:13.372466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:13.386596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:13.388689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:13.389769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:13.391715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:13.654011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc843169b8a742b28d9a94c86a8abebd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fd2c3ca2ac64585b32cb3fea94f6127', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:13.686040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe957fd7-03e1-4069-b2e2-99bf04a0d95f tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 200 len: 1494 microversion: 2.1 time: 0.800035 Jul 20 10:46:13.688588 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 110/263] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:12 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 1494 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:13.895237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:13.895892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:13.908255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:13.922357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:13.922817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:13.923823 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf7781c6-6ff2-4a93-b57f-603c7f16da5c tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1469 microversion: 2.1 time: 0.563035 Jul 20 10:46:13.926482 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 154/264] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:13 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1469 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:13.928048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:13.928882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:14.102629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-789333089", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:14.247831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:46:14.560425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:14.569976 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-22f1147e-e8bc-43c9-970d-8ad36ae6cd5a tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1345 microversion: 2.1 time: 0.680847 Jul 20 10:46:14.570570 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 111/265] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:13 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1345 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:14.630086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:14.705621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:14.706100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:14.706491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:14.706892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:14.707386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:14.725489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:14.727243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:14.729576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:14.730366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:14.783417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Getting quotas for project a6ee2b02dd884f3781a101b8517f4d9a. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:46:14.802031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Getting quotas for user 9f107a581f6143c395d2480776b9193c and project a6ee2b02dd884f3781a101b8517f4d9a. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:46:14.833435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:46:14.842134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:46:14.878430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:14.904199 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8be95bf1-9941-4e2a-8472-106013b482fd tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805440 Jul 20 10:46:14.904851 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 155/266] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 10:46:14.910948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:14.911782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:14.921179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:14.921856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:14.922782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:14.923397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:14.946867 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] HTTP exception thrown: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Request method failure captured: Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 HTTP/1.1 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zIvU8qXeB8fC5ATgr4C1ayAbA6YY0KiptcFGi9gz6EGo8TD8Kamskie3wPGWqlVqgRDlLbKX9keBqwVDjVOOZeW6qdoc-G3OR0z4g4J3kDDRe5u-fR2eBHsKSqajnkrLy9OCz4jOmnjQsq06XXgScZmAm3xcoYL27chB1KSvsaDC0 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7fd2c3ca2ac64585b32cb3fea94f6127 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:14.949993 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7fd2c3ca2ac64585b32cb3fea94f6127", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7fd2c3ca2ac64585b32cb3fea94f6127 Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminTestJSON-1114663467-project Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: dc843169b8a742b28d9a94c86a8abebd Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminTestJSON-1114663467-project Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:14.951391 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '4fec40f4-bb0e-40f1-a1fd-35ea10379155'} Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:14.952678 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:14.954014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:14.955991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Returning 404 to user: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:14.956884 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e61051eb-a1d4-4ddb-b337-e17d6f251c25 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 404 len: 111 microversion: 2.1 time: 0.050547 Jul 20 10:46:14.961273 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 156/267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:14 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:14.972469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d09a1ce3-6a4d-4e1b-9cf1-a0c56f518ce1 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:14.973762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d09a1ce3-6a4d-4e1b-9cf1-a0c56f518ce1 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:15.065078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d09a1ce3-6a4d-4e1b-9cf1-a0c56f518ce1 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:15.079432 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d09a1ce3-6a4d-4e1b-9cf1-a0c56f518ce1 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1218 microversion: 2.1 time: 0.118125 Jul 20 10:46:15.081275 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 157/268] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:14 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:15.120047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7ba076a-542f-4526-93e7-9ad4143e0841 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:15.128033 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:15.128033 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:15.151361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7ba076a-542f-4526-93e7-9ad4143e0841 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.155296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7ba076a-542f-4526-93e7-9ad4143e0841 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:15.232208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3acdc723-15f0-4902-8d2e-92ddd57b6ae1 req-3652b823-b3fb-4267-b5bd-f8cb13e9ea26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fec40f4-bb0e-40f1-a1fd-35ea10379155", "name": "network-vif-deleted", "tag": "27217952-0251-4114-92ed-2d0430db8ce6"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:15.250642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3acdc723-15f0-4902-8d2e-92ddd57b6ae1 req-3652b823-b3fb-4267-b5bd-f8cb13e9ea26 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.252617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3acdc723-15f0-4902-8d2e-92ddd57b6ae1 req-3652b823-b3fb-4267-b5bd-f8cb13e9ea26 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:15.264522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:15.293828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3acdc723-15f0-4902-8d2e-92ddd57b6ae1 req-3652b823-b3fb-4267-b5bd-f8cb13e9ea26 service nova] Creating event network-vif-deleted:27217952-0251-4114-92ed-2d0430db8ce6 for instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 on n-h2-846219-10 Jul 20 10:46:15.307047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3acdc723-15f0-4902-8d2e-92ddd57b6ae1 req-3652b823-b3fb-4267-b5bd-f8cb13e9ea26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.734745 Jul 20 10:46:15.312181 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 112/269] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:15.360989 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7ba076a-542f-4526-93e7-9ad4143e0841 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 299 microversion: 2.1 time: 0.276363 Jul 20 10:46:15.362994 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 158/270] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:46:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:15.376826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c2dfed7-e6d3-412e-9dc0-c7cbc0980e33 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:15.378255 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:15.378255 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:15.437542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c2dfed7-e6d3-412e-9dc0-c7cbc0980e33 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.066121 Jul 20 10:46:15.439648 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 113/271] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:15 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:15.453904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-efeee9a3-04bc-414d-8fd6-70b21437432c req-ab629443-a0ee-4d51-930a-ef273f36db94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccedb4a1-b3db-4e61-abe1-f45ea05f29d4", "name": "network-vif-plugged", "status": "completed", "tag": "1f47d5cd-c6d7-4c02-9d62-3a4f9c38031e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:15.459240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f84fbea7-7238-4bff-bc0f-95e492ab35aa tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1524587331"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:15.461882 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:15.461882 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:15.466724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-f84fbea7-7238-4bff-bc0f-95e492ab35aa tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid 1574f46d-565f-4b6e-af04-436b7eff8139 for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:15.478668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-efeee9a3-04bc-414d-8fd6-70b21437432c req-ab629443-a0ee-4d51-930a-ef273f36db94 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.479192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-efeee9a3-04bc-414d-8fd6-70b21437432c req-ab629443-a0ee-4d51-930a-ef273f36db94 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:15.495931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-efeee9a3-04bc-414d-8fd6-70b21437432c req-ab629443-a0ee-4d51-930a-ef273f36db94 service nova] Creating event network-vif-plugged:1f47d5cd-c6d7-4c02-9d62-3a4f9c38031e for instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 on n-h2-846219-10 Jul 20 10:46:15.505301 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-efeee9a3-04bc-414d-8fd6-70b21437432c req-ab629443-a0ee-4d51-930a-ef273f36db94 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059453 Jul 20 10:46:15.507924 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 159/272] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:15.516498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f84fbea7-7238-4bff-bc0f-95e492ab35aa tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068365 Jul 20 10:46:15.518410 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 114/273] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:15.539780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-256fe581-348f-4f15-8ebb-9f782e16cb93 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:15.541813 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:15.541813 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:15.591104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:15.592178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:15.624731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.627325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-256fe581-348f-4f15-8ebb-9f782e16cb93 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.628453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:15.629585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-256fe581-348f-4f15-8ebb-9f782e16cb93 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:15.632841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.633299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:15.871204 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-256fe581-348f-4f15-8ebb-9f782e16cb93 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.346216 Jul 20 10:46:15.877562 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 160/274] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:46:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:15.884136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40f9787c-c266-442f-99ae-1ff4b630055a tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:15.885052 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:15.885052 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:15.911660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-40f9787c-c266-442f-99ae-1ff4b630055a tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 243 microversion: 2.1 time: 0.032612 Jul 20 10:46:15.912243 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 161/275] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 10:46:15 2022] GET /compute/v2.1/os-aggregates/9 => generated 243 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:15.942722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a8aa6cd3-34e4-45e7-8445-a26143fd7f67 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:15.944152 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:15.944152 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:15.958139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8aa6cd3-34e4-45e7-8445-a26143fd7f67 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:15.958662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8aa6cd3-34e4-45e7-8445-a26143fd7f67 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:16.128744 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a8aa6cd3-34e4-45e7-8445-a26143fd7f67 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.207852 Jul 20 10:46:16.130342 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 162/276] 10.222.0.79 () {60 vars in 1190 bytes} [Wed Jul 20 10:46:15 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:16.136246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:16.136975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:16.148301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:16.148681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:16.149456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:16.149883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:16.170957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:16.183492 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-088c08a3-604d-419f-ba79-75793cbbf1ca tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1323 microversion: 2.1 time: 0.598989 Jul 20 10:46:16.188849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 115/277] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:15 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:16.212483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8cdb46ee-1741-436d-b716-d8fa71405d10 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:16.213345 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.213345 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:16.253516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8cdb46ee-1741-436d-b716-d8fa71405d10 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.060308 Jul 20 10:46:16.254575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 116/278] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:16 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:16.266439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d07e0e31-091e-4720-9e2e-7acd33d199ad tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2009050301"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:16.270101 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.270101 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:16.271552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-d07e0e31-091e-4720-9e2e-7acd33d199ad tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid ff753b16-c000-4e45-ace7-9cec92b35255 for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:16.293940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:16.303722 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7eba528-e48c-4b54-ba3e-9b3abbf626f4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1214 microversion: 2.1 time: 0.171934 Jul 20 10:46:16.308433 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 163/279] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:16 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:16.328893 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d07e0e31-091e-4720-9e2e-7acd33d199ad tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068012 Jul 20 10:46:16.343784 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 117/280] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:16.356172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-579586b0-499a-4b3b-b55c-088f48227d19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:16.358732 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.358732 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:16.371108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-579586b0-499a-4b3b-b55c-088f48227d19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:16.372470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-579586b0-499a-4b3b-b55c-088f48227d19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:16.522527 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-579586b0-499a-4b3b-b55c-088f48227d19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.172459 Jul 20 10:46:16.523129 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 164/281] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:16 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:16.542634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98e4291f-1ef8-4eed-9020-606163d99cc6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:16.543948 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.543948 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:16.572416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98e4291f-1ef8-4eed-9020-606163d99cc6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.1 time: 0.028171 Jul 20 10:46:16.577564 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 118/282] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:46:16 2022] GET /compute/v2.1/os-aggregates => generated 247 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:16.592394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad3d24b4-2aaf-4f70-9384-908e60d3e00e tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:16.593850 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.593850 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:16.616050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad3d24b4-2aaf-4f70-9384-908e60d3e00e tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:16.616510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad3d24b4-2aaf-4f70-9384-908e60d3e00e tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:16.646674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:16.796355 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad3d24b4-2aaf-4f70-9384-908e60d3e00e tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.215206 Jul 20 10:46:16.798957 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 165/283] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:16 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:16.808331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4bc1b928-064c-49a0-bcfe-3a9667a49478 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:16.809673 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.809673 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:16.854592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4bc1b928-064c-49a0-bcfe-3a9667a49478 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.050443 Jul 20 10:46:16.858449 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 119/284] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:16 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:16.872777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-acdbcf0b-3fb7-49b7-ba93-16bdb7901158 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2016459586"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:16.875261 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.875261 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:16.877864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-acdbcf0b-3fb7-49b7-ba93-16bdb7901158 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid d5ae9fdb-7fbd-4ff3-bc5e-81222f6fa547 for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:16.921297 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-acdbcf0b-3fb7-49b7-ba93-16bdb7901158 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055297 Jul 20 10:46:16.923914 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 166/285] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:16.935516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f70c131-fa36-4afb-ba91-7a95a80d83bb tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:16.937707 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:16.937707 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:16.954401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f70c131-fa36-4afb-ba91-7a95a80d83bb tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:16.955656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f70c131-fa36-4afb-ba91-7a95a80d83bb tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.209665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:17.211043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:17.223443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.224417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.225609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.226273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.519680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:17.536694 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-288edba8-bc7c-4824-8e0c-42cd1057e426 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1473 microversion: 2.1 time: 0.333360 Jul 20 10:46:17.538084 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 167/286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:17 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:17.552608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:17.555418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:17.573229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.575909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.578058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.579951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.804504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:17.831660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-489be240-0a97-45b4-96d8-28eeb6e7aa0e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1276 microversion: 2.1 time: 0.289108 Jul 20 10:46:17.832281 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 168/287] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:17 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:17.845681 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f70c131-fa36-4afb-ba91-7a95a80d83bb tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.915212 Jul 20 10:46:17.847385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 120/288] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:16 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:17.850514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:17.854213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:17.860152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-820d464f-13ba-49a3-954c-2de2d50b3e19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:17.863964 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:17.863964 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:17.873434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.875337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.878695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.879498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:17.893118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-820d464f-13ba-49a3-954c-2de2d50b3e19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:17.893564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-820d464f-13ba-49a3-954c-2de2d50b3e19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.061437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Request method failure captured: Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4/diagnostics HTTP/1.1 Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zp7qX-xMW2yrYvQyhqFeJ95wA5oKkK8eia3BL88QxoCPEBnYTogB_GgrmrN1WxIlNl6ti3-KqDoowr0tyqDombopEahNKO9JMVmXs-eA49iiUIj_pRijpPAaZ6x5fBHikjCDFRx8yAmhNoPf01aGK2j0tIZLIYGL2iHemCYezdKYQ Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 88b1bf8c8a5a41e286cab7c9dd11fee8 Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-741252761 Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:18.064269 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_88b1bf8c8a5a41e286cab7c9dd11fee8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/88b1bf8c8a5a41e286cab7c9dd11fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/88b1bf8c8a5a41e286cab7c9dd11fee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/88b1bf8c8a5a41e286cab7c9dd11fee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-741252761 Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 88b1bf8c8a5a41e286cab7c9dd11fee8 Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-741252761 Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerDiagnosticsNegativeTest-741252761-project Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9508a7f7cd4243a99f2653fbfdacc7dc Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-741252761-project Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:18.066088 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': 'ccedb4a1-b3db-4e61-abe1-f45ea05f29d4'} Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:18.067653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.069358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:18.071316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6402b23-51cc-488e-844c-ac63e0113fa4 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.231229 Jul 20 10:46:18.077398 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 169/289] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:46:17 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4/diagnostics => generated 117 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:18.083097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:18.083807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:18.101646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:18.101646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.102619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:18.104038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.162209 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-820d464f-13ba-49a3-954c-2de2d50b3e19 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.306697 Jul 20 10:46:18.171377 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 121/290] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:17 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:18.174103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:46:18.184857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-34c5a0b1-c8e5-4415-9e9f-bba644fb77c9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:18.187095 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.187095 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:18.263532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-34c5a0b1-c8e5-4415-9e9f-bba644fb77c9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.085399 Jul 20 10:46:18.265505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 122/291] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:18 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:18.275449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:18.276551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f7b37c5-495e-4ff2-a59b-d721657a0ff7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1560672252"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:18.279781 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.279781 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:18.282496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-1f7b37c5-495e-4ff2-a59b-d721657a0ff7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid e397e989-9986-4ccc-8b05-8a27156fffae for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:18.327161 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f7b37c5-495e-4ff2-a59b-d721657a0ff7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053915 Jul 20 10:46:18.329825 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 123/292] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:18.342618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89df25b9-e405-47bc-9f49-425d586c5efc tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1055649760"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:18.346164 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.346164 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:18.349073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-89df25b9-e405-47bc-9f49-425d586c5efc tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid 8b992cc1-5d0a-4449-aff7-7439e38e587f for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:18.376289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a05cd6fc-5af8-41c3-8eb6-76f909704a0c tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 204 len: 0 microversion: 2.1 time: 0.297309 Jul 20 10:46:18.377380 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 170/293] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:46:18 2022] DELETE /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:46:18.390024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd324042-b561-4d39-abbd-b8f52e74a214 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:18.392211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-89df25b9-e405-47bc-9f49-425d586c5efc tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.058661 Jul 20 10:46:18.393622 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.393622 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:18.399837 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 124/294] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:18.402009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:18.405360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:18.416733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:18.417431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.418402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:18.418923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.445780 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cd324042-b561-4d39-abbd-b8f52e74a214 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.066536 Jul 20 10:46:18.450257 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 171/295] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:18.469802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ca5e547-a726-40fb-ae75-92178f2fa53a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:18.475640 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.475640 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:18.498464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca5e547-a726-40fb-ae75-92178f2fa53a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:18.499433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca5e547-a726-40fb-ae75-92178f2fa53a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.682389 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ca5e547-a726-40fb-ae75-92178f2fa53a tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 244 microversion: 2.1 time: 0.227815 Jul 20 10:46:18.689775 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 172/296] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:18 2022] POST /compute/v2.1/os-aggregates/13/action => generated 244 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:18.703774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:18.707982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7640fcf-045d-4bfe-95ab-d1277490ae86 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:18.709184 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.709184 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:18.717561 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4ae51710-b447-46ac-b2f1-ba134266e815 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1479 microversion: 2.1 time: 0.320667 Jul 20 10:46:18.721664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 125/297] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:18 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1479 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:18.729610 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e7640fcf-045d-4bfe-95ab-d1277490ae86 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7640fcf-045d-4bfe-95ab-d1277490ae86 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Request method failure captured: Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zLSh6n6-6-8OmcbvoDh8KKRgm_qruC_TCnzaugaikQxx29Axm_1axNP8vFaKYC8BGtxFKGVJtkCA6yCYOoqmjVtcbOkgKtXlhytDMqkO1cbiiX6HigLOsN99tLXJCfMygiFDg8-E4x9CSEwq7g-XoTS8Y2gJ65eHeSfZYV5I6DOmU Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:18.737579 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba8a08b89a4a469a878dc838bf27dfd8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9ea37a65c19142a0b99953527fd4b8a6 Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: exception: Aggregate 12 could not be found. Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '12'} Jul 20 10:46:18.738979 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.739743 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 20 10:46:18.740752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.743437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7640fcf-045d-4bfe-95ab-d1277490ae86 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:18.744734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7640fcf-045d-4bfe-95ab-d1277490ae86 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.053065 Jul 20 10:46:18.745785 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 173/298] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:18 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:18.753203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-976f05d3-5dba-4857-9fc6-d03e893f7d07 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:18.754586 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.754586 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:18.755541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-976f05d3-5dba-4857-9fc6-d03e893f7d07 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '65a3fd82615d4f53a92fb66b39e45b3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffde4d7f1c47497281d75664619fcd7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-976f05d3-5dba-4857-9fc6-d03e893f7d07 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Request method failure captured: Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 43 Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zISKTF_CG4W44T3sRU3L1RT6KlTfhL-0Yz4pcxrHpJ0gcCXC9Whv-QFLA6l0yfWcGNzB70iMaGYYGjNL2rnp-iF_xeJc_JqEPSEyQ8wkvqQUAqs7r9mAbIRypwoLeDdPFUalWl3gnejnN0ZZAsPpenQeBV4zY9023LeoijJap38fI Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:18.757451 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ffde4d7f1c47497281d75664619fcd7e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ffde4d7f1c47497281d75664619fcd7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ffde4d7f1c47497281d75664619fcd7e Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-489020531 Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 65a3fd82615d4f53a92fb66b39e45b3f Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-489020531-project Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: {"remove_host": {"host": "n-h2-846219-10"}} Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:18.759396 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'n-h2-846219-10'}}} Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:18.763064 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 20 10:46:18.766756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.770155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-976f05d3-5dba-4857-9fc6-d03e893f7d07 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:18.770155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-976f05d3-5dba-4857-9fc6-d03e893f7d07 tempest-AggregatesAdminNegativeTestJSON-489020531 tempest-AggregatesAdminNegativeTestJSON-489020531-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.011344 Jul 20 10:46:18.770155 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 174/299] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:18 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:18.773080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0f046e4-d22e-4cec-a678-f996f60e08d6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:18.773962 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:18.773962 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:18.785159 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a0f046e4-d22e-4cec-a678-f996f60e08d6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0f046e4-d22e-4cec-a678-f996f60e08d6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Request method failure captured: Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zLSh6n6-6-8OmcbvoDh8KKRgm_qruC_TCnzaugaikQxx29Axm_1axNP8vFaKYC8BGtxFKGVJtkCA6yCYOoqmjVtcbOkgKtXlhytDMqkO1cbiiX6HigLOsN99tLXJCfMygiFDg8-E4x9CSEwq7g-XoTS8Y2gJ65eHeSfZYV5I6DOmU Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:18.786819 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba8a08b89a4a469a878dc838bf27dfd8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9ea37a65c19142a0b99953527fd4b8a6 Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: exception: Aggregate 12 could not be found. Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '12'} Jul 20 10:46:18.787970 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:18.788643 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:18.789672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0f046e4-d22e-4cec-a678-f996f60e08d6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0f046e4-d22e-4cec-a678-f996f60e08d6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.027992 Jul 20 10:46:18.793810 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 175/300] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:18 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:18.796345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c0e5873-986a-43cf-af36-32a90c618545 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:18.807835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c0e5873-986a-43cf-af36-32a90c618545 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:18.808710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c0e5873-986a-43cf-af36-32a90c618545 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:18.939323 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7c0e5873-986a-43cf-af36-32a90c618545 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.149136 Jul 20 10:46:18.950651 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 176/301] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:18 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:18.961230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e517c444-a994-46c4-a17e-4aa9fe26f3a9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-938118537", "name": "tempest-test_aggregate-1990433761"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:19.008161 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.008161 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.009277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-e517c444-a994-46c4-a17e-4aa9fe26f3a9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid 4be92d5d-5fe8-4c18-8654-ae366202fb5e for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:19.064570 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e517c444-a994-46c4-a17e-4aa9fe26f3a9 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112803 Jul 20 10:46:19.065657 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 177/302] 10.222.0.79 () {60 vars in 1164 bytes} [Wed Jul 20 10:46:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:19.073809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.075003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:19.084593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.085141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.087287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.087841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.193495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:19.206039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ae94a5ab-35ac-4dcd-ae88-759c36670511 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1276 microversion: 2.1 time: 0.138488 Jul 20 10:46:19.207001 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 178/303] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:19 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:19.213187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b67aa4bd-acd3-4e11-97f8-f4d9e5b4ec80 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.214156 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.214156 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.270335 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b67aa4bd-acd3-4e11-97f8-f4d9e5b4ec80 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.061776 Jul 20 10:46:19.275141 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 179/304] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:19 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:19.300267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b50eb48a-5bd2-45e4-b951-73d73b20a671 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.302203 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.302203 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.311285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9acf5e87-3692-4db5-beb5-f88feb86052f tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Calling method '.version_select at 0x7f2c4c0a0040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.312514 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.312514 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:19.313650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9acf5e87-3692-4db5-beb5-f88feb86052f tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.314094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9acf5e87-3692-4db5-beb5-f88feb86052f tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.314880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9acf5e87-3692-4db5-beb5-f88feb86052f tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.316238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9acf5e87-3692-4db5-beb5-f88feb86052f tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.355127 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b50eb48a-5bd2-45e4-b951-73d73b20a671 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.070818 Jul 20 10:46:19.357193 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 180/305] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:19.367390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6139fbf7-2d6c-49c9-8dac-f1c3131bf999 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-425151153"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:19.368933 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.368933 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.369994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-6139fbf7-2d6c-49c9-8dac-f1c3131bf999 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Generated uuid 389b8e12-0c66-42d7-a0a0-933b45bcddfb for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:19.387322 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9acf5e87-3692-4db5-beb5-f88feb86052f tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.663171 Jul 20 10:46:19.389688 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 126/306] 10.222.0.79 () {58 vars in 1127 bytes} [Wed Jul 20 10:46:18 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:19.401414 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6139fbf7-2d6c-49c9-8dac-f1c3131bf999 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043023 Jul 20 10:46:19.405201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-632a1b61-a869-4208-a5cd-283f4fabdfb2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.406790 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.406790 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:19.408873 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 181/307] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:19.441611 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-632a1b61-a869-4208-a5cd-283f4fabdfb2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-632a1b61-a869-4208-a5cd-283f4fabdfb2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Request method failure captured: Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zLSh6n6-6-8OmcbvoDh8KKRgm_qruC_TCnzaugaikQxx29Axm_1axNP8vFaKYC8BGtxFKGVJtkCA6yCYOoqmjVtcbOkgKtXlhytDMqkO1cbiiX6HigLOsN99tLXJCfMygiFDg8-E4x9CSEwq7g-XoTS8Y2gJ65eHeSfZYV5I6DOmU Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:19.444416 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba8a08b89a4a469a878dc838bf27dfd8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9ea37a65c19142a0b99953527fd4b8a6 Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: exception: Aggregate 14 could not be found. Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '14'} Jul 20 10:46:19.447108 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.448609 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 20 10:46:19.450274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.452868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-632a1b61-a869-4208-a5cd-283f4fabdfb2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:19.453990 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-632a1b61-a869-4208-a5cd-283f4fabdfb2 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.061760 Jul 20 10:46:19.454939 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 127/308] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:19 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:19.461001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:19.463630 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.463630 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:19.476305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.477392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.492314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.493805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.508370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.compute.aggregates [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 10:46:19.509772 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Request method failure captured: Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 42 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zM3WS6KCAAaX2HnV7Tv9bFxdi1pal1GMi4oMgT8H-2jwigkeujf9hpjWksAfVcuQ5lDmDUI_xGWgoSGoEhyj9KJ6ZfEYj05oc_CQfF_I2Sb6gobH9n0P8_yjFKGn4FEd07cIu6Y9EG-fqu3kdjs9YrVf5FH4xWjtZIW-8YLtcazOc Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:19.515839 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b278a3477d9e4e46a0bc3bfc50236e22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b278a3477d9e4e46a0bc3bfc50236e22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b278a3477d9e4e46a0bc3bfc50236e22 Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-584300540 Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 933b54f59e6443b0a8e907e5e5fa15ea Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: {"remove_host": {"host": "nonexist_host"}} Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:19.517079 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot remove host nonexist_host in aggregate 15 Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 20 10:46:19.517788 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 20 10:46:19.518847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.520957 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7394a3f1-e0b9-47b5-919c-1ad68e051538 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.061958 Jul 20 10:46:19.523586 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 128/309] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:19 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:19.529009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fabd2ad-f31f-469f-b0c1-a3d5dc55dbe7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.529798 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.529798 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:19.542900 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-6fabd2ad-f31f-469f-b0c1-a3d5dc55dbe7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fabd2ad-f31f-469f-b0c1-a3d5dc55dbe7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Request method failure captured: Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zLSh6n6-6-8OmcbvoDh8KKRgm_qruC_TCnzaugaikQxx29Axm_1axNP8vFaKYC8BGtxFKGVJtkCA6yCYOoqmjVtcbOkgKtXlhytDMqkO1cbiiX6HigLOsN99tLXJCfMygiFDg8-E4x9CSEwq7g-XoTS8Y2gJ65eHeSfZYV5I6DOmU Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:19.545730 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ba8a08b89a4a469a878dc838bf27dfd8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ba8a08b89a4a469a878dc838bf27dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ba8a08b89a4a469a878dc838bf27dfd8 Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022327816 Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9ea37a65c19142a0b99953527fd4b8a6 Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminTestJSON-2022327816-project-admin Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: exception: Aggregate 14 could not be found. Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '14'} Jul 20 10:46:19.547755 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:19.548502 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.549482 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fabd2ad-f31f-469f-b0c1-a3d5dc55dbe7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6fabd2ad-f31f-469f-b0c1-a3d5dc55dbe7 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.024215 Jul 20 10:46:19.551322 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 129/310] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:19.662104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-362018154", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:19.779140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:46:19.809907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef933109-5df7-44dc-bd4c-448fde03a38b tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Calling method '.version_select at 0x7f2c4c4e3ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.812678 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.812678 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.813919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ef933109-5df7-44dc-bd4c-448fde03a38b tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '2224ee1ac1f54d8f8c27dcdc9010fdc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a5ecf6dfb64a2f946585372205f757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef933109-5df7-44dc-bd4c-448fde03a38b tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Request method failure captured: Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z4_IfXGlh-um1-_kT3-B1ftWckwaznABy9juR_0wzERYQyRsQFoDTlyJDP92raN_3NLFDY4Uqz0-OtgPzt3t7Gd7c4xLDMDKbGzcrwvIgpHnIdc_cUWBz5VAWN5E_Vxi8-sAbCsipbKoebWdkiHo5umv2Ls1Y7sVSG9qLVenCGd3k Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:19.817743 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5a5ecf6dfb64a2f946585372205f757", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2224ee1ac1f54d8f8c27dcdc9010fdc2 Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 10:46:19.819308 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:19.820363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 20 10:46:19.821411 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:19.824004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef933109-5df7-44dc-bd4c-448fde03a38b tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:19.825116 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef933109-5df7-44dc-bd4c-448fde03a38b tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.415057 Jul 20 10:46:19.826028 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 182/311] 10.222.0.79 () {58 vars in 1127 bytes} [Wed Jul 20 10:46:19 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 417 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:19.834496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2347589c-696c-4d24-84b0-e14484815f62 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.835747 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.835747 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.866904 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2347589c-696c-4d24-84b0-e14484815f62 tempest-AggregatesAdminNegativeTestJSON-584300540 tempest-AggregatesAdminNegativeTestJSON-584300540-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.037301 Jul 20 10:46:19.875426 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 183/312] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:19 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:19.881954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fc1939b-be56-4383-a21e-38d4fc6aa9af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1305270767"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:19.883865 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:19.883865 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:19.886064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-1fc1939b-be56-4383-a21e-38d4fc6aa9af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid 02682ac4-d7b9-45e0-9bc5-d4bde9eae01f for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:19.928032 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fc1939b-be56-4383-a21e-38d4fc6aa9af tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050687 Jul 20 10:46:19.929979 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 184/313] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:19 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:19.945587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:19.946383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:19.969970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.970808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:19.971743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:19.972291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:20.704742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:20.717639 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-87494212-7f18-40cd-bad5-9c8f86bd0600 tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1479 microversion: 2.1 time: 0.786506 Jul 20 10:46:20.718544 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 185/314] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:19 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1479 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:20.746946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28c8cdba-4658-4939-9fe0-671fa2ebd28c tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Calling method '.version_select at 0x7f2c4c2f64c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:20.752520 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:20.752520 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:20.755968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28c8cdba-4658-4939-9fe0-671fa2ebd28c tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '2224ee1ac1f54d8f8c27dcdc9010fdc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a5ecf6dfb64a2f946585372205f757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28c8cdba-4658-4939-9fe0-671fa2ebd28c tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Request method failure captured: Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hosts/n-d-846219-10/reboot HTTP/1.1 Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z4_IfXGlh-um1-_kT3-B1ftWckwaznABy9juR_0wzERYQyRsQFoDTlyJDP92raN_3NLFDY4Uqz0-OtgPzt3t7Gd7c4xLDMDKbGzcrwvIgpHnIdc_cUWBz5VAWN5E_Vxi8-sAbCsipbKoebWdkiHo5umv2Ls1Y7sVSG9qLVenCGd3k Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:20.760989 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5a5ecf6dfb64a2f946585372205f757", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2224ee1ac1f54d8f8c27dcdc9010fdc2 Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'n-d-846219-10'} Jul 20 10:46:20.763086 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:20.764117 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 20 10:46:20.765352 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:20.767457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28c8cdba-4658-4939-9fe0-671fa2ebd28c tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:20.769406 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28c8cdba-4658-4939-9fe0-671fa2ebd28c tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-846219-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.049209 Jul 20 10:46:20.774833 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 186/315] 10.222.0.79 () {58 vars in 1190 bytes} [Wed Jul 20 10:46:20 2022] GET /compute/v2.1/os-hosts/n-d-846219-10/reboot => generated 111 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:20.786398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-048a8865-3157-4dc5-9cf7-378a3e7f2828 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:20.789864 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:20.789864 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:20.803557 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-048a8865-3157-4dc5-9cf7-378a3e7f2828 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.027022 Jul 20 10:46:20.804677 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 187/316] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:20 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:20.814075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:20.814867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:20.833874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:20.836442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:20.840397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:20.842013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:20.842654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:20.842887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:20.844201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:20.844821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:20.846264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:20.863898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:20.896992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:20.897719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:20.900548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:20.901205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:20.943742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:46:20.974493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:46:20.998971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:46:21.003646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:46:21.098870 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23fb1a91-e604-4cf9-a252-3d70658b0315 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547633 Jul 20 10:46:21.117104 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 130/317] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:46:21.121182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3f8d9b1-8511-4408-b400-74b5ccd97374 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Calling method '.version_select at 0x7f2c3ffde8b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.122480 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.122480 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.140311 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-e3f8d9b1-8511-4408-b400-74b5ccd97374 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3f8d9b1-8511-4408-b400-74b5ccd97374 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.149628 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'nonexistent_hostname'} Jul 20 10:46:21.151060 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:21.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 10:46:21.153910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.155104 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.158679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3f8d9b1-8511-4408-b400-74b5ccd97374 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.162713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.164046 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e3f8d9b1-8511-4408-b400-74b5ccd97374 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.050869 Jul 20 10:46:21.170886 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 131/318] 10.222.0.79 () {58 vars in 1211 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:21.175907 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bfa95326-f1ff-4723-bef9-3f170a48e9d9 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.369471 Jul 20 10:46:21.176182 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 188/319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:20 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:21.183041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07f7fd08-d4c1-4887-a101-e88e6330f7a8 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.188874 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.188874 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.190608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d31d9be3-2bba-4d14-ae76-4045dfe21975 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.191439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d31d9be3-2bba-4d14-ae76-4045dfe21975 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:21.225104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07f7fd08-d4c1-4887-a101-e88e6330f7a8 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.052758 Jul 20 10:46:21.226840 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 132/320] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 10:46:21 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:21.235395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f3a6719d-577e-4ae3-a3f4-ced8b7636548 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Calling method '.version_select at 0x7f2c3fd68670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.239049 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.239049 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.241199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f3a6719d-577e-4ae3-a3f4-ced8b7636548 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '2224ee1ac1f54d8f8c27dcdc9010fdc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a5ecf6dfb64a2f946585372205f757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f3a6719d-577e-4ae3-a3f4-ced8b7636548 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Request method failure captured: Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/n-d-846219-10 HTTP/1.1 Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z4_IfXGlh-um1-_kT3-B1ftWckwaznABy9juR_0wzERYQyRsQFoDTlyJDP92raN_3NLFDY4Uqz0-OtgPzt3t7Gd7c4xLDMDKbGzcrwvIgpHnIdc_cUWBz5VAWN5E_Vxi8-sAbCsipbKoebWdkiHo5umv2Ls1Y7sVSG9qLVenCGd3k Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:21.243123 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5a5ecf6dfb64a2f946585372205f757", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2224ee1ac1f54d8f8c27dcdc9010fdc2 Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10'} Jul 20 10:46:21.244596 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.245471 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 20 10:46:21.247674 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.249985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f3a6719d-577e-4ae3-a3f4-ced8b7636548 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.250989 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f3a6719d-577e-4ae3-a3f4-ced8b7636548 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-846219-10" status: 403 len: 109 microversion: 2.1 time: 0.022631 Jul 20 10:46:21.251865 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 133/321] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/n-d-846219-10 => generated 109 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:21.260592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-569c2783-b667-4faa-9ab1-26bdf9b6c64f tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.261740 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.261740 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.276101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-569c2783-b667-4faa-9ab1-26bdf9b6c64f tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.022417 Jul 20 10:46:21.277037 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 134/322] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:21.284043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bfb8aba-648e-49cc-a153-804f4b011ca9 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Calling method '.version_select at 0x7f2c3fdbb9d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.285148 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.285148 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.300342 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-8bfb8aba-648e-49cc-a153-804f4b011ca9 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bfb8aba-648e-49cc-a153-804f4b011ca9 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.324129 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'nonexistent_hostname'} Jul 20 10:46:21.325580 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.326509 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.327732 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.328903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bfb8aba-648e-49cc-a153-804f4b011ca9 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.328903 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8bfb8aba-648e-49cc-a153-804f4b011ca9 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.050043 Jul 20 10:46:21.334312 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 135/323] 10.222.0.79 () {58 vars in 1190 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:21.347963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d31d9be3-2bba-4d14-ae76-4045dfe21975 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.356813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-90304617-886e-48ae-ad47-2c3990113ddc tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.360604 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.360604 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.361631 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d31d9be3-2bba-4d14-ae76-4045dfe21975 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1216 microversion: 2.1 time: 0.184227 Jul 20 10:46:21.362411 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 189/324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:21.379091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7ecfc870-2f92-4983-9018-f921d320ddbb req-8f29934b-9f26-4ae4-b474-6460820809e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccedb4a1-b3db-4e61-abe1-f45ea05f29d4", "name": "network-vif-deleted", "tag": "1f47d5cd-c6d7-4c02-9d62-3a4f9c38031e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.405320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7ecfc870-2f92-4983-9018-f921d320ddbb req-8f29934b-9f26-4ae4-b474-6460820809e3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:21.405768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7ecfc870-2f92-4983-9018-f921d320ddbb req-8f29934b-9f26-4ae4-b474-6460820809e3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:21.421148 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-90304617-886e-48ae-ad47-2c3990113ddc tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.090589 Jul 20 10:46:21.422836 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 136/325] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:21 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:21.426764 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7ecfc870-2f92-4983-9018-f921d320ddbb req-8f29934b-9f26-4ae4-b474-6460820809e3 service nova] Creating event network-vif-deleted:1f47d5cd-c6d7-4c02-9d62-3a4f9c38031e for instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 on n-h2-846219-10 Jul 20 10:46:21.432395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91f029f1-3aba-4159-b8ae-fcb4cbb1346a tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Calling method '.version_select at 0x7f2c3fe474c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.441473 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.441473 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.449188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-91f029f1-3aba-4159-b8ae-fcb4cbb1346a tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '2224ee1ac1f54d8f8c27dcdc9010fdc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a5ecf6dfb64a2f946585372205f757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.451691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7ecfc870-2f92-4983-9018-f921d320ddbb req-8f29934b-9f26-4ae4-b474-6460820809e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088185 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91f029f1-3aba-4159-b8ae-fcb4cbb1346a tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Request method failure captured: Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/n-d-846219-10/shutdown HTTP/1.1 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z4_IfXGlh-um1-_kT3-B1ftWckwaznABy9juR_0wzERYQyRsQFoDTlyJDP92raN_3NLFDY4Uqz0-OtgPzt3t7Gd7c4xLDMDKbGzcrwvIgpHnIdc_cUWBz5VAWN5E_Vxi8-sAbCsipbKoebWdkiHo5umv2Ls1Y7sVSG9qLVenCGd3k Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:21.453408 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5a5ecf6dfb64a2f946585372205f757", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2224ee1ac1f54d8f8c27dcdc9010fdc2 Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10'} Jul 20 10:46:21.454839 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.455703 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 20 10:46:21.456965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.458163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 190/326] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:21.459361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91f029f1-3aba-4159-b8ae-fcb4cbb1346a tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.460570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-91f029f1-3aba-4159-b8ae-fcb4cbb1346a tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-846219-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.031950 Jul 20 10:46:21.468288 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 137/327] 10.222.0.79 () {58 vars in 1196 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/n-d-846219-10/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:21.470290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-352a36e4-b37b-4a2a-b784-c12ce87cc03d tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1191795948", "availability_zone": "tempest-test_az-84395995"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.473487 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.473487 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:21.479613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed7efafb-3c7e-4bc9-9915-8c2e9f2b6551 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Calling method '.version_select at 0x7f2c3ff5df70>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.485587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-352a36e4-b37b-4a2a-b784-c12ce87cc03d tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid 82d6657e-10df-4906-8a23-d42c9c0c8a71 for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:21.497160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:21.498581 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-ed7efafb-3c7e-4bc9-9915-8c2e9f2b6551 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed7efafb-3c7e-4bc9-9915-8c2e9f2b6551 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.501666 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'nonexistent_hostname'} Jul 20 10:46:21.503246 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:21.504184 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 10:46:21.505302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.506529 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.507855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed7efafb-3c7e-4bc9-9915-8c2e9f2b6551 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.513714 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ed7efafb-3c7e-4bc9-9915-8c2e9f2b6551 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037897 Jul 20 10:46:21.514833 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 138/328] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 10:46:21.529776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07c3fe54-8536-40bd-9c61-447dab82d598 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Calling method '.version_select at 0x7f2c3ff5d550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.534688 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.534688 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.538179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-07c3fe54-8536-40bd-9c61-447dab82d598 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '2224ee1ac1f54d8f8c27dcdc9010fdc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a5ecf6dfb64a2f946585372205f757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07c3fe54-8536-40bd-9c61-447dab82d598 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Request method failure captured: Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/n-d-846219-10/startup HTTP/1.1 Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z4_IfXGlh-um1-_kT3-B1ftWckwaznABy9juR_0wzERYQyRsQFoDTlyJDP92raN_3NLFDY4Uqz0-OtgPzt3t7Gd7c4xLDMDKbGzcrwvIgpHnIdc_cUWBz5VAWN5E_Vxi8-sAbCsipbKoebWdkiHo5umv2Ls1Y7sVSG9qLVenCGd3k Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:21.541326 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5a5ecf6dfb64a2f946585372205f757", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2224ee1ac1f54d8f8c27dcdc9010fdc2 Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10'} Jul 20 10:46:21.542458 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.543423 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 20 10:46:21.544413 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.549574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07c3fe54-8536-40bd-9c61-447dab82d598 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.553099 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07c3fe54-8536-40bd-9c61-447dab82d598 tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-846219-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.031308 Jul 20 10:46:21.554999 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 139/329] 10.222.0.79 () {58 vars in 1193 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/n-d-846219-10/startup => generated 110 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:21.573621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-450e6939-61ae-4821-b157-8593aa8a1e19 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Calling method '.version_select at 0x7f2c3fdc8430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.574046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-352a36e4-b37b-4a2a-b784-c12ce87cc03d tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.111026 Jul 20 10:46:21.578587 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 191/330] 10.222.0.79 () {60 vars in 1164 bytes} [Wed Jul 20 10:46:21 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:21.588774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5ea72091-e63f-48cb-8248-3e9c08ec8016 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1191795948_new", "availability_zone": "tempest-test_az-84395995_new"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.598797 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-450e6939-61ae-4821-b157-8593aa8a1e19 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-450e6939-61ae-4821-b157-8593aa8a1e19 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.600757 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'nonexistent_hostname'} Jul 20 10:46:21.602122 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:21.603194 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 20 10:46:21.604369 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.605974 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.608654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-450e6939-61ae-4821-b157-8593aa8a1e19 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.609660 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-450e6939-61ae-4821-b157-8593aa8a1e19 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.049086 Jul 20 10:46:21.618839 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 140/331] 10.222.0.79 () {58 vars in 1214 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:21.628947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18cb22de-9fc2-4a67-abed-14e0b89ab32e tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4eb4bee0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18cb22de-9fc2-4a67-abed-14e0b89ab32e tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/os-hosts/n-d-846219-10 HTTP/1.1 Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 51 Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.633151 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: {"status": "enable", "maintenance_mode": "invalid"} Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.634329 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance: Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.635055 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.636454 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.638119 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.638119 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:46:21.638119 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:46:21.638119 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.638119 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.642215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18cb22de-9fc2-4a67-abed-14e0b89ab32e tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.643458 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-18cb22de-9fc2-4a67-abed-14e0b89ab32e tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-846219-10" status: 400 len: 199 microversion: 2.1 time: 0.018482 Jul 20 10:46:21.644612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 141/332] 10.222.0.79 () {60 vars in 1189 bytes} [Wed Jul 20 10:46:21 2022] PUT /compute/v2.1/os-hosts/n-d-846219-10 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 10:46:21.653987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8526c12-38df-4061-ab37-cb8b310cb322 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3fdc83a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8526c12-38df-4061-ab37-cb8b310cb322 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/os-hosts/n-d-846219-10 HTTP/1.1 Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 51 Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.656879 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: {"status": "invalid", "maintenance_mode": "enable"} Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.658037 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance: Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.658737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.660067 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.661062 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.661062 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:46:21.661062 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:46:21.661062 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 20 10:46:21.661062 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.672851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8526c12-38df-4061-ab37-cb8b310cb322 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.674068 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d8526c12-38df-4061-ab37-cb8b310cb322 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-846219-10" status: 400 len: 189 microversion: 2.1 time: 0.024196 Jul 20 10:46:21.674776 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 142/333] 10.222.0.79 () {60 vars in 1189 bytes} [Wed Jul 20 10:46:21 2022] PUT /compute/v2.1/os-hosts/n-d-846219-10 => generated 189 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 10:46:21.685488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86c4c7ee-9183-4f79-aaff-7a582b496cde tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Action: 'update', calling method: .version_select at 0x7f2c3ffdeca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.686970 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.686970 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.688358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-86c4c7ee-9183-4f79-aaff-7a582b496cde tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '2224ee1ac1f54d8f8c27dcdc9010fdc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5a5ecf6dfb64a2f946585372205f757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86c4c7ee-9183-4f79-aaff-7a582b496cde tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Request method failure captured: Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/os-hosts/n-d-846219-10 HTTP/1.1 Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 50 Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z4_IfXGlh-um1-_kT3-B1ftWckwaznABy9juR_0wzERYQyRsQFoDTlyJDP92raN_3NLFDY4Uqz0-OtgPzt3t7Gd7c4xLDMDKbGzcrwvIgpHnIdc_cUWBz5VAWN5E_Vxi8-sAbCsipbKoebWdkiHo5umv2Ls1Y7sVSG9qLVenCGd3k Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:21.690300 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5a5ecf6dfb64a2f946585372205f757", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5a5ecf6dfb64a2f946585372205f757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f5a5ecf6dfb64a2f946585372205f757 Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2098769073 Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2224ee1ac1f54d8f8c27dcdc9010fdc2 Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2098769073-project Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 10:46:21.691535 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.692585 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 20 10:46:21.693642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.712060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86c4c7ee-9183-4f79-aaff-7a582b496cde tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.713333 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86c4c7ee-9183-4f79-aaff-7a582b496cde tempest-HostsAdminNegativeTestJSON-2098769073 tempest-HostsAdminNegativeTestJSON-2098769073-project] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-846219-10" status: 403 len: 111 microversion: 2.1 time: 0.032377 Jul 20 10:46:21.714488 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 143/334] 10.222.0.79 () {60 vars in 1189 bytes} [Wed Jul 20 10:46:21 2022] PUT /compute/v2.1/os-hosts/n-d-846219-10 => generated 111 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:46:21.724194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2b79011-8067-45a6-818a-4de820d13cd6 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3fe47310>, body: {"status": null, "maintenance_mode": null} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2b79011-8067-45a6-818a-4de820d13cd6 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/os-hosts/n-d-846219-10 HTTP/1.1 Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 42 Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:21.727151 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: {"status": null, "maintenance_mode": null} Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 10:46:21.730742 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'n-d-846219-10', 'body': {'status': None, 'maintenance_mode': None}} Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'disable', Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'Enable', Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'Disable', Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance: Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi None Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.732897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.737004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2b79011-8067-45a6-818a-4de820d13cd6 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2b79011-8067-45a6-818a-4de820d13cd6 tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-846219-10" status: 400 len: 127 microversion: 2.1 time: 0.008286 Jul 20 10:46:21.738630 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 144/335] 10.222.0.79 () {60 vars in 1189 bytes} [Wed Jul 20 10:46:21 2022] PUT /compute/v2.1/os-hosts/n-d-846219-10 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:46:21.747745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.756636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:21.767603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:21.768354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:21.769379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:21.770039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:21.779316 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.779316 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:21.829065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:21.829780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:21.830484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lazy-loading 'fault' on Instance uuid ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:46:21.860185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ea72091-e63f-48cb-8248-3e9c08ec8016 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:21.860661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ea72091-e63f-48cb-8248-3e9c08ec8016 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:21.907761 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5ea72091-e63f-48cb-8248-3e9c08ec8016 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 333 microversion: 2.1 time: 0.322899 Jul 20 10:46:21.909309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 192/336] 10.222.0.79 () {60 vars in 1172 bytes} [Wed Jul 20 10:46:21 2022] PUT /compute/v2.1/os-aggregates/17 => generated 333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:21.911806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9508a7f7cd4243a99f2653fbfdacc7dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b1bf8c8a5a41e286cab7c9dd11fee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:21.920028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f9d6e089-3658-4465-9a6b-8fce6e5fe4bb tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4c3ebd30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:21.921741 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.921741 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:21.925874 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.hosts [None req-f9d6e089-3658-4465-9a6b-8fce6e5fe4bb tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Enabling host nonexistent_hostname. Jul 20 10:46:21.928065 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b918235d-7814-48ea-955b-287372f8c45f tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 200 len: 1313 microversion: 2.1 time: 0.190949 Jul 20 10:46:21.943598 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 145/337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:21.945680 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f9d6e089-3658-4465-9a6b-8fce6e5fe4bb tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f9d6e089-3658-4465-9a6b-8fce6e5fe4bb tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Request method failure captured: Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 50 Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z6DajLy6Wgk86QTDizmK3DCwqll5cYWm_c-KCRwkz7w5uluIsJd2SzJkCQpdX3RyEO53gPO54An1jUO-852gkQ6OlsgiaFhGdWSkdUXX3xz35_h2l99eWOYj2D2wOJQcGXoCsrMP5Vo-ZrB3miDNz-fAiEp5R36Y68cudG_-w6TbI Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:21.947585 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_35936be3b9ab4cbc91552eefbe429810", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/35936be3b9ab4cbc91552eefbe429810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 35936be3b9ab4cbc91552eefbe429810 Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1772896358 Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 90bd1d1b03e4496b9753ebb3a3418369 Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1772896358-project-admin Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: {"status": "enable", "maintenance_mode": "enable"} Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.948849 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 20 10:46:21.949658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:21.955468 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:21.956984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f9d6e089-3658-4465-9a6b-8fce6e5fe4bb tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:21.957774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f9d6e089-3658-4465-9a6b-8fce6e5fe4bb tempest-HostsAdminNegativeTestJSON-1772896358 tempest-HostsAdminNegativeTestJSON-1772896358-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038728 Jul 20 10:46:21.957774 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 193/338] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:46:21 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:21.959203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c78ff2df-0270-4e35-b3a2-37c3c7f828b6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.960161 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.960161 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:21.978059 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c78ff2df-0270-4e35-b3a2-37c3c7f828b6 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.032215 Jul 20 10:46:21.979345 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 146/339] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:46:21 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:21.990723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c4c7220a-2475-4527-88ac-d295279ca60c tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:21.991565 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:21.991565 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:22.036665 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c4c7220a-2475-4527-88ac-d295279ca60c tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.049682 Jul 20 10:46:22.037267 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 194/340] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:21 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:22.052774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a7d21c7-c647-4a95-85b8-84d072572a33 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-619798968"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:22.054701 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:22.054701 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:22.056350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.aggregate [None req-9a7d21c7-c647-4a95-85b8-84d072572a33 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Generated uuid 87e97cc5-0b20-4456-81b9-349b59c66eb2 for aggregate {{(pid=125886) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 10:46:22.122632 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a7d21c7-c647-4a95-85b8-84d072572a33 tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076724 Jul 20 10:46:22.123534 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 147/341] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 10:46:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:22.133402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-580be020-7242-4f07-940b-fd2f6fd2e42e tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.134419 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:22.134419 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:22.156195 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-580be020-7242-4f07-940b-fd2f6fd2e42e tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.026391 Jul 20 10:46:22.157274 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 195/342] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:46:22 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:22.167612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-993e6e35-81d3-49ed-bc25-168b7880bcbf tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.169519 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:22.169519 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:22.213757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.214523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:22.241419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.241866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.254275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.257655 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-993e6e35-81d3-49ed-bc25-168b7880bcbf tempest-AggregatesAdminTestJSON-2022327816 tempest-AggregatesAdminTestJSON-2022327816-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.093568 Jul 20 10:46:22.262204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.270275 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 148/343] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:46:22 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 10:46:22.279446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.279947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:22.295420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.297701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.302661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.303326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.339884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] HTTP exception thrown: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Request method failure captured: Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 HTTP/1.1 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zIvU8qXeB8fC5ATgr4C1ayAbA6YY0KiptcFGi9gz6EGo8TD8Kamskie3wPGWqlVqgRDlLbKX9keBqwVDjVOOZeW6qdoc-G3OR0z4g4J3kDDRe5u-fR2eBHsKSqajnkrLy9OCz4jOmnjQsq06XXgScZmAm3xcoYL27chB1KSvsaDC0 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 7fd2c3ca2ac64585b32cb3fea94f6127 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:22.345860 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7fd2c3ca2ac64585b32cb3fea94f6127", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 7fd2c3ca2ac64585b32cb3fea94f6127 Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminTestJSON-1114663467-project Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: dc843169b8a742b28d9a94c86a8abebd Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminTestJSON-1114663467-project Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.347380 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '4fec40f4-bb0e-40f1-a1fd-35ea10379155'} Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:22.348154 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.349408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.350863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Returning 404 to user: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:22.350863 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-27bfcb93-ea19-4654-847f-e5988ff957ab tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 404 len: 111 microversion: 2.1 time: 0.074767 Jul 20 10:46:22.350863 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 149/344] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:46:22 2022] DELETE /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:22.361709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.362331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] [instance: 4fec40f4-bb0e-40f1-a1fd-35ea10379155] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:22.377280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.377818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.378610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.379056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.398746 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] HTTP exception thrown: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Request method failure captured: Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 HTTP/1.1 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zIvU8qXeB8fC5ATgr4C1ayAbA6YY0KiptcFGi9gz6EGo8TD8Kamskie3wPGWqlVqgRDlLbKX9keBqwVDjVOOZeW6qdoc-G3OR0z4g4J3kDDRe5u-fR2eBHsKSqajnkrLy9OCz4jOmnjQsq06XXgScZmAm3xcoYL27chB1KSvsaDC0 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 7fd2c3ca2ac64585b32cb3fea94f6127 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:22.412763 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7fd2c3ca2ac64585b32cb3fea94f6127", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7fd2c3ca2ac64585b32cb3fea94f6127"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 7fd2c3ca2ac64585b32cb3fea94f6127 Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1114663467 Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AggregatesAdminTestJSON-1114663467-project Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: dc843169b8a742b28d9a94c86a8abebd Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AggregatesAdminTestJSON-1114663467-project Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.414053 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '4fec40f4-bb0e-40f1-a1fd-35ea10379155'} Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:22.414706 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. Jul 20 10:46:22.416105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:22.417060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] Returning 404 to user: Instance 4fec40f4-bb0e-40f1-a1fd-35ea10379155 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:22.417060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d686f54e-733e-4f9a-af68-c8ff57988fc0 tempest-AggregatesAdminTestJSON-1114663467 tempest-AggregatesAdminTestJSON-1114663467-project] 10.222.0.79 "GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155" status: 404 len: 111 microversion: 2.1 time: 0.056527 Jul 20 10:46:22.417060 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 150/345] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:22 2022] GET /compute/v2.1/servers/4fec40f4-bb0e-40f1-a1fd-35ea10379155 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:22.431975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.432858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:22.446231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.446966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.447989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.448585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.655567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:22.683290 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-89d5df24-293d-4003-9157-2c538acfc6f5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1212 microversion: 2.1 time: 0.267166 Jul 20 10:46:22.687387 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 151/346] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:22 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1212 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:22.766548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:22.778968 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50a5827c-27b6-4cd0-9ca3-12227d5dfcbc tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.580859 Jul 20 10:46:22.795961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 196/347] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:22 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:22.950152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:22.952100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] [instance: ccedb4a1-b3db-4e61-abe1-f45ea05f29d4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:22.966645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.979947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:22.981306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:22.982013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:23.007622 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] HTTP exception thrown: Instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 could not be found. Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Request method failure captured: Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 HTTP/1.1 Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zp7qX-xMW2yrYvQyhqFeJ95wA5oKkK8eia3BL88QxoCPEBnYTogB_GgrmrN1WxIlNl6ti3-KqDoowr0tyqDombopEahNKO9JMVmXs-eA49iiUIj_pRijpPAaZ6x5fBHikjCDFRx8yAmhNoPf01aGK2j0tIZLIYGL2iHemCYezdKYQ Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 88b1bf8c8a5a41e286cab7c9dd11fee8 Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-741252761 Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:23.009500 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_88b1bf8c8a5a41e286cab7c9dd11fee8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/88b1bf8c8a5a41e286cab7c9dd11fee8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/88b1bf8c8a5a41e286cab7c9dd11fee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/88b1bf8c8a5a41e286cab7c9dd11fee8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-741252761 Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 88b1bf8c8a5a41e286cab7c9dd11fee8 Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-741252761 Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiagnosticsNegativeTest-741252761-project Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9508a7f7cd4243a99f2653fbfdacc7dc Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-741252761-project Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 could not be found. Jul 20 10:46:23.010709 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ccedb4a1-b3db-4e61-abe1-f45ea05f29d4'} Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 could not be found. Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:23.011415 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 could not be found. Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 could not be found. Jul 20 10:46:23.013374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:23.024277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] Returning 404 to user: Instance ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:23.025364 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ce1fc7f-05b4-4c49-ab13-4d5b39fa92ad tempest-ServerDiagnosticsNegativeTest-741252761 tempest-ServerDiagnosticsNegativeTest-741252761-project] 10.222.0.79 "GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4" status: 404 len: 111 microversion: 2.1 time: 0.081017 Jul 20 10:46:23.030069 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 152/348] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:22 2022] GET /compute/v2.1/servers/ccedb4a1-b3db-4e61-abe1-f45ea05f29d4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:23.704279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:23.706665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:23.714394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:23.716487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:23.717547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:23.719321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:23.813536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:23.814472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:23.821798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:23.822582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:23.823617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:23.824267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:23.872704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:23.883322 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d466ecf5-0f35-49a7-a50a-a14987d01c17 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1274 microversion: 2.1 time: 0.183351 Jul 20 10:46:23.884628 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 197/349] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:23 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:24.070470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-066b6785-6173-4421-bf55-27615a918507 req-e87148c4-cf5a-4671-937a-bfb92c646515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b15803-72a1-4a48-87dd-eeb427bbfdec", "tag": "56392252-c119-4b8f-9072-028ffb05b53e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:24.090906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-066b6785-6173-4421-bf55-27615a918507 req-e87148c4-cf5a-4671-937a-bfb92c646515 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:24.091945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-066b6785-6173-4421-bf55-27615a918507 req-e87148c4-cf5a-4671-937a-bfb92c646515 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:24.114914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-066b6785-6173-4421-bf55-27615a918507 req-e87148c4-cf5a-4671-937a-bfb92c646515 service nova] Creating event network-changed:56392252-c119-4b8f-9072-028ffb05b53e for instance 27b15803-72a1-4a48-87dd-eeb427bbfdec on n-h1-846219-10 Jul 20 10:46:24.132878 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-066b6785-6173-4421-bf55-27615a918507 req-e87148c4-cf5a-4671-937a-bfb92c646515 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087100 Jul 20 10:46:24.134156 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 198/350] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:24.334512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:24.347713 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25341514-b1b5-43e8-9d09-ca3fcf8b51a4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.534683 Jul 20 10:46:24.349194 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 153/351] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:23 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:24.898916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=11 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:24.904830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:24.905933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:24.929541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:24.929985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:24.931286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:24.931986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:25.272106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:25.299898 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da56b645-6810-4a24-aef3-0f37a4bd1dec tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1274 microversion: 2.1 time: 0.400756 Jul 20 10:46:25.302370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 199/352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:24 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1274 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:25.366968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:25.371726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:25.378141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:25.378586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:25.379393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:25.379824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:25.972190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:25.985625 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c0548bd0-5dcf-4c3b-9287-2278dd2eaf58 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.620074 Jul 20 10:46:25.986963 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 154/353] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:25 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:26.318301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:26.318918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:26.329246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:26.329705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:26.330504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:26.330948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:27.003943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:27.006543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:27.024187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:27.025639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:27.032100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:27.033188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:27.048857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:27.069190 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f5cd957-03ac-4ae3-b79f-f039ee557c05 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 0.754944 Jul 20 10:46:27.078485 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 200/354] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:26 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:27.820609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:27.841340 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-12c4c271-12a2-4998-bd31-486b67dc8388 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.834672 Jul 20 10:46:27.841340 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 155/355] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:26 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:28.099939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:28.108988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:28.131338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:28.134626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:28.143950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:28.146795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:28.694376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:28.704474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6ff1722-2cf0-4ccd-81ac-84626c4fb1d6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 0.612186 Jul 20 10:46:28.717270 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 201/356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:28 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:28.852816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:28.853534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:28.863322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:28.863788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:28.864581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:28.865016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:29.489146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:29.500530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d58dc47-bc4d-431d-873b-137755fc9497 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.652336 Jul 20 10:46:29.502365 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 156/357] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:28 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:29.724791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:29.725409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:29.755427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:29.763032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:29.764650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:29.768215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:30.003461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-03b39e5a-6ab7-49f7-af44-1e4a0e28781f req-b4c6a761-ec42-440e-8061-54601fa1a8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bfeb30c-e126-4abd-9c33-c2ae07eec3e7", "tag": "9e7bc227-f680-4766-b539-3d8116769482"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:30.057657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-03b39e5a-6ab7-49f7-af44-1e4a0e28781f req-b4c6a761-ec42-440e-8061-54601fa1a8a0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:30.060585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-03b39e5a-6ab7-49f7-af44-1e4a0e28781f req-b4c6a761-ec42-440e-8061-54601fa1a8a0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:30.093292 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-03b39e5a-6ab7-49f7-af44-1e4a0e28781f req-b4c6a761-ec42-440e-8061-54601fa1a8a0 service nova] Creating event network-changed:9e7bc227-f680-4766-b539-3d8116769482 for instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 on n-h2-846219-10 Jul 20 10:46:30.108160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-03b39e5a-6ab7-49f7-af44-1e4a0e28781f req-b4c6a761-ec42-440e-8061-54601fa1a8a0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112294 Jul 20 10:46:30.114355 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 157/358] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:46:30.522187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:30.523112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:30.549362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:30.551395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:30.553800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:30.554249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:30.926275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:30.990357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:31.353125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=36 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:31.512711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:31.522237 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f6c12ee-131d-46d9-bc96-7adf31163e52 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 1.801283 Jul 20 10:46:31.537232 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 202/359] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:29 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:31.764964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:31.779629 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-63a71e52-5414-48ca-91ef-027ba4183322 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 1.260679 Jul 20 10:46:31.783918 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 158/360] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:30 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:32.248751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Calling method '.version_select at 0x7f2c4c3eb310>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:32.249689 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:32.249689 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:32.262579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:32.263856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:32.294592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:32.299021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:32.337840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:32.341117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:32.359357 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e18c5543-ea49-4f1e-8e46-cd3b7774ee5e tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.821238 Jul 20 10:46:32.362764 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 203/361] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:32.494424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1420262265", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:32.600684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:46:33.088681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51417060-385c-4b35-8306-67cd3a935605 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Calling method '.version_select at 0x7f2c4c4d1430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:33.089725 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:33.089725 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:33.092185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51417060-385c-4b35-8306-67cd3a935605 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '819be4010c4f4816a2f2e14a80c7c989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2928a5a7713463e895d095219a4221e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51417060-385c-4b35-8306-67cd3a935605 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Request method failure captured: Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/n-h2-846219-10/search HTTP/1.1 Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190DFhTtb0xYgs-8B0Vu-SDsjPI0gm8dAc1uZRfBAm5QgLVuNUORxin9ypUSX51Bl49jUIrecxSvo1fJ8EtEYwkiiFTyjUfv-ySM_KLdRD0mAgNdaPocEJ7cehJTr-efh7BeFScRDR519trVA-R9mm2pEZMvPDbBhnYabWKkdPHw4jM Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e2928a5a7713463e895d095219a4221e Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1776641136 Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:33.094055 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2928a5a7713463e895d095219a4221e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2928a5a7713463e895d095219a4221e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2928a5a7713463e895d095219a4221e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2928a5a7713463e895d095219a4221e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1776641136 Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e2928a5a7713463e895d095219a4221e Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1776641136 Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 819be4010c4f4816a2f2e14a80c7c989 Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 10:46:33.095489 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'n-h2-846219-10'} Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:33.096168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 20 10:46:33.097230 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:33.103223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51417060-385c-4b35-8306-67cd3a935605 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:33.104452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51417060-385c-4b35-8306-67cd3a935605 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-846219-10/search" status: 403 len: 117 microversion: 2.1 time: 0.731886 Jul 20 10:46:33.107894 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 204/362] 10.222.0.79 () {58 vars in 1211 bytes} [Wed Jul 20 10:46:32 2022] GET /compute/v2.1/os-hypervisors/n-h2-846219-10/search => generated 117 bytes in 737 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:46:33.134473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:33.135581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:33.157749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:33.158580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:33.159616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:33.160259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:33.721704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:33.722297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:33.722880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:33.723480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:33.724050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:33.755059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:33.756058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:33.761637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:33.765594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:33.811225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Getting quotas for project c0bd00fa22af486ba7cf6d4330b3ef6b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:46:33.826240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:33.837627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Getting quotas for user 3698cfa68fe544aaa91f4ed4e1025685 and project c0bd00fa22af486ba7cf6d4330b3ef6b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:46:33.863417 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0fc3c721-35ea-4952-aecf-c7b24496d1fc tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 0.752211 Jul 20 10:46:33.866654 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 205/363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:33 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:33.884414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:46:33.887968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:46:33.888220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:33.894687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:33.903985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:33.905634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:33.906481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:33.906928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:33.981216 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dc523f1b-7668-4949-8dc7-f77b038217da tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.195749 Jul 20 10:46:33.983075 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 159/364] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:46:33.999903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Calling method '.version_select at 0x7f2c3fe57af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:34.001064 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:34.001064 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:34.002502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:34.003038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:34.021183 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Request method failure captured: Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190Gmu18SBR23XcjFD7yTW9qPUqjGXLiGjnMrhIvvFKPLJ3Wb94Ftur53HB0Reein5FqABSjMgkks0ZQgaZ4cl_gF1_DIkTQNOTsW_5-Fmx9Jv02T6KGTi1rB9YIjlXU3m6GlHW_rudqVoJ2oj2W7QwU7KTESPQ9kJS1P-5k1cMIbCQ Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 467368531ba64dd6b57af15c111820ee Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1106423945 Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:34.022795 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_467368531ba64dd6b57af15c111820ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/467368531ba64dd6b57af15c111820ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/467368531ba64dd6b57af15c111820ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/467368531ba64dd6b57af15c111820ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1106423945 Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 467368531ba64dd6b57af15c111820ee Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1106423945 Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: d264cd20312d4503bea72f46d1e7fdf8 Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 10:46:34.023973 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:34.024726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:34.026426 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:34.026426 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:34.026426 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:34.026426 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 20 10:46:34.026426 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:34.028285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:34.032087 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-034da87b-9f7a-44ee-96e6-d19a7e1a3eed tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.047495 Jul 20 10:46:34.040982 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 160/365] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 10:46:33 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:34.286604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1171595653", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": "none"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:34.446680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:34.452193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:34.457906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:34.458831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:34.460545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:34.489530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:34.490325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:34.492099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:34.494820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:34.549475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Getting quotas for project 01f1a82236cf47aa9e938840fbdd6e26. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:46:34.556017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Getting quotas for user a8dd32546c094ab689705aec3c4c7659 and project 01f1a82236cf47aa9e938840fbdd6e26. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:46:34.603000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:46:34.608111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:46:34.699940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:DELETE=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:34.770580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ce446ab-8741-42fe-af14-2d6d4c555298 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.732088 Jul 20 10:46:34.773681 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 161/366] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:46:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:46:34.790019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a0ed05e-ad58-4a41-91dd-a7b53d4e2861 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:34.790645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a0ed05e-ad58-4a41-91dd-a7b53d4e2861 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:34.841766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:34.853538 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e65c93b-6c9c-4aa7-9d92-366c04e48bdb tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.984200 Jul 20 10:46:34.855017 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 206/367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:33 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:34.870155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Calling method '.version_select at 0x7f2c4c6f81f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:34.872889 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:34.872889 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:34.877460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:34.879753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:34.935414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:34.939147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:34.992535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:34.997993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:35.024478 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3437e514-8434-48df-b0a5-5056bc790f4d tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.167158 Jul 20 10:46:35.039042 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 207/368] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:46:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:35.045092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3577c3f-a700-424c-b35b-1841e471d517 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:35.046649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3577c3f-a700-424c-b35b-1841e471d517 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:35.195573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9a0ed05e-ad58-4a41-91dd-a7b53d4e2861 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.225601 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a0ed05e-ad58-4a41-91dd-a7b53d4e2861 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1220 microversion: 2.1 time: 0.450516 Jul 20 10:46:35.226090 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 162/369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:34 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1220 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:35.248360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3577c3f-a700-424c-b35b-1841e471d517 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.260294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:35.261022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:35.272804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3577c3f-a700-424c-b35b-1841e471d517 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.279559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3577c3f-a700-424c-b35b-1841e471d517 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.311275 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3577c3f-a700-424c-b35b-1841e471d517 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "PUT /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1359 microversion: 2.75 time: 0.272475 Jul 20 10:46:35.311913 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 208/370] 10.222.0.79 () {62 vars in 1296 bytes} [Wed Jul 20 10:46:35 2022] PUT /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:35.320735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0164ac06-f785-449f-bfd6-e293704d0894 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Calling method '.version_select at 0x7f2c4c2f6d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:35.321551 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:35.321551 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:35.322635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0164ac06-f785-449f-bfd6-e293704d0894 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '819be4010c4f4816a2f2e14a80c7c989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2928a5a7713463e895d095219a4221e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.333972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:35.335093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:35.336467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:35.341879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0164ac06-f785-449f-bfd6-e293704d0894 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Request method failure captured: Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190DFhTtb0xYgs-8B0Vu-SDsjPI0gm8dAc1uZRfBAm5QgLVuNUORxin9ypUSX51Bl49jUIrecxSvo1fJ8EtEYwkiiFTyjUfv-ySM_KLdRD0mAgNdaPocEJ7cehJTr-efh7BeFScRDR519trVA-R9mm2pEZMvPDbBhnYabWKkdPHw4jM Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e2928a5a7713463e895d095219a4221e Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1776641136 Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:35.348108 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e2928a5a7713463e895d095219a4221e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2928a5a7713463e895d095219a4221e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e2928a5a7713463e895d095219a4221e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e2928a5a7713463e895d095219a4221e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1776641136 Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e2928a5a7713463e895d095219a4221e Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1776641136 Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 819be4010c4f4816a2f2e14a80c7c989 Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 10:46:35.350517 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1'} Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:35.352109 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 20 10:46:35.354281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:35.357441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0164ac06-f785-449f-bfd6-e293704d0894 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:35.357441 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0164ac06-f785-449f-bfd6-e293704d0894 tempest-HypervisorAdminNegativeUnderV252Test-1776641136 tempest-HypervisorAdminNegativeUnderV252Test-1776641136-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.036294 Jul 20 10:46:35.357441 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 209/371] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:46:35 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:35.363806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6694b77-f14d-4e24-8b0e-871d1e91d1ea tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:35.364591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6694b77-f14d-4e24-8b0e-871d1e91d1ea tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:35.703097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6694b77-f14d-4e24-8b0e-871d1e91d1ea tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.743249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6694b77-f14d-4e24-8b0e-871d1e91d1ea tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.751926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6694b77-f14d-4e24-8b0e-871d1e91d1ea tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:35.765608 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6694b77-f14d-4e24-8b0e-871d1e91d1ea tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1359 microversion: 2.75 time: 0.402141 Jul 20 10:46:35.767516 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 210/372] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:35 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1359 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:35.781711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Calling method '.version_select at 0x7f2c4c4e3940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:35.787051 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:35.787051 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:35.791550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:35.798047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:35.820161 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] HTTP exception thrown: No hypervisor matching '1af23c50-eaad-48cb-8c32-7aa53ec44201' could be found. Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Request method failure captured: Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-hypervisors/1af23c50-eaad-48cb-8c32-7aa53ec44201/servers HTTP/1.1 Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190Gmu18SBR23XcjFD7yTW9qPUqjGXLiGjnMrhIvvFKPLJ3Wb94Ftur53HB0Reein5FqABSjMgkks0ZQgaZ4cl_gF1_DIkTQNOTsW_5-Fmx9Jv02T6KGTi1rB9YIjlXU3m6GlHW_rudqVoJ2oj2W7QwU7KTESPQ9kJS1P-5k1cMIbCQ Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 467368531ba64dd6b57af15c111820ee Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1106423945 Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:35.830587 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_467368531ba64dd6b57af15c111820ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/467368531ba64dd6b57af15c111820ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/467368531ba64dd6b57af15c111820ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/467368531ba64dd6b57af15c111820ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1106423945 Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 467368531ba64dd6b57af15c111820ee Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1106423945 Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d264cd20312d4503bea72f46d1e7fdf8 Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: exception: No hypervisor matching '1af23c50-eaad-48cb-8c32-7aa53ec44201' could be found. Jul 20 10:46:35.832407 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1af23c50-eaad-48cb-8c32-7aa53ec44201'} Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1af23c50-eaad-48cb-8c32-7aa53ec44201' could be found. Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:35.833087 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:35.834127 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:35.834127 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:35.834127 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:35.834127 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:35.834127 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1af23c50-eaad-48cb-8c32-7aa53ec44201' could be found. Jul 20 10:46:35.834127 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:35.838878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] Returning 404 to user: No hypervisor matching '1af23c50-eaad-48cb-8c32-7aa53ec44201' could be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:35.845721 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f18b84c-1d93-418a-84dc-ca659828aed5 tempest-HypervisorAdminNegativeUnderV252Test-1106423945 tempest-HypervisorAdminNegativeUnderV252Test-1106423945-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1af23c50-eaad-48cb-8c32-7aa53ec44201/servers" status: 404 len: 123 microversion: 2.1 time: 0.074790 Jul 20 10:46:35.849271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 211/373] 10.222.0.79 () {58 vars in 1280 bytes} [Wed Jul 20 10:46:35 2022] GET /compute/v2.1/os-hypervisors/1af23c50-eaad-48cb-8c32-7aa53ec44201/servers => generated 123 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:35.880156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:35.881469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:35.899239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:35.903297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:35.906868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:35.907762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:35.976153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:36.330110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:36.338331 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c7fcdbb-a754-4de7-ad38-b0b09a95c3a3 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 1.095623 Jul 20 10:46:36.359755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 163/374] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:35 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:36.379834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8624f2f3-7b39-45a3-ab13-5d642f1afcfb req-4f8ddeec-f6f6-4a3f-8091-790831cb4d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b15803-72a1-4a48-87dd-eeb427bbfdec", "name": "network-vif-plugged", "status": "completed", "tag": "56392252-c119-4b8f-9072-028ffb05b53e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:36.407296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8624f2f3-7b39-45a3-ab13-5d642f1afcfb req-4f8ddeec-f6f6-4a3f-8091-790831cb4d21 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:36.412558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8624f2f3-7b39-45a3-ab13-5d642f1afcfb req-4f8ddeec-f6f6-4a3f-8091-790831cb4d21 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:36.432000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:36.456240 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5b77547e-fffb-4267-9691-e1a2dc6daef7 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 0.587849 Jul 20 10:46:36.465933 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8624f2f3-7b39-45a3-ab13-5d642f1afcfb req-4f8ddeec-f6f6-4a3f-8091-790831cb4d21 service nova] Creating event network-vif-plugged:56392252-c119-4b8f-9072-028ffb05b53e for instance 27b15803-72a1-4a48-87dd-eeb427bbfdec on n-h1-846219-10 Jul 20 10:46:36.466639 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 212/375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:35 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:36.485311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:36.487512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:36.489137 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8624f2f3-7b39-45a3-ab13-5d642f1afcfb req-4f8ddeec-f6f6-4a3f-8091-790831cb4d21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123905 Jul 20 10:46:36.493407 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 164/376] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:36.503924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:36.504551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:36.505518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:36.506178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:36.794080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:36.795379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:36.815204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:36.816111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:36.820294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:36.821351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:36.906152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:36.933075 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0ef4b1aa-4e1d-48c0-bfd9-bff656b10219 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1272 microversion: 2.1 time: 0.463610 Jul 20 10:46:36.935634 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 213/377] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:36 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1272 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:37.310241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:37.326182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:37.330785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:37.364737 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-326d033c-8e58-48eb-a18b-21690686c270 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1355 microversion: 2.75 time: 0.577128 Jul 20 10:46:37.366258 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 165/378] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:36 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1355 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:46:37.397791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:37.398444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:37.425256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:37.426603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:37.431925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:37.434791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:37.488800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:37.489852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:37.510975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:37.511611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:37.514397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:37.522590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:37.535991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:39.031843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:39.051412 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d91b3da-6c3a-4579-aceb-2d0351443ffe tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1318 microversion: 2.1 time: 1.569732 Jul 20 10:46:39.059701 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 166/379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:37 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1318 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:39.072008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:39.076697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:39.097364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:39.098569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:39.100171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:39.101201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:39.193571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:39.214056 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0e749e2-695c-4b6d-b2de-40539ad8316a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 1.832699 Jul 20 10:46:39.244125 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 214/380] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:37 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:39.269695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:39.272485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:39.301971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:39.302784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:39.303880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:39.305263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:39.459753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:39.490211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:39.499524 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d9922d81-1f78-4c57-815d-ce5d36bc2b15 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1278 microversion: 2.1 time: 0.436059 Jul 20 10:46:39.502871 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 167/381] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:39 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1278 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:39.510266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:39.512789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:39.530434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-622b2363-ccd4-4bb6-9a29-d4b5a5d4bc74 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1417 microversion: 2.75 time: 0.284288 Jul 20 10:46:39.531244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 215/382] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:39 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1417 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:40.093631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:40.095972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:40.169611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.171351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.181256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.188368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.259566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:40.260211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:40.275206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.275862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.276884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.278066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.773991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:40.790643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3d36204-20cb-4e10-bd6a-c5748ec276ab tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1467 microversion: 2.1 time: 0.707037 Jul 20 10:46:40.791304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 168/383] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:40 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1467 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:40.805828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:40.806810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:40.824467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.827044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.828856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.833521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.897597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:40.912221 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7a99b037-71bd-453e-9959-3e74190bb523 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 0.657105 Jul 20 10:46:40.922179 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 216/384] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:40 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:40.922317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:40.922860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:40.942893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.943415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:40.944277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:40.944709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.078291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:41.099869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-791fc2ba-0920-4a32-abcf-fddbe30ff844 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1278 microversion: 2.1 time: 0.292056 Jul 20 10:46:41.101199 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 169/385] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:40 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1278 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:41.106668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:41.111201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:41.135901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.136347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.137444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.138058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.199432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:41.244456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:41.248532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:41.261032 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba9d7338-048d-4cd6-b65c-52a567f13f7b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1438 microversion: 2.75 time: 0.345838 Jul 20 10:46:41.264306 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 217/386] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:40 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1438 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:41.269286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lazy-loading 'flavor' on Instance uuid 27b15803-72a1-4a48-87dd-eeb427bbfdec {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:46:41.284923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:41.286838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:41.297978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.307397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.308633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.309283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.481619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:41.482044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:41.482513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:41.482917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:41.483360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:41.532942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01d62ff5-6b06-4074-b2be-c36b8efda99a tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec/action" status: 202 len: 0 microversion: 2.1 time: 0.430275 Jul 20 10:46:41.533609 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 170/387] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:46:41 2022] POST /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:46:41.544181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:41.545019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:41.561659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.562322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.568509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.569207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.638726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:41.662042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.664265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.666091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:41.667651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:41.984596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:41.993605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:41.995542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:42.003655 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dced16b0-6b31-4bb4-9367-522b42b94e39 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "POST /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c/action" status: 202 len: 1495 microversion: 2.75 time: 0.723042 Jul 20 10:46:42.005418 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 218/388] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:46:41 2022] POST /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c/action => generated 1495 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 20 10:46:42.010342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:42.011225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:42.029412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:42.033170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:42.034268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:42.039537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:42.268393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:42.284512 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fddb305a-0480-4304-b8d5-a21453e8b181 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1475 microversion: 2.1 time: 0.739204 Jul 20 10:46:42.284512 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 171/389] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:41 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1475 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:42.290886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:42.296045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:42.314866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:42.315624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:42.318391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:42.318913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:42.814977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:42.832649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:42.835405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:42.846252 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c38c5c49-ebdb-41f9-ae47-af0b6312b444 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.560516 Jul 20 10:46:42.848329 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 172/390] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:42 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:42.872323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:42.874068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:42.888309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:42.889693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:42.893584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:42.895288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:43.439439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:43.453533 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4361d972-2523-409b-a2c6-6f47b90cb2fd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 1.446727 Jul 20 10:46:43.466915 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 219/391] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:42 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:43.472382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:43.478150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:43.497753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:43.498558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:43.499566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:43.512794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:43.827050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:43.854830 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-201d8982-a2dc-4784-9eb8-121a1c75b078 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 0.993532 Jul 20 10:46:43.860657 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 173/392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:42 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:43.905349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:43.911463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:43.929003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:43.932003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:43.933815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:43.952636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:44.127861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:44.143903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:44.211663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:44.228960 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3fcc601d-2662-4473-8987-9d0bf9eb9b9b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.349642 Jul 20 10:46:44.233357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 174/393] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:43 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:44.278357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:44.308417 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aeb7b23d-5f7c-4886-b6a7-d397cdb4c9f8 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1458 microversion: 2.1 time: 0.839824 Jul 20 10:46:44.322394 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 220/394] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:43 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1458 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:44.328598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:44.330322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:44.339861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:44.341039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:44.342776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:44.343790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:44.475838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:44.476401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:44.490746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:44.491250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:44.492071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:44.492512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:44.518932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:45.218588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:45.369449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:45.379578 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5704c008-9523-47d3-b838-b2bba6cf66ed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 0.908980 Jul 20 10:46:45.380735 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 221/395] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:44 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:45.407230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:45.407939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:45.427772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:45.428230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:45.429641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:45.430495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:45.729768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:46.378557 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a290f250-54c1-440f-ac0d-8c9dbe60c119 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1611 microversion: 2.1 time: 2.054379 Jul 20 10:46:46.383241 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 175/396] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:44 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1611 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:46:46.398119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:46.404137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:46.420920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:46.422865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:46.427131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:46.427705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:46.491995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:46.522715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-02b446f5-ece1-4228-be9b-807c266fd5f5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 1.137727 Jul 20 10:46:46.523878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 222/397] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:45 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:46.537582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:46.549484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:46.564231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:46.595057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:46.596292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:46.599622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:46.613787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:46.809044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:46.832395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:46.845717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:46.871371 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15fbca93-3a0a-450d-8139-a5eb8a7cdbcb tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.485875 Jul 20 10:46:46.874247 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 176/398] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:46 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:46.906706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f82ce89-fa14-4eb8-b8d8-65b13b2e5336 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:46.908688 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:46.908688 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:46.934981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f82ce89-fa14-4eb8-b8d8-65b13b2e5336 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:46.936571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f82ce89-fa14-4eb8-b8d8-65b13b2e5336 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:46.940667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f82ce89-fa14-4eb8-b8d8-65b13b2e5336 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:46.947224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f82ce89-fa14-4eb8-b8d8-65b13b2e5336 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:47.049795 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f82ce89-fa14-4eb8-b8d8-65b13b2e5336 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.173182 Jul 20 10:46:47.053232 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 177/399] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:46:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:47.072983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-10", "block_migration": true, "disk_over_commit": false}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:47.076558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:47.087036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:47.090267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:47.109237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:47.109801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:48.759972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Lazy-loading 'flavor' on Instance uuid 27b15803-72a1-4a48-87dd-eeb427bbfdec {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:46:48.815922 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 27b15803-72a1-4a48-87dd-eeb427bbfdec while it is in vm_state suspended Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Request method failure captured: Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec/action HTTP/1.1 Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 98 Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19zT0mp2xo6L-dxfHAmjUF03IjFbwWs4KkXwk1-y75jsvlCZfPmgA2ncoKnU22SYCchOjsQIir9LUpSbWcWZp17b0d6_JjZ7luAl_LNCSCKqkiDwUFCP4ZzGvsUirYxKfvtH4oUxJXygyZg5VeBGlo3wP9C5fTaXMPP0518r1SbSIMs Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5b57fc0e940d4dad87b784860095a1bc Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-LiveMigrationNegativeTest-9403671 Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:46:48.821875 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5b57fc0e940d4dad87b784860095a1bc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b57fc0e940d4dad87b784860095a1bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b57fc0e940d4dad87b784860095a1bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5b57fc0e940d4dad87b784860095a1bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-LiveMigrationNegativeTest-9403671 Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5b57fc0e940d4dad87b784860095a1bc Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-9403671 Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-LiveMigrationNegativeTest-9403671-project-admin Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: caebf0dbb63b4822b4c279651ba21aa8 Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-LiveMigrationNegativeTest-9403671-project-admin Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: {"os-migrateLive": {"host": "n-h2-846219-10", "block_migration": true, "disk_over_commit": false}} Jul 20 10:46:48.823343 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'os-migrateLive' instance 27b15803-72a1-4a48-87dd-eeb427bbfdec while it is in vm_state suspended Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '27b15803-72a1-4a48-87dd-eeb427bbfdec', 'body': {'os-migrateLive': {'host': 'n-h2-846219-10', 'block_migration': True, 'disk_over_commit': False}}} Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 10:46:48.824766 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:48.825930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 27b15803-72a1-4a48-87dd-eeb427bbfdec while it is in vm_state suspended Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 27b15803-72a1-4a48-87dd-eeb427bbfdec while it is in vm_state suspended Jul 20 10:46:48.827249 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:48.833944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 27b15803-72a1-4a48-87dd-eeb427bbfdec while it is in vm_state suspended {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:48.835207 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ec909ca-bfc4-4046-9be4-9cda7caea761 tempest-LiveMigrationNegativeTest-9403671 tempest-LiveMigrationNegativeTest-9403671-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec/action" status: 409 len: 155 microversion: 2.1 time: 1.771669 Jul 20 10:46:48.835973 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 178/400] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:46:47 2022] POST /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec/action => generated 155 bytes in 1773 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:46:48.865713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:48.866480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:48.902866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:48.903596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:48.904740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:48.905934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.063518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:49.082083 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43400078-b256-4b48-8748-8ed36accc339 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 2.552618 Jul 20 10:46:49.093975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 223/401] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:46 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:49.472334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa435881-3d78-4b6d-9f56-66b9ebb9d344 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:49.473082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:49.475828 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:49.475828 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:46:49.479239 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-fa435881-3d78-4b6d-9f56-66b9ebb9d344 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa435881-3d78-4b6d-9f56-66b9ebb9d344 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin] Request method failure captured: Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190XX8qQIMgAcDzC2RbjmKi10z1C4i5P9FHeeAcY56-MjxnZhrtkeC8mIXv8wcyshC2Nz443HOUAPL4CGNlD0XZQNQ_rKil8496Es8bsLJBLH6tagDzp7xOW25VS2PD3U94Npagg1XlC8Ztvc7nCCpQsySetebSAAEixyaNEaoBcRZw Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 02b7848ca1b44297b17751f4cb58a443 Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:46:49.489620 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_02b7848ca1b44297b17751f4cb58a443", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02b7848ca1b44297b17751f4cb58a443"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/02b7848ca1b44297b17751f4cb58a443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/02b7848ca1b44297b17751f4cb58a443"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 02b7848ca1b44297b17751f4cb58a443 Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: aebb2143216d400c808b03f7336472ab Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:49.491140 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid timestamp for date invalid_time Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'invalid_time'} Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:49.491910 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa435881-3d78-4b6d-9f56-66b9ebb9d344 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:49.493181 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fa435881-3d78-4b6d-9f56-66b9ebb9d344 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872 tempest-InstanceUsageAuditLogNegativeTestJSON-1801830872-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.396055 Jul 20 10:46:49.494970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc5e127d-b256-4245-a9e1-747ca6729501 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 0.648853 Jul 20 10:46:49.505097 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 179/402] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:48 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:49.505327 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 224/403] 10.222.0.79 () {58 vars in 1223 bytes} [Wed Jul 20 10:46:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:46:49.505427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6e102d9b-8082-4891-aab3-0dfddd16c445 req-99e6eb30-c15e-4962-aeaf-9a8e6dd54844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ff8913-499d-4ea6-9c1a-655b13210334", "tag": "5fae7bd8-f480-43e3-bc2b-d65334aafaaf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:49.513000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:49.515525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:49.520845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6e102d9b-8082-4891-aab3-0dfddd16c445 req-99e6eb30-c15e-4962-aeaf-9a8e6dd54844 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:49.528280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6e102d9b-8082-4891-aab3-0dfddd16c445 req-99e6eb30-c15e-4962-aeaf-9a8e6dd54844 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.537888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:49.541159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.545283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:49.546442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.556411 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6e102d9b-8082-4891-aab3-0dfddd16c445 req-99e6eb30-c15e-4962-aeaf-9a8e6dd54844 service nova] Creating event network-changed:5fae7bd8-f480-43e3-bc2b-d65334aafaaf for instance c5ff8913-499d-4ea6-9c1a-655b13210334 on n-h2-846219-10 Jul 20 10:46:49.572509 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6e102d9b-8082-4891-aab3-0dfddd16c445 req-99e6eb30-c15e-4962-aeaf-9a8e6dd54844 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074383 Jul 20 10:46:49.573449 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 180/404] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:49.589603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e3e5bbd9-b599-41f4-a673-9e2b1d570c9f req-cdbbf3ae-b3a5-463a-9f71-db0af8725ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bfeb30c-e126-4abd-9c33-c2ae07eec3e7", "name": "network-vif-plugged", "status": "completed", "tag": "9e7bc227-f680-4766-b539-3d8116769482"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:49.624492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e3e5bbd9-b599-41f4-a673-9e2b1d570c9f req-cdbbf3ae-b3a5-463a-9f71-db0af8725ba8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:49.628840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e3e5bbd9-b599-41f4-a673-9e2b1d570c9f req-cdbbf3ae-b3a5-463a-9f71-db0af8725ba8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.650556 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e3e5bbd9-b599-41f4-a673-9e2b1d570c9f req-cdbbf3ae-b3a5-463a-9f71-db0af8725ba8 service nova] Creating event network-vif-plugged:9e7bc227-f680-4766-b539-3d8116769482 for instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 on n-h2-846219-10 Jul 20 10:46:49.663416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e3e5bbd9-b599-41f4-a673-9e2b1d570c9f req-cdbbf3ae-b3a5-463a-9f71-db0af8725ba8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087277 Jul 20 10:46:49.667445 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 181/405] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:49.681617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:49.682328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:49.705579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:49.706237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.707143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:49.708744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:49.786171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:46:49.826563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:49.986146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:50.002818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:50.004729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:50.008884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff70b039-03c2-4fd3-9726-4ddda1aae98f tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "DELETE /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 204 len: 0 microversion: 2.1 time: 0.337886 Jul 20 10:46:50.010971 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 182/406] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:46:49 2022] DELETE /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:46:50.034624 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dbc3c45e-963e-44a7-a543-f162813a84e3 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.528529 Jul 20 10:46:50.038388 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 225/407] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:49 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:50.060012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:50.062088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:50.097204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:50.097759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:50.098479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:50.098947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:50.350550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9fd2cd46-4857-493e-b9fe-641e9a7324a8 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:50.352138 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:50.352138 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:50.353303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9fd2cd46-4857-493e-b9fe-641e9a7324a8 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '889c36eed57c484a868b17b8916bf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eb7d0337f64ee3a5813658b22ecba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9fd2cd46-4857-493e-b9fe-641e9a7324a8 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Request method failure captured: Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190VXWWMb_DMsiSo_lrf_0jm3rNOhjGJImxSpjX743W4prWuQ1IZ2yHUQ-oA08NBO76Vw6Ai6tF3p007Er3Uy1HWolEN3BsUekodXv6iL85_87h22tacwY3u-M6lFuDPlBlyF__-ekfP_nSz_JiwpAQd3Vsm048vhcL-qkiVQxBjeHU Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9eb7d0337f64ee3a5813658b22ecba4 Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:50.355580 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9eb7d0337f64ee3a5813658b22ecba4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9eb7d0337f64ee3a5813658b22ecba4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9eb7d0337f64ee3a5813658b22ecba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9eb7d0337f64ee3a5813658b22ecba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9eb7d0337f64ee3a5813658b22ecba4 Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 889c36eed57c484a868b17b8916bf13d Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:50.357705 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: action_args: {} Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:50.358772 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:50.362902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9fd2cd46-4857-493e-b9fe-641e9a7324a8 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:50.366416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9fd2cd46-4857-493e-b9fe-641e9a7324a8 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.349082 Jul 20 10:46:50.366416 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 183/408] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 10:46:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 353 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:50.384336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:50.385585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:50.412986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:50.419384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:50.422375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:50.423158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:50.921755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:50.956495 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e281d52-a413-4af2-a0f4-28b4924fe5ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 0.587615 Jul 20 10:46:50.960710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:50.969006 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 184/409] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:50 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:50.981541 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bca6dfea-a48c-4406-a503-623215d18439 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1464 microversion: 2.1 time: 0.932222 Jul 20 10:46:50.987293 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 226/410] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:50 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1464 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:50.999052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb1a81b2-e65b-467c-a447-cecc07a2f971 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:51.000672 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:46:51.000672 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:46:51.004567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eb1a81b2-e65b-467c-a447-cecc07a2f971 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '889c36eed57c484a868b17b8916bf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eb7d0337f64ee3a5813658b22ecba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:51.012875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:51.013656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb1a81b2-e65b-467c-a447-cecc07a2f971 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Request method failure captured: Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2010:46:50 HTTP/1.1 Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190VXWWMb_DMsiSo_lrf_0jm3rNOhjGJImxSpjX743W4prWuQ1IZ2yHUQ-oA08NBO76Vw6Ai6tF3p007Er3Uy1HWolEN3BsUekodXv6iL85_87h22tacwY3u-M6lFuDPlBlyF__-ekfP_nSz_JiwpAQd3Vsm048vhcL-qkiVQxBjeHU Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9eb7d0337f64ee3a5813658b22ecba4 Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:46:51.014288 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9eb7d0337f64ee3a5813658b22ecba4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9eb7d0337f64ee3a5813658b22ecba4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9eb7d0337f64ee3a5813658b22ecba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9eb7d0337f64ee3a5813658b22ecba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9eb7d0337f64ee3a5813658b22ecba4 Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 889c36eed57c484a868b17b8916bf13d Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:46:51.016044 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2022-07-20 10:46:50'} Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:46:51.016770 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 20 10:46:51.018915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:46:51.020047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb1a81b2-e65b-467c-a447-cecc07a2f971 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:51.020798 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eb1a81b2-e65b-467c-a447-cecc07a2f971 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817 tempest-InstanceUsageAuditLogNegativeTestJSON-864620817-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20 10:46:50" status: 403 len: 128 microversion: 2.1 time: 0.047728 Jul 20 10:46:51.023238 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 185/411] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 10:46:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-20%2010%3A46%3A50 => generated 128 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:51.027930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:51.028701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:51.030267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:51.030931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:51.072316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:51.073031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:51.097601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:51.098291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:51.099282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:51.106147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:51.466006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:51.552104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:51.566436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:51.576331 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-49840145-1180-4638-9ff0-2be5dd4b80dc tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.511199 Jul 20 10:46:51.577167 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 186/412] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:51 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:51.825006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:51.848575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:51.856257 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eea8d697-91c2-4bd1-80af-42f68f1e5c95 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 0.865688 Jul 20 10:46:51.875974 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 227/413] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:50 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:51.989729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:51.990630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:52.003741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:52.005367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:52.006267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:52.006732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:52.009543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:52.013145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:52.029240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:52.033015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:52.034459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:52.039649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:53.702892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:53.716886 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-53664996-573f-43d1-86f8-5dfdf3af68aa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1316 microversion: 2.1 time: 1.732155 Jul 20 10:46:53.717488 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 187/414] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:51 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1316 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:53.725816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:53.728165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:53.736786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:53.737236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:53.738021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:53.738459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:53.887104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:53.897536 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-82c1e0a4-bf6d-46e0-b67a-d2855987657d tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1464 microversion: 2.1 time: 1.900466 Jul 20 10:46:53.903776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 228/415] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:51 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1464 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:53.908648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:53.909262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:53.927657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:53.934996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:53.936452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:53.937113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:54.123454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:54.138909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:54.142767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:54.170085 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ba0f241-8f8d-4792-a6d6-6dea276f10df tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.451349 Jul 20 10:46:54.177851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 188/416] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:53 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:54.500571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-980667013", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "896bfaeb-a0b5-419b-bf8d-148d7d420fcc"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:54.587321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] validate_networks() for [('896bfaeb-a0b5-419b-bf8d-148d7d420fcc', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:46:54.608010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:54.622462 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-53ec7750-4247-4c7b-98ea-1298a4404b7f tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 0.717054 Jul 20 10:46:54.627849 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 229/417] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:53 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:54.737420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:54.738369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:54.750914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:54.754978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:54.756426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:54.758028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:55.609251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:55.629936 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b988b4d-4cd5-4d14-a794-c7f2e538fe73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1466 microversion: 2.1 time: 0.899019 Jul 20 10:46:55.632550 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 230/418] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:54 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1466 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:55.661386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:55.664097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:55.679488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:55.680222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:55.681175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:55.685737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:56.149380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:56.159099 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca3d6811-74e6-46a5-987d-f5ddc3f7c682 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 200 len: 1422 microversion: 2.1 time: 0.523377 Jul 20 10:46:56.164795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 231/419] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:55 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 1422 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:56.171419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:56.177850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:56.196003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:56.196719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:56.197791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:56.200111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:56.787294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:56.812104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:56.817007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:56.827715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2307917-1184-4a5e-abdb-eb12f1d95ef5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.661464 Jul 20 10:46:56.829337 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 232/420] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:56 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:56.836877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:56.838056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:56.851583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:56.852674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:56.858265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:56.860353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:56.975520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:46:57.037812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:46:57.037812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:46:57.037812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:46:57.038047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:46:57.038995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:46:57.093823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:57.111404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:57.113855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:57.116235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:57.150029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:46:57.165172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for user 90200241ccaf4904a4b973e0351fdff6 and project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:46:57.196172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:46:57.203741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:46:57.294375 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ce46a704-f4a3-4f66-b104-bf181be27aec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.101615 Jul 20 10:46:57.296391 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 189/421] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:46:57.886882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:57.924535 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ecb0bb3-babb-4284-9971-87ab089d5d6b tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 1.092500 Jul 20 10:46:57.940643 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 233/422] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:56 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:57.953889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1fcbdf9b-1015-422a-a8b4-968c3930a4b8 req-1a3e6a27-4555-45ea-9724-9bdccda2749b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b15803-72a1-4a48-87dd-eeb427bbfdec", "name": "network-vif-deleted", "tag": "56392252-c119-4b8f-9072-028ffb05b53e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:57.980854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1fcbdf9b-1015-422a-a8b4-968c3930a4b8 req-1a3e6a27-4555-45ea-9724-9bdccda2749b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:57.984416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1fcbdf9b-1015-422a-a8b4-968c3930a4b8 req-1a3e6a27-4555-45ea-9724-9bdccda2749b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.030093 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1fcbdf9b-1015-422a-a8b4-968c3930a4b8 req-1a3e6a27-4555-45ea-9724-9bdccda2749b service nova] Creating event network-vif-deleted:56392252-c119-4b8f-9072-028ffb05b53e for instance 27b15803-72a1-4a48-87dd-eeb427bbfdec on n-h1-846219-10 Jul 20 10:46:58.040515 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1fcbdf9b-1015-422a-a8b4-968c3930a4b8 req-1a3e6a27-4555-45ea-9724-9bdccda2749b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097678 Jul 20 10:46:58.081628 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 234/423] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:58.097205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:58.112349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: 27b15803-72a1-4a48-87dd-eeb427bbfdec] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:58.122796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.123558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.125875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.126903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.212528 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] HTTP exception thrown: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec could not be found. Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Request method failure captured: Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec HTTP/1.1 Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zR5GKgdaVNzSy3ijzLsZ3GiY_QZEcjApem5xBLzFFwEJ5fN1clc0nSyZHbtC0ve_LCpRYBArtDsAIdUL8aY4i9_qTe1rx7ZnkIDOsh-P-bbQJxHiQx8-NkZO7hcDSB34GC2e8z4aKdkCAWOkmJylGrBQJYLVa4eBowNJ4d3X0lloE Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: a6ee2b02dd884f3781a101b8517f4d9a Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-LiveMigrationNegativeTest-1275286826 Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:46:58.217430 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6ee2b02dd884f3781a101b8517f4d9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6ee2b02dd884f3781a101b8517f4d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6ee2b02dd884f3781a101b8517f4d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6ee2b02dd884f3781a101b8517f4d9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-LiveMigrationNegativeTest-1275286826 Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: a6ee2b02dd884f3781a101b8517f4d9a Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1275286826 Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-LiveMigrationNegativeTest-1275286826-project Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9f107a581f6143c395d2480776b9193c Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-LiveMigrationNegativeTest-1275286826-project Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec could not be found. Jul 20 10:46:58.220097 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '27b15803-72a1-4a48-87dd-eeb427bbfdec'} Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec could not be found. Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:46:58.221484 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec could not be found. Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec could not be found. Jul 20 10:46:58.224486 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:46:58.228677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Returning 404 to user: Instance 27b15803-72a1-4a48-87dd-eeb427bbfdec could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:46:58.230618 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7608029a-7d1a-413c-ac8c-760825f4943e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec" status: 404 len: 111 microversion: 2.1 time: 0.146213 Jul 20 10:46:58.231855 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 235/424] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:58 2022] GET /compute/v2.1/servers/27b15803-72a1-4a48-87dd-eeb427bbfdec => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:46:58.243731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:58.245186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:58.256170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-adfc78f7-6eac-47bd-89a1-40324475950a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:58.267590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-adfc78f7-6eac-47bd-89a1-40324475950a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:58.274545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.275860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.281150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.285973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.484389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-adfc78f7-6eac-47bd-89a1-40324475950a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:58.491701 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-adfc78f7-6eac-47bd-89a1-40324475950a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1210 microversion: 2.1 time: 0.256326 Jul 20 10:46:58.509588 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 236/425] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:58 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1210 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:58.520601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b2ee1b7b-befa-43b1-b305-227b9315e8c4 req-28de78b9-f989-47d1-9bcf-d6c2f94c79db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ff8913-499d-4ea6-9c1a-655b13210334", "name": "network-vif-plugged", "status": "completed", "tag": "5fae7bd8-f480-43e3-bc2b-d65334aafaaf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:46:58.541254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b2ee1b7b-befa-43b1-b305-227b9315e8c4 req-28de78b9-f989-47d1-9bcf-d6c2f94c79db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.542085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b2ee1b7b-befa-43b1-b305-227b9315e8c4 req-28de78b9-f989-47d1-9bcf-d6c2f94c79db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.567919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b2ee1b7b-befa-43b1-b305-227b9315e8c4 req-28de78b9-f989-47d1-9bcf-d6c2f94c79db service nova] Creating event network-vif-plugged:5fae7bd8-f480-43e3-bc2b-d65334aafaaf for instance c5ff8913-499d-4ea6-9c1a-655b13210334 on n-h2-846219-10 Jul 20 10:46:58.577175 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b2ee1b7b-befa-43b1-b305-227b9315e8c4 req-28de78b9-f989-47d1-9bcf-d6c2f94c79db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065772 Jul 20 10:46:58.581101 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 237/426] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:46:58.587672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:58.599797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:58.640130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.641655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.648636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.651200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.858884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:58.894190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:58.898950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:46:58.910239 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08a1ef71-aab6-4ba1-9810-20eb86ca57c4 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.324439 Jul 20 10:46:58.923286 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 238/427] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:46:58 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:46:58.939992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:58.941229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:58.959499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.960021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:58.963857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:58.963857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:59.034055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:46:59.199993 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67c92cd7-ddb1-43a6-8fa1-ee219f21fcb4 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 204 len: 0 microversion: 2.1 time: 0.274078 Jul 20 10:46:59.203510 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 239/428] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:46:58 2022] DELETE /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:46:59.219810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:59.228112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:59.229261 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c1ae47f-8978-4fdb-802a-140c335ae5e4 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1619 microversion: 2.1 time: 1.928460 Jul 20 10:46:59.238173 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 190/429] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:57 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1619 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:46:59.242313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:59.243134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:59.244091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:59.244786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:59.255706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:46:59.256415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:46:59.284131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:59.284819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:46:59.287108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:46:59.287833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:00.421223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:00.476495 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6eb5655f-fc43-4017-a0ef-eca94aef6ed5 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1475 microversion: 2.1 time: 1.232714 Jul 20 10:47:00.480432 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 191/430] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:59 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1475 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:00.499764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:00.520036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f98e9494-b581-4663-9309-84a46230a213 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: .version_select at 0x7f2c3fabbe50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-289949706", "policies": ["affinity"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:00.639055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-462ed892-1608-46fa-a3d8-eda4c83bc1c6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1320 microversion: 2.1 time: 1.426879 Jul 20 10:47:00.656112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f98e9494-b581-4663-9309-84a46230a213 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:00.671296 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 240/431] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:46:59 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1320 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:00.693506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:00.694684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:00.697137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:00.704618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f98e9494-b581-4663-9309-84a46230a213 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:00.731418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:00.736171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:00.748159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:00.750923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:00.959777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f98e9494-b581-4663-9309-84a46230a213 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:00.973414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f98e9494-b581-4663-9309-84a46230a213 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:01.010489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:01.026268 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dad7c556-476e-441a-891b-7a92eb167064 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1262 microversion: 2.1 time: 0.356351 Jul 20 10:47:01.031707 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 241/432] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:00 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1262 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:01.046251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f98e9494-b581-4663-9309-84a46230a213 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.560990 Jul 20 10:47:01.055463 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 192/433] 10.222.0.79 () {60 vars in 1173 bytes} [Wed Jul 20 10:47:00 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:01.099697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:01.101027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:01.152270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:01.153496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:01.156565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:01.157677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:01.477955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-37705616", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "96edb646-1686-4fd1-8062-c44bd883172b"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:01.529273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:01.556923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:01.563468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:01.582679 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5de603ad-6cfc-4574-bbb0-6a7dd964e713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.549783 Jul 20 10:47:01.595424 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 242/434] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:01 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:01.623914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:01.628871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:01.635580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:01.653364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:01.654139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:01.657519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:01.658308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:03.153193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f107a581f6143c395d2480776b9193c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ee2b02dd884f3781a101b8517f4d9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:03.197837 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ac730d45-8be3-4cb1-8b55-07dc22f14312 tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 200 len: 1475 microversion: 2.1 time: 1.597338 Jul 20 10:47:03.220629 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 243/435] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:01 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 1475 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:03.238538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:03.242252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:03.267202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:03.278457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:03.283658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:03.284711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:03.603069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:03.604906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:03.605609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:03.606352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:03.607015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:03.649994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:03.652656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:03.654703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:03.655470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:03.714418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:03.728308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:03.762603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Going to run 2 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:03.773177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:03.880667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125886) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 10:47:03.946272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:03.957405 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12d3570f-7ef9-4007-ab30-3ed815359108 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1469 microversion: 2.1 time: 0.747303 Jul 20 10:47:03.963022 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 244/436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:03 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1469 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:03.971366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:03.976205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:03.993238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:03.994376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:04.000604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:04.001502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:04.023515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:04.041340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:04.293957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:04.309437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:04.365394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=fdd8a1f5-0da1-47f2-8767-dd476d919da5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:04.385718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:04.420637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:04.430289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-594dd4e0-65bb-4307-b758-39101d018651 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1268 microversion: 2.1 time: 0.465524 Jul 20 10:47:04.443139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 245/437] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:03 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1268 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:04.450538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:04.455540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:04.486577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:04.487834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:04.493786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:04.494785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:04.506108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:04.525046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:04.655446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:04.679631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:04.759607 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01146ecb-3a90-447a-b159-6776e36ae068 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.287983 Jul 20 10:47:04.767612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 193/438] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 3298 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 10:47:05.264143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:05.316749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:05.335298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:05.373604 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf86df45-4f1a-4ae0-b7c8-6c16f61183fa tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.928515 Jul 20 10:47:05.380333 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 246/439] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:04 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:05.418743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-28808abe-41a9-4ad9-acdf-8f5aa594f51d req-e949a3f3-4ca4-4a82-8b11-2a0934624ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce08e02c-a024-4c26-9f5c-c31f77250a04", "name": "network-vif-deleted", "tag": "5ae8f5cc-0235-4254-b993-46d5617c9c27"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:05.486319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-28808abe-41a9-4ad9-acdf-8f5aa594f51d req-e949a3f3-4ca4-4a82-8b11-2a0934624ee9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.492958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-28808abe-41a9-4ad9-acdf-8f5aa594f51d req-e949a3f3-4ca4-4a82-8b11-2a0934624ee9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.542035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:05.543082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:05.552838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.554597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.556823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.558856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.579583 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-28808abe-41a9-4ad9-acdf-8f5aa594f51d req-e949a3f3-4ca4-4a82-8b11-2a0934624ee9 service nova] Creating event network-vif-deleted:5ae8f5cc-0235-4254-b993-46d5617c9c27 for instance ce08e02c-a024-4c26-9f5c-c31f77250a04 on n-h1-846219-10 Jul 20 10:47:05.624958 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-28808abe-41a9-4ad9-acdf-8f5aa594f51d req-e949a3f3-4ca4-4a82-8b11-2a0934624ee9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225592 Jul 20 10:47:05.629671 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 247/440] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:05.662268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:05.668651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] [instance: ce08e02c-a024-4c26-9f5c-c31f77250a04] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:05.668939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:47:05.709214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.710619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.712197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.713287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.781060 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] HTTP exception thrown: Instance ce08e02c-a024-4c26-9f5c-c31f77250a04 could not be found. Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Request method failure captured: Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 HTTP/1.1 Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19zR5GKgdaVNzSy3ijzLsZ3GiY_QZEcjApem5xBLzFFwEJ5fN1clc0nSyZHbtC0ve_LCpRYBArtDsAIdUL8aY4i9_qTe1rx7ZnkIDOsh-P-bbQJxHiQx8-NkZO7hcDSB34GC2e8z4aKdkCAWOkmJylGrBQJYLVa4eBowNJ4d3X0lloE Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: a6ee2b02dd884f3781a101b8517f4d9a Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-LiveMigrationNegativeTest-1275286826 Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:47:05.785249 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6ee2b02dd884f3781a101b8517f4d9a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6ee2b02dd884f3781a101b8517f4d9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6ee2b02dd884f3781a101b8517f4d9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6ee2b02dd884f3781a101b8517f4d9a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-LiveMigrationNegativeTest-1275286826 Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: a6ee2b02dd884f3781a101b8517f4d9a Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1275286826 Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-LiveMigrationNegativeTest-1275286826-project Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9f107a581f6143c395d2480776b9193c Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-LiveMigrationNegativeTest-1275286826-project Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ce08e02c-a024-4c26-9f5c-c31f77250a04 could not be found. Jul 20 10:47:05.787585 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ce08e02c-a024-4c26-9f5c-c31f77250a04'} Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce08e02c-a024-4c26-9f5c-c31f77250a04 could not be found. Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:05.788917 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce08e02c-a024-4c26-9f5c-c31f77250a04 could not be found. Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce08e02c-a024-4c26-9f5c-c31f77250a04 could not be found. Jul 20 10:47:05.791154 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:05.810446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] Returning 404 to user: Instance ce08e02c-a024-4c26-9f5c-c31f77250a04 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:05.812495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9474f538-3464-47b1-a668-373af396b95e tempest-LiveMigrationNegativeTest-1275286826 tempest-LiveMigrationNegativeTest-1275286826-project] 10.222.0.79 "GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04" status: 404 len: 111 microversion: 2.1 time: 0.178033 Jul 20 10:47:05.819960 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 248/441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:05 2022] GET /compute/v2.1/servers/ce08e02c-a024-4c26-9f5c-c31f77250a04 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:47:05.840597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:05.848167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:05.862241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Searching by: {'deleted': False, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:47:05.888887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:05.906150 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fbcd2e1a-56ae-41d4-b612-3befd124a0c1 tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 204 len: 0 microversion: 2.1 time: 1.137143 Jul 20 10:47:05.907076 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 194/442] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:47:04 2022] DELETE /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 0 bytes in 1139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:47:05.915773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:05.917469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:05.929821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.949720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.955689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.959226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.993925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:05.994714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:05.997528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:06.000576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:06.264688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:47:06.654702 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12b8067b-b3bb-40e5-9582-740f28d65b6d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 999 microversion: 2.1 time: 0.831774 Jul 20 10:47:06.657076 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 249/443] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 10:47:05 2022] GET /compute/v2.1/servers => generated 999 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:06.669586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:06.671289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:06.698569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:06.708504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:06.711237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:06.713328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:07.454185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:07.482206 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72e6df7f-94f8-43ae-be03-ca8d066a2e1d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 1.573910 Jul 20 10:47:07.483259 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 195/444] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:05 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:07.496328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:07.497257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:07.516304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:07.516753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:07.517524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:07.517947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:07.697589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:07.708597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:07.721818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:07.741365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-51041f91-8e00-4e5b-b4f7-1c0bc2a3722d tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.256763 Jul 20 10:47:07.756404 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 196/445] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:07 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:07.766683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:07.772717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:07.789780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:07.795478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:07.796561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:07.797337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:08.376428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:08.398895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:08.409888 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cdb29b09-e569-40ea-a90a-5b5cd740fa0c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1475 microversion: 2.1 time: 1.750798 Jul 20 10:47:08.425952 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e847c578-0c73-4090-94ce-098e2dfb1070 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1269 microversion: 2.1 time: 0.668025 Jul 20 10:47:08.437738 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 250/446] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:06 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1475 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:08.444357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 197/447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:07 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1269 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:08.508632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:08.509251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:08.513115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:08.537703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:08.539763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:08.543829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:08.544883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:08.774275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:08.776251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:08.824860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:08.825649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:08.827109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:08.831786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:09.309955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:09.325630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:09.328791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:09.344702 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1cd3c8f4-5203-4c69-9ecd-7411abc7aaec tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.578494 Jul 20 10:47:09.345310 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 198/448] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:08 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:47:09.356773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b922d9dc-eef4-4f21-b770-03104be13b27 req-04893a1d-6d81-45a0-bd20-94a3a6987a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae21dfc-ec5d-483b-81c8-6b3d2a601620", "tag": "06e1be1c-ac80-4793-896d-da3e027de287"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:09.380855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b922d9dc-eef4-4f21-b770-03104be13b27 req-04893a1d-6d81-45a0-bd20-94a3a6987a63 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:09.381312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b922d9dc-eef4-4f21-b770-03104be13b27 req-04893a1d-6d81-45a0-bd20-94a3a6987a63 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:09.416000 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b922d9dc-eef4-4f21-b770-03104be13b27 req-04893a1d-6d81-45a0-bd20-94a3a6987a63 service nova] Creating event network-changed:06e1be1c-ac80-4793-896d-da3e027de287 for instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 on n-h1-846219-10 Jul 20 10:47:09.430636 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b922d9dc-eef4-4f21-b770-03104be13b27 req-04893a1d-6d81-45a0-bd20-94a3a6987a63 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084087 Jul 20 10:47:09.435543 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 199/449] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:09.451806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:09.456610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:09.480026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:09.482728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:09.486160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:09.486779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:10.278405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:10.300625 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f11e9290-036f-482c-aff0-e2fde5aa01ea tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1275 microversion: 2.1 time: 0.859930 Jul 20 10:47:10.324519 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 200/450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:09 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1275 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:10.330678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:10.331530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:10.351053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:10.351914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:10.357975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:10.358613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:10.426079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:11.313445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:11.331453 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-af63594b-bddb-4e59-aec4-78d6661a7b69 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 200 len: 1305 microversion: 2.1 time: 1.005574 Jul 20 10:47:11.344641 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 201/451] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:10 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 1305 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:11.353689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8a493d10-e321-484c-af29-de737fb9b14b req-96122412-a515-460b-90af-3349bd5d572a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ff8913-499d-4ea6-9c1a-655b13210334", "name": "network-vif-deleted", "tag": "5fae7bd8-f480-43e3-bc2b-d65334aafaaf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:11.383863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8a493d10-e321-484c-af29-de737fb9b14b req-96122412-a515-460b-90af-3349bd5d572a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:11.389901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8a493d10-e321-484c-af29-de737fb9b14b req-96122412-a515-460b-90af-3349bd5d572a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:11.411223 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8a493d10-e321-484c-af29-de737fb9b14b req-96122412-a515-460b-90af-3349bd5d572a service nova] Creating event network-vif-deleted:5fae7bd8-f480-43e3-bc2b-d65334aafaaf for instance c5ff8913-499d-4ea6-9c1a-655b13210334 on n-h2-846219-10 Jul 20 10:47:11.443807 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8a493d10-e321-484c-af29-de737fb9b14b req-96122412-a515-460b-90af-3349bd5d572a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094944 Jul 20 10:47:11.447665 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 202/452] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:11.461194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:11.461955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:11.473000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:11.473694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:11.475055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:11.475866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:11.759664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:11.778195 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35e45830-2347-4886-83a9-0c074ffb1989 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 3.276637 Jul 20 10:47:11.779047 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 251/453] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:08 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 3279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:11.786625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:11.787876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:11.802369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:11.803296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:11.803898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:11.804346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:11.810159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:11.850729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:11.852565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:11.873360 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-451fa283-2688-475a-8566-0eedd4bb21e5 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1447 microversion: 2.75 time: 0.421212 Jul 20 10:47:11.876447 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 203/454] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:11 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1447 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:12.161527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:12.175862 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cbe6df4b-ad71-42e5-abe8-133f25dc86cd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1275 microversion: 2.1 time: 0.393011 Jul 20 10:47:12.176735 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 252/455] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:11 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:12.353973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:12.354914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:12.379419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:12.382069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:12.384417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:12.387842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:12.421214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] HTTP exception thrown: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Request method failure captured: Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 HTTP/1.1 Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190DREHUils3hLMhbk86bSPjicSjKEODV-HcWOEnJuh6pXc339B47JyvmiDBqoHLyA22xYMSIw5q15HvDlNRWS9fD561YPj4ncUdTrYOrPoQbbMtob1ThBOabfGkznjR-HWMm7oZL8AnC9JGUCA89CWbK1aywVExK6EvQQDET6nS3fg Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:47:12.425397 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c0bd00fa22af486ba7cf6d4330b3ef6b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3698cfa68fe544aaa91f4ed4e1025685 Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:12.426773 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c5ff8913-499d-4ea6-9c1a-655b13210334'} Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:12.427642 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:12.429019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:12.436383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Returning 404 to user: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:12.439514 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df7d0553-7a84-45b9-8b33-9f1c9744a552 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 404 len: 111 microversion: 2.1 time: 0.093848 Jul 20 10:47:12.440713 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 204/456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:12 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:47:12.680924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-913596672", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:12.797773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:12.798406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:12.814270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:12.814728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:12.815554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:12.815995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:12.819990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:13.681129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:13.798240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:13.827693 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d2779b9-c4dc-4472-b1d2-f5f7d0fb9f20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 1.028980 Jul 20 10:47:13.829237 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 205/457] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:12 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:47:13.848103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:13.849435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:13.869364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:13.873143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:13.874613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:13.878731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:13.942371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:13.943162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:13.943772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:13.944282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:13.944929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:13.961676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:13.970704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:13.972038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:13.972720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:14.018374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Getting quotas for project c0bd00fa22af486ba7cf6d4330b3ef6b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:14.029346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Getting quotas for user 3698cfa68fe544aaa91f4ed4e1025685 and project c0bd00fa22af486ba7cf6d4330b3ef6b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:14.056711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:14.063438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:14.146254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:14.170049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:14.175582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:14.181888 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-433cc85d-09ab-4c65-bd7e-4544ffcc38ff tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504510 Jul 20 10:47:14.183233 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 253/458] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 10:47:14.193421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:14.195122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:14.204065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:14.204944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:14.205958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:14.206606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:14.210796 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee2214d0-016c-4e8c-aeec-45af8fd7c713 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1465 microversion: 2.75 time: 0.379841 Jul 20 10:47:14.211425 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 206/459] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:13 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1465 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:14.232613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5c64f19-ab8a-4178-846a-148c665cf768 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:14.233664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5c64f19-ab8a-4178-846a-148c665cf768 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:14.492246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e5c64f19-ab8a-4178-846a-148c665cf768 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:14.519621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5c64f19-ab8a-4178-846a-148c665cf768 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1219 microversion: 2.1 time: 0.305858 Jul 20 10:47:14.523616 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 207/460] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:14 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1219 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:14.854358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:14.855265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:14.883554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:14.887377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:14.889014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:14.889636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:15.712289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:15.723648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2fc3fb25-b5cf-4b3f-9507-778933fed840 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 1.537745 Jul 20 10:47:15.729464 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 254/461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:14 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:15.743733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:15.747201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:15.784276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:15.784798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:15.791692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:15.792821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:16.394141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:16.398579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:16.470278 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ea44b46b-76b7-4191-9ca7-12178e3f96f4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 1.621428 Jul 20 10:47:16.471972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:16.476485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:16.481548 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 208/462] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:14 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:47:16.528768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:16.536937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:16.537226 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fcb9adfe-0a93-4878-b9c2-4049c01af97a tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1453 microversion: 2.75 time: 0.800686 Jul 20 10:47:16.544583 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 255/463] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:15 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1453 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:16.581123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:16.581853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:16.590240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:16.590866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:16.759028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:16.767491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:16.796980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:16.822678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:16.836527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:16.840040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:16.845025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:17.246486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:17.275101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b35ec7c6-694d-4c06-b56e-7dbd80b3c9a6 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1271 microversion: 2.1 time: 0.771480 Jul 20 10:47:17.299000 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 209/464] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:16 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1271 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:17.506628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:17.511278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:17.537909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:17.542709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:17.546458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:17.547753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:18.271523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:18.300805 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4ed1da4-da0c-456a-94a0-ab235ca38890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 1.551563 Jul 20 10:47:18.304340 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 256/465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:16 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:18.311303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:18.336463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:18.345480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:18.346323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:18.347430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:18.348115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:18.428842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:18.457160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3bebd9a-12b4-4d1e-8c95-c19c55e8e309 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 0.962131 Jul 20 10:47:18.471819 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 210/466] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:17 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:18.488174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:18.491635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:18.503730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:18.505116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:18.507131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:18.510088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:18.650526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:18.669663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:18.671888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:18.691059 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-80194304-4a0d-4614-8e09-efb7580e5c53 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1438 microversion: 2.75 time: 0.385302 Jul 20 10:47:18.704596 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 257/467] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:18 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1438 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:18.860774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:18.875195 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e27d49d5-1b79-4cc6-98ab-86a7d542622d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1277 microversion: 2.1 time: 0.399379 Jul 20 10:47:18.876482 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 211/468] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:18 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1277 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:19.189249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7400f9b4-df36-433e-8efb-876869233519 tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] Calling method '.version_select at 0x7f2c3f9db4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:19.190151 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:47:19.190151 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:47:19.243213 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7400f9b4-df36-433e-8efb-876869233519 tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.250621 Jul 20 10:47:19.248904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 212/469] 10.222.0.79 () {60 vars in 1225 bytes} [Wed Jul 20 10:47:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:47:19.293823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-821e1d11-96bc-413c-a9a3-50da49d2b126 tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3fabbe50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:19.314844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:19.314844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:19.321892 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:47:19.321892 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:47:19.335459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:19.336271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:19.337900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:19.338598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:19.645081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-821e1d11-96bc-413c-a9a3-50da49d2b126 tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.385186 Jul 20 10:47:19.645880 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 213/470] 10.222.0.79 () {62 vars in 1246 bytes} [Wed Jul 20 10:47:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:47:19.650847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:19.652105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:19.671251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:19.672325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:19.673382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:19.675860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:19.845331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:19.845832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:19.846313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:19.847301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:19.847736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:20.099341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:20.137671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:20.138737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:20.146232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:20.147492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:20.879974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:21.082043 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9ec5eb69-97f5-49fc-aca5-efad4917c776 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c/action" status: 202 len: 1944 microversion: 2.75 time: 2.359626 Jul 20 10:47:21.091631 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 258/471] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:47:18 2022] POST /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c/action => generated 1944 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 10:47:21.096888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:21.097812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:21.104389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.107795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.109184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.109858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.514654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:21.533301 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4eeb669e-040f-4284-b90a-c9389695a6c8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 1.886265 Jul 20 10:47:21.535337 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 214/472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:19 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:21.542482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6e9ecf1e-fa14-4875-946d-d5997339441b tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] Calling method '.version_select at 0x7f2c3f992dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:21.544020 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:47:21.544020 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:47:21.557060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6e9ecf1e-fa14-4875-946d-d5997339441b tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.020454 Jul 20 10:47:21.559231 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 215/473] 10.222.0.79 () {60 vars in 1225 bytes} [Wed Jul 20 10:47:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:47:21.567042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:21.568628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:21.577000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.577815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.578871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.579653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.694795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:21.697879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:21.715260 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-de685b1b-ea33-4ea5-9414-e472034ce658 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1277 microversion: 2.1 time: 0.152934 Jul 20 10:47:21.718792 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7da2bb8-2ea6-4475-b556-df7044909c43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 0.625365 Jul 20 10:47:21.719828 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 216/474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:21 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:21.721019 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 259/475] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:21 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:21.739118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d5a02a03-296f-4520-a2dd-96efc9a0bd57 req-aaf89b51-e26e-491a-9d12-bd1261cc41c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11dc629c-81a7-45b0-93b7-fd3f394e0d8d", "tag": "bbc6b72f-9345-49ed-9f5b-83aba0b1d14d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:21.746532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-96c7d5d6-0f91-4981-a107-0d1149d98101 req-70463add-e5c1-47e3-af85-b5bf3e8fa7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae21dfc-ec5d-483b-81c8-6b3d2a601620", "name": "network-vif-plugged", "status": "completed", "tag": "06e1be1c-ac80-4793-896d-da3e027de287"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:21.759248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d5a02a03-296f-4520-a2dd-96efc9a0bd57 req-aaf89b51-e26e-491a-9d12-bd1261cc41c4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.759694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d5a02a03-296f-4520-a2dd-96efc9a0bd57 req-aaf89b51-e26e-491a-9d12-bd1261cc41c4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.770821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-96c7d5d6-0f91-4981-a107-0d1149d98101 req-70463add-e5c1-47e3-af85-b5bf3e8fa7ca service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.771614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-96c7d5d6-0f91-4981-a107-0d1149d98101 req-70463add-e5c1-47e3-af85-b5bf3e8fa7ca service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.796985 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d5a02a03-296f-4520-a2dd-96efc9a0bd57 req-aaf89b51-e26e-491a-9d12-bd1261cc41c4 service nova] Creating event network-changed:bbc6b72f-9345-49ed-9f5b-83aba0b1d14d for instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d on n-h1-846219-10 Jul 20 10:47:21.810337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d5a02a03-296f-4520-a2dd-96efc9a0bd57 req-aaf89b51-e26e-491a-9d12-bd1261cc41c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086284 Jul 20 10:47:21.810907 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-96c7d5d6-0f91-4981-a107-0d1149d98101 req-70463add-e5c1-47e3-af85-b5bf3e8fa7ca service nova] Creating event network-vif-plugged:06e1be1c-ac80-4793-896d-da3e027de287 for instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 on n-h1-846219-10 Jul 20 10:47:21.818189 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 260/476] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:21.830043 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-96c7d5d6-0f91-4981-a107-0d1149d98101 req-70463add-e5c1-47e3-af85-b5bf3e8fa7ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099932 Jul 20 10:47:21.837176 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 217/477] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:21.844072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:21.849663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:21.860741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1348b704-889e-47bd-ab44-79b812849a34 tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f992dc0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:21.867624 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:47:21.867624 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:47:21.871121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.876873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:21.883203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:21.888200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:22.037185 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1348b704-889e-47bd-ab44-79b812849a34 tempest-QuotaClassesAdmin257Test-657551640 tempest-QuotaClassesAdmin257Test-657551640-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.194076 Jul 20 10:47:22.038661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 218/478] 10.222.0.79 () {62 vars in 1246 bytes} [Wed Jul 20 10:47:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:47:22.045917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4daa5f6c-bdac-4928-9d0c-91e1e0fa28ff req-cedc7c01-1c3c-4f3c-8c1a-fe52295cdbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd8a1f5-0da1-47f2-8767-dd476d919da5", "tag": "0033d629-ebb8-49e1-8ce2-712fe79ed7c5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:22.071637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4daa5f6c-bdac-4928-9d0c-91e1e0fa28ff req-cedc7c01-1c3c-4f3c-8c1a-fe52295cdbc9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:22.072621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4daa5f6c-bdac-4928-9d0c-91e1e0fa28ff req-cedc7c01-1c3c-4f3c-8c1a-fe52295cdbc9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:22.093017 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4daa5f6c-bdac-4928-9d0c-91e1e0fa28ff req-cedc7c01-1c3c-4f3c-8c1a-fe52295cdbc9 service nova] Creating event network-changed:0033d629-ebb8-49e1-8ce2-712fe79ed7c5 for instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 on n-h1-846219-10 Jul 20 10:47:22.100835 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4daa5f6c-bdac-4928-9d0c-91e1e0fa28ff req-cedc7c01-1c3c-4f3c-8c1a-fe52295cdbc9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060072 Jul 20 10:47:22.102427 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 219/479] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:22.212733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:22.233310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:22.271467 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2534d355-cbdf-4811-9726-bc1989f350c4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.450478 Jul 20 10:47:22.273442 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 261/480] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:21 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:22.570264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:22.575463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:22.597114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:22.598204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:22.601976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:22.602835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:22.750116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:22.751883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:22.776927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:22.777378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:22.779807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:22.780456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:22.958583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:22.976841 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de367c2d-b261-4f6a-976f-2661bee6f838 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1277 microversion: 2.1 time: 0.242072 Jul 20 10:47:22.978366 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 262/481] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:22 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:22.990964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:22.998969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:23.021128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:23.022274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:23.024285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:23.025627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:23.057904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:23.084161 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5a44eba-62ca-4060-bedb-19e9c2fffcda tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.533242 Jul 20 10:47:23.088484 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 220/482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:22 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:47:23.304114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:23.305214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:23.316190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:23.316886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:23.319893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:23.321255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:23.641772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:23.676889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:23.722945 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f8185364-9804-4dbc-8bb9-a62edd8197a7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 0.740593 Jul 20 10:47:23.723765 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 263/483] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:22 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:23.752770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:23.759583 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b89d2b9d-a085-4c06-8720-48e9bf2eefb4 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.463784 Jul 20 10:47:23.772117 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 221/484] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:23 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:47:24.009507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:24.017359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:24.017995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:24.035356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.036561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.038217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.039753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.050652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:24.114563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:24.117409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:24.145570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.145570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.145570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.146460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.457243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:24.477481 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2aa58e03-70ba-458c-8b63-31cae3ada77c tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.469086 Jul 20 10:47:24.479031 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 264/485] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:23 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:24.485865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:24.497178 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7fad3a6a-0598-434c-ac5a-f7e5e82fe0b0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.392454 Jul 20 10:47:24.498109 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 222/486] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:24 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:24.746573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:24.752389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:24.778655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.779700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.781278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.784433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.797195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:24.798412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:24.822324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.823798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:24.827189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:24.830278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:25.388568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:25.453963 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02140afc-5196-4579-a94d-0332a6f1281f tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.663456 Jul 20 10:47:25.461810 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 223/487] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:24 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:25.733800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:25.767021 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-456d6c47-2a29-45cf-a594-7fe30e69bd31 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1310 microversion: 2.1 time: 1.021260 Jul 20 10:47:25.771246 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 265/488] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:24 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1310 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:25.788476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:25.796644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:25.837625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:25.843390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:25.848082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:25.852148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:26.360704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d5cc09a-439d-42ad-9a19-c9faa1b76a12 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:26.410211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d5cc09a-439d-42ad-9a19-c9faa1b76a12 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.946419 Jul 20 10:47:26.417754 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 224/489] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:47:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:26.474109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:26.475859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:26.490279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:26.491402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:26.496362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:26.509325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:27.125438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:27.139236 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8e7b90e-5d99-4f14-839d-0ea573f52e37 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 1.365344 Jul 20 10:47:27.140373 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 266/490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:25 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:27.182590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:27.191325 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eaaa2068-4c8e-456e-92d7-12be1c8d3130 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.770718 Jul 20 10:47:27.196276 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 225/491] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:26 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:27.211251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:27.212247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:27.232183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:27.236281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:27.241024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:27.243015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:27.254335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:27.477388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:27.536771 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8fe78d7f-b840-451e-bc4d-a8838930d851 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.339133 Jul 20 10:47:27.537588 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 226/492] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:27 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:27.556477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:27.560495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:27.576303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:27.578198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:27.579444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:27.579892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:27.655215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c858fa12-386e-4572-b1d2-d7443eaa5916 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-511200265", "id": 1900604824, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:27.657983 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:47:27.657983 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:47:27.700465 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c858fa12-386e-4572-b1d2-d7443eaa5916 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.555014 Jul 20 10:47:27.710070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 267/493] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:27 2022] POST /compute/v2.1/flavors => generated 424 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:27.719651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1c318e9-e245-4057-baea-94d934f19e8a tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:27.749536 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1c318e9-e245-4057-baea-94d934f19e8a tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033486 Jul 20 10:47:27.753189 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 268/494] 10.222.0.79 () {58 vars in 1181 bytes} [Wed Jul 20 10:47:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:47:27.765378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b914e1a2-35c1-4872-bf80-9e3ff257cf6e tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1200414840", "id": 1289318237, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:27.821361 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b914e1a2-35c1-4872-bf80-9e3ff257cf6e tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.059757 Jul 20 10:47:27.824917 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 269/495] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:27 2022] POST /compute/v2.1/flavors => generated 425 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:47:27.844933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-376f6e4e-cbf2-4447-827e-a3f3086a9f36 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:27.884476 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-376f6e4e-cbf2-4447-827e-a3f3086a9f36 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.046870 Jul 20 10:47:27.888764 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 270/496] 10.222.0.79 () {58 vars in 1181 bytes} [Wed Jul 20 10:47:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 10:47:27.907539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-798d037c-dca8-4fad-98b1-208a9b0912c4 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Action: 'create', calling method: .version_select at 0x7f2c4c316e50>, body: {"keypair": {"name": "tempest-keypair-2046461815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn/pHavchEJHirBSRVVIUkAFp4g0Ez/BY/XUUZbA0FxPWdF37g0BgFL1j0LOph/8y4VtimCu3CXs0VncZG7J8RLoqSMHOEo+aTVD9QZV8pHrS1brII3Q9jyMacIX8JELw=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:27.962754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:27.988857 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6cb70845-c1eb-46ff-a694-b4ecb7362177 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1492 microversion: 2.1 time: 0.448017 Jul 20 10:47:28.019156 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 227/497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:27 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1492 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:28.064090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-798d037c-dca8-4fad-98b1-208a9b0912c4 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Getting quotas for project b1f86bfd704a4e09873d14c9aa3f88dc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:28.134363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-798d037c-dca8-4fad-98b1-208a9b0912c4 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Getting quotas for user 860bf9c0b96a4f0996edbaa5a0a49977 and project b1f86bfd704a4e09873d14c9aa3f88dc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:28.234214 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-798d037c-dca8-4fad-98b1-208a9b0912c4 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.332975 Jul 20 10:47:28.242221 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 271/498] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:47:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:28.257632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:28.261841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:28.286579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:28.287322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:28.288159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:28.292745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:28.669661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:28.671562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:28.691057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:28.692350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:28.694758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:28.702489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.174825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:29.205699 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0cea9a43-d5a7-43eb-ba85-96a396ab58cd tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.963331 Jul 20 10:47:29.216755 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 272/499] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:28 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:29.223641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:29.223641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:29.236751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:29.237084 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6bde57cb-3ae3-4003-95e2-9261e27a425e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1645 microversion: 2.1 time: 1.215603 Jul 20 10:47:29.238843 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 228/500] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:28 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1645 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:29.239535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.244019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:29.244747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.254228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:29.257674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:29.279140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:29.279831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.280859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:29.282798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.577683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:29.676954 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a99b6418-1e75-4c1e-92cb-9112788c02c9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.435901 Jul 20 10:47:29.683675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 229/501] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:29 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:29.693520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:29.696680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:29.731572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:29.740905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.743132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:29.744443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:29.879868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:29.899711 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d8f7564-5dd5-4f23-bc9b-2dd7da3e3c45 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.686378 Jul 20 10:47:29.911392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 273/502] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:29 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:30.226344 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd6f2320-ea9c-4b72-95f5-17d08462c581 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1645 microversion: 2.1 time: 0.537253 Jul 20 10:47:30.231149 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 230/503] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:29 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1645 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:30.237166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:30.237997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:30.253198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:30.254170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:30.260160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:30.261805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:30.265638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a20ccb7-d924-4428-ab15-7f153cce25fc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:30.272479 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:47:30.272479 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:47:30.276964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a20ccb7-d924-4428-ab15-7f153cce25fc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:30.279038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a20ccb7-d924-4428-ab15-7f153cce25fc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:30.281013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a20ccb7-d924-4428-ab15-7f153cce25fc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:30.282011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a20ccb7-d924-4428-ab15-7f153cce25fc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:30.445549 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a20ccb7-d924-4428-ab15-7f153cce25fc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.188454 Jul 20 10:47:30.449074 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 231/504] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:47:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:30.467695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-10", "block_migration": true, "disk_over_commit": false}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:30.476870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:30.504941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:30.508490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:30.509612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:30.512303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:30.574331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lazy-loading 'flavor' on Instance uuid 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:30.622531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Going to try to live migrate instance to n-h2-846219-10 {{(pid=125886) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:47:31.154574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:31.185613 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fac287a4-094b-433e-9b51-7abf5dba4fc5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.956417 Jul 20 10:47:31.201431 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 274/505] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:30 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:31.232583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-786a837d-2446-4d46-8d38-09b86231f6da req-e6591bb4-e957-424e-925c-94ebb3197d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "897b1110-b87f-4ca6-b8cb-e6d2b9746533", "tag": "b7a06a75-c5ad-4c35-b0be-fa71850bdfae"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:31.270630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-786a837d-2446-4d46-8d38-09b86231f6da req-e6591bb4-e957-424e-925c-94ebb3197d3c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:31.275572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-786a837d-2446-4d46-8d38-09b86231f6da req-e6591bb4-e957-424e-925c-94ebb3197d3c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:31.330532 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-786a837d-2446-4d46-8d38-09b86231f6da req-e6591bb4-e957-424e-925c-94ebb3197d3c service nova] Creating event network-changed:b7a06a75-c5ad-4c35-b0be-fa71850bdfae for instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 on n-h2-846219-10 Jul 20 10:47:31.346664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-786a837d-2446-4d46-8d38-09b86231f6da req-e6591bb4-e957-424e-925c-94ebb3197d3c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140742 Jul 20 10:47:31.352538 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 275/506] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:31.380853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:31.388288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:31.412684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:31.414851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:31.422447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:31.423476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:31.840876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:31.936434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89b66f46-d3b2-46f1-9817-34112033dfce tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.581921 Jul 20 10:47:31.953130 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 276/507] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:31 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:31.997647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:31.999374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:32.014274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:32.015477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:32.017708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:32.019089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:32.028809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:32.693254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:32.716174 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e30959ae-1c0b-4b89-9a5c-7c631ba64e25 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.745984 Jul 20 10:47:32.739108 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 277/508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:31 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:32.756575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:32.759729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:32.781956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:32.783393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:32.785001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:32.785713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:33.383615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:33.405742 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf44dda6-8faf-42ec-be66-fa91de4eecc4 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.662263 Jul 20 10:47:33.407932 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 278/509] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:32 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:33.993109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dde5ac5a-86ab-4d27-9501-2e6055bcfedb tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '.version_select at 0x7f2c4c0d3dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:34.290134 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dde5ac5a-86ab-4d27-9501-2e6055bcfedb tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2" status: 200 len: 371 microversion: 2.1 time: 0.880540 Jul 20 10:47:34.305989 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 279/510] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:47:33 2022] GET /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2 => generated 371 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:34.325878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:34.327895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:34.343463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:34.345672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:34.347343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:34.348741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:34.794965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:34.932900 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-115eea4b-00c7-468c-bcff-f610bebcfcfb tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.623861 Jul 20 10:47:34.950007 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 280/511] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:34 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:34.972134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:34.973865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:34.992647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:34.993886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:34.997443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:34.998724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:35.964217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:36.007686 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-956e59ed-515e-4e79-8a0d-6a42fbd82c4b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 1.054048 Jul 20 10:47:36.009223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 281/512] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:34 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:36.025441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bacaf5e6-2a90-47af-bf65-f5644b83289f tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3ff07af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:36.615561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bacaf5e6-2a90-47af-bf65-f5644b83289f tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:36.616018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bacaf5e6-2a90-47af-bf65-f5644b83289f tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:36.617962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bacaf5e6-2a90-47af-bf65-f5644b83289f tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:36.618592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bacaf5e6-2a90-47af-bf65-f5644b83289f tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:36.697639 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2509b7be-4619-49bd-92a1-8d695341f5a3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620/action" status: 202 len: 0 microversion: 2.1 time: 6.237016 Jul 20 10:47:36.699131 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 232/513] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:47:30 2022] POST /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620/action => generated 0 bytes in 6241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:47:36.705544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:36.706451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:36.723344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:36.728013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:36.729310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:36.730283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:36.762323 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bacaf5e6-2a90-47af-bf65-f5644b83289f tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2" status: 200 len: 328 microversion: 2.1 time: 0.751730 Jul 20 10:47:36.776630 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 282/514] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:47:36 2022] PUT /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2 => generated 328 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:36.784685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-288781567", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "1289318237", "adminPass": "***", "networks": [{"uuid": "04856346-c838-4631-acfb-10202c0fe807"}], "security_groups": [{"name": "tempest-securitygroup--1289740485"}], "key_name": "tempest-keypair-2046461815", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:37.190336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:37.201220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] validate_networks() for [('04856346-c838-4631-acfb-10202c0fe807', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:37.203991 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f32fd1fb-8a99-448a-acb4-c3ffe4603bd5 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.503803 Jul 20 10:47:37.214513 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 233/515] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:36 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:37.223986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:37.226067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:37.237455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:37.246800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:37.248534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:37.249433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:37.608989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:37.655215 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0397fe59-58b7-4932-bc01-d8ec356b96ee tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.436681 Jul 20 10:47:37.655837 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 234/516] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:37 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:37.665075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-adf170f4-7300-4699-a3fa-5133750b9fc5 req-0eb58475-7bab-4e9f-937f-3c1583a7e951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd8a1f5-0da1-47f2-8767-dd476d919da5", "name": "network-vif-plugged", "status": "completed", "tag": "0033d629-ebb8-49e1-8ce2-712fe79ed7c5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:37.692562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-adf170f4-7300-4699-a3fa-5133750b9fc5 req-0eb58475-7bab-4e9f-937f-3c1583a7e951 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:37.693732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-adf170f4-7300-4699-a3fa-5133750b9fc5 req-0eb58475-7bab-4e9f-937f-3c1583a7e951 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:37.721957 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-adf170f4-7300-4699-a3fa-5133750b9fc5 req-0eb58475-7bab-4e9f-937f-3c1583a7e951 service nova] Creating event network-vif-plugged:0033d629-ebb8-49e1-8ce2-712fe79ed7c5 for instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 on n-h1-846219-10 Jul 20 10:47:37.733782 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-adf170f4-7300-4699-a3fa-5133750b9fc5 req-0eb58475-7bab-4e9f-937f-3c1583a7e951 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075331 Jul 20 10:47:37.735772 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 235/517] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:37.751708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:37.753740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:37.772200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:37.774594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:37.778955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:37.781943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:38.230743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:38.247159 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19f86a9d-1d29-4795-bb8b-fa66d5e33e32 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1502 microversion: 2.1 time: 0.507140 Jul 20 10:47:38.248243 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 236/518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:37 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1502 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:38.255506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2b5fbcf-4427-4002-a073-6ae5167b04f6 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:38.268398 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2b5fbcf-4427-4002-a073-6ae5167b04f6 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2" status: 202 len: 0 microversion: 2.1 time: 0.018546 Jul 20 10:47:38.269662 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 237/519] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 10:47:38 2022] DELETE /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2 => generated 0 bytes in 20 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:47:38.279438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:38.280722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:38.289922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:38.290891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:38.296790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:38.297578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:39.052153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:39.052913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:39.052913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:39.053314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:39.054298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:39.056760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:39.092550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:39.093647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:39.095625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:39.096973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:39.145612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Getting quotas for project b1f86bfd704a4e09873d14c9aa3f88dc. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:39.174944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Getting quotas for user 860bf9c0b96a4f0996edbaa5a0a49977 and project b1f86bfd704a4e09873d14c9aa3f88dc. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:39.204770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:39.218859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:39.223672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:39.243632 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d78afa00-d101-497b-bc22-719e74ba2118 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.971306 Jul 20 10:47:39.260750 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 238/520] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:38 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:39.285927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:39.287234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:39.302741 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed5cb9c5-dfe3-4206-aebd-7f96c8f8d86a tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.523446 Jul 20 10:47:39.304229 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 283/521] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:47:39.310177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e45f8b6-7946-49d6-9082-50bd897d4696 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '.version_select at 0x7f2c4c1514c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:39.321860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:39.322731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:39.324161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:39.324879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:40.013641 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e45f8b6-7946-49d6-9082-50bd897d4696 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2" status: 200 len: 371 microversion: 2.1 time: 0.707871 Jul 20 10:47:40.015961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 284/522] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:47:39 2022] GET /compute/v2.1/os-quota-sets/3c6cd92bde3747ceaaac2df61ad307c2 => generated 371 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:40.028001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:40.039366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:40.042964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:40.048721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b1d2f9d-43ba-44bd-8401-d9ceb2a9e34d tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.784834 Jul 20 10:47:40.051587 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 239/523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:39 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:40.056154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:40.057583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:40.057975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:40.059958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:40.067096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7985b6fe-9e78-4821-a9f3-5fed1e521251 req-118b26dc-c276-4271-93e8-7cd41ecd6da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae21dfc-ec5d-483b-81c8-6b3d2a601620", "name": "network-vif-unplugged", "status": "completed", "tag": "06e1be1c-ac80-4793-896d-da3e027de287"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:40.090845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7985b6fe-9e78-4821-a9f3-5fed1e521251 req-118b26dc-c276-4271-93e8-7cd41ecd6da5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:40.092192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7985b6fe-9e78-4821-a9f3-5fed1e521251 req-118b26dc-c276-4271-93e8-7cd41ecd6da5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:40.117212 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7985b6fe-9e78-4821-a9f3-5fed1e521251 req-118b26dc-c276-4271-93e8-7cd41ecd6da5 service nova] Creating event network-vif-unplugged:06e1be1c-ac80-4793-896d-da3e027de287 for instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 on n-h1-846219-10 Jul 20 10:47:40.131595 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7985b6fe-9e78-4821-a9f3-5fed1e521251 req-118b26dc-c276-4271-93e8-7cd41ecd6da5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076044 Jul 20 10:47:40.136555 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 240/524] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:40.296684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:40.303431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:40.358505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1224503035", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:40.367729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-56678f92-06ea-4336-97e0-a55bc546af93 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.349505 Jul 20 10:47:40.387222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 285/525] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:40 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:40.393767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:40.400598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:40.421584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:40.422568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:40.430810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:40.433403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:40.530891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:40.552059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:41.336957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:41.358388 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cae46af5-7bea-433f-a1cf-84c11bb54abc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1502 microversion: 2.1 time: 0.987389 Jul 20 10:47:41.362402 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 286/526] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:40 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1502 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:41.371271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:41.372530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:41.384068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.386255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.387618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.388995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.564021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:41.593386 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13cd6d1d-7256-4b67-aafc-72df9a359030 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1316 microversion: 2.1 time: 0.222801 Jul 20 10:47:41.599402 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 287/527] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:41 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:41.599637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:41.600526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:41.600779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:41.601432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:41.602209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:41.613487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0b4c91b2-a96e-4b55-9fd0-702c3272dcba req-f03416bc-3e27-454e-b5a2-1957cc2aa702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc629c-81a7-45b0-93b7-fd3f394e0d8d", "name": "network-vif-plugged", "status": "completed", "tag": "bbc6b72f-9345-49ed-9f5b-83aba0b1d14d"}, {"server_uuid": "897b1110-b87f-4ca6-b8cb-e6d2b9746533", "name": "network-vif-plugged", "status": "completed", "tag": "b7a06a75-c5ad-4c35-b0be-fa71850bdfae"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:41.628936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.629656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.630900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.631601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.642442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0b4c91b2-a96e-4b55-9fd0-702c3272dcba req-f03416bc-3e27-454e-b5a2-1957cc2aa702 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.643258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0b4c91b2-a96e-4b55-9fd0-702c3272dcba req-f03416bc-3e27-454e-b5a2-1957cc2aa702 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.656408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:41.663334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for user 14131c23a0e24e56bbf0ea1a167e256c and project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:41.684434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0b4c91b2-a96e-4b55-9fd0-702c3272dcba req-f03416bc-3e27-454e-b5a2-1957cc2aa702 service nova] Creating event network-vif-plugged:bbc6b72f-9345-49ed-9f5b-83aba0b1d14d for instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d on n-h1-846219-10 Jul 20 10:47:41.685049 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0b4c91b2-a96e-4b55-9fd0-702c3272dcba req-f03416bc-3e27-454e-b5a2-1957cc2aa702 service nova] Creating event network-vif-plugged:b7a06a75-c5ad-4c35-b0be-fa71850bdfae for instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 on n-h2-846219-10 Jul 20 10:47:41.700667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:41.706033 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0b4c91b2-a96e-4b55-9fd0-702c3272dcba req-f03416bc-3e27-454e-b5a2-1957cc2aa702 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103385 Jul 20 10:47:41.708869 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 288/528] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:41.715238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:41.729416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:41.731443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:41.747673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.752132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.753932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:41.755953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:41.855358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f1cbaa86-b239-412c-bb62-2960c748e283 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705916 Jul 20 10:47:41.856232 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 241/529] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:47:41.874449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a44c329-046c-4392-9dba-18ee51f26802 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '.version_select at 0x7f2c3f94a940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:42.446191 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a44c329-046c-4392-9dba-18ee51f26802 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa/defaults" status: 200 len: 371 microversion: 2.1 time: 0.588135 Jul 20 10:47:42.446938 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 242/530] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:47:41 2022] GET /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa/defaults => generated 371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:42.468843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:42.470044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:42.497656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:42.498198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:42.499335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:42.500013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:42.606033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:42.649184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb55c7ed-27a0-440d-98b2-690d09cf5890 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1317 microversion: 2.1 time: 0.936272 Jul 20 10:47:42.651104 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 289/531] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:41 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1317 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:42.660531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:42.662146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:42.681585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:42.683118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:42.686682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:42.687358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:42.875797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:42.930587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-20a2f297-a001-406d-9679-cae7151ca124 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.277213 Jul 20 10:47:42.937093 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 290/532] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:42 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:42.958933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5dee5b2d-bb81-4776-bf27-7a90d75a4c39 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:42.966217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5dee5b2d-bb81-4776-bf27-7a90d75a4c39 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:43.141996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5dee5b2d-bb81-4776-bf27-7a90d75a4c39 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:43.142291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:43.153795 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-af537c9d-bb1d-4f44-8578-24ac8e226351 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1319 microversion: 2.1 time: 0.691200 Jul 20 10:47:43.154403 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 243/533] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:42 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:43.159722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9bba217c-9095-4d79-928c-85d728dfa856 req-19ff5ff9-102e-4d9a-aac1-287c2076d947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae21dfc-ec5d-483b-81c8-6b3d2a601620", "tag": "06e1be1c-ac80-4793-896d-da3e027de287"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:43.172076 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5dee5b2d-bb81-4776-bf27-7a90d75a4c39 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1213 microversion: 2.1 time: 0.231194 Jul 20 10:47:43.172731 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 291/534] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:42 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:43.177484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9bba217c-9095-4d79-928c-85d728dfa856 req-19ff5ff9-102e-4d9a-aac1-287c2076d947 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.178307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9bba217c-9095-4d79-928c-85d728dfa856 req-19ff5ff9-102e-4d9a-aac1-287c2076d947 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.196730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:43.196999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:43.214477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.216805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.221365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.222382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.222530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9bba217c-9095-4d79-928c-85d728dfa856 req-19ff5ff9-102e-4d9a-aac1-287c2076d947 service nova] Creating event network-changed:06e1be1c-ac80-4793-896d-da3e027de287 for instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 on n-h1-846219-10 Jul 20 10:47:43.233503 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9bba217c-9095-4d79-928c-85d728dfa856 req-19ff5ff9-102e-4d9a-aac1-287c2076d947 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077418 Jul 20 10:47:43.234761 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 244/535] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:43.241857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:43.247566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:43.268362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.273676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.275627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.279660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.289637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:43.523711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:43.542585 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78edd09c-a6e3-4755-a49e-d1655bdce461 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1322 microversion: 2.1 time: 0.303616 Jul 20 10:47:43.575394 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 245/536] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:43 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:43.589976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11b33423-279a-4ede-8b1c-c30a3484dfd7 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f94a9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:43.724083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:43.747396 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a48b91f-4d15-46a4-b79a-45178df0077f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1502 microversion: 2.1 time: 0.548967 Jul 20 10:47:43.762923 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 292/537] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:43 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1502 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:43.812363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b33423-279a-4ede-8b1c-c30a3484dfd7 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.813170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b33423-279a-4ede-8b1c-c30a3484dfd7 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.823409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:43.824561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:43.835879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b33423-279a-4ede-8b1c-c30a3484dfd7 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.836613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b33423-279a-4ede-8b1c-c30a3484dfd7 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.845455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.858354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:43.866657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:43.867672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.080561 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11b33423-279a-4ede-8b1c-c30a3484dfd7 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17" status: 200 len: 328 microversion: 2.1 time: 0.497930 Jul 20 10:47:44.088904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 246/538] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:47:43 2022] PUT /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17 => generated 328 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:44.110086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:44.111465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:44.137545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.138815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.141218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.142412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.313944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:44.332109 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2173a0e-d907-4ff2-a702-2d4b16b74613 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1466 microversion: 2.1 time: 0.567077 Jul 20 10:47:44.348273 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 293/539] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:43 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1466 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:44.368765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a1f7216-e2d8-45a0-bbbe-d50033a12e5d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '.version_select at 0x7f2c3fe8d820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:44.437053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:44.489212 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d4cbd88-00f7-4a8c-8050-91320456a0d3 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.398047 Jul 20 10:47:44.492371 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 247/540] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:44 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:44.514333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:44.515381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:44.520512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a1f7216-e2d8-45a0-bbbe-d50033a12e5d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.521264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a1f7216-e2d8-45a0-bbbe-d50033a12e5d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.523284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a1f7216-e2d8-45a0-bbbe-d50033a12e5d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.524027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a1f7216-e2d8-45a0-bbbe-d50033a12e5d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.526729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.527582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.528730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.529464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.595267 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a1f7216-e2d8-45a0-bbbe-d50033a12e5d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17/detail" status: 200 len: 916 microversion: 2.1 time: 0.239097 Jul 20 10:47:44.604893 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 294/541] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:47:44 2022] GET /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17/detail => generated 916 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:44.609020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:44.609874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:44.640381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.640978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.647621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:44.648397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:44.965212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:44.978562 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2093543b-bb80-4626-a48f-754c0cda8a42 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1265 microversion: 2.1 time: 0.379190 Jul 20 10:47:44.979236 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 295/542] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:44 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1265 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:44.996824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:44.997448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:45.006890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:45.007379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:45.008170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:45.008609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:45.422201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:45.433344 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a7d6531-f488-4967-8ff4-cc0d4167ab63 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1468 microversion: 2.1 time: 0.938746 Jul 20 10:47:45.435846 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 248/543] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:44 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1468 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:45.450862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:45.453696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:45.473295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:45.476332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:45.478093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:45.479189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:45.514591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:45.527504 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-688bd584-d9fc-4b3e-a248-4260518ae61d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 200 len: 1467 microversion: 2.1 time: 0.533540 Jul 20 10:47:45.545490 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 296/544] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:44 2022] GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 1467 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:45.571604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:45.573525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:45.624595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:45.626643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:45.629154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:45.629866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.139575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:46.156289 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eb7c5e31-fd55-40d7-86f0-49c2cd7c3182 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 0.717995 Jul 20 10:47:46.158357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 249/545] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:45 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:46.165878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f910940>, body: {"quota_set": {"ram": "2048"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:46.197023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:46.207587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c5f3d10-a0b6-49c7-95e5-b97d7387f202 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1502 microversion: 2.1 time: 0.660498 Jul 20 10:47:46.208562 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 297/546] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:45 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1502 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:46.214712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:46.216197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:46.223486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.224013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.224867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.225569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.242246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:46.253070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.253778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.254763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.255407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.313999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.315041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.316477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.317455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.388430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a133da91-d4a5-49c4-b198-9883d9b72e4e tempest-DeleteServersAdminTestJSON-1294894424 tempest-DeleteServersAdminTestJSON-1294894424-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533/action" status: 202 len: 0 microversion: 2.1 time: 0.177179 Jul 20 10:47:46.389432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 298/547] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:47:46 2022] POST /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:47:46.396764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:46.397808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:46.409821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.410787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.412193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.413650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.440027 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d6de693-e145-4b10-b793-9224c63a4d12 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17?user_id=09e7608943da45c8b9e31c28e478a2c0" status: 200 len: 328 microversion: 2.1 time: 0.280096 Jul 20 10:47:46.440991 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 250/548] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:47:46 2022] PUT /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17?user_id=09e7608943da45c8b9e31c28e478a2c0 => generated 328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:46.449670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:46.456954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:46.458609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Searching by: {'reservation_id': 'r-3rfznbk0', 'deleted': False, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:47:46.472642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.473639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.474921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.475624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.655745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:46.704896 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1af4962-d977-47ee-a17e-1ace9419cac2 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1931 microversion: 2.75 time: 0.313811 Jul 20 10:47:46.712129 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 299/549] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:46 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1931 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:46.717373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7dc899c4-7f86-4a95-8a26-645c5a0b5f56 req-cff0c949-83ba-446e-bb12-578c8017fc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe91d9f2-c297-46cf-a70d-409e036899a2", "tag": "b0f43925-7a7a-4678-ae05-2d2660124131"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:46.726804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:47:46.731210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7dc899c4-7f86-4a95-8a26-645c5a0b5f56 req-cff0c949-83ba-446e-bb12-578c8017fc04 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.732191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7dc899c4-7f86-4a95-8a26-645c5a0b5f56 req-cff0c949-83ba-446e-bb12-578c8017fc04 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.750406 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7dc899c4-7f86-4a95-8a26-645c5a0b5f56 req-cff0c949-83ba-446e-bb12-578c8017fc04 service nova] Creating event network-changed:b0f43925-7a7a-4678-ae05-2d2660124131 for instance fe91d9f2-c297-46cf-a70d-409e036899a2 on n-h2-846219-10 Jul 20 10:47:46.756457 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7dc899c4-7f86-4a95-8a26-645c5a0b5f56 req-cff0c949-83ba-446e-bb12-578c8017fc04 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043230 Jul 20 10:47:46.757392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 300/550] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:46.768050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:46.768528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:46.788986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.789327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.790142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.790587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:46.927368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:46.936055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:46.936495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.052292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:47.066413 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-39549d98-83af-41ec-b604-f0962580cb00 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1271 microversion: 2.1 time: 0.307121 Jul 20 10:47:47.068160 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 301/551] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:46 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:47.074102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:47.074962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:47.091054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.091919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.092949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.093555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.205362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.206312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.207058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lazy-loading 'fault' on Instance uuid 897b1110-b87f-4ca6-b8cb-e6d2b9746533 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:47.417208 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-14d5ecd3-862a-479b-a90a-d5d6e889b718 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-3rfznbk0" status: 200 len: 2926 microversion: 2.1 time: 0.974253 Jul 20 10:47:47.418468 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 251/552] 10.222.0.79 () {58 vars in 1196 bytes} [Wed Jul 20 10:47:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-3rfznbk0 => generated 2926 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:47.423048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-20b0a558-387e-42df-94d0-ae0b9e8059f0 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '.version_select at 0x7f2c3fa8f310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:47.578902 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-20b0a558-387e-42df-94d0-ae0b9e8059f0 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17?user_id=09e7608943da45c8b9e31c28e478a2c0" status: 200 len: 370 microversion: 2.1 time: 0.159206 Jul 20 10:47:47.587600 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 252/553] 10.222.0.79 () {58 vars in 1322 bytes} [Wed Jul 20 10:47:47 2022] GET /compute/v2.1/os-quota-sets/5698b447c7874410b37f625f091f0f17?user_id=09e7608943da45c8b9e31c28e478a2c0 => generated 370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:47.588208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:47.590006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:47.601065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.602146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.603443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.604650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.891331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:47.905447 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebbb4c44-e260-46aa-8749-7887ce2f1ebf tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1451 microversion: 2.1 time: 0.835706 Jul 20 10:47:47.918317 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 302/554] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:47 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1451 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:47.929020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:47.929650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:47.941163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.941617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:47.942408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:47.942846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.002273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:48.083532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:48.110033 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a3e758d-f7be-4c5b-bfbc-78e9accaafad tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 0.527192 Jul 20 10:47:48.111012 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 253/555] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:47 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:48.116159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9873cb7e-d393-4889-928a-947864220a93 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:48.143041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.server_groups [None req-9873cb7e-d393-4889-928a-947864220a93 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Querying cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) for 2 instances {{(pid=125886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 10:47:48.144199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9873cb7e-d393-4889-928a-947864220a93 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.144818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9873cb7e-d393-4889-928a-947864220a93 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.214117 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9873cb7e-d393-4889-928a-947864220a93 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/96edb646-1686-4fd1-8062-c44bd883172b" status: 200 len: 265 microversion: 2.1 time: 0.100244 Jul 20 10:47:48.215860 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 254/556] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:47:48 2022] GET /compute/v2.1/os-server-groups/96edb646-1686-4fd1-8062-c44bd883172b => generated 265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:48.225417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:48.226729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:48.236181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.236633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.237428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.238048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.367921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:48.397163 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5a051a53-418e-49bc-b8f6-7824cd4de3af tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1937 microversion: 2.75 time: 0.179200 Jul 20 10:47:48.398221 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 255/557] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:48 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1937 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:48.423981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:48.424973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:48.437145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.438151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.439843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.441098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.493830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:48.504717 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-053a9157-ac21-4317-829a-119af026fdef tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1502 microversion: 2.1 time: 0.593107 Jul 20 10:47:48.507216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:47:48.511583 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 303/558] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:47 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1502 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:48.521328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:48.525306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:48.540990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.543039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.547924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:48.548631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:48.664918 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94b76b64-775e-4f76-9da8-6f85d2a9b822 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 204 len: 0 microversion: 2.1 time: 0.251570 Jul 20 10:47:48.671573 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 256/559] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:47:48 2022] DELETE /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:47:49.080779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:49.090364 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c9ded871-7872-4a72-be32-5c75e0168c7c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.577685 Jul 20 10:47:49.094948 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 304/560] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:48 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:49.104369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:49.109833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:49.130217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:49.130790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:49.131675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:49.132118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:49.141962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-68200726", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "91e8e2a5-7d79-4c89-b21c-e5ff9469e846"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:49.276508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] validate_networks() for [('91e8e2a5-7d79-4c89-b21c-e5ff9469e846', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:49.693021 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a568112-e3a7-4482-8cd0-a52660b0354d tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 200 len: 1619 microversion: 2.1 time: 0.596766 Jul 20 10:47:49.694146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 305/561] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:49 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 1619 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:49.706512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-46b600ce-e5cd-485e-b58d-70ec16e26f32 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Calling method '.version_select at 0x7f2c4c1514c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:49.922817 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-46b600ce-e5cd-485e-b58d-70ec16e26f32 tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa/defaults" status: 200 len: 371 microversion: 2.1 time: 0.227430 Jul 20 10:47:49.929431 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 306/562] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:47:49 2022] GET /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa/defaults => generated 371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:49.936302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:49.937693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:49.950106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:49.950563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:49.951842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:49.952619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.017254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.018015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.018852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lazy-loading 'fault' on Instance uuid 897b1110-b87f-4ca6-b8cb-e6d2b9746533 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:50.285611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:50.288731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:50.291996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:50.293003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:50.293947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:50.315874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.316668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.319376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.320833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.382779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:50.408358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for user cc3921f3f8264fb2aa9c95b86cf4dd9d and project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:50.450450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:50.453803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:50.456497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:50.465601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-624597b5-c0bf-4d5c-be0a-06342e6d4be3 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1457 microversion: 2.1 time: 0.534448 Jul 20 10:47:50.466215 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 307/563] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:49 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1457 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:50.482042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-70d07160-ed45-48c3-8bd2-d81b2ed83d1e req-c9ce761f-508f-4cc2-baf9-43505e4cd8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae21dfc-ec5d-483b-81c8-6b3d2a601620", "name": "network-vif-unplugged", "status": "completed", "tag": "06e1be1c-ac80-4793-896d-da3e027de287"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:50.492278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-70d07160-ed45-48c3-8bd2-d81b2ed83d1e req-c9ce761f-508f-4cc2-baf9-43505e4cd8be service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.492717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-70d07160-ed45-48c3-8bd2-d81b2ed83d1e req-c9ce761f-508f-4cc2-baf9-43505e4cd8be service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.520181 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-70d07160-ed45-48c3-8bd2-d81b2ed83d1e req-c9ce761f-508f-4cc2-baf9-43505e4cd8be service nova] Creating event network-vif-unplugged:06e1be1c-ac80-4793-896d-da3e027de287 for instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 on n-h1-846219-10 Jul 20 10:47:50.531766 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-70d07160-ed45-48c3-8bd2-d81b2ed83d1e req-c9ce761f-508f-4cc2-baf9-43505e4cd8be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053860 Jul 20 10:47:50.533892 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 308/564] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:50.553507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:50.555379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:50.576283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.577583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.583378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.586479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.629120 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b14927f-37a9-4d2c-8984-04fbc612f820 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.953330 Jul 20 10:47:50.632616 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 257/565] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:47:50.648619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:50.651637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:50.665830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.667619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.669293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:50.671510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:50.966518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:51.029743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cfed88d1-7f3e-4b74-9e1c-ae721c8c6293 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1937 microversion: 2.75 time: 0.394428 Jul 20 10:47:51.034714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 258/566] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:50 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1937 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:51.051150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:51.052135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:51.090407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:51.091055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:51.094862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:51.112117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:51.179221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:51.212322 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2008a371-60e8-44fb-9e4c-2995d54ce0b8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 0.667532 Jul 20 10:47:51.228276 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 309/567] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:50 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:51.241102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:51.241718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:51.273125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:51.273595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:51.274404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:51.274842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:51.853136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:51.862414 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e3619b68-ac24-481b-aecd-3e0741b08276 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1502 microversion: 2.1 time: 0.826255 Jul 20 10:47:51.883330 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 259/568] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:51 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1502 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:51.899854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fbf722ec-808d-4eb9-bd3f-13e614cb09cf tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f643430>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:51.990948 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-68348498-a06b-4d10-8ed3-a42b86707dca tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 200 len: 1620 microversion: 2.1 time: 0.760781 Jul 20 10:47:51.994584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 310/569] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:51 2022] GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 1620 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:52.008380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:52.012996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:52.035889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.036687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.039852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.040580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.143738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbf722ec-808d-4eb9-bd3f-13e614cb09cf tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.144729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbf722ec-808d-4eb9-bd3f-13e614cb09cf tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.146733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbf722ec-808d-4eb9-bd3f-13e614cb09cf tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.148289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbf722ec-808d-4eb9-bd3f-13e614cb09cf tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.495431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=14,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:52.578422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fbf722ec-808d-4eb9-bd3f-13e614cb09cf tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa" status: 200 len: 329 microversion: 2.1 time: 0.693413 Jul 20 10:47:52.579447 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 260/570] 10.222.0.79 () {60 vars in 1262 bytes} [Wed Jul 20 10:47:51 2022] PUT /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa => generated 329 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:52.585989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:52.586953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:52.595512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.596370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.597395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.605498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.719502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:52.754837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:52.761936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:52.765534 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5bfc1ead-9f3a-41a4-9255-9ed44388f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1312 microversion: 2.25 time: 0.184325 Jul 20 10:47:52.788499 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 261/571] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:52 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:52.802190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-98b11548-eb95-4a8c-a5d2-2c5d06ad0d2e req-988e9654-fa5b-4443-9287-de32f241e597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c246d4-40d9-44e6-ba74-ae2d6391c4c2", "tag": "bd65064d-d349-4797-86ea-06a35e3eb77f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:52.847598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-98b11548-eb95-4a8c-a5d2-2c5d06ad0d2e req-988e9654-fa5b-4443-9287-de32f241e597 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.848588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-98b11548-eb95-4a8c-a5d2-2c5d06ad0d2e req-988e9654-fa5b-4443-9287-de32f241e597 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.901454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:52.913670 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-98b11548-eb95-4a8c-a5d2-2c5d06ad0d2e req-988e9654-fa5b-4443-9287-de32f241e597 service nova] Creating event network-changed:bd65064d-d349-4797-86ea-06a35e3eb77f for instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 on n-h1-846219-10 Jul 20 10:47:52.939402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-98b11548-eb95-4a8c-a5d2-2c5d06ad0d2e req-988e9654-fa5b-4443-9287-de32f241e597 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149553 Jul 20 10:47:52.940087 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 262/572] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:52.949880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:52.950729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:52.962814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.964369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:52.965415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:52.965890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.055570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.057301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.058180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lazy-loading 'fault' on Instance uuid 897b1110-b87f-4ca6-b8cb-e6d2b9746533 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:53.212080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3698cfa68fe544aaa91f4ed4e1025685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0bd00fa22af486ba7cf6d4330b3ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:53.229332 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-935835c4-5f7b-462b-9fe4-986c48f5ab59 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 200 len: 1309 microversion: 2.1 time: 0.287156 Jul 20 10:47:53.230257 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 263/573] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:52 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:53.235247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dbcbe9c1-15f1-4207-bdfc-94763617b541 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: .version_select at 0x7f2c3f698700>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1521157602", "policies": ["anti-affinity"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:53.263323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dbcbe9c1-15f1-4207-bdfc-94763617b541 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:53.266530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:53.274911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dbcbe9c1-15f1-4207-bdfc-94763617b541 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:53.275131 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3eb1b4a8-71f4-4b1f-8e78-9737dd1cf86d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 1.278930 Jul 20 10:47:53.275663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 311/574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:51 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:53.290299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:53.291210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:53.299341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.299961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.301075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.301517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.360303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dbcbe9c1-15f1-4207-bdfc-94763617b541 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:53.368683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dbcbe9c1-15f1-4207-bdfc-94763617b541 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:53.393183 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dbcbe9c1-15f1-4207-bdfc-94763617b541 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.161285 Jul 20 10:47:53.394804 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 264/575] 10.222.0.79 () {60 vars in 1173 bytes} [Wed Jul 20 10:47:53 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:53.402854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:53.403743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:53.424741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] Lazy-loading 'services' on Instance uuid f90503e7-ffd6-4a64-bc05-aaf50786bb6c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:47:53.433402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.435735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.439720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.440518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.520753 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50e88352-07d5-4361-bd1b-5fb1593898e9 tempest-ServersAdmin275Test-254817947 tempest-ServersAdmin275Test-254817947-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1922 microversion: 2.75 time: 0.232838 Jul 20 10:47:53.547258 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 312/576] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:53 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1922 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:53.553256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8c9b3e0e-2a35-4907-ba5b-93945ebc6e2d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3fed8ee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:53.660786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c9b3e0e-2a35-4907-ba5b-93945ebc6e2d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.661898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c9b3e0e-2a35-4907-ba5b-93945ebc6e2d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.662727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c9b3e0e-2a35-4907-ba5b-93945ebc6e2d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.663217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c9b3e0e-2a35-4907-ba5b-93945ebc6e2d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.704700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:53.775919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:53.789495 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7f6cd63-b175-442a-94ec-860e1a62b33d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 0.388694 Jul 20 10:47:53.800575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 265/577] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:53 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:53.807718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-68750089-5ae3-4cd8-85dd-471d5ee434e4 req-376044d3-7f8f-4623-8b89-8a3d80215d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897b1110-b87f-4ca6-b8cb-e6d2b9746533", "name": "network-vif-deleted", "tag": "b7a06a75-c5ad-4c35-b0be-fa71850bdfae"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:53.815827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-68750089-5ae3-4cd8-85dd-471d5ee434e4 req-376044d3-7f8f-4623-8b89-8a3d80215d5e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.816271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-68750089-5ae3-4cd8-85dd-471d5ee434e4 req-376044d3-7f8f-4623-8b89-8a3d80215d5e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.829273 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-68750089-5ae3-4cd8-85dd-471d5ee434e4 req-376044d3-7f8f-4623-8b89-8a3d80215d5e service nova] Creating event network-vif-deleted:b7a06a75-c5ad-4c35-b0be-fa71850bdfae for instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 on n-h2-846219-10 Jul 20 10:47:53.835642 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-68750089-5ae3-4cd8-85dd-471d5ee434e4 req-376044d3-7f8f-4623-8b89-8a3d80215d5e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Jul 20 10:47:53.836678 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 266/578] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:53.843133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:53.843736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:53.856683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.857372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:53.858306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:53.858306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.076876 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8c9b3e0e-2a35-4907-ba5b-93945ebc6e2d tempest-QuotasAdminTestJSON-1718315904 tempest-QuotasAdminTestJSON-1718315904-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa" status: 200 len: 329 microversion: 2.1 time: 0.527824 Jul 20 10:47:54.077340 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 313/579] 10.222.0.79 () {60 vars in 1262 bytes} [Wed Jul 20 10:47:53 2022] PUT /compute/v2.1/os-quota-sets/a0e05f80dcda4dc8864937008edd62aa => generated 329 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:54.082392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1358681379", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c7801ff6-e5f6-4bcd-8cf4-b7f7178f0053"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:54.102232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:54.110632 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b6fe024-9f5a-448e-94bf-ffaf461f3420 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1492 microversion: 2.1 time: 0.272449 Jul 20 10:47:54.111464 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 267/580] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:53 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1492 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:54.116181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:54.116914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:54.124567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.125307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.126270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.126875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.160018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:54.183390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:47:54.336905 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9743ebaa-9f55-4d76-be78-34d0be6ebf97 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 204 len: 0 microversion: 2.75 time: 0.223442 Jul 20 10:47:54.339132 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 268/581] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:47:54 2022] DELETE /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:47:54.347803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:54.349325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:54.360689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.361866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.363066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.364700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.542417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:54.558296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:54.562227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:54.565423 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0ac926b2-ddf2-4b6f-bb68-b2e390432fdc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1318 microversion: 2.25 time: 0.224498 Jul 20 10:47:54.567126 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 269/582] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:54 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:54.576757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5fc69760-48fa-4dd9-89c2-759c28fb5188 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '.version_select at 0x7f2c3f69b1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:54.582229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fc69760-48fa-4dd9-89c2-759c28fb5188 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.583300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fc69760-48fa-4dd9-89c2-759c28fb5188 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.831500 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5fc69760-48fa-4dd9-89c2-759c28fb5188 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.262303 Jul 20 10:47:54.839117 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 270/583] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:47:54 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:47:54.844908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:54.845160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:54.854182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.854635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.855459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.855917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.861839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:54.862818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:54.863484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:54.864259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:54.864833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:54.877828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] HTTP exception thrown: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Request method failure captured: Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 HTTP/1.1 Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190DREHUils3hLMhbk86bSPjicSjKEODV-HcWOEnJuh6pXc339B47JyvmiDBqoHLyA22xYMSIw5q15HvDlNRWS9fD561YPj4ncUdTrYOrPoQbbMtob1ThBOabfGkznjR-HWMm7oZL8AnC9JGUCA89CWbK1aywVExK6EvQQDET6nS3fg Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:47:54.879767 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c0bd00fa22af486ba7cf6d4330b3ef6b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3698cfa68fe544aaa91f4ed4e1025685 Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:54.881402 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '897b1110-b87f-4ca6-b8cb-e6d2b9746533'} Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:54.882288 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:54.883797 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:54.886929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Returning 404 to user: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:54.888018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3759756b-cefc-4ff3-84e5-94eb937a0447 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 404 len: 111 microversion: 2.1 time: 0.047910 Jul 20 10:47:54.889101 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 271/584] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:54 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:47:54.901747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:54.902867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:54.909324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=61 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:54.916511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.917660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.918653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.919755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.919973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.920543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.921807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:54.922445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:54.985185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:54.997840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:55.023339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Going to run 2 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:55.029132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:55.115464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125885) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 20 10:47:55.149467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:55.152942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:55.158624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:55.170399 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c5e521f-d754-4537-bb0f-c236f0243b85 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.279694 Jul 20 10:47:55.171768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 272/585] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:54 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:55.188348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:55.190357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:55.201559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.202796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.204584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.205792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.251820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:55.269602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:55.277582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:INSERT=18,nova_api:SELECT=68,nova_api:UPDATE=14 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:47:55.304136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=2be79bf8-dce5-4535-8171-8b67b688223c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:55.310397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:55.324797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:55.328093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8dd32546c094ab689705aec3c4c7659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f1a82236cf47aa9e938840fbdd6e26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:55.343828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d210dd1f-fa5e-4662-b24a-68867d17d745 tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 200 len: 1444 microversion: 2.75 time: 0.169812 Jul 20 10:47:55.344849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 273/586] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:55 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:55.353308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:55.355545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:55.365087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.366608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.367692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.368495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.411673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:55.420970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:55.500024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:55.511072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:55.563115 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bda74d96-87c7-4ad9-a335-355cf47951b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.484432 Jul 20 10:47:55.564481 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 314/587] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1486 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 10:47:55.572600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:55.574022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:55.584784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.585284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.586866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.587637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.597469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:55.618991 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8571793b-5dd9-4f4b-bd3f-79b59d52fb06 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 0.269903 Jul 20 10:47:55.635282 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 274/588] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:55 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:55.644201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:55.645094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:55.661371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.662028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.663004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.663638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.705592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] HTTP exception thrown: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Request method failure captured: Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 HTTP/1.1 Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190DREHUils3hLMhbk86bSPjicSjKEODV-HcWOEnJuh6pXc339B47JyvmiDBqoHLyA22xYMSIw5q15HvDlNRWS9fD561YPj4ncUdTrYOrPoQbbMtob1ThBOabfGkznjR-HWMm7oZL8AnC9JGUCA89CWbK1aywVExK6EvQQDET6nS3fg Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:47:55.712568 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c0bd00fa22af486ba7cf6d4330b3ef6b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3698cfa68fe544aaa91f4ed4e1025685 Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:55.714469 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '897b1110-b87f-4ca6-b8cb-e6d2b9746533'} Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:55.715156 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:55.716376 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:55.717504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Returning 404 to user: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:55.718113 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eeb77866-1ead-4dd0-9ae2-2f6b138e0754 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 404 len: 111 microversion: 2.1 time: 0.089127 Jul 20 10:47:55.720749 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 275/589] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:47:55 2022] DELETE /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:47:55.732074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:55.735705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:55.737332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Searching by: {'deleted': False, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:47:55.763923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.764178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.765410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.766073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.830087 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0ed0b7ad-38ed-4a73-9f46-ca45efc97232 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1645 microversion: 2.1 time: 0.263706 Jul 20 10:47:55.831331 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 315/590] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:55 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1645 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:55.839989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:55.841107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:55.890432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.894330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.898605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:55.902427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:55.973601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:47:56.143907 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e028b60b-ab14-4428-a2a2-9d64838f91cf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.422565 Jul 20 10:47:56.145304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 276/591] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 10:47:55 2022] GET /compute/v2.1/servers => generated 1661 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:56.177123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:56.177966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: 897b1110-b87f-4ca6-b8cb-e6d2b9746533] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:56.217109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:56.217838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:56.218815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:56.219571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:56.271516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] HTTP exception thrown: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Request method failure captured: Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 HTTP/1.1 Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190DREHUils3hLMhbk86bSPjicSjKEODV-HcWOEnJuh6pXc339B47JyvmiDBqoHLyA22xYMSIw5q15HvDlNRWS9fD561YPj4ncUdTrYOrPoQbbMtob1ThBOabfGkznjR-HWMm7oZL8AnC9JGUCA89CWbK1aywVExK6EvQQDET6nS3fg Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:47:56.275250 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c0bd00fa22af486ba7cf6d4330b3ef6b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3698cfa68fe544aaa91f4ed4e1025685 Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:56.277136 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '897b1110-b87f-4ca6-b8cb-e6d2b9746533'} Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:56.277815 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. Jul 20 10:47:56.278921 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:47:56.279955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Returning 404 to user: Instance 897b1110-b87f-4ca6-b8cb-e6d2b9746533 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:56.279955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-53c2489f-0d54-4723-9dd3-8aaa51848834 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533" status: 404 len: 111 microversion: 2.1 time: 0.129724 Jul 20 10:47:56.280924 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 277/592] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:56 2022] GET /compute/v2.1/servers/897b1110-b87f-4ca6-b8cb-e6d2b9746533 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:47:56.298281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-762248989", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "896bfaeb-a0b5-419b-bf8d-148d7d420fcc"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:47:56.377735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] validate_networks() for [('896bfaeb-a0b5-419b-bf8d-148d7d420fcc', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:47:56.638512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:56.655818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:56.657596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:56.658760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4d962acf-c630-424e-a7a5-d7f1e40d812e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1360 microversion: 2.25 time: 0.826318 Jul 20 10:47:56.659378 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 316/593] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:55 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1360 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:47:56.688156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff3c3e39-f5fa-4953-9ed3-6cfa90ac55a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:56.689111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff3c3e39-f5fa-4953-9ed3-6cfa90ac55a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:56.824340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff3c3e39-f5fa-4953-9ed3-6cfa90ac55a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:56.831418 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff3c3e39-f5fa-4953-9ed3-6cfa90ac55a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1219 microversion: 2.1 time: 0.146949 Jul 20 10:47:56.849557 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 317/594] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:56 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1219 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:56.856416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:56.864255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:56.881334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:56.882098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:56.883551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:56.884240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:57.913304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:57.929749 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-71bafd06-cbcb-430b-86f7-762be1addd9d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 1.073710 Jul 20 10:47:57.929749 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 318/595] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:56 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:57.938061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:57.938577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:57.967422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:57.968305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:57.976434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:57.977536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:58.017289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] HTTP exception thrown: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Request method failure captured: Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 HTTP/1.1 Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190DREHUils3hLMhbk86bSPjicSjKEODV-HcWOEnJuh6pXc339B47JyvmiDBqoHLyA22xYMSIw5q15HvDlNRWS9fD561YPj4ncUdTrYOrPoQbbMtob1ThBOabfGkznjR-HWMm7oZL8AnC9JGUCA89CWbK1aywVExK6EvQQDET6nS3fg Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:47:58.019014 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c0bd00fa22af486ba7cf6d4330b3ef6b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3698cfa68fe544aaa91f4ed4e1025685 Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:58.021837 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'c5ff8913-499d-4ea6-9c1a-655b13210334'} Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:58.022541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:47:58.024993 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.029100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Returning 404 to user: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:58.029100 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f7d89ee-e444-4ca0-9fdf-a468da56fc10 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 404 len: 111 microversion: 2.1 time: 0.096683 Jul 20 10:47:58.029100 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 319/596] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:47:57 2022] DELETE /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:47:58.043903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:58.044890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] [instance: f90503e7-ffd6-4a64-bc05-aaf50786bb6c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:58.052912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:58.053369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:58.054353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:58.055330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:58.094297 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] HTTP exception thrown: Instance f90503e7-ffd6-4a64-bc05-aaf50786bb6c could not be found. Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Request method failure captured: Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c HTTP/1.1 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190HXAKLOBwD0lcx6OIEoiEWHDjfGKQ90tpndMMgsz2Q_8fJiiWRF9cD0o4TEHnPrFwJ0W129QBiR3MET5BwqKRM60n4RXBtz1tZ9p_6MD-qqSGzWEQCUsISXp3lKcVOeuFIVg-9r_h3f_ZSKITTa7pbJNyLF37le8IXG4FUBQzcMFE Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.75 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 01f1a82236cf47aa9e938840fbdd6e26 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdmin275Test-667538053 Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:47:58.096350 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_01f1a82236cf47aa9e938840fbdd6e26", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/01f1a82236cf47aa9e938840fbdd6e26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/01f1a82236cf47aa9e938840fbdd6e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/01f1a82236cf47aa9e938840fbdd6e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdmin275Test-667538053 Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 01f1a82236cf47aa9e938840fbdd6e26 Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdmin275Test-667538053 Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdmin275Test-667538053-project Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: a8dd32546c094ab689705aec3c4c7659 Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdmin275Test-667538053-project Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f90503e7-ffd6-4a64-bc05-aaf50786bb6c could not be found. Jul 20 10:47:58.097814 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f90503e7-ffd6-4a64-bc05-aaf50786bb6c'} Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90503e7-ffd6-4a64-bc05-aaf50786bb6c could not be found. Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:47:58.098696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90503e7-ffd6-4a64-bc05-aaf50786bb6c could not be found. Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90503e7-ffd6-4a64-bc05-aaf50786bb6c could not be found. Jul 20 10:47:58.099845 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:47:58.104698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] Returning 404 to user: Instance f90503e7-ffd6-4a64-bc05-aaf50786bb6c could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:47:58.106219 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6653beb-1090-4051-9b83-bb509748716b tempest-ServersAdmin275Test-667538053 tempest-ServersAdmin275Test-667538053-project] 10.222.0.79 "GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c" status: 404 len: 111 microversion: 2.75 time: 0.081522 Jul 20 10:47:58.107320 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 320/597] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:58 2022] GET /compute/v2.1/servers/f90503e7-ffd6-4a64-bc05-aaf50786bb6c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:47:58.115626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:58.116484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:58.127929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:58.128894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:58.130143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:58.130952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:59.385552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:47:59.397348 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c136ec1-cf03-4879-9cca-fb0c1f751f16 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 1.288644 Jul 20 10:47:59.398358 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 321/598] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:58 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:47:59.414180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:59.414782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:59.425277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:59.426004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:59.426324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:47:59.427107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:47:59.427722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:59.427918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:47:59.428498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:47:59.429255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:59.429600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:47:59.482462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:59.483661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:59.486218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:59.487501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:59.593903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:47:59.615074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for user 90200241ccaf4904a4b973e0351fdff6 and project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:47:59.682212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:47:59.688681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:47:59.849140 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2693c37-4255-4662-b5f0-718a55b676cf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.562011 Jul 20 10:47:59.850461 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 278/599] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:47:59.910522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:47:59.911562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:47:59.946270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:59.947871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:47:59.948815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:47:59.949499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:00.691613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:00.749075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:00.755789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:00.757350 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-10ba06dd-31e6-4af0-aade-c96ccf211a5c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1360 microversion: 2.25 time: 1.347614 Jul 20 10:48:00.760422 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 322/600] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:47:59 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1360 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:00.772327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:00.781093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] [instance: c5ff8913-499d-4ea6-9c1a-655b13210334] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:00.811066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:00.812923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:00.816033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:00.820441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:00.864156 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] HTTP exception thrown: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Request method failure captured: Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 HTTP/1.1 Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190DREHUils3hLMhbk86bSPjicSjKEODV-HcWOEnJuh6pXc339B47JyvmiDBqoHLyA22xYMSIw5q15HvDlNRWS9fD561YPj4ncUdTrYOrPoQbbMtob1ThBOabfGkznjR-HWMm7oZL8AnC9JGUCA89CWbK1aywVExK6EvQQDET6nS3fg Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:48:00.865930 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c0bd00fa22af486ba7cf6d4330b3ef6b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c0bd00fa22af486ba7cf6d4330b3ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c0bd00fa22af486ba7cf6d4330b3ef6b Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1669318741 Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3698cfa68fe544aaa91f4ed4e1025685 Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersAdminTestJSON-1669318741-project Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:48:00.867550 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'c5ff8913-499d-4ea6-9c1a-655b13210334'} Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:00.868317 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. Jul 20 10:48:00.871037 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:00.886653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] Returning 404 to user: Instance c5ff8913-499d-4ea6-9c1a-655b13210334 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:00.887972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f15cdc28-bb37-4048-b14c-96abb3928c46 tempest-DeleteServersAdminTestJSON-1669318741 tempest-DeleteServersAdminTestJSON-1669318741-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334" status: 404 len: 111 microversion: 2.1 time: 0.126209 Jul 20 10:48:00.888724 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 323/601] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:00 2022] GET /compute/v2.1/servers/c5ff8913-499d-4ea6-9c1a-655b13210334 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:00.904625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:00.905737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:00.914491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:00.915567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:00.917126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:00.917732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.083643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:01.107101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c568ecb0-8fa1-41f9-baa1-776f6c8d212a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 1.254799 Jul 20 10:48:01.107838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 279/602] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:47:59 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:01.151426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5e4d2e5a-4fd1-4f1a-bea2-0908e4b48e9c req-d332d842-0a87-4d58-8356-5c60b7114acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe91d9f2-c297-46cf-a70d-409e036899a2", "name": "network-vif-plugged", "status": "completed", "tag": "b0f43925-7a7a-4678-ae05-2d2660124131"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:01.212173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e4d2e5a-4fd1-4f1a-bea2-0908e4b48e9c req-d332d842-0a87-4d58-8356-5c60b7114acf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.216209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e4d2e5a-4fd1-4f1a-bea2-0908e4b48e9c req-d332d842-0a87-4d58-8356-5c60b7114acf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.259483 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5e4d2e5a-4fd1-4f1a-bea2-0908e4b48e9c req-d332d842-0a87-4d58-8356-5c60b7114acf service nova] Creating event network-vif-plugged:b0f43925-7a7a-4678-ae05-2d2660124131 for instance fe91d9f2-c297-46cf-a70d-409e036899a2 on n-h2-846219-10 Jul 20 10:48:01.273910 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5e4d2e5a-4fd1-4f1a-bea2-0908e4b48e9c req-d332d842-0a87-4d58-8356-5c60b7114acf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148198 Jul 20 10:48:01.281945 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 280/603] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:01.304031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2e15c845-8f9a-4f43-910b-f80cfe4da61d req-afa2d858-5a93-490e-8f7b-33da829e08d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb079f77-4d01-445b-85ff-da7793b9aefb", "tag": "14f4e2fa-0661-43d1-a011-83ca3e6093aa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:01.330586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:01.336966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2e15c845-8f9a-4f43-910b-f80cfe4da61d req-afa2d858-5a93-490e-8f7b-33da829e08d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.337576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2e15c845-8f9a-4f43-910b-f80cfe4da61d req-afa2d858-5a93-490e-8f7b-33da829e08d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.347727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:01.369593 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-83a78add-b067-4c9d-b1c8-4b6f7fa8f1e4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.478060 Jul 20 10:48:01.379746 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 324/604] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:00 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:01.380263 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2e15c845-8f9a-4f43-910b-f80cfe4da61d req-afa2d858-5a93-490e-8f7b-33da829e08d2 service nova] Creating event network-changed:14f4e2fa-0661-43d1-a011-83ca3e6093aa for instance cb079f77-4d01-445b-85ff-da7793b9aefb on n-h2-846219-10 Jul 20 10:48:01.386280 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2e15c845-8f9a-4f43-910b-f80cfe4da61d req-afa2d858-5a93-490e-8f7b-33da829e08d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099212 Jul 20 10:48:01.386668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:01.387328 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 281/605] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:01.393219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:01.393497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:01.394545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:01.404224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.404966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.405918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.406511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.412084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.420288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.421763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.422530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.479460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:01.627814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:01.659922 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b4b3409c-3810-4d16-9e0c-c4220d5dbc9c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1206 microversion: 2.1 time: 0.280953 Jul 20 10:48:01.663455 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 325/606] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:01 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1206 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:01.789634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:01.792899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:01.817177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.820525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:01.823385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:01.832676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:02.156699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:02.189827 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9b8264e-58fc-4756-8d85-068b2657b876 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 0.800668 Jul 20 10:48:02.191576 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 282/607] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:01 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:02.201700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:02.205775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:02.219329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:02.220577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:02.222434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:02.223572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:02.264717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:03.284811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:03.326605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:03.329799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:03.333323 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f592a1ca-3d42-4269-91a0-8cab92dc864e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1360 microversion: 2.25 time: 1.558614 Jul 20 10:48:03.334386 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 326/608] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:01 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1360 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:48:03.358076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:03.358863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:03.393987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.394771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:03.396727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.397508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:03.524844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:03.536694 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e7649cf-2c4f-4d44-af96-4e260575678b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 1.342994 Jul 20 10:48:03.537879 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 283/609] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:02 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:03.543535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2f91d187-1c39-4120-a078-3dd0328d0ea5 req-4f23ab3e-bdbe-44a3-8318-accee431d781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7853d70-d6d3-4beb-bff5-594f44c16beb", "tag": "c570e27b-f54c-406c-aa54-34133e6d3bb5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:03.552579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2f91d187-1c39-4120-a078-3dd0328d0ea5 req-4f23ab3e-bdbe-44a3-8318-accee431d781 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.553275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2f91d187-1c39-4120-a078-3dd0328d0ea5 req-4f23ab3e-bdbe-44a3-8318-accee431d781 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:03.567340 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2f91d187-1c39-4120-a078-3dd0328d0ea5 req-4f23ab3e-bdbe-44a3-8318-accee431d781 service nova] Creating event network-changed:c570e27b-f54c-406c-aa54-34133e6d3bb5 for instance a7853d70-d6d3-4beb-bff5-594f44c16beb on n-h1-846219-10 Jul 20 10:48:03.574529 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2f91d187-1c39-4120-a078-3dd0328d0ea5 req-4f23ab3e-bdbe-44a3-8318-accee431d781 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035285 Jul 20 10:48:03.576380 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 284/610] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:03.584521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:03.585927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:03.597355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.598631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:03.599839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.600784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:03.762850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:03.775893 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1072d09-b30e-443a-8cf8-b936626c0b3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1268 microversion: 2.1 time: 0.197439 Jul 20 10:48:03.776730 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 285/611] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:03 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:03.782012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:03.782994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:03.790080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.790548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:03.793002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:03.793530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:04.230403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:04.240903 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8e08f31-894d-4275-8690-2d5681117277 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.904926 Jul 20 10:48:04.251063 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 327/612] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:03 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:04.256527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4c5e009b-f299-4dcb-951b-0ca7bdcd7000 req-c7dc4bbb-f22b-4bfe-9c91-831273e18729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c246d4-40d9-44e6-ba74-ae2d6391c4c2", "name": "network-vif-plugged", "status": "completed", "tag": "bd65064d-d349-4797-86ea-06a35e3eb77f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:04.278242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4c5e009b-f299-4dcb-951b-0ca7bdcd7000 req-c7dc4bbb-f22b-4bfe-9c91-831273e18729 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:04.279487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4c5e009b-f299-4dcb-951b-0ca7bdcd7000 req-c7dc4bbb-f22b-4bfe-9c91-831273e18729 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:04.302728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4c5e009b-f299-4dcb-951b-0ca7bdcd7000 req-c7dc4bbb-f22b-4bfe-9c91-831273e18729 service nova] Creating event network-vif-plugged:bd65064d-d349-4797-86ea-06a35e3eb77f for instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 on n-h1-846219-10 Jul 20 10:48:04.318060 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4c5e009b-f299-4dcb-951b-0ca7bdcd7000 req-c7dc4bbb-f22b-4bfe-9c91-831273e18729 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065185 Jul 20 10:48:04.321776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 328/613] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:04.357745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:04.362304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:04.391137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:04.395965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:04.399303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:04.407948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:04.942689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:05.213514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:05.231011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:05.239751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:05.245542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:05.248490 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a22dc0a-b706-4c2d-abd1-62c27bc780bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1360 microversion: 2.25 time: 0.898767 Jul 20 10:48:05.252919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 329/614] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:04 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1360 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:05.256996 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-810c0a01-f27a-456d-8707-bc70b9f08c45 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1390 microversion: 2.1 time: 1.478207 Jul 20 10:48:05.260249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:05.261221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:05.271435 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 286/615] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:03 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1390 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:05.279491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:05.280576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:05.281822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:05.284160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:05.287861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:05.289057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:05.311036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:05.312572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:05.323705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:05.324650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:05.938982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:05.952823 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff8f3484-925e-4e58-88c2-2fae4f5fd290 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.698364 Jul 20 10:48:05.953632 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 330/616] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:05 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:05.958384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:05.958990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:05.977622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:05.981487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:05.984650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:05.986055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:06.012894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:06.026540 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-690e5a26-1846-42e8-a924-e1f89168da7b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.752786 Jul 20 10:48:06.027348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 287/617] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:05 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:06.278783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:06.283533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:06.309154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:06.311026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:06.316702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:06.317954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:06.327704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:06.345333 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c0960f3b-b5e8-4c95-9f09-3e0a83de7ed0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.390035 Jul 20 10:48:06.354783 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 331/618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:05 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:06.382226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:06.383290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:06.414478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:06.416617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:06.419852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:06.420771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:06.831471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=23 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:06.902509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:06.915490 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02accf88-310d-4467-bbe8-eccb82272e7c tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1589 microversion: 2.1 time: 0.644221 Jul 20 10:48:06.916652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 288/619] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:06 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1589 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:48:06.921832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4a10ae62-2966-4dd6-a6cc-8326283b9391 req-d18509b6-9038-4f95-a69c-8ea3206e8caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be79bf8-dce5-4535-8171-8b67b688223c", "tag": "5ab052fc-41bd-403f-89a2-083ab8636f8a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:06.942387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4a10ae62-2966-4dd6-a6cc-8326283b9391 req-d18509b6-9038-4f95-a69c-8ea3206e8caf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:06.949396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4a10ae62-2966-4dd6-a6cc-8326283b9391 req-d18509b6-9038-4f95-a69c-8ea3206e8caf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:06.969970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4a10ae62-2966-4dd6-a6cc-8326283b9391 req-d18509b6-9038-4f95-a69c-8ea3206e8caf service nova] Creating event network-changed:5ab052fc-41bd-403f-89a2-083ab8636f8a for instance 2be79bf8-dce5-4535-8171-8b67b688223c on n-h2-846219-10 Jul 20 10:48:06.981037 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4a10ae62-2966-4dd6-a6cc-8326283b9391 req-d18509b6-9038-4f95-a69c-8ea3206e8caf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062855 Jul 20 10:48:06.981670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 289/620] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:06.993229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c56e5555-4575-4cb8-8015-046bdee4eb4e req-85ad0492-8d57-491a-b37a-573d7f69149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb079f77-4d01-445b-85ff-da7793b9aefb", "name": "network-vif-plugged", "status": "completed", "tag": "14f4e2fa-0661-43d1-a011-83ca3e6093aa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:07.012327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c56e5555-4575-4cb8-8015-046bdee4eb4e req-85ad0492-8d57-491a-b37a-573d7f69149f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.012783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c56e5555-4575-4cb8-8015-046bdee4eb4e req-85ad0492-8d57-491a-b37a-573d7f69149f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.037848 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c56e5555-4575-4cb8-8015-046bdee4eb4e req-85ad0492-8d57-491a-b37a-573d7f69149f service nova] Creating event network-vif-plugged:14f4e2fa-0661-43d1-a011-83ca3e6093aa for instance cb079f77-4d01-445b-85ff-da7793b9aefb on n-h2-846219-10 Jul 20 10:48:07.045932 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c56e5555-4575-4cb8-8015-046bdee4eb4e req-85ad0492-8d57-491a-b37a-573d7f69149f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062891 Jul 20 10:48:07.050971 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 290/621] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:07.057247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:07.061566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:07.081588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.082187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.092154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:07.098348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.106012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:07.107433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.132534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:07.134133 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-551d10b0-853e-41b3-890c-ebfca61f70e9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1360 microversion: 2.25 time: 0.775217 Jul 20 10:48:07.146701 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 332/622] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:06 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1360 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:07.146701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:07.146701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:07.172246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.172706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.173802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.174570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.382642 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fdee814d-034c-4969-88f7-771075bb18e2 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321652 Jul 20 10:48:07.391879 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 291/623] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:48:07 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2/os-interface => generated 285 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:07.411486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:07.413450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:07.458996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.461869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.465656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.466776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.476073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:07.487552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebc7442c-233c-41c6-9fbe-56cc99f5b2d1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.348109 Jul 20 10:48:07.488146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 333/624] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:07 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:07.493689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:07.500618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:07.512468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.513189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.514714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:07.515344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:07.840792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:07.850146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:07.857120 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e2e0620-9ab0-4a21-8157-510e3fb2d5d0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.365792 Jul 20 10:48:07.859454 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 334/625] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:07 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:07.863490 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b96de7cc-dc8d-4875-9763-53a9ddc6c083 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.466853 Jul 20 10:48:07.871681 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 292/626] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:07 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:08.169848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:08.173464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:08.193239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:08.194581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:08.196066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:08.197032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:08.475678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-4245695", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:08.507678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:08.542716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:08.548512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:08.557931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5687f26c-439f-4839-a417-dd3c1e95c0dd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1360 microversion: 2.25 time: 0.390115 Jul 20 10:48:08.560540 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 335/627] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:08 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1360 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:08.582685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:08.583231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:08.610123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:08.611451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:08.611608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:08.613798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:08.614715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:09.215875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:09.240014 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d4b01b3f-a11a-4a17-95c1-8a869ba07e96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.675242 Jul 20 10:48:09.240975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 336/628] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:08 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:09.262326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:09.263606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:09.278648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:09.279660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:09.280638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:09.281239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:09.525087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=19 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:09.648722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=86 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:09.782793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:48:09.784691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:48:09.796527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:48:09.797544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:48:09.798108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:48:09.831098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:09.831427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:09.832670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:09.832670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:09.860399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Getting quotas for project 9b34d0320ed7473299470fdf484e2080. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:09.869363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Getting quotas for user 91fda43ed940488da05b3e440098d36c and project 9b34d0320ed7473299470fdf484e2080. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:09.883980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:48:09.887588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:48:09.950858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:09.966033 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-553291d3-3f0c-4ad9-a36b-2cc5d2d15460 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1313 microversion: 2.1 time: 0.707796 Jul 20 10:48:09.968353 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c2537ec2-f777-4cba-9887-72d4e45eb8d0 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756950 Jul 20 10:48:09.969714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 293/629] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 10:48:09.971739 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 337/630] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:09 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:09.984261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:09.985816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:09.999355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:09.999555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:10.000394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:10.000857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:10.397708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:10.411487 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5985cb81-52b0-47ac-bdae-51a0aa0d6ef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.439259 Jul 20 10:48:10.412085 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 294/631] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:09 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:10.424922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:10.425838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:10.439372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:10.440147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:10.440970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:10.441412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:10.555048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ac5175f-679e-4b63-b434-e622b7149f2a tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1836036218", "id": 2078833752, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:10.573415 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:10.573415 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:10.631982 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ac5175f-679e-4b63-b434-e622b7149f2a tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.657036 Jul 20 10:48:10.640668 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 338/632] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:48:09 2022] POST /compute/v2.1/flavors => generated 449 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:48:10.656818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-465f6382-d3c3-4292-a3c0-36d88b666f52 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:10.666435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-465f6382-d3c3-4292-a3c0-36d88b666f52 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:10.832329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-465f6382-d3c3-4292-a3c0-36d88b666f52 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:10.833974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:10.846074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:10.847845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:10.855031 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fe82a8e-8816-4d8a-b953-c1b2154c48a4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1557 microversion: 2.25 time: 0.441789 Jul 20 10:48:10.855877 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 295/633] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:10 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1557 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:10.860220 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-465f6382-d3c3-4292-a3c0-36d88b666f52 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1219 microversion: 2.1 time: 0.204957 Jul 20 10:48:10.865656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 339/634] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:10 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1219 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:10.881445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-88ed4d9c-3a3e-40a1-a5d4-9c04c61f134f req-0a009b7b-e5f5-437c-8d2f-5f8c32bef7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:10.917811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-88ed4d9c-3a3e-40a1-a5d4-9c04c61f134f req-0a009b7b-e5f5-437c-8d2f-5f8c32bef7d6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:10.918265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-88ed4d9c-3a3e-40a1-a5d4-9c04c61f134f req-0a009b7b-e5f5-437c-8d2f-5f8c32bef7d6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:10.950317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-88ed4d9c-3a3e-40a1-a5d4-9c04c61f134f req-0a009b7b-e5f5-437c-8d2f-5f8c32bef7d6 service nova] Creating event network-changed:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h1-846219-10 Jul 20 10:48:10.969567 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-88ed4d9c-3a3e-40a1-a5d4-9c04c61f134f req-0a009b7b-e5f5-437c-8d2f-5f8c32bef7d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101329 Jul 20 10:48:10.976182 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 340/635] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:10.986739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:10.987700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:11.012201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.012719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.013895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.014536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.039287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b103fda3-b9d0-428b-9c4d-a7b3657766e2 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:11.044982 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:11.044982 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:11.047260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b103fda3-b9d0-428b-9c4d-a7b3657766e2 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.048072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b103fda3-b9d0-428b-9c4d-a7b3657766e2 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.049395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b103fda3-b9d0-428b-9c4d-a7b3657766e2 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.050062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b103fda3-b9d0-428b-9c4d-a7b3657766e2 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.131302 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b103fda3-b9d0-428b-9c4d-a7b3657766e2 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.257688 Jul 20 10:48:11.148064 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 296/636] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:48:10 2022] GET /compute/v2.1/os-services => generated 949 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:11.154417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:11.155111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:11.182575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.186562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.190766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.193092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.730925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:11.742442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:11.761527 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-292c5332-369d-4277-9517-8b24a136eed0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.782116 Jul 20 10:48:11.762112 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 341/637] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:10 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:11.763752 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-248b1aaa-a344-408b-984b-f3adb932f427 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 200 len: 1589 microversion: 2.1 time: 0.608246 Jul 20 10:48:11.770620 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 297/638] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:11 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 1589 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:11.778617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-89aed9b4-2558-412d-86b7-ee0f85b114cd req-7e086914-2949-4186-8ac9-653ec462bb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe91d9f2-c297-46cf-a70d-409e036899a2", "tag": "b0f43925-7a7a-4678-ae05-2d2660124131"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:11.797894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-89aed9b4-2558-412d-86b7-ee0f85b114cd req-7e086914-2949-4186-8ac9-653ec462bb31 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:11.798636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-89aed9b4-2558-412d-86b7-ee0f85b114cd req-7e086914-2949-4186-8ac9-653ec462bb31 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:11.813600 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-89aed9b4-2558-412d-86b7-ee0f85b114cd req-7e086914-2949-4186-8ac9-653ec462bb31 service nova] Creating event network-changed:b0f43925-7a7a-4678-ae05-2d2660124131 for instance fe91d9f2-c297-46cf-a70d-409e036899a2 on n-h2-846219-10 Jul 20 10:48:11.821917 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-89aed9b4-2558-412d-86b7-ee0f85b114cd req-7e086914-2949-4186-8ac9-653ec462bb31 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057806 Jul 20 10:48:11.823892 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 342/639] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:11.980849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f4550b42-a162-43f2-a024-428d17ac86ab tempest-FlavorsV255TestJSON-1506034873 tempest-FlavorsV255TestJSON-1506034873-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:11.991926 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f4550b42-a162-43f2-a024-428d17ac86ab tempest-FlavorsV255TestJSON-1506034873 tempest-FlavorsV255TestJSON-1506034873-project] 10.222.0.79 "GET /compute/v2.1/flavors/2078833752" status: 200 len: 449 microversion: 2.55 time: 0.225431 Jul 20 10:48:11.995583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 298/640] 10.222.0.79 () {60 vars in 1198 bytes} [Wed Jul 20 10:48:11 2022] GET /compute/v2.1/flavors/2078833752 => generated 449 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:48:12.001816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:12.002649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:12.013478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.018491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.018491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.018491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.018763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:12.018763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:12.027802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.028654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.029101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.029716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.366346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:12.401094 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-22d3983e-24b6-48d9-af83-4d659103c19c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1463 microversion: 2.1 time: 0.402218 Jul 20 10:48:12.405258 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 299/641] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:11 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1463 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:12.435668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d0fad92-c722-406d-8f9f-500c150d984a tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:12.442472 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:12.442472 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:12.445995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0fad92-c722-406d-8f9f-500c150d984a tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.448100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0fad92-c722-406d-8f9f-500c150d984a tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.449076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0fad92-c722-406d-8f9f-500c150d984a tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.451088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0fad92-c722-406d-8f9f-500c150d984a tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.517750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d0fad92-c722-406d-8f9f-500c150d984a tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-846219-10" status: 200 len: 581 microversion: 2.1 time: 0.107610 Jul 20 10:48:12.529277 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 300/642] 10.222.0.79 () {58 vars in 1173 bytes} [Wed Jul 20 10:48:12 2022] GET /compute/v2.1/os-services?host=n-d-846219-10 => generated 581 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:12.537331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:12.537988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:12.557870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.558882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.560685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.561537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.627024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cb079f77-4d01-445b-85ff-da7793b9aefb {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:48:12.658645 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-893df6f1-541c-40f3-920c-90ca87c502f6 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 2050 microversion: 2.25 time: 0.832929 Jul 20 10:48:12.659809 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 343/643] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:11 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 2050 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:12.671284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:12.675254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:12.689302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.690069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.692191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.693464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.812762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:12.827981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90b9e151-1a28-4bcd-b75f-9d60a5cdd7de tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1277 microversion: 2.1 time: 0.166368 Jul 20 10:48:12.846990 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 344/644] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:12 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:12.855524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-22b7f2e2-9979-4ba4-8eb0-0009260bd670 tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] Action: 'update', calling method: .version_select at 0x7f2c4ea47310>, body: {"flavor": {"description": "new"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:12.876539 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:12.876539 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:12.899027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:12.912255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:12.929791 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-22b7f2e2-9979-4ba4-8eb0-0009260bd670 tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/2078833752" status: 200 len: 450 microversion: 2.55 time: 0.080517 Jul 20 10:48:12.931792 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 345/645] 10.222.0.79 () {62 vars in 1218 bytes} [Wed Jul 20 10:48:12 2022] PUT /compute/v2.1/flavors/2078833752 => generated 450 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:48:12.933233 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d388353-cb75-43c5-9be7-bcded62bb1e7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.399170 Jul 20 10:48:12.933889 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 301/646] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:12 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:12.950898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad807281-6ee3-488a-a0c0-2f7e09efa5b0 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:12.960879 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:12.960879 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:12.963881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad807281-6ee3-488a-a0c0-2f7e09efa5b0 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.964588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad807281-6ee3-488a-a0c0-2f7e09efa5b0 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:12.965618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad807281-6ee3-488a-a0c0-2f7e09efa5b0 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:12.969040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad807281-6ee3-488a-a0c0-2f7e09efa5b0 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.018910 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad807281-6ee3-488a-a0c0-2f7e09efa5b0 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.072219 Jul 20 10:48:13.019602 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 302/647] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:48:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:13.024020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.035245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:13.049071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.049523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.050314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.050751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.077497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.078440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:13.087470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.087926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.088712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.096371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.424841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cb079f77-4d01-445b-85ff-da7793b9aefb {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:48:13.466875 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-153e3e04-34d6-409f-8e9d-89ec652619bd tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 2050 microversion: 2.25 time: 0.446211 Jul 20 10:48:13.467698 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 303/648] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:13 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 2050 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:13.487785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.488995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:13.497728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.498278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.499226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.500422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.686778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:13.695162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a75032c4-582a-42c5-833d-aacfd19575d5 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1616 microversion: 2.1 time: 0.761330 Jul 20 10:48:13.707455 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 346/649] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:12 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1616 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:13.713357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c16d317c-239f-4bd8-aeb7-17a1cd5f43d5 tempest-FlavorsV255TestJSON-1506034873 tempest-FlavorsV255TestJSON-1506034873-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.733408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:13.737946 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c16d317c-239f-4bd8-aeb7-17a1cd5f43d5 tempest-FlavorsV255TestJSON-1506034873 tempest-FlavorsV255TestJSON-1506034873-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6596 microversion: 2.55 time: 0.029035 Jul 20 10:48:13.745246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-37ae2530-4c2c-43da-8ebc-f4426642a9c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.275521 Jul 20 10:48:13.746414 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 304/650] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:13 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:13.751457 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 347/651] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 10:48:13 2022] GET /compute/v2.1/flavors/detail => generated 6596 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:13.754580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00ebd301-ebd9-4405-812c-517f99c03004 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.756466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b3e1db03-5646-440b-b5aa-d9a4039dca4b req-0e407404-2ba9-4f7c-9696-ab6747e095f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be79bf8-dce5-4535-8171-8b67b688223c", "name": "network-vif-plugged", "status": "completed", "tag": "5ab052fc-41bd-403f-89a2-083ab8636f8a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:13.757103 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:13.757103 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:13.759464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ebd301-ebd9-4405-812c-517f99c03004 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.760568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ebd301-ebd9-4405-812c-517f99c03004 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.761932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ebd301-ebd9-4405-812c-517f99c03004 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.762656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ebd301-ebd9-4405-812c-517f99c03004 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.768615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b3e1db03-5646-440b-b5aa-d9a4039dca4b req-0e407404-2ba9-4f7c-9696-ab6747e095f0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.769186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b3e1db03-5646-440b-b5aa-d9a4039dca4b req-0e407404-2ba9-4f7c-9696-ab6747e095f0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.781849 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b3e1db03-5646-440b-b5aa-d9a4039dca4b req-0e407404-2ba9-4f7c-9696-ab6747e095f0 service nova] Creating event network-vif-plugged:5ab052fc-41bd-403f-89a2-083ab8636f8a for instance 2be79bf8-dce5-4535-8171-8b67b688223c on n-h2-846219-10 Jul 20 10:48:13.787469 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b3e1db03-5646-440b-b5aa-d9a4039dca4b req-0e407404-2ba9-4f7c-9696-ab6747e095f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034592 Jul 20 10:48:13.788355 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 348/652] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:13.796454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed681991-6df0-4354-8395-fa2068ed11ce tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.798300 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:13.798300 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:13.799938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed681991-6df0-4354-8395-fa2068ed11ce tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.800755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed681991-6df0-4354-8395-fa2068ed11ce tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.802311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed681991-6df0-4354-8395-fa2068ed11ce tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.803099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed681991-6df0-4354-8395-fa2068ed11ce tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.835423 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed681991-6df0-4354-8395-fa2068ed11ce tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.045533 Jul 20 10:48:13.837010 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 349/653] 10.222.0.79 () {60 vars in 1216 bytes} [Wed Jul 20 10:48:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:48:13.842395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:13.843534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:13.852370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.853797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.854937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.855620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.858050 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-00ebd301-ebd9-4405-812c-517f99c03004 tempest-ServicesAdminTestJSON-1684832283 tempest-ServicesAdminTestJSON-1684832283-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.109763 Jul 20 10:48:13.859774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 305/654] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:48:13 2022] GET /compute/v2.1/os-services => generated 949 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:13.869846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-57dde24b-debe-45ce-8aa4-a39897740895 tempest-FlavorsV255TestJSON-1506034873 tempest-FlavorsV255TestJSON-1506034873-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:13.907487 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-57dde24b-debe-45ce-8aa4-a39897740895 tempest-FlavorsV255TestJSON-1506034873 tempest-FlavorsV255TestJSON-1506034873-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3686 microversion: 2.55 time: 0.044864 Jul 20 10:48:13.908637 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 306/655] 10.222.0.79 () {60 vars in 1165 bytes} [Wed Jul 20 10:48:13 2022] GET /compute/v2.1/flavors => generated 3686 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:13.925884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-10", "block_migration": "auto"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:13.927747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:13.942992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.948226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.949208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:13.950589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:13.999162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:14.027947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'flavor' on Instance uuid cb079f77-4d01-445b-85ff-da7793b9aefb {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:48:14.031370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8a00230248c642b2adf1648f2803eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd874be1613274eeaa476b5049c093157', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:14.031983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] flavor_id is None. Assuming migration. {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 10:48:14.032738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 10:48:14.058184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Going to try to live migrate instance to n-h1-846219-10 {{(pid=125886) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:48:14.557610 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-24585c66-9fa3-45b7-a0e3-4ee26ef36dc9 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2/action" status: 202 len: 0 microversion: 2.1 time: 0.717582 Jul 20 10:48:14.562919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 350/656] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:13 2022] POST /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:14.567709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:14.568436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:14.577030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:14.577503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:14.578505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:14.578941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:15.106289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:15.116893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b580baf4-ac36-4be8-a300-a9dbabf13a41 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.556787 Jul 20 10:48:15.118366 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 351/657] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:14 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:15.158205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e1be8e42-e2b8-435f-913e-09a85014d872 tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:15.165257 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:15.165257 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:15.220395 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e1be8e42-e2b8-435f-913e-09a85014d872 tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2078833752" status: 202 len: 0 microversion: 2.55 time: 0.098350 Jul 20 10:48:15.225738 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 352/658] 10.222.0.79 () {60 vars in 1201 bytes} [Wed Jul 20 10:48:15 2022] DELETE /compute/v2.1/flavors/2078833752 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:48:15.261009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:15.264869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:15.301971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:15.302667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:15.328488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:15.330717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:15.945358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:15.958171 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69de11b9-1300-4fbc-a896-f030e0f0c21c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.729826 Jul 20 10:48:15.973279 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 353/659] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:15 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:15.978862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:15.985516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:15.998815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:16.001592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:16.005175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:16.008346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:16.386822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:16.402628 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e67cd978-5045-4b06-ba61-81c30f323cd0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1472 microversion: 2.1 time: 0.427877 Jul 20 10:48:16.416463 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 354/660] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:15 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:16.424663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:16.426190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:16.455391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:16.457268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:16.458586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:16.465750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:16.888580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:16.905268 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3d998a0d-b48f-4645-98e2-eea7e7f7045d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.487184 Jul 20 10:48:16.906661 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 355/661] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:16 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:16.923142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1edbf8f7-984a-4382-9492-56c83c1829fc tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:17.032738 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5d7f56e-fd08-40d1-9b7d-ea3c0afb96da tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb/action" status: 202 len: 0 microversion: 2.25 time: 3.122408 Jul 20 10:48:17.034007 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 307/662] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:48:13 2022] POST /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb/action => generated 0 bytes in 3125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:48:17.044785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-60f715ad-19e0-44fc-90fb-3bc389490d1a req-7b23dae9-2565-45a7-b497-9809e0875c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c93c19a-6f7e-443a-b114-ec9d91350260", "tag": "474245ce-4a0e-4e5e-8b60-2f357227629d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:17.064154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-60f715ad-19e0-44fc-90fb-3bc389490d1a req-7b23dae9-2565-45a7-b497-9809e0875c8d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.065063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-60f715ad-19e0-44fc-90fb-3bc389490d1a req-7b23dae9-2565-45a7-b497-9809e0875c8d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.082768 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-60f715ad-19e0-44fc-90fb-3bc389490d1a req-7b23dae9-2565-45a7-b497-9809e0875c8d service nova] Creating event network-changed:474245ce-4a0e-4e5e-8b60-2f357227629d for instance 6c93c19a-6f7e-443a-b114-ec9d91350260 on n-h2-846219-10 Jul 20 10:48:17.088729 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-60f715ad-19e0-44fc-90fb-3bc389490d1a req-7b23dae9-2565-45a7-b497-9809e0875c8d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052356 Jul 20 10:48:17.089644 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 308/663] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:17.095851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f36c6ae2-d7ae-430c-ae5d-c33b193340cf req-c2c14788-76ea-4351-9aa4-60cf45536911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7853d70-d6d3-4beb-bff5-594f44c16beb", "name": "network-vif-plugged", "status": "completed", "tag": "c570e27b-f54c-406c-aa54-34133e6d3bb5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:17.107050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f36c6ae2-d7ae-430c-ae5d-c33b193340cf req-c2c14788-76ea-4351-9aa4-60cf45536911 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.108495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f36c6ae2-d7ae-430c-ae5d-c33b193340cf req-c2c14788-76ea-4351-9aa4-60cf45536911 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.130891 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f36c6ae2-d7ae-430c-ae5d-c33b193340cf req-c2c14788-76ea-4351-9aa4-60cf45536911 service nova] Creating event network-vif-plugged:c570e27b-f54c-406c-aa54-34133e6d3bb5 for instance a7853d70-d6d3-4beb-bff5-594f44c16beb on n-h1-846219-10 Jul 20 10:48:17.140057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f36c6ae2-d7ae-430c-ae5d-c33b193340cf req-c2c14788-76ea-4351-9aa4-60cf45536911 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048015 Jul 20 10:48:17.141108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 309/664] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:17.149951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:17.151576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:17.169795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.170471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.171460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.171916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.216387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1edbf8f7-984a-4382-9492-56c83c1829fc tempest-FlavorsV255TestJSON-1996322660 tempest-FlavorsV255TestJSON-1996322660-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.308114 Jul 20 10:48:17.217364 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 356/665] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 10:48:16 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:17.253261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:17.254371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:17.265580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.266357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.267449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.268035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.565429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:17.581287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-952e8eeb-2c26-40dc-8187-12c36db029bd tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.438521 Jul 20 10:48:17.582947 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 310/666] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:17 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:17.596794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:17.598191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:17.615792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.623587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.625190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.626004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.668211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:17.700962 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c2c0a9d9-423a-4c44-8a77-282b8bd65c99 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.481860 Jul 20 10:48:17.721197 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 357/667] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:17 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:17.737554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:17.738200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:17.764277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.769551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.771473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.771933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.932424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:17.941699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:17.946098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:17.949556 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9229953c-2b1f-4607-9550-c2e6a21614da tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.364922 Jul 20 10:48:17.950940 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 311/668] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:17 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:17.957403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:17.958833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:17.978253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.979381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:17.980484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:17.981141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:18.118888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:18.135220 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2c06d4d0-b8cf-4456-a325-bc6e9aa8aad0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1472 microversion: 2.1 time: 0.409228 Jul 20 10:48:18.151794 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 358/669] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:17 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:18.298753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:18.313408 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d0b88d9-9b03-4d3f-bf4f-8803c0466013 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1319 microversion: 2.1 time: 0.360710 Jul 20 10:48:18.314851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 312/670] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:17 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:18.609780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:18.610426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:18.623027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:18.629657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:18.631951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:18.632744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:18.726728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:18.728052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:18.757288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:18.761197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:18.763023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:18.766589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:19.096776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:19.119392 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d3db2fa-feff-4841-a515-bd27478b3942 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.517672 Jul 20 10:48:19.121838 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 359/671] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:18 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:48:19.161140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:19.193575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7557d80-1afd-4056-8391-8734d90a7e42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.472323 Jul 20 10:48:19.195755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 313/672] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:18 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:19.205568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:19.206687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:19.229964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:19.230738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:19.232049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:19.232899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:19.487150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c0a39745-5960-4fe0-8fc2-b8d89de74f7d tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Action: 'create', calling method: .version_select at 0x7f2c4c151f70>, body: {"keypair": {"name": "tempest-keypair-1308436049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQvKjbWGoJTIZDXLXDEMUOY1ci89k8PUGsylcRld0nsgM55weHa8PNgTzzBv+eScVS4O6LUT1Tgo+56m2NNiQUwiUV9epTsVD8EsKopZEYoYx7GrMm4MWQdcQlHpzBB4Q=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:19.570000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c0a39745-5960-4fe0-8fc2-b8d89de74f7d tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:19.586737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c0a39745-5960-4fe0-8fc2-b8d89de74f7d tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for user c32f8119fb384338ab5c7fc01e6ac14e and project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:19.648681 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c0a39745-5960-4fe0-8fc2-b8d89de74f7d tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.524713 Jul 20 10:48:19.649755 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 360/673] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:48:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:19.670290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:19.671771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:19.687560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:19.691985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:19.695535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:19.696256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:19.862943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:19.880575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:19.889344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:19.894855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:19.902421 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5f7b2ee-f288-48d2-a5f9-70076a73b93a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.704145 Jul 20 10:48:19.916507 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 314/674] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:19 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:19.939229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:19.940946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:19.958765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:19.959884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:19.962149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:19.962951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.043477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:20.052632 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b3d7978-dc63-4995-a07b-1a548a0f2b9c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1472 microversion: 2.1 time: 0.400823 Jul 20 10:48:20.064112 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 361/675] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:19 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:20.072692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0d336c1a-6533-453b-b5d7-a2c18328da4b req-625e8726-0aa8-417f-b87f-33f72ec160a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "name": "network-vif-plugged", "status": "completed", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:20.082254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0d336c1a-6533-453b-b5d7-a2c18328da4b req-625e8726-0aa8-417f-b87f-33f72ec160a6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.083087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0d336c1a-6533-453b-b5d7-a2c18328da4b req-625e8726-0aa8-417f-b87f-33f72ec160a6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.100608 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0d336c1a-6533-453b-b5d7-a2c18328da4b req-625e8726-0aa8-417f-b87f-33f72ec160a6 service nova] Creating event network-vif-plugged:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h1-846219-10 Jul 20 10:48:20.107554 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0d336c1a-6533-453b-b5d7-a2c18328da4b req-625e8726-0aa8-417f-b87f-33f72ec160a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040993 Jul 20 10:48:20.108869 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 362/676] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:20.115931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-75382d26-7eb6-48a9-ae5a-7817d2879f86 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3fe14700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:20.127955 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-75382d26-7eb6-48a9-ae5a-7817d2879f86 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1308436049" status: 200 len: 497 microversion: 2.1 time: 0.017030 Jul 20 10:48:20.129464 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 363/677] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 10:48:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1308436049 => generated 497 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:20.137916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:20.139075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:20.148551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.149393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.150680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.151430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.446718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:20.463876 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0497d68a-9f32-4c79-9b05-d97eaffdb72f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1469 microversion: 2.1 time: 0.545349 Jul 20 10:48:20.464795 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 315/678] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:19 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:20.474796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18f91801-869f-4fd5-8c00-a78c8dc8bc11 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3f65da60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:20.520299 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-18f91801-869f-4fd5-8c00-a78c8dc8bc11 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308436049" status: 202 len: 0 microversion: 2.1 time: 0.054054 Jul 20 10:48:20.521671 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 316/679] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 10:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308436049 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:20.530325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:20.539805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:20.541987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:20.551957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.553144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.554778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.555894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.558158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2a7df6b0-9c75-47c5-9e0d-dee575efe805 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.424954 Jul 20 10:48:20.558759 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 364/680] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:20 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:20.570266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:20.571289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:20.585590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.586880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.588855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.589935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.907993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:20.911348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:20.917879 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-218961c7-13eb-4e57-b71a-b7697cbff792 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1469 microversion: 2.1 time: 0.356671 Jul 20 10:48:20.920532 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 365/681] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:20 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:20.925278 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86b98f20-7959-426e-b537-c4a38f521f09 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.397822 Jul 20 10:48:20.927825 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 317/682] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:20 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:20.930284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-677a9fd7-74e8-4a60-911a-d825d9258aae tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Action: 'create', calling method: .version_select at 0x7f2c3ff07430>, body: {"keypair": {"name": "tempest-keypair-367699576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8Zup5I6KNBqaUB+oFp0vCKnq7R4vosHfrrcNy22CcXQkaCjaImJdQns1S5sZVZ39u78Q6JQgzFv8nJljMIYJrGubf9MSpjeRLiSPScsLxhbnoFLeIMp94Jmn2QNQJ49A=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:20.940496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:20.941345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:20.945713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:20.953393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-677a9fd7-74e8-4a60-911a-d825d9258aae tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:20.954275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.955279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.956995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:20.957910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:20.960666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-677a9fd7-74e8-4a60-911a-d825d9258aae tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for user c32f8119fb384338ab5c7fc01e6ac14e and project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:20.992701 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-677a9fd7-74e8-4a60-911a-d825d9258aae tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.070477 Jul 20 10:48:20.994883 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 366/683] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:48:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:21.005115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.010703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.011682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Searching by: {'reservation_id': 'r-71l602du', 'deleted': False, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:48:21.018056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.018711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.019602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.020231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.150926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:48:21.190076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.200091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.201606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.203371 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b4bc7b2-6259-4e49-b6d0-cc69d9c29ad1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.274224 Jul 20 10:48:21.203937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 318/684] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:20 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:21.211020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4c85701-2325-4e5d-966c-696f44320a7b tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3fa9e310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.232813 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4c85701-2325-4e5d-966c-696f44320a7b tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367699576" status: 202 len: 0 microversion: 2.1 time: 0.027597 Jul 20 10:48:21.233714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 319/685] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 10:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367699576 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:21.239353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.240180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:21.248451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.249092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.250033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.250624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.260703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.268619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.269116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.470520 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9de9b3a7-2b3c-4ea1-ba65-b44629e74a6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-71l602du" status: 200 len: 2931 microversion: 2.1 time: 0.473480 Jul 20 10:48:21.471905 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 367/686] 10.222.0.79 () {58 vars in 1196 bytes} [Wed Jul 20 10:48:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-71l602du => generated 2931 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:21.475008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.485339 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e9c0ba80-54b4-491e-b178-d7fa54ff8825 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.250361 Jul 20 10:48:21.485919 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 320/687] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:21 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:21.489746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df97c04b-7af0-4fd6-b1a1-44e3a4b9a552 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Action: 'create', calling method: .version_select at 0x7f2c3fed8ca0>, body: {"keypair": {"name": "tempest-keypair-464166972", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:21.490505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e79f4bbc-57f9-4547-998f-1304c125a39f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.510940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-df97c04b-7af0-4fd6-b1a1-44e3a4b9a552 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:21.512274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.server_groups [None req-e79f4bbc-57f9-4547-998f-1304c125a39f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Querying cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) for 2 instances {{(pid=125886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 10:48:21.513344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e79f4bbc-57f9-4547-998f-1304c125a39f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.513788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e79f4bbc-57f9-4547-998f-1304c125a39f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.516636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-df97c04b-7af0-4fd6-b1a1-44e3a4b9a552 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for user c32f8119fb384338ab5c7fc01e6ac14e and project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:21.547360 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df97c04b-7af0-4fd6-b1a1-44e3a4b9a552 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.074048 Jul 20 10:48:21.552487 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 368/688] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:48:21 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:21.552661 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e79f4bbc-57f9-4547-998f-1304c125a39f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/c7801ff6-e5f6-4bcd-8cf4-b7f7178f0053" status: 200 len: 271 microversion: 2.1 time: 0.062338 Jul 20 10:48:21.552661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 321/689] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:48:21 2022] GET /compute/v2.1/os-server-groups/c7801ff6-e5f6-4bcd-8cf4-b7f7178f0053 => generated 271 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:21.558439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-04d645ba-66d2-4ef2-95ac-b027492cab30 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3fe35430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.561107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.561983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:21.571275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.572358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.573486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.573708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.581846 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-04d645ba-66d2-4ef2-95ac-b027492cab30 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464166972" status: 202 len: 0 microversion: 2.1 time: 0.028093 Jul 20 10:48:21.582654 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 369/690] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 10:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464166972 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:21.588964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.589844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:21.596277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.596718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.597491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.597924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.813979 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-43e18739-fd25-494c-81b3-3060007d4d6e tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1622 microversion: 2.1 time: 0.256987 Jul 20 10:48:21.816337 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 322/691] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:21 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1622 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:21.838398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:21.848786 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3bc6a889-508f-4765-87c4-350d8c047699 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.265290 Jul 20 10:48:21.849856 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 370/692] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:21 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:21.852593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2fcd38b-be8a-483d-a457-ffe565fd3c06 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Action: 'create', calling method: .version_select at 0x7f2c3f992040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-757956709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPwlBROJdy0oq+o98Yqs/ixGp7ezXJrt87/KnBMR6p2414czy8KQb7Mf8tD+3EckNSJWsICduPfi6noH364wGQksdlC30UrhjANDeHCvZ7h5dlfUWbgSMpQiDt8sRygmA=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:21.855531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.856361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:21.863726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.864553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.865807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:21.866506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:21.873418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:21.914791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d2fcd38b-be8a-483d-a457-ffe565fd3c06 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:21.930881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d2fcd38b-be8a-483d-a457-ffe565fd3c06 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for user c32f8119fb384338ab5c7fc01e6ac14e and project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:21.989345 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2fcd38b-be8a-483d-a457-ffe565fd3c06 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.170681 Jul 20 10:48:21.990987 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 323/693] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:48:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:21.997800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:21.998697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:22.013894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:22.014925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:22.017266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:22.019261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:22.196249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d6f8052-50c0-4925-be08-242476a20483 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 200 len: 1622 microversion: 2.1 time: 0.345116 Jul 20 10:48:22.197569 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 371/694] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:21 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 1622 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:22.207678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-802a7b0e-6400-440f-8014-42847208f350 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Action: 'create', calling method: .version_select at 0x7f2c4c3ebaf0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-148529496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlhKkCNq9LZPMVJflrsNx5VPRT3v8hrbOy2vBERwaa7UUYB1y4c4IN8uENUhBg6X9e4ZI3tUcV1FlrH7jVuVkEYtkBhfKit+DaKTznUk8CpjggJKXrJ4ycIIrO5wux2sg=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:22.216502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:22.273360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-802a7b0e-6400-440f-8014-42847208f350 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:22.301862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-802a7b0e-6400-440f-8014-42847208f350 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for user c32f8119fb384338ab5c7fc01e6ac14e and project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:22.393313 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-802a7b0e-6400-440f-8014-42847208f350 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.194309 Jul 20 10:48:22.401481 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 372/695] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:48:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:22.437515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-92a4c569-828b-43f9-9848-d2aae8baf202 req-dd84a087-1aab-45c2-b064-c07bfc845280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb079f77-4d01-445b-85ff-da7793b9aefb", "name": "network-vif-unplugged", "status": "completed", "tag": "14f4e2fa-0661-43d1-a011-83ca3e6093aa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:22.469869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-92a4c569-828b-43f9-9848-d2aae8baf202 req-dd84a087-1aab-45c2-b064-c07bfc845280 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:22.471600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-92a4c569-828b-43f9-9848-d2aae8baf202 req-dd84a087-1aab-45c2-b064-c07bfc845280 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:22.476917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:22.495519 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-12da6803-d2d3-404e-9241-3bc17b536460 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1310 microversion: 2.1 time: 0.502593 Jul 20 10:48:22.495831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-92a4c569-828b-43f9-9848-d2aae8baf202 req-dd84a087-1aab-45c2-b064-c07bfc845280 service nova] Creating event network-vif-unplugged:14f4e2fa-0661-43d1-a011-83ca3e6093aa for instance cb079f77-4d01-445b-85ff-da7793b9aefb on n-h2-846219-10 Jul 20 10:48:22.511424 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 324/696] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:21 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1310 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:22.517263 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-92a4c569-828b-43f9-9848-d2aae8baf202 req-dd84a087-1aab-45c2-b064-c07bfc845280 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107463 Jul 20 10:48:22.521546 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 373/697] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:22.528434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:22.533157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:22.545994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7c303af6-22f9-4473-af1e-7425c3da42ab req-628300c0-9ddb-4844-9b3e-06c9ca044278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c93c19a-6f7e-443a-b114-ec9d91350260", "name": "network-vif-plugged", "status": "completed", "tag": "474245ce-4a0e-4e5e-8b60-2f357227629d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:22.565423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:22.566343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:22.572780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:22.581492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:22.606747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7c303af6-22f9-4473-af1e-7425c3da42ab req-628300c0-9ddb-4844-9b3e-06c9ca044278 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:22.607622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7c303af6-22f9-4473-af1e-7425c3da42ab req-628300c0-9ddb-4844-9b3e-06c9ca044278 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:22.670434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7c303af6-22f9-4473-af1e-7425c3da42ab req-628300c0-9ddb-4844-9b3e-06c9ca044278 service nova] Creating event network-vif-plugged:474245ce-4a0e-4e5e-8b60-2f357227629d for instance 6c93c19a-6f7e-443a-b114-ec9d91350260 on n-h2-846219-10 Jul 20 10:48:22.680754 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7c303af6-22f9-4473-af1e-7425c3da42ab req-628300c0-9ddb-4844-9b3e-06c9ca044278 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154987 Jul 20 10:48:22.682851 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 374/698] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:22.695949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e2e9c00-e050-4a9a-b444-f95790a777d9 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Action: 'create', calling method: .version_select at 0x7f2c4c3eb700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-518598703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxgsslD73STd3xlD/gADcV6s8f9jvSt3Z8NS5IFv/n71aadJDkS2G9AnMvBc1ZB29riQNLuGZwV5XTtRmEQRCZBaJykC5yqhJ8GNqPq1L8WJlDYvdLvaWnP+TGM8b5iKA=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:22.726577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6e2e9c00-e050-4a9a-b444-f95790a777d9 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:22.739310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6e2e9c00-e050-4a9a-b444-f95790a777d9 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Getting quotas for user c32f8119fb384338ab5c7fc01e6ac14e and project e55e0cc6a7754f9a85cdc9568882062e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:22.781792 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e2e9c00-e050-4a9a-b444-f95790a777d9 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.097338 Jul 20 10:48:22.791251 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 375/699] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:48:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:22.797433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1798683320", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "9bfeb30c-e126-4abd-9c33-c2ae07eec3e7"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:22.953142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:22.962116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:22.977008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:22.984333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:22.987758 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a081d55-b833-40cb-9536-748499ea846f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.479836 Jul 20 10:48:22.990709 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 325/700] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:22 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:23.007511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.008242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:23.027200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.027793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.030276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.035010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.444441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:23.451363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:23.454803 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a5fb609f-8d32-4642-8f56-aeaa7a4d47be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.460899 Jul 20 10:48:23.455439 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 326/701] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:22 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:23.479744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-31e04669-29d7-4f84-a0c7-d24cef181bbe tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3f9105e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.483452 n-d-846219-10 devstack@n-api.service[125886]: WARNING oslo_db.sqlalchemy.utils [None req-31e04669-29d7-4f84-a0c7-d24cef181bbe tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 10:48:23.495458 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-31e04669-29d7-4f84-a0c7-d24cef181bbe tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.036789 Jul 20 10:48:23.496847 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 327/702] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:48:23 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:23.504798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.505704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:23.513663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.514395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.515473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.516399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.528083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:48:23.528818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:48:23.528997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:48:23.529418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:48:23.529837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:48:23.547538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.547998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.548813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.549434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.596638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:23.604696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:23.621354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:48:23.624744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:48:23.721714 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28148b47-1a50-46a9-8e40-26f6672a73b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934076 Jul 20 10:48:23.726884 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 376/703] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:48:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:48:23.733547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dac71823-3b14-4821-888e-92ed01a4482a tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c4c21a3a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.747535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:23.763887 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eac24498-a576-4a97-a95d-37179daee2e8 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.265245 Jul 20 10:48:23.765689 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dac71823-3b14-4821-888e-92ed01a4482a tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-518598703" status: 202 len: 0 microversion: 2.1 time: 0.035956 Jul 20 10:48:23.766625 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 328/704] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:23 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:23.768854 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 377/705] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-518598703 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:23.778311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.779407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:23.786047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d6527ebc-1d5c-4a69-9893-39f20dd9dd8a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.787462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d6527ebc-1d5c-4a69-9893-39f20dd9dd8a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:23.790829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.792197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.793115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:23.793920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:23.801677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:23.891527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d6527ebc-1d5c-4a69-9893-39f20dd9dd8a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:23.907369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d6527ebc-1d5c-4a69-9893-39f20dd9dd8a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1217 microversion: 2.1 time: 0.137299 Jul 20 10:48:23.908563 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 378/706] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:23 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:23.927104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da61cd8c-f404-48bf-a046-3c8c48305b26 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3ff07280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:23.954479 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da61cd8c-f404-48bf-a046-3c8c48305b26 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-148529496" status: 202 len: 0 microversion: 2.1 time: 0.042913 Jul 20 10:48:23.958520 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 379/707] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-148529496 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:24.004663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:24.025884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b53c8bd-7a68-46d1-8bc9-eda2d443dae9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1492 microversion: 2.1 time: 0.254886 Jul 20 10:48:24.028113 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 329/708] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:23 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1492 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:24.038696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-528c3ad3-fcf4-4ef1-9299-56d30ab13962 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] Calling method '.version_select at 0x7f2c3fc3d1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.072993 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-528c3ad3-fcf4-4ef1-9299-56d30ab13962 tempest-KeyPairsV2TestJSON-957247111 tempest-KeyPairsV2TestJSON-957247111-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-757956709" status: 202 len: 0 microversion: 2.1 time: 0.042322 Jul 20 10:48:24.074021 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 330/709] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-757956709 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:24.081413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.082849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:24.095513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.096204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.097488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.098168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.220985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af4700d1-1c69-4ff5-8e04-6601ee5352c1 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c4c3eb700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.234584 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:24.234584 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:24.236913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af4700d1-1c69-4ff5-8e04-6601ee5352c1 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.237656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af4700d1-1c69-4ff5-8e04-6601ee5352c1 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.239046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af4700d1-1c69-4ff5-8e04-6601ee5352c1 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.239881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af4700d1-1c69-4ff5-8e04-6601ee5352c1 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.303250 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af4700d1-1c69-4ff5-8e04-6601ee5352c1 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.345090 Jul 20 10:48:24.316230 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 380/710] 10.222.0.79 () {58 vars in 1127 bytes} [Wed Jul 20 10:48:23 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:24.328263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.329565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:24.343134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.343324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.344621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.344931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:24.345154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.364704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:24.369462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:24.372408 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c92d92ad-6cef-4a3d-a629-bea52833dc2e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.296692 Jul 20 10:48:24.376186 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 331/711] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:24.395680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e5cf817-c6c3-4c1d-a228-101bf48ae5ac tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3fc6dca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.398977 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:24.398977 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:24.402913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5cf817-c6c3-4c1d-a228-101bf48ae5ac tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.404484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5cf817-c6c3-4c1d-a228-101bf48ae5ac tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.405990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5cf817-c6c3-4c1d-a228-101bf48ae5ac tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.406497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5cf817-c6c3-4c1d-a228-101bf48ae5ac tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.447839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e5cf817-c6c3-4c1d-a228-101bf48ae5ac tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.069379 Jul 20 10:48:24.454984 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 332/712] 10.222.0.79 () {58 vars in 1138 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:24.460217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb408efb-c732-4d3c-abb2-5456845e9d15 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3fbd6670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.461633 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:24.461633 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:24.463265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb408efb-c732-4d3c-abb2-5456845e9d15 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.463891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb408efb-c732-4d3c-abb2-5456845e9d15 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.464847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb408efb-c732-4d3c-abb2-5456845e9d15 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.465420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb408efb-c732-4d3c-abb2-5456845e9d15 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.498310 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb408efb-c732-4d3c-abb2-5456845e9d15 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.041865 Jul 20 10:48:24.505190 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 333/713] 10.222.0.79 () {58 vars in 1144 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:48:24.511106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.511848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:24.518789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.519362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.520134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.520569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.534294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ca5afcd-e734-465d-98e7-51d211a4c313 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1645 microversion: 2.1 time: 0.214684 Jul 20 10:48:24.552005 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 381/714] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1645 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:24.552005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b675134-a272-457b-b9a9-6e600490fc92 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3fe35430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.552005 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:24.552005 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:24.552005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b675134-a272-457b-b9a9-6e600490fc92 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.552005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b675134-a272-457b-b9a9-6e600490fc92 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.553150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b675134-a272-457b-b9a9-6e600490fc92 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.553150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b675134-a272-457b-b9a9-6e600490fc92 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.606409 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b675134-a272-457b-b9a9-6e600490fc92 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.069287 Jul 20 10:48:24.607235 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 382/715] 10.222.0.79 () {58 vars in 1127 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:24.619823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.620449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:24.627571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.628552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.630478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.631101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.814508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:24.825447 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c886fee5-7ebf-41dd-a07c-a2d9e695a030 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.318661 Jul 20 10:48:24.826984 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 334/716] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:24.831436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-501dd3a0-e8ec-4969-9984-22174d803867 req-3814de51-cb76-45d1-91c9-66ab2342a5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb079f77-4d01-445b-85ff-da7793b9aefb", "tag": "14f4e2fa-0661-43d1-a011-83ca3e6093aa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:24.842416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-501dd3a0-e8ec-4969-9984-22174d803867 req-3814de51-cb76-45d1-91c9-66ab2342a5e6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.842891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-501dd3a0-e8ec-4969-9984-22174d803867 req-3814de51-cb76-45d1-91c9-66ab2342a5e6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.857087 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-501dd3a0-e8ec-4969-9984-22174d803867 req-3814de51-cb76-45d1-91c9-66ab2342a5e6 service nova] Creating event network-changed:14f4e2fa-0661-43d1-a011-83ca3e6093aa for instance cb079f77-4d01-445b-85ff-da7793b9aefb on n-h2-846219-10 Jul 20 10:48:24.862282 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-501dd3a0-e8ec-4969-9984-22174d803867 req-3814de51-cb76-45d1-91c9-66ab2342a5e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034990 Jul 20 10:48:24.863260 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 335/717] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:24.869320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50740bb8-129b-4b45-9080-b1441dbf6b42 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3fd41dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.871661 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:24.871661 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:24.873019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50740bb8-129b-4b45-9080-b1441dbf6b42 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.873486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50740bb8-129b-4b45-9080-b1441dbf6b42 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.874348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50740bb8-129b-4b45-9080-b1441dbf6b42 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.875145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50740bb8-129b-4b45-9080-b1441dbf6b42 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.909853 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f9c048b0-bef1-4e21-91a2-52bd250cf187 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1645 microversion: 2.1 time: 0.300951 Jul 20 10:48:24.910173 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50740bb8-129b-4b45-9080-b1441dbf6b42 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.045268 Jul 20 10:48:24.910497 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 336/718] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:24.912559 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 383/719] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1645 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:24.929001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.929767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:24.937691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.938209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.939000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.939483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.943501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:24.944827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:24.955856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.956776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:24.959539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:24.961199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.073402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:25.086173 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-25245887-454a-4eff-8c49-340de8128437 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1213 microversion: 2.1 time: 0.161147 Jul 20 10:48:25.086718 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 384/720] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:48:25.096922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c86004d9-46bf-4090-bf63-4fe77cf91d17 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.098236 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:25.098236 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:25.110543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c86004d9-46bf-4090-bf63-4fe77cf91d17 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.111024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c86004d9-46bf-4090-bf63-4fe77cf91d17 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.111986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c86004d9-46bf-4090-bf63-4fe77cf91d17 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.112427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c86004d9-46bf-4090-bf63-4fe77cf91d17 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.185272 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c86004d9-46bf-4090-bf63-4fe77cf91d17 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.097203 Jul 20 10:48:25.191771 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 385/721] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:25.198185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5c8b4719-2c79-40bd-a7ba-c59ff500873e tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3fd7faf0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.199458 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:25.199458 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:25.200668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c8b4719-2c79-40bd-a7ba-c59ff500873e tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.201119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c8b4719-2c79-40bd-a7ba-c59ff500873e tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.202005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c8b4719-2c79-40bd-a7ba-c59ff500873e tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.202464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c8b4719-2c79-40bd-a7ba-c59ff500873e tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.254833 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5c8b4719-2c79-40bd-a7ba-c59ff500873e tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.061773 Jul 20 10:48:25.255917 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 386/722] 10.222.0.79 () {58 vars in 1127 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:25.261181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:25.270136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4cf7dc40-a120-424f-9686-45d7a29f4cb9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1319 microversion: 2.1 time: 0.358277 Jul 20 10:48:25.275455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:25.286511 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 337/723] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:24 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:25.292713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:25.296473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fcc790e2-1e4c-4db1-9b3b-feaf587ff1d0 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3f85d700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.297273 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:25.297273 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:48:25.310069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.311755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.312966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.315390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.316403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcc790e2-1e4c-4db1-9b3b-feaf587ff1d0 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.317681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcc790e2-1e4c-4db1-9b3b-feaf587ff1d0 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.347437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcc790e2-1e4c-4db1-9b3b-feaf587ff1d0 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.349695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcc790e2-1e4c-4db1-9b3b-feaf587ff1d0 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.416635 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fcc790e2-1e4c-4db1-9b3b-feaf587ff1d0 tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h2-846219-10" status: 200 len: 999 microversion: 2.1 time: 0.127314 Jul 20 10:48:25.417775 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 338/724] 10.222.0.79 () {58 vars in 1172 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/os-hosts/n-h2-846219-10 => generated 999 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:25.427349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.429067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:25.441625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.442410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.444464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.445505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.553356 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4fc94de7-a8cd-488a-872d-bf338b4f9184 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c/action" status: 202 len: 0 microversion: 2.1 time: 0.292540 Jul 20 10:48:25.559578 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 387/725] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:25 2022] POST /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:25.580703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0267457d-1b91-4c99-a836-082dedc5018c tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Calling method '.version_select at 0x7f2c3ff071f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.582241 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:48:25.582241 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:48:25.612697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0267457d-1b91-4c99-a836-082dedc5018c tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.621415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0267457d-1b91-4c99-a836-082dedc5018c tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.692332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0267457d-1b91-4c99-a836-082dedc5018c tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.692797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0267457d-1b91-4c99-a836-082dedc5018c tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.834463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0267457d-1b91-4c99-a836-082dedc5018c tempest-HostsAdminTestJSON-1938184484 tempest-HostsAdminTestJSON-1938184484-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h1-846219-10" status: 200 len: 735 microversion: 2.1 time: 0.269740 Jul 20 10:48:25.835108 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 388/726] 10.222.0.79 () {58 vars in 1172 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/os-hosts/n-h1-846219-10 => generated 735 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:25.848065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:25.851775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.854724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:25.871338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:25.872588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.872866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:25.874048 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e6f18ade-2d11-4f53-b886-108db9075618 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.454905 Jul 20 10:48:25.874481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.876333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.882741 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 339/727] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:25.883470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.894889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:25.896101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:25.906348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.906996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:25.907811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:25.908280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:26.311469 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ce28531-02da-4f05-ab90-5e7ef40d8f86 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1650 microversion: 2.1 time: 0.470702 Jul 20 10:48:26.314871 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 389/728] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1650 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:26.344096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:26.344794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:26.375104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:26.375722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:26.376766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:26.377405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:26.396313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:26.408633 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f8504f7c-9593-4f82-85e5-3a74cdcb603d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.524337 Jul 20 10:48:26.423367 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 340/729] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:25 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:26.437580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:26.438880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:26.452636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:26.454026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:26.456682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:26.457936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:26.573532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:26.592259 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-98a9d417-6858-4673-a048-9978831cb5db tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1287 microversion: 2.1 time: 0.271924 Jul 20 10:48:26.593085 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 390/730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:26 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1287 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:26.810745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:26.825567 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3725d85-450d-434c-a1ce-b5310e5cda42 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1469 microversion: 2.1 time: 0.400023 Jul 20 10:48:26.846266 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 341/731] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:26 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:26.900654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:26.901647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:26.922189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:26.922189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:26.922189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:26.922189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:27.261353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:27.293539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:27.302161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:27.304603 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-819a80e2-d723-4262-bf7e-7002afbf69ac tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.404420 Jul 20 10:48:27.310321 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 342/732] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:26 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:48:27.333826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:27.334948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:27.359429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:27.360177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:27.361477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:27.361628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e05ae6ce-08eb-4fd7-b3e1-95909ad13463 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:27.362161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e05ae6ce-08eb-4fd7-b3e1-95909ad13463 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] [instance: d8674bc0-e1c6-47db-9918-3bbfc8ba644d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:27.366746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:27.371014 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e05ae6ce-08eb-4fd7-b3e1-95909ad13463 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] HTTP exception thrown: Instance d8674bc0-e1c6-47db-9918-3bbfc8ba644d could not be found. Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e05ae6ce-08eb-4fd7-b3e1-95909ad13463 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Request method failure captured: Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/d8674bc0-e1c6-47db-9918-3bbfc8ba644d/action HTTP/1.1 Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 15 Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi191nWwSl7zYq9VhNExwd1ldNih1MO22DPI258XDRO0UgtqITuJDwjzBHpJbEFnNHFicEHWDZgjIFzw4t3mrjV18qI0HjOPrNglFvL1kutf8JBU3143xXQFMyvqPyFgeBgR-05xi3yrAjj1eaYN-xoIjFZ-8lIHddhD2n0WFR7gGLFhI Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:48:27.373093 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26a3432c56d34ca1ae6f5d67a608f642", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 1ee7309882ba4f06866a2009359e2400 Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: {"migrate": {}} Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:48:27.374403 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d8674bc0-e1c6-47db-9918-3bbfc8ba644d could not be found. Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd8674bc0-e1c6-47db-9918-3bbfc8ba644d', 'body': {'migrate': {}}} Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8674bc0-e1c6-47db-9918-3bbfc8ba644d could not be found. Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:27.375267 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8674bc0-e1c6-47db-9918-3bbfc8ba644d could not be found. Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8674bc0-e1c6-47db-9918-3bbfc8ba644d could not be found. Jul 20 10:48:27.377503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:27.381297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e05ae6ce-08eb-4fd7-b3e1-95909ad13463 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Returning 404 to user: Instance d8674bc0-e1c6-47db-9918-3bbfc8ba644d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:27.382404 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e05ae6ce-08eb-4fd7-b3e1-95909ad13463 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/d8674bc0-e1c6-47db-9918-3bbfc8ba644d/action" status: 404 len: 111 microversion: 2.1 time: 0.535536 Jul 20 10:48:27.383576 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 391/733] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:26 2022] POST /compute/v2.1/servers/d8674bc0-e1c6-47db-9918-3bbfc8ba644d/action => generated 111 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:27.449853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:27.453332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:27.477527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:27.478832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:27.480324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:27.481105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:27.648018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f7b0fbb-76cc-4fea-9771-5525a848917d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1630 microversion: 2.1 time: 0.320716 Jul 20 10:48:27.661683 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 343/734] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:27 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1630 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:27.667741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1247219273", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:27.744461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:27.782515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:27.792217 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cb541188-bf7a-4cf9-8863-48d317f95ca0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.358275 Jul 20 10:48:27.793180 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 392/735] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:27 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:27.801628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:27.802597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:27.819889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:27.820578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:27.823351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:27.824276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:28.228735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:28.248960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e169cd28-1e56-492b-bb8e-f8c7e24be153 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.453961 Jul 20 10:48:28.249987 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 393/736] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:27 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:28.258832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-10", "block_migration": true, "disk_over_commit": false}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:28.273788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:28.295004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:28.295781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:28.296726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:28.297320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:28.359011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lazy-loading 'flavor' on Instance uuid 0dcb596a-1664-4e9f-9764-e9bc6c5e498c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:48:28.394090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Going to try to live migrate instance to n-h2-846219-10 {{(pid=125885) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:48:28.461068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:48:28.461813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:48:28.464690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:48:28.465604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:48:28.466265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:48:28.489764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:28.490569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:28.491728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:28.492458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:28.551901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Getting quotas for project 9b34d0320ed7473299470fdf484e2080. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:28.563857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Getting quotas for user 91fda43ed940488da05b3e440098d36c and project 9b34d0320ed7473299470fdf484e2080. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:28.586451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:48:28.592933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:48:28.796995 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4f8d56f-2ba5-492a-b82d-5a23a5eaae0a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132960 Jul 20 10:48:28.803578 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 344/737] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:48:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:48:28.819348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:28.820349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:28.838794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:28.839664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:28.841776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:28.842508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:29.265841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:29.308284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:29.310834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:29.317621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e44d52f-91e8-4f75-949a-06918d747a7a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.510350 Jul 20 10:48:29.318266 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 345/738] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:28 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:29.325436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:29.326079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:29.354179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:29.354628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:29.355631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:29.360972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:29.743343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:29.766825 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52a2ae38-ab6e-490d-99d4-ddebeea037dc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.445379 Jul 20 10:48:29.767691 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 346/739] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:29 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:29.790475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-957918b3-1b3b-4e2a-90cb-fbdaee2689ce tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:29.793260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-957918b3-1b3b-4e2a-90cb-fbdaee2689ce tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:29.929497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-957918b3-1b3b-4e2a-90cb-fbdaee2689ce tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:29.958826 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-957918b3-1b3b-4e2a-90cb-fbdaee2689ce tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1222 microversion: 2.1 time: 0.179669 Jul 20 10:48:29.960504 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 347/740] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:29 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:29.965997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:29.966521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:29.984747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:29.995587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:30.003909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:30.005048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:30.005656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:31.224264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:31.252417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c15006f3-29a6-4f4e-a781-522a9f5dfe7a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 1.290323 Jul 20 10:48:31.254333 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 348/741] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:29 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:31.260596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-75dc412f-9f15-4f4f-adcd-30b5fd43f556 req-b020c609-58cc-4488-8b0d-65dcb245f0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87dade9-92b8-4c8c-82b5-676ef7f3bcc6", "tag": "74643744-81fd-4302-844f-2bc1865c2326"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:31.297678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-75dc412f-9f15-4f4f-adcd-30b5fd43f556 req-b020c609-58cc-4488-8b0d-65dcb245f0d1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:31.311692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-75dc412f-9f15-4f4f-adcd-30b5fd43f556 req-b020c609-58cc-4488-8b0d-65dcb245f0d1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:31.325985 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-75dc412f-9f15-4f4f-adcd-30b5fd43f556 req-b020c609-58cc-4488-8b0d-65dcb245f0d1 service nova] Creating event network-changed:74643744-81fd-4302-844f-2bc1865c2326 for instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 on n-h1-846219-10 Jul 20 10:48:31.340580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-75dc412f-9f15-4f4f-adcd-30b5fd43f556 req-b020c609-58cc-4488-8b0d-65dcb245f0d1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084204 Jul 20 10:48:31.342280 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 349/742] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:31.350562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:31.351867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:31.383637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:31.384769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:31.385697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:31.386155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:31.412035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:32.147588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:32.194282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:32.198959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:32.208243 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56015b0b-90e1-404f-ac8d-ff663a887af7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.863106 Jul 20 10:48:32.210543 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 350/743] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:31 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:32.223891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:32.225887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:32.260037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:32.261760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:32.266503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:32.269006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:32.749978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:32.761239 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f198fe91-9046-4eb9-9f66-d68ca6e74742 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.548721 Jul 20 10:48:32.762038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 351/744] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:32 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:32.775007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:32.775965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:32.810291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:32.810749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:32.813802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:32.814308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:32.913458 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-88e1883a-5832-497d-9767-5535e4c3224e tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c/action" status: 202 len: 0 microversion: 2.1 time: 4.661726 Jul 20 10:48:32.916365 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 394/745] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:28 2022] POST /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c/action => generated 0 bytes in 4666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:32.926282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:32.926665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:32.950995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:32.951592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:32.953025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:32.953869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:32.991070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:33.492127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:33.510645 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4dd0a1e2-7e12-4d19-a0c4-e18abfe70e16 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1322 microversion: 2.1 time: 0.739900 Jul 20 10:48:33.511516 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 352/746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:32 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:33.516454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:33.521887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:33.538885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:33.539639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:33.541266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:33.542286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:33.809311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:33.820411 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de27aeca-0601-44fc-8324-128d9edbe279 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.902426 Jul 20 10:48:33.833548 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 395/747] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:32 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:33.839521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-587bf7a8-9bff-47ba-ad3f-3261a16d1568 req-31c82292-9594-40e0-befd-64b7a0eb1b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb079f77-4d01-445b-85ff-da7793b9aefb", "name": "network-vif-unplugged", "status": "completed", "tag": "14f4e2fa-0661-43d1-a011-83ca3e6093aa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:33.846705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:33.854711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-587bf7a8-9bff-47ba-ad3f-3261a16d1568 req-31c82292-9594-40e0-befd-64b7a0eb1b5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:33.857931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-587bf7a8-9bff-47ba-ad3f-3261a16d1568 req-31c82292-9594-40e0-befd-64b7a0eb1b5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:33.882435 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-587bf7a8-9bff-47ba-ad3f-3261a16d1568 req-31c82292-9594-40e0-befd-64b7a0eb1b5b service nova] Creating event network-vif-unplugged:14f4e2fa-0661-43d1-a011-83ca3e6093aa for instance cb079f77-4d01-445b-85ff-da7793b9aefb on n-h2-846219-10 Jul 20 10:48:33.894485 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-587bf7a8-9bff-47ba-ad3f-3261a16d1568 req-31c82292-9594-40e0-befd-64b7a0eb1b5b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059182 Jul 20 10:48:33.895825 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 396/748] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:33.898704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=32 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:33.913340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:33.918132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:33.938909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:33.939969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:33.941542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:33.942540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:34.490782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:34.525023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d22bd2b4-fdae-43db-822f-dcb3b7486969 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.998816 Jul 20 10:48:34.530701 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 353/749] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:33 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:34.874136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-322fefb8-072f-4a20-b9b5-f1a39d8ff245 tempest-TenantUsagesNegativeTestJSON-382293228 tempest-TenantUsagesNegativeTestJSON-382293228-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T10%3A48%3A33.588526&end=2022-07-21T10%3A48%3A33.588526" status: 404 len: 112 microversion: - time: 0.341283 Jul 20 10:48:34.882844 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 354/750] 10.222.0.79 () {58 vars in 1315 bytes} [Wed Jul 20 10:48:34 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-19T10%3A48%3A33.588526&end=2022-07-21T10%3A48%3A33.588526 => generated 112 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 10:48:34.892479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:34.893967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:34.917086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:34.923886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:34.928761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:34.929904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.117486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:35.135311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:35.137021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:35.138249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f5003f0-b4e7-471b-93ff-a64c84e76097 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 1.240705 Jul 20 10:48:35.138761 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 397/751] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:33 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:35.153097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0a53d654-ad63-4b89-8ea3-22a3d5148086 req-cd2d002b-b0a6-4935-9193-bae9135c0c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e66db65-7841-45f9-ae17-59102a3a2802", "tag": "6d5bf098-e8ec-42a6-ad3e-1b1603af7601"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:35.167118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0a53d654-ad63-4b89-8ea3-22a3d5148086 req-cd2d002b-b0a6-4935-9193-bae9135c0c4f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.167830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0a53d654-ad63-4b89-8ea3-22a3d5148086 req-cd2d002b-b0a6-4935-9193-bae9135c0c4f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.190035 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0a53d654-ad63-4b89-8ea3-22a3d5148086 req-cd2d002b-b0a6-4935-9193-bae9135c0c4f service nova] Creating event network-changed:6d5bf098-e8ec-42a6-ad3e-1b1603af7601 for instance 6e66db65-7841-45f9-ae17-59102a3a2802 on n-h2-846219-10 Jul 20 10:48:35.194707 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0a53d654-ad63-4b89-8ea3-22a3d5148086 req-cd2d002b-b0a6-4935-9193-bae9135c0c4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054290 Jul 20 10:48:35.195585 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 398/752] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:35.202221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:35.203217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:35.210002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.210711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.211784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.212530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.248321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=14 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:35.499855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:35.511399 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e0d30f7-aca6-4752-8c3d-c0511bdac4f0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.626428 Jul 20 10:48:35.512035 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 355/753] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:34 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:35.522463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:35.528246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:35.560592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.561062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.561881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.569166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.897607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:35.914653 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-108af93f-4734-46b4-bc7f-90e8f36aa0ef tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1322 microversion: 2.1 time: 0.717262 Jul 20 10:48:35.919147 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 399/754] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:35 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1322 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:35.926584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7b41e65e-6cbf-4ff8-b8bb-d1abb66b4cd4 tempest-TenantUsagesNegativeTestJSON-382293228 tempest-TenantUsagesNegativeTestJSON-382293228-project-admin] Calling method '.version_select at 0x7f2c3fca40d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:35.937155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-7b41e65e-6cbf-4ff8-b8bb-d1abb66b4cd4 tempest-TenantUsagesNegativeTestJSON-382293228 tempest-TenantUsagesNegativeTestJSON-382293228-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7b41e65e-6cbf-4ff8-b8bb-d1abb66b4cd4 tempest-TenantUsagesNegativeTestJSON-382293228 tempest-TenantUsagesNegativeTestJSON-382293228-project-admin] Request method failure captured: Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-simple-tenant-usage/2b59258add9d4c519800f6013a38d770?start=2022-07-21T10%3A48%3A33.588526&end=2022-07-19T10%3A48%3A33.588526 HTTP/1.1 Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi192BoEBeeKkTv_wszYssco-lsWuaXKUskhcgdAgt4bINHhePpvNA7a7yGm13wUXPk6mjkPJBIKBK5l8-fsdOT79uaInDhYp0WE8QOA3HeWOwD8Dyy8GqO-oFf_ldPdfZtWafJpNn8C0borle898B8FunFwKRBl-ppozjNfQhhEoZxaY Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 121a682f1d2d4f0684b4000150694d12 Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-382293228 Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:48:35.942275 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_121a682f1d2d4f0684b4000150694d12", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/121a682f1d2d4f0684b4000150694d12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/121a682f1d2d4f0684b4000150694d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/121a682f1d2d4f0684b4000150694d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-382293228 Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 121a682f1d2d4f0684b4000150694d12 Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-382293228 Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TenantUsagesNegativeTestJSON-382293228-project-admin Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 962d2bcd7cf945d4b4cc93f4c12a3363 Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-382293228-project-admin Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid start time. The start time cannot occur after the end time. Jul 20 10:48:35.945197 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '2b59258add9d4c519800f6013a38d770'} Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 10:48:35.946336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7b41e65e-6cbf-4ff8-b8bb-d1abb66b4cd4 tempest-TenantUsagesNegativeTestJSON-382293228 tempest-TenantUsagesNegativeTestJSON-382293228-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:35.949815 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7b41e65e-6cbf-4ff8-b8bb-d1abb66b4cd4 tempest-TenantUsagesNegativeTestJSON-382293228 tempest-TenantUsagesNegativeTestJSON-382293228-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/2b59258add9d4c519800f6013a38d770?start=2022-07-21T10%3A48%3A33.588526&end=2022-07-19T10%3A48%3A33.588526" status: 400 len: 111 microversion: 2.1 time: 0.026942 Jul 20 10:48:35.956878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 400/755] 10.222.0.79 () {58 vars in 1411 bytes} [Wed Jul 20 10:48:35 2022] GET /compute/v2.1/os-simple-tenant-usage/2b59258add9d4c519800f6013a38d770?start=2022-07-21T10%3A48%3A33.588526&end=2022-07-19T10%3A48%3A33.588526 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:48:35.962199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:35.963435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:35.971137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.971864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:35.972830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:35.973610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:36.023101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:36.056844 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0917af00-7f33-4c9b-9069-40b355929eed tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.542285 Jul 20 10:48:36.058173 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 356/756] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:35 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:36.286018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c33005c-9184-42d8-ab04-3ba8e9610819 tempest-TenantUsagesNegativeTestJSON-1767344299 tempest-TenantUsagesNegativeTestJSON-1767344299-project] Calling method '.version_select at 0x7f2c3f871040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:36.289894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c33005c-9184-42d8-ab04-3ba8e9610819 tempest-TenantUsagesNegativeTestJSON-1767344299 tempest-TenantUsagesNegativeTestJSON-1767344299-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '560505fd90094c4284df504b4f736512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b59258add9d4c519800f6013a38d770', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c33005c-9184-42d8-ab04-3ba8e9610819 tempest-TenantUsagesNegativeTestJSON-1767344299 tempest-TenantUsagesNegativeTestJSON-1767344299-project] Request method failure captured: Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T10%3A48%3A33.588526&end=2022-07-21T10%3A48%3A33.588526&detailed=1 HTTP/1.1 Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191_k7a8L51zVbvZDNuKL0S7bh_Mne7O17aJKaFDci5rbZMSog6nEoAYyuW21QR3rZxzex_WoxZg2cPrLS4e1ai2quN4qCyl4k9uBqtUYlLoujggtWHzSiHipugz5xb0UwWAFK2z11OZ5ZnxpRgE9ZVXkonxGzOZS-cXkQjkJM9lb4U Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 2b59258add9d4c519800f6013a38d770 Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1767344299 Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:48:36.294862 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2b59258add9d4c519800f6013a38d770", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2b59258add9d4c519800f6013a38d770"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2b59258add9d4c519800f6013a38d770"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2b59258add9d4c519800f6013a38d770"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1767344299 Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 2b59258add9d4c519800f6013a38d770 Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1767344299 Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TenantUsagesNegativeTestJSON-1767344299-project Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 560505fd90094c4284df504b4f736512 Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1767344299-project Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: action_args: {} Jul 20 10:48:36.296491 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:48:36.297954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:48:36.299279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:48:36.301108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 20 10:48:36.301108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:36.301108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c33005c-9184-42d8-ab04-3ba8e9610819 tempest-TenantUsagesNegativeTestJSON-1767344299 tempest-TenantUsagesNegativeTestJSON-1767344299-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:36.301670 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0c33005c-9184-42d8-ab04-3ba8e9610819 tempest-TenantUsagesNegativeTestJSON-1767344299 tempest-TenantUsagesNegativeTestJSON-1767344299-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T10%3A48%3A33.588526&end=2022-07-21T10%3A48%3A33.588526&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.242424 Jul 20 10:48:36.302261 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 357/757] 10.222.0.79 () {58 vars in 1334 bytes} [Wed Jul 20 10:48:36 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T10%3A48%3A33.588526&end=2022-07-21T10%3A48%3A33.588526&detailed=1 => generated 123 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:36.310359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:36.311076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:36.323124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:36.323616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:36.324590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:36.325041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:36.715339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:36.735158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf6d284f-fdf5-483d-ab61-b4362a313473 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.776776 Jul 20 10:48:36.739487 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 401/758] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:35 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:36.760925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:36.761545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:36.784618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:36.785369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:36.786374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:36.787878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:37.033082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:37.061933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:37.068542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:37.076758 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b33c7ea6-5ace-47fd-ad62-a57613113705 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 0.767119 Jul 20 10:48:37.080467 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 358/759] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:36 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:37.104191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:37.106070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:37.128932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:37.132037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:37.138782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:37.141882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:37.934284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:37.955782 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-590430ea-29c8-4987-badf-379d2436fc90 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 1.214025 Jul 20 10:48:37.960163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 402/760] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:36 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:37.974507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:37.980546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:38.002152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:38.002820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:38.003598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:38.008610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:38.193361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:38.206477 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-acc5ca05-3c33-4be4-a12c-1a4ca1e61c4c tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1322 microversion: 2.1 time: 1.123798 Jul 20 10:48:38.220905 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 359/761] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:37 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1322 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:38.244229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:38.246056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:38.258078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:38.260064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:38.262002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:38.263644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:38.511491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:38.530246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1b92046-a185-4502-82a5-2ee265900362 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.568210 Jul 20 10:48:38.537853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:38.538407 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 403/762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:37 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:38.556326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:38.559786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:38.570608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:38.571745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:38.572889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:38.574009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:39.816888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:39.841464 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbb7d639-fb5d-41c0-879e-3743e3dd05ac tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 1.604381 Jul 20 10:48:39.842776 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 360/763] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:38 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:39.868686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:39.872362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:39.892739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:39.894028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:39.895656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:39.896604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:39.950004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:39.961957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=12 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:40.000677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:40.010203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:40.012871 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd20b2c5-6f82-44b6-8c6a-17d5f45c007d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1567 microversion: 2.25 time: 1.472735 Jul 20 10:48:40.015519 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 404/764] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:38 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1567 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:40.026272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bd055dbb-a208-4a3e-8707-f77a3b672e5c req-48afb590-d225-4cdd-871d-e406040ae15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e66db65-7841-45f9-ae17-59102a3a2802", "name": "network-vif-plugged", "status": "completed", "tag": "6d5bf098-e8ec-42a6-ad3e-1b1603af7601"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:40.066536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bd055dbb-a208-4a3e-8707-f77a3b672e5c req-48afb590-d225-4cdd-871d-e406040ae15d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.088287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bd055dbb-a208-4a3e-8707-f77a3b672e5c req-48afb590-d225-4cdd-871d-e406040ae15d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:40.134773 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bd055dbb-a208-4a3e-8707-f77a3b672e5c req-48afb590-d225-4cdd-871d-e406040ae15d service nova] Creating event network-vif-plugged:6d5bf098-e8ec-42a6-ad3e-1b1603af7601 for instance 6e66db65-7841-45f9-ae17-59102a3a2802 on n-h2-846219-10 Jul 20 10:48:40.148213 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bd055dbb-a208-4a3e-8707-f77a3b672e5c req-48afb590-d225-4cdd-871d-e406040ae15d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129962 Jul 20 10:48:40.156717 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 405/765] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:40.175823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:40.184271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:40.205283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.205735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:40.223427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.225006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:40.511944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:40.546847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19ab6b88-4f33-4bed-ba66-e3900b9f4d78 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.697299 Jul 20 10:48:40.547900 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 361/766] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:39 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:40.561607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:40.562259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:40.590548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.592706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:40.597719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.602218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:40.755570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:40.780254 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7612c6ae-9b32-48ec-a90e-69515113cd19 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1322 microversion: 2.1 time: 0.622151 Jul 20 10:48:40.783710 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 406/767] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:40 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:40.867155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:40.868765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:40.889993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.891592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:40.893268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:40.893990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.113461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:41.146116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f14f7f73-f538-4a45-a078-a407500ac375 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.594320 Jul 20 10:48:41.150768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 362/768] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:40 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:41.173252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:41.178661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:41.195931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.196926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.197995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.198882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.271549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:41.303349 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79d9489f-beab-45ac-bf89-ee969be04a46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.440284 Jul 20 10:48:41.309869 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 407/769] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:40 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:41.409500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b70ef023-9b5c-4642-962b-ab111518c237 req-f6427fc2-5f4c-4244-bf8f-2c1f76729a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "name": "network-vif-unplugged", "status": "completed", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:41.448688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b70ef023-9b5c-4642-962b-ab111518c237 req-f6427fc2-5f4c-4244-bf8f-2c1f76729a06 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.451417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b70ef023-9b5c-4642-962b-ab111518c237 req-f6427fc2-5f4c-4244-bf8f-2c1f76729a06 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.473584 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b70ef023-9b5c-4642-962b-ab111518c237 req-f6427fc2-5f4c-4244-bf8f-2c1f76729a06 service nova] Creating event network-vif-unplugged:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h1-846219-10 Jul 20 10:48:41.484323 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b70ef023-9b5c-4642-962b-ab111518c237 req-f6427fc2-5f4c-4244-bf8f-2c1f76729a06 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085262 Jul 20 10:48:41.485996 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 408/770] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:41.572333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:41.573961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:41.598909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.601709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.604692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.643647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.691519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:41.711548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:41.714192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:41.715516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-54c5e39a-670b-4e8a-9940-957f21269dee tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1557 microversion: 2.25 time: 0.558604 Jul 20 10:48:41.718971 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 363/771] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:41 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1557 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:41.750108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81becfac-ea3d-4f37-baf6-e106dc9d82b5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '.version_select at 0x7f2c3f7c2b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:41.753351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81becfac-ea3d-4f37-baf6-e106dc9d82b5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.754146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81becfac-ea3d-4f37-baf6-e106dc9d82b5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.785776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81becfac-ea3d-4f37-baf6-e106dc9d82b5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2206 microversion: 2.25 time: 0.038569 Jul 20 10:48:41.786908 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 364/772] 10.222.0.79 () {60 vars in 1183 bytes} [Wed Jul 20 10:48:41 2022] GET /compute/v2.1/os-migrations => generated 2206 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:41.804700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:41.807630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:41.828174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.829145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:41.831458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:41.835211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.322021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:42.346048 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebe4dbb3-d6c9-4bdd-b4b1-416fa30b014f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1477 microversion: 2.1 time: 0.779251 Jul 20 10:48:42.358407 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 409/773] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:41 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1477 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:42.364875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:42.365822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:42.373354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.374548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.376030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.376831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.405062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cb079f77-4d01-445b-85ff-da7793b9aefb {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:48:42.440575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1fc6bea4-71f9-41e0-ab63-b4ee81513153 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 2050 microversion: 2.25 time: 0.639211 Jul 20 10:48:42.455295 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 365/774] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:41 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 2050 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:42.470014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:42.471116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:42.486781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.487469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.488509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.489074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.836346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:42.853033 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c5466fd-099c-4780-a108-c78dad9218b9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1472 microversion: 2.1 time: 0.492970 Jul 20 10:48:42.854826 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 410/775] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:42 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:42.860817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3a9db975-71de-47ef-bfb6-4eebf73f240e req-bad2ce99-b768-405a-a203-2821829460f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87dade9-92b8-4c8c-82b5-676ef7f3bcc6", "name": "network-vif-plugged", "status": "completed", "tag": "74643744-81fd-4302-844f-2bc1865c2326"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:42.879281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3a9db975-71de-47ef-bfb6-4eebf73f240e req-bad2ce99-b768-405a-a203-2821829460f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.880128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3a9db975-71de-47ef-bfb6-4eebf73f240e req-bad2ce99-b768-405a-a203-2821829460f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.904108 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3a9db975-71de-47ef-bfb6-4eebf73f240e req-bad2ce99-b768-405a-a203-2821829460f1 service nova] Creating event network-vif-plugged:74643744-81fd-4302-844f-2bc1865c2326 for instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 on n-h1-846219-10 Jul 20 10:48:42.919302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:42.921680 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3a9db975-71de-47ef-bfb6-4eebf73f240e req-bad2ce99-b768-405a-a203-2821829460f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065202 Jul 20 10:48:42.922297 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 411/776] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:42.929883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:42.931395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:42.936404 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-abfd4996-9db6-46b5-83eb-f07960fb7d06 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.477584 Jul 20 10:48:42.944677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.944677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.944677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:42.944677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:42.949626 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 366/777] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:42 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:43.184154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:43.199940 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c9419012-8378-4810-8d37-b968bef098dd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.274091 Jul 20 10:48:43.213374 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 412/778] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:42 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:43.224806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-693049480", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "91e8e2a5-7d79-4c89-b21c-e5ff9469e846"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:43.344052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] validate_networks() for [('91e8e2a5-7d79-4c89-b21c-e5ff9469e846', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:43.464236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Calling method '.version_select at 0x7f2c3fa36790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:43.540604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:48:43.542706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Neutron security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:48:43.543628 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] HTTP exception thrown: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.543628 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Request method failure captured: Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-security-groups/dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 HTTP/1.1 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi192Ko3NtpGxzp-efmE3RXqKVvJR-5sHygquVwZhMC9XcyrYLhPWMFWl0pTihbqDmnubaqnkqvVTUbfpfPruEK4yfzflpimKQZoXbOWEmfZRr_FrCown6oi699_tKXDIuAkADzPPEarGUt3-OtHtDSuEDL76DQq3MOm7OKFXAzkhv5T0 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:48:43.574955 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_668d6c02174d4009a38e334ba1a4c713", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ca778307085f41bb84d0471bd80995ed Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] Jul 20 10:48:43.576792 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7'} Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:43.577694 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:48:43.582660 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.588594 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] Jul 20 10:48:43.590253 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:43.592360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Returning 404 to user: Security group dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 does not exist Jul 20 10:48:43.592360 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-1108d0d4-916e-44c5-b315-70aaa26598ea'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:43.593397 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d58f8544-4fe2-4211-9ade-740e1c3e8e2b tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7" status: 404 len: 194 microversion: 2.1 time: 0.643312 Jul 20 10:48:43.594726 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 367/779] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:48:42 2022] DELETE /compute/v2.1/os-security-groups/dc64ce0c-5e9c-4420-ba53-4a6786bf2dd7 => generated 194 bytes in 645 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:43.601916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:43.603434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:43.617454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:43.618819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:43.620100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:43.620711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:43.660363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lazy-loading 'flavor' on Instance uuid 6e66db65-7841-45f9-ae17-59102a3a2802 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:48:43.796673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:43.816784 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c748fe38-c28b-480a-a9bf-1165eb643ec6 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802/action" status: 202 len: 0 microversion: 2.1 time: 0.219359 Jul 20 10:48:43.818514 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 368/780] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:43 2022] POST /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:48:43.842722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:43.844289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:43.855217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:43.855531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:43.856509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:43.856959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.146725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:44.162777 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9929df0d-55fa-44f9-9ebe-5d658a08c545 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1476 microversion: 2.1 time: 0.334090 Jul 20 10:48:44.166139 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 369/781] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:43 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1476 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:44.190737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ed0c9162-5d1a-4f16-a196-3778d4c5c051 req-132a05b1-1a03-4bb2-9a0a-b529c263af79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:44.214844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ed0c9162-5d1a-4f16-a196-3778d4c5c051 req-132a05b1-1a03-4bb2-9a0a-b529c263af79 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.224288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ed0c9162-5d1a-4f16-a196-3778d4c5c051 req-132a05b1-1a03-4bb2-9a0a-b529c263af79 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.238115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:48:44.239417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:48:44.240506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:48:44.241367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:48:44.242261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:48:44.266402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ed0c9162-5d1a-4f16-a196-3778d4c5c051 req-132a05b1-1a03-4bb2-9a0a-b529c263af79 service nova] Creating event network-changed:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h1-846219-10 Jul 20 10:48:44.294761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.296019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.297741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.298901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.299266 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ed0c9162-5d1a-4f16-a196-3778d4c5c051 req-132a05b1-1a03-4bb2-9a0a-b529c263af79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128535 Jul 20 10:48:44.303572 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 370/782] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:44.326546 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b50c3d7-bdeb-4efb-904b-013a2f21ac26 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.020923 Jul 20 10:48:44.327544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 371/783] 10.222.0.79 () {58 vars in 1163 bytes} [Wed Jul 20 10:48:44 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 10:48:44.340966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:44.342209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:44.357525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:44.361843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.362962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.366078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.367365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.370897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for user cc3921f3f8264fb2aa9c95b86cf4dd9d and project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:44.412056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:48:44.420190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:48:44.485864 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f6ed42bc-e620-4204-998c-47026bccddfe tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.269351 Jul 20 10:48:44.486896 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 413/784] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:48:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:48:44.492461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:44.493960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:44.505428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.506786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.510642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.513225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:44.951010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:44.969186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8923cb29-d2e9-4c76-8228-e378c0ede9a9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1317 microversion: 2.1 time: 0.480438 Jul 20 10:48:44.969473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 414/785] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:44 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:44.985179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:44.985667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:44.996887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:44.998790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:45.002451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:45.002954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:45.415973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:45.449390 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7ba496f6-f97e-4798-9f62-6011607ab2f8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.478683 Jul 20 10:48:45.450742 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-646f4540-bb71-49ad-b8d7-31368510e6dc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1633 microversion: 2.1 time: 1.121045 Jul 20 10:48:45.451852 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 415/786] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:44 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:45.463806 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 372/787] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:44 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1633 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:45.471223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-221cc698-5cf1-4287-9eb8-24eb359f4d7a tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Calling method '.version_select at 0x7f2c3f73c670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:45.842297 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-221cc698-5cf1-4287-9eb8-24eb359f4d7a tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.376181 Jul 20 10:48:45.844304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 373/788] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:48:45 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:45.849404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:45.850237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:45.866247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:45.867090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:45.873185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:45.874727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:45.981846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36ac44cd-fe01-4588-bf78-df624050710e tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:46.032648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36ac44cd-fe01-4588-bf78-df624050710e tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.578535 Jul 20 10:48:46.034124 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 416/789] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:48:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:46.053339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:46.054982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:46.074761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:46.075616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:46.077022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:46.077797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:46.152378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:46.179241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:46.181574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:46.188903 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ee676e2-8b03-4f69-853f-a38d10bd846d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1313 microversion: 2.25 time: 0.343193 Jul 20 10:48:46.190348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 374/790] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:45 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:46.209072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a232f0e3-0947-4644-ace0-eb5090331a87 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Calling method '.version_select at 0x7f2c3f73c790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:46.666433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:46.688449 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1cfa30c-67ed-42e4-9aa1-95d2f344bd4d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1476 microversion: 2.1 time: 0.652150 Jul 20 10:48:46.717113 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 417/791] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:46 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1476 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:46.726696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:46.728428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:46.750568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:46.751339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:46.765068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:46.766610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:46.823250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:46.864514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-a232f0e3-0947-4644-ace0-eb5090331a87 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:48:46.866826 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a232f0e3-0947-4644-ace0-eb5090331a87 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 20 10:48:46.866826 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a232f0e3-0947-4644-ace0-eb5090331a87 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Request method failure captured: Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-security-groups/36ad5633-b3dc-4fd5-91e8-2f0802b3d010 HTTP/1.1 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi192Ko3NtpGxzp-efmE3RXqKVvJR-5sHygquVwZhMC9XcyrYLhPWMFWl0pTihbqDmnubaqnkqvVTUbfpfPruEK4yfzflpimKQZoXbOWEmfZRr_FrCown6oi699_tKXDIuAkADzPPEarGUt3-OtHtDSuEDL76DQq3MOm7OKFXAzkhv5T0 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:48:46.871842 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_668d6c02174d4009a38e334ba1a4c713", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ca778307085f41bb84d0471bd80995ed Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: exception: Insufficient rights for removing default security group. Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] Jul 20 10:48:46.874454 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '36ad5633-b3dc-4fd5-91e8-2f0802b3d010'} Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:46.876090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 20 10:48:46.878340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:46.880683 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:46.883302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:46.883302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:46.883302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:46.883302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 20 10:48:46.883302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] Jul 20 10:48:46.883302 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:46.885560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a232f0e3-0947-4644-ace0-eb5090331a87 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 20 10:48:46.885560 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-6b872bb4-6e55-471b-b4e2-c514a098cb94'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:46.887589 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a232f0e3-0947-4644-ace0-eb5090331a87 tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/36ad5633-b3dc-4fd5-91e8-2f0802b3d010" status: 400 len: 182 microversion: 2.1 time: 0.694826 Jul 20 10:48:46.900367 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 375/792] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:48:46 2022] DELETE /compute/v2.1/os-security-groups/36ad5633-b3dc-4fd5-91e8-2f0802b3d010 => generated 182 bytes in 708 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:48:46.920080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ba5db973-41f8-41ce-afee-1eeb2ae2b4f0 req-6ef22dba-5437-4b91-acf5-3476fc5682a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c246d4-40d9-44e6-ba74-ae2d6391c4c2", "name": "network-vif-unplugged", "status": "completed", "tag": "bd65064d-d349-4797-86ea-06a35e3eb77f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:46.941457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ba5db973-41f8-41ce-afee-1eeb2ae2b4f0 req-6ef22dba-5437-4b91-acf5-3476fc5682a4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:46.942771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ba5db973-41f8-41ce-afee-1eeb2ae2b4f0 req-6ef22dba-5437-4b91-acf5-3476fc5682a4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:46.958365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ba5db973-41f8-41ce-afee-1eeb2ae2b4f0 req-6ef22dba-5437-4b91-acf5-3476fc5682a4 service nova] Creating event network-vif-unplugged:bd65064d-d349-4797-86ea-06a35e3eb77f for instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 on n-h2-846219-10 Jul 20 10:48:46.978361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-ba5db973-41f8-41ce-afee-1eeb2ae2b4f0 req-6ef22dba-5437-4b91-acf5-3476fc5682a4 service nova] Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:48:47.005069 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ba5db973-41f8-41ce-afee-1eeb2ae2b4f0 req-6ef22dba-5437-4b91-acf5-3476fc5682a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102022 Jul 20 10:48:47.006833 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 376/793] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:47.018658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:47.020395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:47.030574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:47.031516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:47.032962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:47.033768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:47.519703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:47.535959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-02dcc842-6720-40bf-a2dc-ce021bfdf1a1 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1467 microversion: 2.1 time: 0.817547 Jul 20 10:48:47.536925 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 418/794] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:46 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1467 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:47.542890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:47.543546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:47.564966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:47.565751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:47.566758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:47.567399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:47.748746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:47.760258 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f45be16-1026-410a-bb88-51bb961988b2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.750680 Jul 20 10:48:47.772362 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 377/795] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:47 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:47.785786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Calling method '.version_select at 0x7f2c3f6b68b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:47.897175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:48:47.897773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Neutron security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:48:47.900318 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] HTTP exception thrown: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.900318 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Request method failure captured: Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-security-groups/c85be5e7-1192-4a7f-9870-6bb3afe5ba89 HTTP/1.1 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi192Ko3NtpGxzp-efmE3RXqKVvJR-5sHygquVwZhMC9XcyrYLhPWMFWl0pTihbqDmnubaqnkqvVTUbfpfPruEK4yfzflpimKQZoXbOWEmfZRr_FrCown6oi699_tKXDIuAkADzPPEarGUt3-OtHtDSuEDL76DQq3MOm7OKFXAzkhv5T0 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:48:47.905687 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_668d6c02174d4009a38e334ba1a4c713", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ca778307085f41bb84d0471bd80995ed Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] Jul 20 10:48:47.908550 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c85be5e7-1192-4a7f-9870-6bb3afe5ba89'} Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:47.910004 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:48:47.914315 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.918232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Returning 404 to user: Security group c85be5e7-1192-4a7f-9870-6bb3afe5ba89 does not exist Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-077372eb-40d3-4309-aaf8-26032fe135e2'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d29839e5-8c97-4c0b-a668-cc2d83d8078d tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/c85be5e7-1192-4a7f-9870-6bb3afe5ba89" status: 404 len: 194 microversion: 2.1 time: 0.133781 Jul 20 10:48:47.921164 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 378/796] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:48:47 2022] GET /compute/v2.1/os-security-groups/c85be5e7-1192-4a7f-9870-6bb3afe5ba89 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:47.922781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0dbf1384-20a8-4871-bb6e-fabf7f486e3b tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-341269465", "imageRef": "43c64e2a-9c19-441c-a636-1446e3a5f31a", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:48.007747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-0dbf1384-20a8-4871-bb6e-fabf7f486e3b tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:48.012112 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-077f9833-fcae-47d2-9f87-8e8411c5faca tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1616 microversion: 2.1 time: 0.473647 Jul 20 10:48:48.013519 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 419/797] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:47 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1616 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:48.032015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:48.033020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:48.045462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:48.053160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:48.054143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:48.054596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:48.611342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:48.623912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:48.626167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:48.627641 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3422b8bc-4a20-439b-a221-fa65891eb87b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.612365 Jul 20 10:48:48.628937 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 420/798] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:48 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:48.645945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:48.647067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:48.655331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:48.656469 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0dbf1384-20a8-4871-bb6e-fabf7f486e3b tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 20 10:48:48.656619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0dbf1384-20a8-4871-bb6e-fabf7f486e3b tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] Request method failure captured: Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 142 Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi192M1j-XAcAc1o2rpg50NMXCL5R8n2i_rJsd-_VHxwwU7xRqENbZrdAdFwj2A-QXgnhMLHocxaiWMV8W5qKImaA_iKhP5ZvGJcwS2slovrYLKMT3xvFeZ-AuzM63yMWoBNsPG8C1rYVuhZ6Amy6z_yZJB2y8rQl_UdvOeGDrFTAOLSs Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: bcb2fcc6943c4cd7ad69c1b0aedbb760 Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FlavorsV2NegativeTest-551841200 Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:48:48.659434 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bcb2fcc6943c4cd7ad69c1b0aedbb760", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bcb2fcc6943c4cd7ad69c1b0aedbb760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bcb2fcc6943c4cd7ad69c1b0aedbb760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bcb2fcc6943c4cd7ad69c1b0aedbb760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FlavorsV2NegativeTest-551841200 Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: bcb2fcc6943c4cd7ad69c1b0aedbb760 Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-551841200 Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FlavorsV2NegativeTest-551841200-project Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9939c562f52a41bfbe7dfe61479ed140 Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FlavorsV2NegativeTest-551841200-project Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-341269465", "imageRef": "43c64e2a-9c19-441c-a636-1446e3a5f31a", "flavorRef": "452"}} Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:48:48.660811 n-d-846219-10 devstack@n-api.service[125886]: exception: Flavor's memory is too small for requested image. Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-341269465', 'imageRef': '43c64e2a-9c19-441c-a636-1446e3a5f31a', 'flavorRef': '452'}}} Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:48.661669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:48.662747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0dbf1384-20a8-4871-bb6e-fabf7f486e3b tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:48.664214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0dbf1384-20a8-4871-bb6e-fabf7f486e3b tempest-FlavorsV2NegativeTest-551841200 tempest-FlavorsV2NegativeTest-551841200-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.746042 Jul 20 10:48:48.665488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:48.669108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 379/799] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:48:47 2022] POST /compute/v2.1/servers => generated 93 bytes in 755 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:48:48.669799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:48.685584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:48.685584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:48.729983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:48.731826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:48.736287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:48.737240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.249806 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-522cf3f3-6b89-4217-a9b7-43a44b5ad80b tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1620 microversion: 2.1 time: 0.608296 Jul 20 10:48:49.250403 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 421/800] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:48 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1620 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:49.258096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:49.260670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Action: 'update', calling method: .version_select at 0x7f2c3fcbb310>, body: {"security_group": {"name": "tempest-sg-754517662", "description": "tempest-description-441400313"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.287694 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-193428d1-f9a0-40f1-bf9e-667ee5556932 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1476 microversion: 2.1 time: 0.622763 Jul 20 10:48:49.295970 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 380/801] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:48 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:49.320192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:49.323308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:49.333384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:48:49.334006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Neutron security group 88d2bd42-ca97-4a67-9667-93ce574b5274 not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:48:49.334595 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] HTTP exception thrown: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.334595 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] Jul 20 10:48:49.338939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.339553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.340462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.340998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Request method failure captured: Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/os-security-groups/88d2bd42-ca97-4a67-9667-93ce574b5274 HTTP/1.1 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 100 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi192Ko3NtpGxzp-efmE3RXqKVvJR-5sHygquVwZhMC9XcyrYLhPWMFWl0pTihbqDmnubaqnkqvVTUbfpfPruEK4yfzflpimKQZoXbOWEmfZRr_FrCown6oi699_tKXDIuAkADzPPEarGUt3-OtHtDSuEDL76DQq3MOm7OKFXAzkhv5T0 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:48:49.346496 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_668d6c02174d4009a38e334ba1a4c713", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/668d6c02174d4009a38e334ba1a4c713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 668d6c02174d4009a38e334ba1a4c713 Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112 Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: ca778307085f41bb84d0471bd80995ed Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-2088993112-project Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: {"security_group": {"name": "tempest-sg-754517662", "description": "tempest-description-441400313"}} Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:48:49.347889 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '88d2bd42-ca97-4a67-9667-93ce574b5274', 'body': {'security_group': {'name': 'tempest-sg-754517662', 'description': 'tempest-description-441400313'}}} Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:48:49.348614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:48:49.349616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] Jul 20 10:48:49.350682 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] Returning 404 to user: Security group 88d2bd42-ca97-4a67-9667-93ce574b5274 does not exist Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-dc782cbf-77b1-4421-936a-0a963230d77d'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:49.354081 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-480d0d7e-b500-4e82-8f80-11fbe69141ce tempest-SecurityGroupsNegativeTestJSON-2088993112 tempest-SecurityGroupsNegativeTestJSON-2088993112-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/88d2bd42-ca97-4a67-9667-93ce574b5274" status: 404 len: 194 microversion: 2.1 time: 0.096770 Jul 20 10:48:49.357149 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 422/802] 10.222.0.79 () {60 vars in 1289 bytes} [Wed Jul 20 10:48:49 2022] PUT /compute/v2.1/os-security-groups/88d2bd42-ca97-4a67-9667-93ce574b5274 => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:49.378092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.378709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:49.400323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.401425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.402883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.403884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.413035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:48:49.475085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6e66db65-7841-45f9-ae17-59102a3a2802 while it is in vm_state suspended Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Request method failure captured: Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802/action HTTP/1.1 Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 15 Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi191nWwSl7zYq9VhNExwd1ldNih1MO22DPI258XDRO0UgtqITuJDwjzBHpJbEFnNHFicEHWDZgjIFzw4t3mrjV18qI0HjOPrNglFvL1kutf8JBU3143xXQFMyvqPyFgeBgR-05xi3yrAjj1eaYN-xoIjFZ-8lIHddhD2n0WFR7gGLFhI Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:48:49.478618 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26a3432c56d34ca1ae6f5d67a608f642", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 1ee7309882ba4f06866a2009359e2400 Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: {"migrate": {}} Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:48:49.480281 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot 'migrate' instance 6e66db65-7841-45f9-ae17-59102a3a2802 while it is in vm_state suspended Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6e66db65-7841-45f9-ae17-59102a3a2802', 'body': {'migrate': {}}} Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 in vm_state suspended. Cannot resize while the instance is in this state. Jul 20 10:48:49.481114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6e66db65-7841-45f9-ae17-59102a3a2802 while it is in vm_state suspended Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.482231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.483427 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:49.483427 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:49.483427 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:49.483427 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:49.483427 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6e66db65-7841-45f9-ae17-59102a3a2802 while it is in vm_state suspended Jul 20 10:48:49.483427 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.485869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Returning 409 to user: Cannot 'migrate' instance 6e66db65-7841-45f9-ae17-59102a3a2802 while it is in vm_state suspended {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:49.487203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f01ce86-0689-4df4-8381-cd318e40ca70 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802/action" status: 409 len: 148 microversion: 2.1 time: 0.126544 Jul 20 10:48:49.488348 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 423/803] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:49 2022] POST /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802/action => generated 148 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:48:49.503515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3bace03a-f661-47e2-a8ef-b6cc99aa5fb1 req-fb3a9c74-4de9-434f-8ae3-0a78d409407e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "name": "network-vif-unplugged", "status": "completed", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.526538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3bace03a-f661-47e2-a8ef-b6cc99aa5fb1 req-fb3a9c74-4de9-434f-8ae3-0a78d409407e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.527528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3bace03a-f661-47e2-a8ef-b6cc99aa5fb1 req-fb3a9c74-4de9-434f-8ae3-0a78d409407e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.547378 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3bace03a-f661-47e2-a8ef-b6cc99aa5fb1 req-fb3a9c74-4de9-434f-8ae3-0a78d409407e service nova] Creating event network-vif-unplugged:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h1-846219-10 Jul 20 10:48:49.560028 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3bace03a-f661-47e2-a8ef-b6cc99aa5fb1 req-fb3a9c74-4de9-434f-8ae3-0a78d409407e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063313 Jul 20 10:48:49.561586 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 424/804] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:49.581069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-32429863-659d-40ba-8089-af68d8bfba5c req-cacc4372-e088-403b-a79e-b74d59888d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "name": "network-vif-unplugged", "status": "completed", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.595477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-32429863-659d-40ba-8089-af68d8bfba5c req-cacc4372-e088-403b-a79e-b74d59888d17 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.596138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-32429863-659d-40ba-8089-af68d8bfba5c req-cacc4372-e088-403b-a79e-b74d59888d17 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.615521 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-32429863-659d-40ba-8089-af68d8bfba5c req-cacc4372-e088-403b-a79e-b74d59888d17 service nova] Creating event network-vif-unplugged:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h1-846219-10 Jul 20 10:48:49.627503 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-32429863-659d-40ba-8089-af68d8bfba5c req-cacc4372-e088-403b-a79e-b74d59888d17 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059937 Jul 20 10:48:49.628427 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 425/805] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:49.639189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:49.640171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:49.648123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.649715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.650698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.651339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.709578 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-535fe6b4-9f4f-4acf-94e5-b892f6a91eb1 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 204 len: 0 microversion: 2.1 time: 0.409043 Jul 20 10:48:49.710299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 381/806] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:48:49 2022] DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:48:49.728071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-cf57152d-39f9-4c83-8a55-54dd968d6cde req-448431fe-df48-4320-b4ad-027ecaa36b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c246d4-40d9-44e6-ba74-ae2d6391c4c2", "tag": "bd65064d-d349-4797-86ea-06a35e3eb77f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.746899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cf57152d-39f9-4c83-8a55-54dd968d6cde req-448431fe-df48-4320-b4ad-027ecaa36b25 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:49.747932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cf57152d-39f9-4c83-8a55-54dd968d6cde req-448431fe-df48-4320-b4ad-027ecaa36b25 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:49.783284 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-cf57152d-39f9-4c83-8a55-54dd968d6cde req-448431fe-df48-4320-b4ad-027ecaa36b25 service nova] Creating event network-changed:bd65064d-d349-4797-86ea-06a35e3eb77f for instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 on n-h2-846219-10 Jul 20 10:48:49.791011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-cf57152d-39f9-4c83-8a55-54dd968d6cde req-448431fe-df48-4320-b4ad-027ecaa36b25 service nova] Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:48:49.809749 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-cf57152d-39f9-4c83-8a55-54dd968d6cde req-448431fe-df48-4320-b4ad-027ecaa36b25 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091985 Jul 20 10:48:49.812383 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 382/807] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:49.821609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0305de7a-c589-4154-972f-88a929ec6e3a tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0305de7a-c589-4154-972f-88a929ec6e3a tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Request method failure captured: Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260/action HTTP/1.1 Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 39 Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191nWwSl7zYq9VhNExwd1ldNih1MO22DPI258XDRO0UgtqITuJDwjzBHpJbEFnNHFicEHWDZgjIFzw4t3mrjV18qI0HjOPrNglFvL1kutf8JBU3143xXQFMyvqPyFgeBgR-05xi3yrAjj1eaYN-xoIjFZ-8lIHddhD2n0WFR7gGLFhI Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:48:49.825908 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26a3432c56d34ca1ae6f5d67a608f642", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 1ee7309882ba4f06866a2009359e2400 Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: {"os-resetState": {"state": "invalid"}} Jul 20 10:48:49.828012 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '6c93c19a-6f7e-443a-b114-ec9d91350260', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:49.829497 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:48:49.833463 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 20 10:48:49.839271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:49.840205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0305de7a-c589-4154-972f-88a929ec6e3a tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:49.845287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0305de7a-c589-4154-972f-88a929ec6e3a tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260/action" status: 400 len: 144 microversion: 2.1 time: 0.030470 Jul 20 10:48:49.847383 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 383/808] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:49 2022] POST /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260/action => generated 144 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:48:49.862413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-672930011", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["9bfeb30c-e126-4abd-9c33-c2ae07eec3e7"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:49.951980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:50.201422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:50.211283 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33cfca39-a91d-4c0d-951e-6f9faa5dda1e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.580343 Jul 20 10:48:50.214140 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 426/809] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:49 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:50.220088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:50.220920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:50.229296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:50.230088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:50.231443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:50.232078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:50.601582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:48:50.604156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:48:50.604156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:48:50.604156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:48:50.604822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:48:50.617575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:50.618760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:50.619809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:50.620787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:50.649554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:50.653601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:50.660353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:50.663913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:50.669062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:50.671544 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a0fae52-fe53-467d-af0b-b4271dea1867 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.455633 Jul 20 10:48:50.672542 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 427/810] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:50 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:50.682977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5041f91-05a3-4b66-8f14-f6ddb75eabd1 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:50.687671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5041f91-05a3-4b66-8f14-f6ddb75eabd1 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Request method failure captured: Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260/action HTTP/1.1 Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 31 Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi191nWwSl7zYq9VhNExwd1ldNih1MO22DPI258XDRO0UgtqITuJDwjzBHpJbEFnNHFicEHWDZgjIFzw4t3mrjV18qI0HjOPrNglFvL1kutf8JBU3143xXQFMyvqPyFgeBgR-05xi3yrAjj1eaYN-xoIjFZ-8lIHddhD2n0WFR7gGLFhI Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:48:50.687874 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26a3432c56d34ca1ae6f5d67a608f642", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 1ee7309882ba4f06866a2009359e2400 Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: {"os-resetState": {"state": 1}} Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:48:50.689114 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6c93c19a-6f7e-443a-b114-ec9d91350260', 'body': {'os-resetState': {'state': 1}}} Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 1 Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:50.689880 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 20 10:48:50.693165 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:48:50.696704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5041f91-05a3-4b66-8f14-f6ddb75eabd1 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:50.696954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:48:50.697180 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5041f91-05a3-4b66-8f14-f6ddb75eabd1 tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260/action" status: 400 len: 120 microversion: 2.1 time: 0.015472 Jul 20 10:48:50.698914 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 428/811] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:50 2022] POST /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260/action => generated 120 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:48:50.708991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-663540755", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "1900604824", "adminPass": "***", "networks": [{"uuid": "04856346-c838-4631-acfb-10202c0fe807"}], "security_groups": [{"name": "tempest-securitygroup--1289740485"}], "key_name": "tempest-keypair-2046461815", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:50.745938 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a3b0a3c-e7c5-4c47-af3c-e48aeddab388 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894957 Jul 20 10:48:50.747007 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 384/812] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:48:50.752982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:50.753803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:50.777607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:50.778467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:50.779888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:50.780499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:51.028189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] validate_networks() for [('04856346-c838-4631-acfb-10202c0fe807', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:48:51.343677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:51.357115 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fabb36eb-5b2d-4764-9b3b-5daf214d2f24 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1474 microversion: 2.1 time: 0.608534 Jul 20 10:48:51.358151 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 385/813] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:50 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1474 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:51.374721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f33fc585-9cab-4e12-b465-5a165df636bc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:51.377375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f33fc585-9cab-4e12-b465-5a165df636bc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Failed to fetch instance by id 999 {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 10:48:51.379614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f33fc585-9cab-4e12-b465-5a165df636bc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f33fc585-9cab-4e12-b465-5a165df636bc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Request method failure captured: Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 37 Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191nWwSl7zYq9VhNExwd1ldNih1MO22DPI258XDRO0UgtqITuJDwjzBHpJbEFnNHFicEHWDZgjIFzw4t3mrjV18qI0HjOPrNglFvL1kutf8JBU3143xXQFMyvqPyFgeBgR-05xi3yrAjj1eaYN-xoIjFZ-8lIHddhD2n0WFR7gGLFhI Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:48:51.384266 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_26a3432c56d34ca1ae6f5d67a608f642", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/26a3432c56d34ca1ae6f5d67a608f642"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 26a3432c56d34ca1ae6f5d67a608f642 Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-589315055 Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 1ee7309882ba4f06866a2009359e2400 Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-589315055-project-admin Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: {"os-resetState": {"state": "error"}} Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:48:51.386844 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 999 could not be found. Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:48:51.388290 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 10:48:51.390638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:51.395348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f33fc585-9cab-4e12-b465-5a165df636bc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:51.397498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f33fc585-9cab-4e12-b465-5a165df636bc tempest-ServersAdminNegativeTestJSON-589315055 tempest-ServersAdminNegativeTestJSON-589315055-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.037765 Jul 20 10:48:51.399573 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 386/814] 10.222.0.79 () {60 vars in 1178 bytes} [Wed Jul 20 10:48:51 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:48:51.411153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d12b002f-d481-4226-b250-33771d869436 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:51.412986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d12b002f-d481-4226-b250-33771d869436 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:51.538622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d12b002f-d481-4226-b250-33771d869436 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:51.563004 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d12b002f-d481-4226-b250-33771d869436 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1216 microversion: 2.1 time: 0.161547 Jul 20 10:48:51.563918 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 387/815] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:51 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:51.568784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:51.572624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:51.581996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:51.583557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:51.584485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:51.585005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.202917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:52.220533 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8607a9c-1226-4a17-b687-1c96e8a20b0f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 0.655327 Jul 20 10:48:52.231674 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 388/816] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:51 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:52.236596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:52.237143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:52.252431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:52.253217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.254177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:52.254628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.317002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:48:52.487380 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b051fec1-f894-4c35-9755-68e24cafe206 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 204 len: 0 microversion: 2.1 time: 0.251272 Jul 20 10:48:52.487841 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 389/817] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:48:52 2022] DELETE /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:48:52.506616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:52.508196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:52.516287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:52.517040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.518489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:52.519970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.750520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:48:52.751143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:48:52.754541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:48:52.755314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:48:52.755942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:48:52.769085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:52.769841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.770826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:52.771662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:52.794555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Getting quotas for project b1f86bfd704a4e09873d14c9aa3f88dc. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:48:52.801106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Getting quotas for user 860bf9c0b96a4f0996edbaa5a0a49977 and project b1f86bfd704a4e09873d14c9aa3f88dc. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:48:52.822477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:48:52.825846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:48:52.890336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:52.910374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:52.933722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:52.952037 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60372076-826c-49ec-8638-4eb5a5b36538 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.460381 Jul 20 10:48:52.954574 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 390/818] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:52 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:52.980520 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2c5e924-2f3a-4059-8875-c45d7966214d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.279368 Jul 20 10:48:53.005584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 429/819] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:48:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:48:53.007785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-eff9e9e8-8709-4ef4-9490-fa4ff1e7e4b8 req-c204269c-ac7b-4c1e-8263-0b3c388e755c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e633ca39-5368-44a8-ae5c-829663eb825c", "tag": "fa3c62ec-954a-4138-aa41-81928ecc6a5e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:53.020772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:53.027600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:53.032969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eff9e9e8-8709-4ef4-9490-fa4ff1e7e4b8 req-c204269c-ac7b-4c1e-8263-0b3c388e755c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.033424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eff9e9e8-8709-4ef4-9490-fa4ff1e7e4b8 req-c204269c-ac7b-4c1e-8263-0b3c388e755c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.045295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.046097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.047729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.048271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.063690 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-eff9e9e8-8709-4ef4-9490-fa4ff1e7e4b8 req-c204269c-ac7b-4c1e-8263-0b3c388e755c service nova] Creating event network-changed:fa3c62ec-954a-4138-aa41-81928ecc6a5e for instance e633ca39-5368-44a8-ae5c-829663eb825c on n-h2-846219-10 Jul 20 10:48:53.076927 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-eff9e9e8-8709-4ef4-9490-fa4ff1e7e4b8 req-c204269c-ac7b-4c1e-8263-0b3c388e755c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103214 Jul 20 10:48:53.079696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 391/820] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:53.095685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:53.096598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:53.105816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.106484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.107310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.107760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.438711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:53.448204 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc15deb7-1d0a-4e11-8c6d-26e428d27813 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1471 microversion: 2.1 time: 0.438582 Jul 20 10:48:53.448896 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 430/821] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:53 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1471 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:53.456090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:53.457191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:53.466560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.467969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.469108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.469889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.530374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:53.533620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:53.545949 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-36330ae6-7cb7-4526-8599-b10321fbd37a tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1469 microversion: 2.1 time: 0.463165 Jul 20 10:48:53.547163 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 392/822] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:53 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:53.553482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ff6b2e4-cc9e-4261-b62a-e70c63a45da7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:53.554867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2ff6b2e4-cc9e-4261-b62a-e70c63a45da7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:53.575802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:53.610856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:53.629997 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c95dc4d6-adec-43f7-bb22-ff0fd2af01b9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1274 microversion: 2.1 time: 0.179299 Jul 20 10:48:53.642004 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 431/823] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:53 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:53.648208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1588ffb5-8c90-4651-9e34-180f22a2c1f8 req-579f7f73-baf0-4c70-b7c0-4912f346b29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c246d4-40d9-44e6-ba74-ae2d6391c4c2", "name": "network-vif-plugged", "status": "completed", "tag": "bd65064d-d349-4797-86ea-06a35e3eb77f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:53.659871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1588ffb5-8c90-4651-9e34-180f22a2c1f8 req-579f7f73-baf0-4c70-b7c0-4912f346b29d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.660699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1588ffb5-8c90-4651-9e34-180f22a2c1f8 req-579f7f73-baf0-4c70-b7c0-4912f346b29d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.675952 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1588ffb5-8c90-4651-9e34-180f22a2c1f8 req-579f7f73-baf0-4c70-b7c0-4912f346b29d service nova] Creating event network-vif-plugged:bd65064d-d349-4797-86ea-06a35e3eb77f for instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 on n-h2-846219-10 Jul 20 10:48:53.698163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-1588ffb5-8c90-4651-9e34-180f22a2c1f8 req-579f7f73-baf0-4c70-b7c0-4912f346b29d service nova] Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:48:53.708924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ff6b2e4-cc9e-4261-b62a-e70c63a45da7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:53.728715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2ff6b2e4-cc9e-4261-b62a-e70c63a45da7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1264 microversion: 2.1 time: 0.179746 Jul 20 10:48:53.731230 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 393/824] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:53 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:53.749806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:53.753236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:53.753993 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1588ffb5-8c90-4651-9e34-180f22a2c1f8 req-579f7f73-baf0-4c70-b7c0-4912f346b29d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108433 Jul 20 10:48:53.759059 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 432/825] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:53.779955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.780668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:53.781260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.782054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:53.783570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.785923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.809546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.811083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.812283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:53.816966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:53.995731 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-24c80838-c842-42a8-bbb0-1099fa209961 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2/action" status: 204 len: 0 microversion: 2.1 time: 0.232642 Jul 20 10:48:54.002106 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 433/826] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:48:53 2022] POST /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2/action => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:48:54.028449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:54.032577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:54.048675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:54.054642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:54.058174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:54.059370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:54.060375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:55.097106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:55.116864 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48a39aba-3dab-4c8d-8598-ec4a4032aa33 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 1.380913 Jul 20 10:48:55.129592 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 394/827] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:53 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:55.129592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:55.129592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:55.151820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:55.152288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:55.153283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:55.153895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:55.599827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:55.610390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:55.611952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:55.614742 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d3ef6301-88f9-4567-a713-ba7a552cb64d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 1.608453 Jul 20 10:48:55.615371 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 434/828] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:54 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:55.634859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:55.636301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:55.644809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:55.645540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:55.646647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:55.647290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:56.613037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:56.633026 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7462d133-5f97-40e9-bbff-cf90aa7d64f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1471 microversion: 2.1 time: 1.513809 Jul 20 10:48:56.651701 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 395/829] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:55 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1471 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:56.659870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:56.663344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:56.672522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:56.672995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:56.674128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:56.674875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:56.841356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:56.865549 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f7ea8bef-d74f-4449-95ef-25e249e36e57 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 200 len: 1469 microversion: 2.1 time: 1.234874 Jul 20 10:48:56.868933 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 435/830] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:55 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 1469 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:56.892573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:56.893941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:56.941932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:56.946978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:56.949825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:56.951950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:57.190267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:57.210911 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-71d04b74-c887-4d44-aa9d-2d9ba0b2da2b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1322 microversion: 2.1 time: 0.339962 Jul 20 10:48:57.213868 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 436/831] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:56 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:57.222163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:57.222891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:57.247918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:57.248896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:57.250033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:57.250764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:57.742494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:57.773157 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c59cf92f-10e6-4681-910a-d951e35ba625 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 1.120098 Jul 20 10:48:57.775664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 396/832] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:56 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:57.802374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:57.804182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:57.828338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:57.829233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:57.830324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:57.831116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:58.594235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:58.611380 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-558f39d3-c023-4b07-bdef-121ceecf8731 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1502 microversion: 2.1 time: 1.394097 Jul 20 10:48:58.619478 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 437/833] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:57 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1502 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:58.634673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:58.636065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:58.650951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:58.660355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:58.661102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:58.661352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:58.687979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:48:59.355480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:59.372011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:59.374671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:59.398540 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b7c3495a-bda2-43b7-88b3-ca782e83dff6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 1.621332 Jul 20 10:48:59.400670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 397/834] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:48:57 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:48:59.409544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0e053293-ddb6-40a4-b241-18ac22ebc7a6 req-d915b6fa-e546-4ca9-9f8b-245f834d5eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e66db65-7841-45f9-ae17-59102a3a2802", "name": "network-vif-deleted", "tag": "6d5bf098-e8ec-42a6-ad3e-1b1603af7601"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:48:59.455608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0e053293-ddb6-40a4-b241-18ac22ebc7a6 req-d915b6fa-e546-4ca9-9f8b-245f834d5eeb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.458290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0e053293-ddb6-40a4-b241-18ac22ebc7a6 req-d915b6fa-e546-4ca9-9f8b-245f834d5eeb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:59.514916 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0e053293-ddb6-40a4-b241-18ac22ebc7a6 req-d915b6fa-e546-4ca9-9f8b-245f834d5eeb service nova] Creating event network-vif-deleted:6d5bf098-e8ec-42a6-ad3e-1b1603af7601 for instance 6e66db65-7841-45f9-ae17-59102a3a2802 on n-h2-846219-10 Jul 20 10:48:59.531314 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0e053293-ddb6-40a4-b241-18ac22ebc7a6 req-d915b6fa-e546-4ca9-9f8b-245f834d5eeb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128140 Jul 20 10:48:59.536033 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 398/835] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:48:59.551728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:59.552792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6e66db65-7841-45f9-ae17-59102a3a2802] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:59.572929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.573860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:59.575818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.577044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:59.646764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] HTTP exception thrown: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 could not be found. Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Request method failure captured: Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 HTTP/1.1 Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191mRZZPKmIYN9DNif_n6CKULQpx_IgUU9MmpCsX5qElIJjoZLlEehggWe92Pz1G5WGilGW60SAxs2No4J_JaxDd-u8DKRLuPkHdh-c69sJ4pmXDFf_5L-R-PKUsDgLhRLRslG_s4UktVX8sK-GYfXgTVTYjAOK4qXcJh2iGBJI2M1M Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9b34d0320ed7473299470fdf484e2080 Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1951601830 Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:48:59.649805 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b34d0320ed7473299470fdf484e2080", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b34d0320ed7473299470fdf484e2080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b34d0320ed7473299470fdf484e2080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b34d0320ed7473299470fdf484e2080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1951601830 Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9b34d0320ed7473299470fdf484e2080 Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1951601830 Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersAdminNegativeTestJSON-1951601830-project Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 91fda43ed940488da05b3e440098d36c Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1951601830-project Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 could not be found. Jul 20 10:48:59.651921 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '6e66db65-7841-45f9-ae17-59102a3a2802'} Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 could not be found. Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:48:59.652661 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 could not be found. Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 could not be found. Jul 20 10:48:59.653778 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:48:59.670047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Returning 404 to user: Instance 6e66db65-7841-45f9-ae17-59102a3a2802 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:48:59.671366 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5303c0db-d754-4d45-b345-94cdacf5102e tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802" status: 404 len: 111 microversion: 2.1 time: 0.133775 Jul 20 10:48:59.672202 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 399/836] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:59 2022] GET /compute/v2.1/servers/6e66db65-7841-45f9-ae17-59102a3a2802 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:48:59.679428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:59.681266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:59.691672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.692511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:59.694668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.695569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:59.918405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:48:59.932515 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a834e87-2a13-41c2-be77-f805830f221b tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1322 microversion: 2.1 time: 0.258359 Jul 20 10:48:59.945296 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 400/837] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:59 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:48:59.954750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:48:59.955992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:48:59.966099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.966943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:48:59.968549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:48:59.969246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.072120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:00.093132 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f588b19c-ad0f-4796-b865-f3217a3d25e9 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1471 microversion: 2.1 time: 1.472080 Jul 20 10:49:00.107440 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 438/838] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:58 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1471 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:00.123015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:00.124094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:00.139440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.144142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.145638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.148572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.588096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:00.600604 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-06f940a2-eacd-4fa6-b6c9-4ff9fc7c2283 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.652674 Jul 20 10:49:00.604958 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 401/839] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:48:59 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:00.610212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:00.614815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:00.634344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:00.636865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.637514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.638501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.639728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.689896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:49:00.702864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:00.715540 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1075eaa4-4a98-421a-aea0-ecb3d1c7584f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1477 microversion: 2.1 time: 0.602426 Jul 20 10:49:00.716362 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 439/840] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:00 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:00.725307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:00.726256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:00.744555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.748167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.752622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.753226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.915444 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86d7ec00-ac93-4629-aa2b-690eb7e87931 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 204 len: 0 microversion: 2.1 time: 0.307429 Jul 20 10:49:00.917986 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 402/841] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:49:00 2022] DELETE /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:49:00.949094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b22ee274-918c-463e-8570-24135e130375 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '.version_select at 0x7f2c3f9dbdc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:00.953713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b22ee274-918c-463e-8570-24135e130375 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:00.954171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b22ee274-918c-463e-8570-24135e130375 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:00.986240 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b22ee274-918c-463e-8570-24135e130375 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1575 microversion: 2.1 time: 0.063023 Jul 20 10:49:00.995253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 403/842] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:49:00 2022] GET /compute/v2.1/os-migrations => generated 1575 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:00.997690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:01.004414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:01.020685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.021634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.022831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.023574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.097874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:01.113470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:01.115677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:01.117627 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-77b2e127-259c-4665-859c-a18f48f020aa tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.399440 Jul 20 10:49:01.118919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 440/843] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:00 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:01.124462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:01.125481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:01.134607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.135467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.136724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.137417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.387439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:01.404606 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-945c8307-768f-4ed4-9a65-98c7667d4da7 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1475 microversion: 2.1 time: 0.411388 Jul 20 10:49:01.416470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 404/844] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:00 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1475 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:01.422479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:01.424073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:01.434081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.434797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.435780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.439040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.445152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:01.464685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bff5fb17-238e-405c-9a6b-0fd8b51ed253 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.341546 Jul 20 10:49:01.465460 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 441/845] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:01 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:01.477976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:01.478629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:01.494116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.494568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.495949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.496723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.851603 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a6ea7bf-fc2a-4203-8d39-a8997339190f tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1630 microversion: 2.1 time: 0.433707 Jul 20 10:49:01.859703 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 405/846] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:01 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1630 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:01.868989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-70088fac-5d55-4368-82c7-ca0417cb3dba req-95051b5b-1448-4e66-910e-d88fb3001ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe91d9f2-c297-46cf-a70d-409e036899a2", "name": "network-vif-deleted", "tag": "b0f43925-7a7a-4678-ae05-2d2660124131"}, {"name": "network-changed", "server_uuid": "fccb59b4-bd80-4718-9944-b4a51909a7f8", "tag": "8389716e-3b45-4172-8e90-43445afb9e45"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:01.897193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-70088fac-5d55-4368-82c7-ca0417cb3dba req-95051b5b-1448-4e66-910e-d88fb3001ff2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.897843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-70088fac-5d55-4368-82c7-ca0417cb3dba req-95051b5b-1448-4e66-910e-d88fb3001ff2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.916673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:01.926438 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-70088fac-5d55-4368-82c7-ca0417cb3dba req-95051b5b-1448-4e66-910e-d88fb3001ff2 service nova] Creating event network-vif-deleted:b0f43925-7a7a-4678-ae05-2d2660124131 for instance fe91d9f2-c297-46cf-a70d-409e036899a2 on n-h2-846219-10 Jul 20 10:49:01.929264 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-70088fac-5d55-4368-82c7-ca0417cb3dba req-95051b5b-1448-4e66-910e-d88fb3001ff2 service nova] Creating event network-changed:8389716e-3b45-4172-8e90-43445afb9e45 for instance fccb59b4-bd80-4718-9944-b4a51909a7f8 on n-h1-846219-10 Jul 20 10:49:01.937718 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2845fe00-f061-4c7d-8465-a8180b3b2060 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1463 microversion: 2.1 time: 0.468044 Jul 20 10:49:01.938334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 442/847] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:01 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1463 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:01.942939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:01.948154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:01.959475 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-70088fac-5d55-4368-82c7-ca0417cb3dba req-95051b5b-1448-4e66-910e-d88fb3001ff2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098208 Jul 20 10:49:01.962480 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 406/848] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:01.977669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.978392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:01.978816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-43dc8888-bac1-4df0-9be4-eeb55df2f0a0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Action: 'create', calling method: .version_select at 0x7f2c3f73c040>, body: {"keypair": {"name": "tempest-keypair-1973584643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQlz/I01sf1CdXt+UDzgCeQLyEQllUHfJrAcMV+zK0DTUkct46r7lQC01MVSK5b8MUQNl+J1fPR0cqaHnribaBjcii6gvYJN4gJgvpQGVy6Xy4kqwDlj9h+dPjgdRDWyQ=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:01.979385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:01.979824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.013336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-43dc8888-bac1-4df0-9be4-eeb55df2f0a0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:02.024181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-43dc8888-bac1-4df0-9be4-eeb55df2f0a0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for user 90200241ccaf4904a4b973e0351fdff6 and project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:02.089018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-43dc8888-bac1-4df0-9be4-eeb55df2f0a0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124010 Jul 20 10:49:02.089999 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 407/849] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:49:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:02.095409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:02.096878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:02.106362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.107016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.108029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.108529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.405878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:02.418402 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e76ab352-38ef-47ef-a8c6-573850732154 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.478877 Jul 20 10:49:02.419271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 443/850] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:01 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:02.431979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:02.432640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:02.457534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.458990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.463981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.463981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.530532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d599e1db-7f3e-4010-9e54-8d4f324b8683 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1616 microversion: 2.1 time: 0.439359 Jul 20 10:49:02.537156 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 408/851] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:02 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1616 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:02.552673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e2869222-76c0-45df-b1ec-2c04976169f8 req-7d376701-1eee-466b-b555-5af369203656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d", "tag": "3e13c0e2-943f-4d1e-80af-d6e976269473"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:02.568260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e2869222-76c0-45df-b1ec-2c04976169f8 req-7d376701-1eee-466b-b555-5af369203656 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.568847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e2869222-76c0-45df-b1ec-2c04976169f8 req-7d376701-1eee-466b-b555-5af369203656 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.583306 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e2869222-76c0-45df-b1ec-2c04976169f8 req-7d376701-1eee-466b-b555-5af369203656 service nova] Creating event network-changed:3e13c0e2-943f-4d1e-80af-d6e976269473 for instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d on n-h2-846219-10 Jul 20 10:49:02.590429 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e2869222-76c0-45df-b1ec-2c04976169f8 req-7d376701-1eee-466b-b555-5af369203656 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050335 Jul 20 10:49:02.591820 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 409/852] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:02.600959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:02.602777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:02.612701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.614030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.614862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:02.615737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:02.786377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:02.813849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:02.932091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:02.945516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:02.951898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:02.954769 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fd5c2afe-3422-4022-b5cf-ab1c3310a691 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.534519 Jul 20 10:49:02.956759 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 444/853] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:02 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:02.979533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:02.981224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:03.013503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:03.016535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:03.018164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:03.021450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:03.041309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:03.072077 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d842b48a-07a4-40e4-b934-3efda4adcbdb tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1475 microversion: 2.1 time: 0.475674 Jul 20 10:49:03.094927 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 410/854] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:02 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1475 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:03.117545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f46adbe-a6a3-4894-a6c5-088269e1bd95 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '.version_select at 0x7f2c3f82baf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:03.140903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f46adbe-a6a3-4894-a6c5-088269e1bd95 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:03.143122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f46adbe-a6a3-4894-a6c5-088269e1bd95 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:03.167955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f46adbe-a6a3-4894-a6c5-088269e1bd95 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1577 microversion: 2.1 time: 0.070366 Jul 20 10:49:03.169239 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 411/855] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:49:03 2022] GET /compute/v2.1/os-migrations => generated 1577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:03.336579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-492050822", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:03.423294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:49:03.484798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:03.516890 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-96e34bf1-cf69-4c16-a2c8-67cc9a64535f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.552590 Jul 20 10:49:03.520719 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 445/856] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:02 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:03.532700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:03.534178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:03.552326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:03.553671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:03.556934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:03.558878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.044099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:04.059382 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-270f49b3-30e7-442d-bf9f-ea7356622294 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.533566 Jul 20 10:49:04.060333 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 446/857] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:03 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:04.077056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-aeebe72d-eb26-44bf-9818-50b95b5b527d req-08475155-8c47-49e3-80a5-eea65ee0edd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e633ca39-5368-44a8-ae5c-829663eb825c", "name": "network-vif-plugged", "status": "completed", "tag": "fa3c62ec-954a-4138-aa41-81928ecc6a5e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:04.102332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aeebe72d-eb26-44bf-9818-50b95b5b527d req-08475155-8c47-49e3-80a5-eea65ee0edd0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.103220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aeebe72d-eb26-44bf-9818-50b95b5b527d req-08475155-8c47-49e3-80a5-eea65ee0edd0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.116447 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-aeebe72d-eb26-44bf-9818-50b95b5b527d req-08475155-8c47-49e3-80a5-eea65ee0edd0 service nova] Creating event network-vif-plugged:fa3c62ec-954a-4138-aa41-81928ecc6a5e for instance e633ca39-5368-44a8-ae5c-829663eb825c on n-h2-846219-10 Jul 20 10:49:04.131419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-aeebe72d-eb26-44bf-9818-50b95b5b527d req-08475155-8c47-49e3-80a5-eea65ee0edd0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069428 Jul 20 10:49:04.132864 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 447/858] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:04.152927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:04.154998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:04.165784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:49:04.166253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:49:04.166735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:49:04.167152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:49:04.167786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:49:04.168074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.168758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.170134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.171542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.186761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.187225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.198293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.198852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.251830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:04.281081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for user 14131c23a0e24e56bbf0ea1a167e256c and project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:04.326017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:49:04.339810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:49:04.449462 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7545fa0f-36c1-4705-9bac-07b8b0a3ad11 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.123603 Jul 20 10:49:04.451549 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 412/859] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:49:04.464136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-12cbccaf-91ad-4fc5-855d-333a1c578777 req-3f4d3b48-6162-4497-8ed9-5cfe24865fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c93c19a-6f7e-443a-b114-ec9d91350260", "name": "network-vif-deleted", "tag": "474245ce-4a0e-4e5e-8b60-2f357227629d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:04.478159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-12cbccaf-91ad-4fc5-855d-333a1c578777 req-3f4d3b48-6162-4497-8ed9-5cfe24865fba service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.479113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-12cbccaf-91ad-4fc5-855d-333a1c578777 req-3f4d3b48-6162-4497-8ed9-5cfe24865fba service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.497964 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-12cbccaf-91ad-4fc5-855d-333a1c578777 req-3f4d3b48-6162-4497-8ed9-5cfe24865fba service nova] Creating event network-vif-deleted:474245ce-4a0e-4e5e-8b60-2f357227629d for instance 6c93c19a-6f7e-443a-b114-ec9d91350260 on n-h2-846219-10 Jul 20 10:49:04.505228 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-12cbccaf-91ad-4fc5-855d-333a1c578777 req-3f4d3b48-6162-4497-8ed9-5cfe24865fba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051137 Jul 20 10:49:04.507311 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 413/860] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:04.514515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:04.515865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:04.524761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.526113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.528037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.528896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.579837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:04.594323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:04.597421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:04.599496 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bb8578c7-d134-4fd4-a009-cd8a12355877 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.461599 Jul 20 10:49:04.600762 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 448/861] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:04 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:04.622555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d7268b6-2b44-4092-8a4b-d56b0c43ea4b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:04.624117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d7268b6-2b44-4092-8a4b-d56b0c43ea4b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:04.625292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.626257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.632864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lazy-loading 'fault' on Instance uuid 6c93c19a-6f7e-443a-b114-ec9d91350260 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:04.775247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91fda43ed940488da05b3e440098d36c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b34d0320ed7473299470fdf484e2080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:04.780045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:04.796940 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a544b5d1-61c2-48ee-8e80-4ca945b21562 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 200 len: 1309 microversion: 2.1 time: 0.288714 Jul 20 10:49:04.801849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 414/862] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:04 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:04.819232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d7268b6-2b44-4092-8a4b-d56b0c43ea4b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:04.826646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:04.835932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:04.838093 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d7268b6-2b44-4092-8a4b-d56b0c43ea4b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1212 microversion: 2.1 time: 0.235878 Jul 20 10:49:04.858455 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 449/863] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:04 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1212 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:04.869060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.877793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:04.879094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:04.879779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.084391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:05.085383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:05.124729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.128799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.132687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.142622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.426375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:05.449454 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7045b785-cd77-40c3-8c84-d326e38b1f99 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.642112 Jul 20 10:49:05.452897 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 415/864] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:04 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:05.524902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:05.536789 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e825d326-152c-40cf-bd98-813020d28441 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.461934 Jul 20 10:49:05.549883 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 450/865] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:05 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:05.625239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:05.626092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:05.637315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.638156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.639487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.640290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.828541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:05.830866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] [instance: 6c93c19a-6f7e-443a-b114-ec9d91350260] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:05.848876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.855420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.856584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.857248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.894977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] HTTP exception thrown: Instance 6c93c19a-6f7e-443a-b114-ec9d91350260 could not be found. Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Request method failure captured: Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 HTTP/1.1 Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi191mRZZPKmIYN9DNif_n6CKULQpx_IgUU9MmpCsX5qElIJjoZLlEehggWe92Pz1G5WGilGW60SAxs2No4J_JaxDd-u8DKRLuPkHdh-c69sJ4pmXDFf_5L-R-PKUsDgLhRLRslG_s4UktVX8sK-GYfXgTVTYjAOK4qXcJh2iGBJI2M1M Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 9b34d0320ed7473299470fdf484e2080 Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1951601830 Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:49:05.896898 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b34d0320ed7473299470fdf484e2080", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b34d0320ed7473299470fdf484e2080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b34d0320ed7473299470fdf484e2080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b34d0320ed7473299470fdf484e2080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1951601830 Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 9b34d0320ed7473299470fdf484e2080 Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1951601830 Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminNegativeTestJSON-1951601830-project Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 91fda43ed940488da05b3e440098d36c Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1951601830-project Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 6c93c19a-6f7e-443a-b114-ec9d91350260 could not be found. Jul 20 10:49:05.898451 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6c93c19a-6f7e-443a-b114-ec9d91350260'} Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c93c19a-6f7e-443a-b114-ec9d91350260 could not be found. Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:49:05.899437 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c93c19a-6f7e-443a-b114-ec9d91350260 could not be found. Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c93c19a-6f7e-443a-b114-ec9d91350260 could not be found. Jul 20 10:49:05.901045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:05.902316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] Returning 404 to user: Instance 6c93c19a-6f7e-443a-b114-ec9d91350260 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:49:05.902316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7176171-62fe-44dc-8841-464a73a66dd9 tempest-ServersAdminNegativeTestJSON-1951601830 tempest-ServersAdminNegativeTestJSON-1951601830-project] 10.222.0.79 "GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260" status: 404 len: 111 microversion: 2.1 time: 0.079377 Jul 20 10:49:05.903934 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 451/866] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:05 2022] GET /compute/v2.1/servers/6c93c19a-6f7e-443a-b114-ec9d91350260 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:49:05.912307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:05.913109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:05.920380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.921145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:05.922137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:05.922921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:06.179947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:06.215299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:06.217189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:06.221481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:06.228117 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c480947-4118-4c1a-8990-4b7c42d76d3a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.610540 Jul 20 10:49:06.230575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 416/867] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:05 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:06.253796 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce938c47-e2d2-44b4-b3be-d82eff6e9eca tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1264 microversion: 2.1 time: 0.348559 Jul 20 10:49:06.259020 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 452/868] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:05 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1264 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:06.488433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:06.489895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:06.504407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:06.506257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:06.507509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:06.510512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:06.569547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:06.570703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:06.584569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:06.587659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:06.594592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:06.595717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:07.334293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:07.349421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:07.363282 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b09aef07-b932-4088-8ecb-2a3c3ee958f8 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.889018 Jul 20 10:49:07.365474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7120b103-b28f-4985-a239-54e0e647bb96 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.800232 Jul 20 10:49:07.366299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 417/869] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:06 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:07.373345 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 453/870] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:06 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:07.384932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:07.386583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:07.387494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:07.387622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:07.398222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:07.399634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:07.400865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:07.402050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:07.403772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:07.404324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:07.406877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:07.408521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:07.745149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:07.771294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1dbeddd4-0a59-4719-bbdd-55f44348a400 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1270 microversion: 2.1 time: 0.396302 Jul 20 10:49:07.774166 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 454/871] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:07 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1270 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:08.135756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:08.157215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:08.161808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:08.162998 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7eb6ace1-bca9-41d7-9c99-b5ab4572111b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1361 microversion: 2.25 time: 0.793430 Jul 20 10:49:08.163628 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 418/872] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:07 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1361 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:08.392397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:08.394040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:08.396195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:08.397492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:08.419928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:08.421468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:08.421731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:08.422586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:08.423727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:08.424872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:08.425978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:08.427717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:08.904068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:08.913048 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7602481-fea3-4c95-a00f-e9df2c6c55b5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.528375 Jul 20 10:49:08.915521 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 419/873] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:08 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:08.929339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:08.930730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:08.953966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:08.958938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:08.958938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:08.958938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:09.007253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:09.022723 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f4e69583-9388-4ec2-acbb-f3351c6e5db6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.641987 Jul 20 10:49:09.027617 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 455/874] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:08 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:09.049352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-686617949", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "896bfaeb-a0b5-419b-bf8d-148d7d420fcc"}], "security_groups": [{"name": "tempest-securitygroup--2093050264"}], "key_name": "tempest-keypair-1973584643", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:09.594523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] validate_networks() for [('896bfaeb-a0b5-419b-bf8d-148d7d420fcc', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:49:09.768147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:09.777979 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1024159d-674b-47da-862b-c7bb97944a71 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 0.861320 Jul 20 10:49:09.783120 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 420/875] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:08 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:09.798831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:09.799727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:09.811903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:09.812539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:09.813499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:09.814091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:10.299351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:10.315635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:10.321391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:10.334146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-baa81932-d7ef-457d-ae5a-ce31e38ba043 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1558 microversion: 2.25 time: 0.549055 Jul 20 10:49:10.337533 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 421/876] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:09 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1558 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:11.004218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be1494c0-2c6a-4baa-9a59-f6e33802d4a4 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Calling method '.version_select at 0x7f2c3f48f160>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:11.049260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:49:11.049751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:49:11.051011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:49:11.051877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:49:11.052833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:49:11.078287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.078765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:11.079629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.082010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:11.135619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:11.144617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for user 90200241ccaf4904a4b973e0351fdff6 and project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:11.197944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:49:11.205940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:49:11.324465 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be1494c0-2c6a-4baa-9a59-f6e33802d4a4 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.985446 Jul 20 10:49:11.325352 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 422/877] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 10:49:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:49:11.341569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c62c65f6-bfca-4abf-b0b6-e3a9ead8d3c9 req-1e5d29f1-d53c-4804-8760-e7e34a3243f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d", "name": "network-vif-plugged", "status": "completed", "tag": "3e13c0e2-943f-4d1e-80af-d6e976269473"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:11.357082 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1b8c678-2370-4212-b8f5-2ecfd4119a3c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.323525 Jul 20 10:49:11.365220 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 456/878] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:49:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:49:11.377895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c62c65f6-bfca-4abf-b0b6-e3a9ead8d3c9 req-1e5d29f1-d53c-4804-8760-e7e34a3243f0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.381683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c62c65f6-bfca-4abf-b0b6-e3a9ead8d3c9 req-1e5d29f1-d53c-4804-8760-e7e34a3243f0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:11.389259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:11.407678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:11.445180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.452191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:11.455440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.456241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:11.459337 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c62c65f6-bfca-4abf-b0b6-e3a9ead8d3c9 req-1e5d29f1-d53c-4804-8760-e7e34a3243f0 service nova] Creating event network-vif-plugged:3e13c0e2-943f-4d1e-80af-d6e976269473 for instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d on n-h2-846219-10 Jul 20 10:49:11.476169 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c62c65f6-bfca-4abf-b0b6-e3a9ead8d3c9 req-1e5d29f1-d53c-4804-8760-e7e34a3243f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149400 Jul 20 10:49:11.497951 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 423/879] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:11.530970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:11.535818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:11.577311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.577779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:11.578625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:11.579073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:12.029667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:12.050627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5545fe7-cb1d-4988-a118-7a8e62eacee0 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.543206 Jul 20 10:49:12.064968 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 424/880] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:11 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:12.098226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:12.100185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:12.126079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:12.126935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:12.130415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:12.131404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:12.163872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:12.172921 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7e07e72f-0883-4517-96ee-621ab6edd096 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.806117 Jul 20 10:49:12.186451 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 457/881] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:11 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:12.199854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:12.200805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:12.216916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:12.217662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:12.218758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:12.219394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:12.293239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:12.981876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid e633ca39-5368-44a8-ae5c-829663eb825c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:12.983288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:13.002590 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-409d39d2-4ac7-42c1-b4e5-e3bfa8c9ec68 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 0.814450 Jul 20 10:49:13.004552 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 458/882] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:12 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:13.019647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f562fa8-7e40-4dfc-bd87-09888161cfc5 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Action: 'create', calling method: .version_select at 0x7f2c3fb5e430>, body: {"pool": "non_exist_pool"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:13.020941 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f267a6a-466b-4631-acbb-36792235df1d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 2052 microversion: 2.25 time: 0.954657 Jul 20 10:49:13.021871 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 425/883] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:12 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 2052 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:13.032528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:13.033200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:13.058931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.059429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.060420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.061018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.202478 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9f562fa8-7e40-4dfc-bd87-09888161cfc5 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] HTTP exception thrown: Floating IP pool not found. Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f562fa8-7e40-4dfc-bd87-09888161cfc5 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Request method failure captured: Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 26 Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi192lratwThmknehREycGcWN-lZ0kaZ3dem9mMVD5L0UGLQF-jom7Pb9u1qyDz1hc3zoSJ1ZVlVtLh-PGuZRPJCyJCfGABuajZu0jAG3drbwvRlwjtoEmaE5kcca5URhKHB3rYlQ7p-KKHS4tvlqRlntmlBCpwkdyfb-RC8oAlQGcS7Y Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 03cd918b6fb944ad8666feb954a4de6e Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-361720616 Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:49:13.206532 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03cd918b6fb944ad8666feb954a4de6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03cd918b6fb944ad8666feb954a4de6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03cd918b6fb944ad8666feb954a4de6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03cd918b6fb944ad8666feb954a4de6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-361720616 Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 03cd918b6fb944ad8666feb954a4de6e Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-361720616 Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsNegativeTestJSON-361720616-project Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 03cbddcffa6c475482fd416aff1136af Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-361720616-project Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: {"pool": "non_exist_pool"} Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: exception: Floating IP pool not found. Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 20 10:49:13.208140 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:49:13.209186 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 20 10:49:13.210747 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:13.214399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f562fa8-7e40-4dfc-bd87-09888161cfc5 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Returning 404 to user: Floating IP pool not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:49:13.220188 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f562fa8-7e40-4dfc-bd87-09888161cfc5 tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.210104 Jul 20 10:49:13.221257 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 459/884] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:49:13 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:49:13.318462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:13.333797 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d2645a0-9ef9-46ac-8529-13a36e3331a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1230 microversion: 2.1 time: 0.306502 Jul 20 10:49:13.339448 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 426/885] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:13 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1230 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:13.352973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:13.353874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:13.376526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.377433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.378488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.379163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.544671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41220788-3520-4bd3-84f3-330d494dcb1d tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:13.547001 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:13.547001 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:49:13.552639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41220788-3520-4bd3-84f3-330d494dcb1d tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.553280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41220788-3520-4bd3-84f3-330d494dcb1d tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.558949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41220788-3520-4bd3-84f3-330d494dcb1d tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.560553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41220788-3520-4bd3-84f3-330d494dcb1d tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.644570 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41220788-3520-4bd3-84f3-330d494dcb1d tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.414354 Jul 20 10:49:13.651602 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 460/886] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:49:13 2022] GET /compute/v2.1/os-services => generated 949 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:13.661741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:13.662380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:13.678790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.679023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid e633ca39-5368-44a8-ae5c-829663eb825c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:13.679714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.681332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.681978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.715256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-627a05e1-5da1-436f-b0b1-609fdf5924db tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 2052 microversion: 2.25 time: 0.374386 Jul 20 10:49:13.723488 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 427/887] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:13 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 2052 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:13.732462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-503c7df8-a1ed-43bc-9115-b4e509087b0b req-e29abb9d-6c29-43a9-b091-2e6a0d0a00f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ac7237-71ff-472f-bc87-9da4f2249221", "tag": "24e47f7f-6301-495e-893e-49d3d309e0c0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:13.802208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-503c7df8-a1ed-43bc-9115-b4e509087b0b req-e29abb9d-6c29-43a9-b091-2e6a0d0a00f2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.802667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-503c7df8-a1ed-43bc-9115-b4e509087b0b req-e29abb9d-6c29-43a9-b091-2e6a0d0a00f2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.845046 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-503c7df8-a1ed-43bc-9115-b4e509087b0b req-e29abb9d-6c29-43a9-b091-2e6a0d0a00f2 service nova] Creating event network-changed:24e47f7f-6301-495e-893e-49d3d309e0c0 for instance c5ac7237-71ff-472f-bc87-9da4f2249221 on n-h1-846219-10 Jul 20 10:49:13.863459 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-503c7df8-a1ed-43bc-9115-b4e509087b0b req-e29abb9d-6c29-43a9-b091-2e6a0d0a00f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138181 Jul 20 10:49:13.864357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 428/888] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:13.886539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:13.888454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:13.903838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.907800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:13.908892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:13.909338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.230424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:14.298615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=20 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:14.406554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:14.416030 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0fd74b15-ae44-49c9-b152-ceaa5d245e04 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1390 microversion: 2.1 time: 0.762891 Jul 20 10:49:14.417330 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 461/889] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:13 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1390 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:14.422184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8666f02-345e-4332-9f53-09f962c9d6ab tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Calling method '.version_select at 0x7f2c3fb5f700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:14.443639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:14.460532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-400bf22c-1e6e-4a6e-accb-6f37af6f4486 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.588416 Jul 20 10:49:14.471470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 429/890] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:13 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:14.471470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3bbfbfbb-006f-4ac0-a6f1-75c5a992fd5a req-8519fbc5-0d2d-4b68-8b43-ecea3ddceb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccb59b4-bd80-4718-9944-b4a51909a7f8", "name": "network-vif-plugged", "status": "completed", "tag": "8389716e-3b45-4172-8e90-43445afb9e45"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:14.480010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:14.487289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3bbfbfbb-006f-4ac0-a6f1-75c5a992fd5a req-8519fbc5-0d2d-4b68-8b43-ecea3ddceb2f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.488048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3bbfbfbb-006f-4ac0-a6f1-75c5a992fd5a req-8519fbc5-0d2d-4b68-8b43-ecea3ddceb2f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.529023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3bbfbfbb-006f-4ac0-a6f1-75c5a992fd5a req-8519fbc5-0d2d-4b68-8b43-ecea3ddceb2f service nova] Creating event network-vif-plugged:8389716e-3b45-4172-8e90-43445afb9e45 for instance fccb59b4-bd80-4718-9944-b4a51909a7f8 on n-h1-846219-10 Jul 20 10:49:14.546924 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3bbfbfbb-006f-4ac0-a6f1-75c5a992fd5a req-8519fbc5-0d2d-4b68-8b43-ecea3ddceb2f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081900 Jul 20 10:49:14.550384 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 430/891] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:14.559273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e8778f25-1c72-4a2f-840c-676e4612bb77 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:14.560887 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:14.560887 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:49:14.568136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8778f25-1c72-4a2f-840c-676e4612bb77 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.568954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8778f25-1c72-4a2f-840c-676e4612bb77 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.574428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-c8666f02-345e-4332-9f53-09f962c9d6ab tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 280ae5ae-5624-4317-bbc1-f03131e3d5ce could not be found", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:49:14.583954 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c8666f02-345e-4332-9f53-09f962c9d6ab tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] HTTP exception thrown: Floating IP not found for ID 280ae5ae-5624-4317-bbc1-f03131e3d5ce Jul 20 10:49:14.588790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8778f25-1c72-4a2f-840c-676e4612bb77 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.590298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8778f25-1c72-4a2f-840c-676e4612bb77 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8666f02-345e-4332-9f53-09f962c9d6ab tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Request method failure captured: Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-floating-ips/280ae5ae-5624-4317-bbc1-f03131e3d5ce HTTP/1.1 Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi192lratwThmknehREycGcWN-lZ0kaZ3dem9mMVD5L0UGLQF-jom7Pb9u1qyDz1hc3zoSJ1ZVlVtLh-PGuZRPJCyJCfGABuajZu0jAG3drbwvRlwjtoEmaE5kcca5URhKHB3rYlQ7p-KKHS4tvlqRlntmlBCpwkdyfb-RC8oAlQGcS7Y Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 03cd918b6fb944ad8666feb954a4de6e Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-361720616 Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:49:14.591893 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03cd918b6fb944ad8666feb954a4de6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03cd918b6fb944ad8666feb954a4de6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03cd918b6fb944ad8666feb954a4de6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03cd918b6fb944ad8666feb954a4de6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-361720616 Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 03cd918b6fb944ad8666feb954a4de6e Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-361720616 Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsNegativeTestJSON-361720616-project Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 03cbddcffa6c475482fd416aff1136af Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-361720616-project Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: exception: Floating IP not found for ID 280ae5ae-5624-4317-bbc1-f03131e3d5ce Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '280ae5ae-5624-4317-bbc1-f03131e3d5ce'} Jul 20 10:49:14.593190 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:49:14.594051 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 280ae5ae-5624-4317-bbc1-f03131e3d5ce could not be found Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3cf12b0-f701-4886-9088-9c164da0c06f'] Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 280ae5ae-5624-4317-bbc1-f03131e3d5ce. Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:14.595721 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 280ae5ae-5624-4317-bbc1-f03131e3d5ce Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:49:14.598207 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:49:14.604213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 280ae5ae-5624-4317-bbc1-f03131e3d5ce Jul 20 10:49:14.604213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:49:14.608360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8666f02-345e-4332-9f53-09f962c9d6ab tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] Returning 404 to user: Floating IP not found for ID 280ae5ae-5624-4317-bbc1-f03131e3d5ce {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:49:14.612305 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8666f02-345e-4332-9f53-09f962c9d6ab tempest-FloatingIPsNegativeTestJSON-361720616 tempest-FloatingIPsNegativeTestJSON-361720616-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/280ae5ae-5624-4317-bbc1-f03131e3d5ce" status: 404 len: 111 microversion: 2.1 time: 0.193643 Jul 20 10:49:14.613941 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 462/892] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:49:14 2022] DELETE /compute/v2.1/os-floating-ips/280ae5ae-5624-4317-bbc1-f03131e3d5ce => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:49:14.638521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15de7b15-d7a2-4203-aba9-7447117073d5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:14.646378 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:14.646378 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:49:14.647815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15de7b15-d7a2-4203-aba9-7447117073d5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.651215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15de7b15-d7a2-4203-aba9-7447117073d5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.653157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15de7b15-d7a2-4203-aba9-7447117073d5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.654404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15de7b15-d7a2-4203-aba9-7447117073d5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.671457 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e8778f25-1c72-4a2f-840c-676e4612bb77 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.119005 Jul 20 10:49:14.672336 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 431/893] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 10:49:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:14.693079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:14.694701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:14.695121 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-15de7b15-d7a2-4203-aba9-7447117073d5 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.077662 Jul 20 10:49:14.696511 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 463/894] 10.222.0.79 () {60 vars in 1216 bytes} [Wed Jul 20 10:49:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:49:14.701679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:14.704617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:14.713078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.713822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.715035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.716265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.716964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.718260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:14.718913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.723069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:14.954197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:14.977507 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-641d9341-5008-474e-9736-da65ef32740a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1292 microversion: 2.1 time: 0.278415 Jul 20 10:49:14.989388 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 464/895] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:14 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1292 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:14.997466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0bfa812-c477-4d71-a216-3303995c5d52 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:14.999852 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:14.999852 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:49:15.002203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0bfa812-c477-4d71-a216-3303995c5d52 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.002908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0bfa812-c477-4d71-a216-3303995c5d52 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.004494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0bfa812-c477-4d71-a216-3303995c5d52 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.004994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0bfa812-c477-4d71-a216-3303995c5d52 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.032816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:15.046336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0bfa812-c477-4d71-a216-3303995c5d52 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.055009 Jul 20 10:49:15.055446 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 465/896] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:49:14 2022] GET /compute/v2.1/os-services => generated 949 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:15.060766 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4ca81d32-6b0c-4ce0-8410-b9b4c5b4a7f7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 0.386795 Jul 20 10:49:15.063075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:15.063908 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 432/897] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:14 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:15.064678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:15.071653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.072395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.073359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.073964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.078119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99c6bb0d-6495-4f52-8cf4-c208bf9c8808 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.080225 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:15.080225 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:49:15.081871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c6bb0d-6495-4f52-8cf4-c208bf9c8808 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.089935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c6bb0d-6495-4f52-8cf4-c208bf9c8808 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.091312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c6bb0d-6495-4f52-8cf4-c208bf9c8808 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.091987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c6bb0d-6495-4f52-8cf4-c208bf9c8808 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.173606 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99c6bb0d-6495-4f52-8cf4-c208bf9c8808 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-846219-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.108323 Jul 20 10:49:15.182374 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 433/898] 10.222.0.79 () {58 vars in 1195 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/os-services?host=n-d-846219-10&binary=xxx => generated 16 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:49:15.197238 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33f82529-63aa-41ce-9ac5-92da40b2bac1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c/action" status: 202 len: 0 microversion: 2.25 time: 0.139229 Jul 20 10:49:15.203250 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 466/899] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:49:15 2022] POST /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:49:15.212817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.214158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:15.214728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83782864-5ab0-44a1-ade4-4f18343586f1 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.220955 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:15.220955 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:49:15.225624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83782864-5ab0-44a1-ade4-4f18343586f1 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.226161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83782864-5ab0-44a1-ade4-4f18343586f1 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.228618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.229910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.231076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83782864-5ab0-44a1-ade4-4f18343586f1 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.232072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.232889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83782864-5ab0-44a1-ade4-4f18343586f1 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.234460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.323092 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83782864-5ab0-44a1-ade4-4f18343586f1 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.138324 Jul 20 10:49:15.327565 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 434/900] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:15.337641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dc44bab7-edda-43e1-b825-10fccbc338d5 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.339313 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:15.339313 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:49:15.340859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc44bab7-edda-43e1-b825-10fccbc338d5 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.342581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc44bab7-edda-43e1-b825-10fccbc338d5 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.343669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc44bab7-edda-43e1-b825-10fccbc338d5 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.344375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc44bab7-edda-43e1-b825-10fccbc338d5 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.379978 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dc44bab7-edda-43e1-b825-10fccbc338d5 tempest-ServicesAdminNegativeTestJSON-1140398618 tempest-ServicesAdminNegativeTestJSON-1140398618-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.046599 Jul 20 10:49:15.381202 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 435/901] 10.222.0.79 () {58 vars in 1197 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:49:15.641542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b663942e-1157-47ce-824e-d5abb6be1983 tempest-ServicesAdminNegativeTestJSON-1408586738 tempest-ServicesAdminNegativeTestJSON-1408586738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.643466 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:49:15.643466 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:49:15.645567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b663942e-1157-47ce-824e-d5abb6be1983 tempest-ServicesAdminNegativeTestJSON-1408586738 tempest-ServicesAdminNegativeTestJSON-1408586738-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '762eba1ae59d4d4b8f84f937fe6104e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9284190bb4024700a034b0cd7cdadac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b663942e-1157-47ce-824e-d5abb6be1983 tempest-ServicesAdminNegativeTestJSON-1408586738 tempest-ServicesAdminNegativeTestJSON-1408586738-project] Request method failure captured: Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi192mdohhp4ue6FsgyRY_RThelgSs9BY-D4TqjrqPrJWWLhuUivljwB1a1hI_h-SQfbuQC3CwptGwpVF4PgVr5kg7jTi5dYlrkjX8RjaMEs5swID57OaPH1-Oy-dHReZOD6PT2rOo6rwz_g5UDkX-qal8-xPqCOqB1pPtfPStZ7TZCNo Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9284190bb4024700a034b0cd7cdadac0 Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1408586738 Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:49:15.650080 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9284190bb4024700a034b0cd7cdadac0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9284190bb4024700a034b0cd7cdadac0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9284190bb4024700a034b0cd7cdadac0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9284190bb4024700a034b0cd7cdadac0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1408586738 Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9284190bb4024700a034b0cd7cdadac0 Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1408586738 Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServicesAdminNegativeTestJSON-1408586738-project Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 762eba1ae59d4d4b8f84f937fe6104e5 Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1408586738-project Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 10:49:15.651512 n-d-846219-10 devstack@n-api.service[125886]: action_args: {} Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:49:15.652373 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 10:49:15.653560 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:15.657059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b663942e-1157-47ce-824e-d5abb6be1983 tempest-ServicesAdminNegativeTestJSON-1408586738 tempest-ServicesAdminNegativeTestJSON-1408586738-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:49:15.658334 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b663942e-1157-47ce-824e-d5abb6be1983 tempest-ServicesAdminNegativeTestJSON-1408586738 tempest-ServicesAdminNegativeTestJSON-1408586738-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.268574 Jul 20 10:49:15.659571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 436/902] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:49:15.669909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.680196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:15.688156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.688850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.689784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.692703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid e633ca39-5368-44a8-ae5c-829663eb825c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:15.693726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.724505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:15.752950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1feac277-e6df-4001-9f2b-65e7aa8de02c tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 2057 microversion: 2.25 time: 0.545933 Jul 20 10:49:15.754453 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 467/903] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 2057 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:15.782718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:15.784426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:15.798204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.798677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:15.800261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:15.800902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.267577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:16.282861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:16.294345 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec47c884-eb82-4e37-8e14-6301f0fc7330 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1588 microversion: 2.1 time: 0.633380 Jul 20 10:49:16.294949 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 437/904] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1588 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:16.298046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a35b1be9-46e2-43b3-a941-b02ffd9bfe6b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 0.525271 Jul 20 10:49:16.298928 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 468/905] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:15 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:16.312278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:16.312903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:16.318931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:16.319900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:16.327438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.327893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.328815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.329447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.334278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.335809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.337013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.343452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.869024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:16.881799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:16.898040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73271f33-2229-4de6-bd3c-0efb982887f4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 0.597676 Jul 20 10:49:16.899492 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 469/906] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:16 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:16.901064 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-03273374-dd41-4123-9679-ef63f3d2642b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1360 microversion: 2.1 time: 0.603584 Jul 20 10:49:16.910611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:16.910926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:16.911253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 438/907] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:16 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1360 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:16.918972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:16.920122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:16.931152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.931152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.932869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.933588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.940185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.941423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:16.942417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:16.943647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:17.506908 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c3265d5e-0b75-4d63-86e5-14dc81058d90 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.600303 Jul 20 10:49:17.508017 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 470/908] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:49:16 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d/os-interface => generated 284 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:17.517845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:17.517845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:17.526708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:17.531061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:17.532156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:17.532915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:18.126110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid e633ca39-5368-44a8-ae5c-829663eb825c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:18.161326 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f4fd5180-5887-448c-acbd-78a9d8a45e24 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 2037 microversion: 2.25 time: 1.248587 Jul 20 10:49:18.176708 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 439/909] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:16 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 2037 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:18.190324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:18.190964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:18.207594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:18.208064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:18.217572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:18.218422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:18.676730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:18.688292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-300a08cc-00bb-4d2e-a96f-143ddcccc52f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1316 microversion: 2.1 time: 1.178195 Jul 20 10:49:18.689078 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 471/910] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:17 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1316 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:18.703469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:18.704630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:18.711985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:18.712694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:18.713537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:18.714205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:19.388874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:19.402933 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35b668ea-356c-4ad9-8e15-bb8b5491e75e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 1.224968 Jul 20 10:49:19.409292 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 440/911] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:18 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:19.423404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-10", "block_migration": "auto"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:19.425039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:19.438604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:19.439081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:19.439928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:19.440846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:19.525690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'flavor' on Instance uuid e633ca39-5368-44a8-ae5c-829663eb825c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:19.539896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Going to try to live migrate instance to n-h1-846219-10 {{(pid=125886) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:49:20.119053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:20.136898 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-291dfbf5-a221-4a7c-8470-65884b36893c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1360 microversion: 2.1 time: 1.446478 Jul 20 10:49:20.137823 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 472/912] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:18 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1360 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:20.143341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-78b00705-d635-42e4-bb44-695f364da8b3 req-9e744dfe-22b1-49c9-abf5-b214c06ff9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:20.169537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-78b00705-d635-42e4-bb44-695f364da8b3 req-9e744dfe-22b1-49c9-abf5-b214c06ff9a3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:20.169999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-78b00705-d635-42e4-bb44-695f364da8b3 req-9e744dfe-22b1-49c9-abf5-b214c06ff9a3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:20.255812 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-78b00705-d635-42e4-bb44-695f364da8b3 req-9e744dfe-22b1-49c9-abf5-b214c06ff9a3 service nova] Creating event network-changed:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:49:20.277407 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-78b00705-d635-42e4-bb44-695f364da8b3 req-9e744dfe-22b1-49c9-abf5-b214c06ff9a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137810 Jul 20 10:49:20.281770 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 473/913] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:20.646539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e1e4fb2-4d7f-40bb-b270-7af29557d678 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Action: 'create', calling method: .version_select at 0x7f2c3fca4d30>, body: {"keypair": {"name": "tempest-keypair-882327533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp4gQqj6dqInOYJvTj6y8gq4rRe9rr/Z0f7y2S7uVS3K4wuBIuGlImKCtVjigtReB9IG1EPErwD71Rxlo3H8ZbglR3Q1N9xxhIWJZtTm3bDLrXCqs36bGKVFn5TD4k+UQ=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:20.662988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:20.686788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8e1e4fb2-4d7f-40bb-b270-7af29557d678 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Getting quotas for project e44c48be958e4d67aa16c3b0abbcfe13. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:20.702666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8e1e4fb2-4d7f-40bb-b270-7af29557d678 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Getting quotas for user e5c3f91971e542f3a5c3d6d7ef1c29ca and project e44c48be958e4d67aa16c3b0abbcfe13. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:20.760114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e1e4fb2-4d7f-40bb-b270-7af29557d678 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.475168 Jul 20 10:49:20.762627 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 474/914] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:49:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:20.775483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:20.777808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:20.798227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:20.801481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:20.804235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:20.806769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:21.397114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:21.414609 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c490b0f4-a095-4637-b593-63136b8f50c9 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1466 microversion: 2.1 time: 0.649266 Jul 20 10:49:21.419545 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 475/915] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:20 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1466 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:21.432738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:21.432944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:21.469356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:21.469836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:21.470592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:21.471197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:22.079327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:22.125044 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1836e2b-db03-40d0-b78d-fcdab690407d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 0.703828 Jul 20 10:49:22.136473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 476/916] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:21 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:22.157914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:22.163340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:22.190173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:22.190702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:22.192332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:22.192786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:22.531708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:22.551074 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ac9afa8b-77b1-435f-ad0c-a3fc33bdaca5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1360 microversion: 2.1 time: 0.409615 Jul 20 10:49:22.552111 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 477/917] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:22 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1360 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:22.558833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-debd565b-8811-446c-bfe3-6ab621a05d8f req-a8123b93-8469-493a-ada7-e21fa8d80ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ac7237-71ff-472f-bc87-9da4f2249221", "name": "network-vif-plugged", "status": "completed", "tag": "24e47f7f-6301-495e-893e-49d3d309e0c0"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:22.604178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-debd565b-8811-446c-bfe3-6ab621a05d8f req-a8123b93-8469-493a-ada7-e21fa8d80ccc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:22.604931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-debd565b-8811-446c-bfe3-6ab621a05d8f req-a8123b93-8469-493a-ada7-e21fa8d80ccc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:22.649666 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-debd565b-8811-446c-bfe3-6ab621a05d8f req-a8123b93-8469-493a-ada7-e21fa8d80ccc service nova] Creating event network-vif-plugged:24e47f7f-6301-495e-893e-49d3d309e0c0 for instance c5ac7237-71ff-472f-bc87-9da4f2249221 on n-h1-846219-10 Jul 20 10:49:22.672774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-debd565b-8811-446c-bfe3-6ab621a05d8f req-a8123b93-8469-493a-ada7-e21fa8d80ccc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118655 Jul 20 10:49:22.678639 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 478/918] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:22.690685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:22.691810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:22.706185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:22.707022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:22.708046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:22.708692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:23.642621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-133d8602-8570-4d96-a956-b3caec6845fe tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c/action" status: 202 len: 0 microversion: 2.25 time: 4.231581 Jul 20 10:49:23.643704 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 441/919] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:49:19 2022] POST /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c/action => generated 0 bytes in 4234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:49:23.667941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:23.671787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:23.681648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea8f0b83-43f0-437b-9e3b-13be0cdfc1a2 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1619 microversion: 2.1 time: 0.998752 Jul 20 10:49:23.682170 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 479/920] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:22 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1619 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:23.688337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:23.689051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:23.690067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:23.690894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:23.781211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4f3e0470-1a7f-4c6c-b87f-4c795ab4b50d req-b65bf476-1fa4-4bee-a3e7-1508f66babf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d", "tag": "3e13c0e2-943f-4d1e-80af-d6e976269473"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:23.801633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4f3e0470-1a7f-4c6c-b87f-4c795ab4b50d req-b65bf476-1fa4-4bee-a3e7-1508f66babf0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:23.802669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4f3e0470-1a7f-4c6c-b87f-4c795ab4b50d req-b65bf476-1fa4-4bee-a3e7-1508f66babf0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:23.812437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:23.853181 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4f3e0470-1a7f-4c6c-b87f-4c795ab4b50d req-b65bf476-1fa4-4bee-a3e7-1508f66babf0 service nova] Creating event network-changed:3e13c0e2-943f-4d1e-80af-d6e976269473 for instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d on n-h2-846219-10 Jul 20 10:49:23.899452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4f3e0470-1a7f-4c6c-b87f-4c795ab4b50d req-b65bf476-1fa4-4bee-a3e7-1508f66babf0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214487 Jul 20 10:49:23.902203 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 480/921] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:23.962674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:23.972856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:24.001822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:24.018637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:24.020170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:24.021115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:24.797287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:24.821631 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f09ab736-d6d0-4295-98af-5f21cfd38737 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1588 microversion: 2.1 time: 1.169627 Jul 20 10:49:24.833734 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 442/922] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:23 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1588 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:24.838974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:24.839995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:24.847680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:24.848476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:24.849331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:24.859891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:24.924553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:24.934993 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fb824841-b7aa-4006-a5e2-ee570037ded4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1312 microversion: 2.1 time: 1.030559 Jul 20 10:49:24.939324 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 481/923] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:23 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1312 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:24.951810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:24.956566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:24.969595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:24.970284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:24.973842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:24.974485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:25.024409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:25.356256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:25.867309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:25.867858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:25.877096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-964443e7-e131-4907-ab79-594eb5b54b46 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1360 microversion: 2.1 time: 1.042056 Jul 20 10:49:25.879581 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 443/924] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:24 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1360 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:25.902800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:25.905901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:25.910206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1110465894", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9bfeb30c-e126-4abd-9c33-c2ae07eec3e7"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:25.914749 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ea78b90-b8da-4013-ab05-65f581d3a5c0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 0.971107 Jul 20 10:49:25.916309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 482/925] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:24 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:25.965108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:25.982360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:26.013314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:26.020884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:26.025166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:26.028691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:26.105770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:49:26.937692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:26.991443 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-089f2bcc-74ef-4959-89f3-44f38a4a727c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1462 microversion: 2.1 time: 1.035707 Jul 20 10:49:26.997182 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 483/926] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:25 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1462 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:27.020097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-95a8fab3-e759-46cb-91f3-7c48370bdfad req-97067b3b-dfc0-47c0-84b2-209b647df6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "name": "network-vif-plugged", "status": "completed", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:27.068616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-95a8fab3-e759-46cb-91f3-7c48370bdfad req-97067b3b-dfc0-47c0-84b2-209b647df6bb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.076670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-95a8fab3-e759-46cb-91f3-7c48370bdfad req-97067b3b-dfc0-47c0-84b2-209b647df6bb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.121948 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-95a8fab3-e759-46cb-91f3-7c48370bdfad req-97067b3b-dfc0-47c0-84b2-209b647df6bb service nova] Creating event network-vif-plugged:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:49:27.135819 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-95a8fab3-e759-46cb-91f3-7c48370bdfad req-97067b3b-dfc0-47c0-84b2-209b647df6bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127128 Jul 20 10:49:27.137804 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 484/927] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:27.146253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:27.147180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:27.159096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.159960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.161060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.161767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.364078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:49:27.364661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:49:27.364949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:49:27.365347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:49:27.365909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:49:27.379776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.381874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.389838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.392729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.431129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:27.450626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Getting quotas for user 20ec069dcf98464793c8b5822c40616b and project abca5f8615aa4063b091fcfde64a48aa. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:27.471053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:49:27.474059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:49:27.533705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96914e1d-2d7a-4ddf-a548-03efebeeeb73 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.647453 Jul 20 10:49:27.535582 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 444/928] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:49:27.546959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:27.547598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:27.562242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.567512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.568590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.570290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.813887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:27.824410 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0578be6-a253-4ba2-8b12-4f7b766e31de tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1360 microversion: 2.1 time: 0.685158 Jul 20 10:49:27.834913 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 485/929] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:27 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1360 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:27.856268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:27.867429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:27.884021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.885389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:27.887085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:27.888256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.216590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:28.232278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Old instance type m1.heat2, new instance type m1.heat {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 10:49:28.249481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:49:28.250857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:49:28.252378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:49:28.253698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:49:28.254896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:49:28.403228 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab4dca71-128c-45c8-99f3-fc8903bada4f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221/action" status: 202 len: 0 microversion: 2.1 time: 0.566408 Jul 20 10:49:28.404523 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 486/930] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:49:27 2022] POST /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:49:28.411711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f87482a0-f880-4ad3-9692-b4903e1145e7 req-deed8722-213f-4208-ad2c-f26e20ce0a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e633ca39-5368-44a8-ae5c-829663eb825c", "name": "network-vif-unplugged", "status": "completed", "tag": "fa3c62ec-954a-4138-aa41-81928ecc6a5e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:28.424470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f87482a0-f880-4ad3-9692-b4903e1145e7 req-deed8722-213f-4208-ad2c-f26e20ce0a5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.425458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f87482a0-f880-4ad3-9692-b4903e1145e7 req-deed8722-213f-4208-ad2c-f26e20ce0a5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.438509 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f87482a0-f880-4ad3-9692-b4903e1145e7 req-deed8722-213f-4208-ad2c-f26e20ce0a5b service nova] Creating event network-vif-unplugged:fa3c62ec-954a-4138-aa41-81928ecc6a5e for instance e633ca39-5368-44a8-ae5c-829663eb825c on n-h2-846219-10 Jul 20 10:49:28.444535 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f87482a0-f880-4ad3-9692-b4903e1145e7 req-deed8722-213f-4208-ad2c-f26e20ce0a5b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038280 Jul 20 10:49:28.446662 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 487/931] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:28.456776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:28.457742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:28.468170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.469376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.470623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.471990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.625648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:28.647836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:28.650095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:28.651356 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff1256c4-66fb-4eba-a94e-4f959d76dee3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 1.114299 Jul 20 10:49:28.651950 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 445/932] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:27 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:28.671572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:28.672194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:28.689820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.690361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.691236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.691693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.740470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:28.749170 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7eede27c-159b-413c-9766-0c6f8d873b9d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1221 microversion: 2.1 time: 0.300708 Jul 20 10:49:28.750310 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 488/933] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:28 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1221 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:28.844453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:28.845164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:28.854895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.855504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:28.856368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:28.857644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:29.334255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:29.370705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-91fea5f8-ab1b-4efb-a481-0443b8aab99e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1471 microversion: 2.1 time: 0.717679 Jul 20 10:49:29.378401 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 446/934] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:28 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1471 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:29.388286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:29.433225 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3bb6b622-66fd-4372-9c80-61941c98c4b4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1360 microversion: 2.1 time: 0.592734 Jul 20 10:49:29.434387 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 489/935] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:28 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1360 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:29.671596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:29.673099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:29.700065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:29.701252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:29.704744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:29.705267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:29.767839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:29.768454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:29.785578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:29.786042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:29.786851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:29.787336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.031860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:30.048716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1dfb2b9f-c490-4d4d-bdce-6df1d9e163d0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1287 microversion: 2.1 time: 0.284628 Jul 20 10:49:30.049891 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 490/936] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:29 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1287 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:30.189748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:30.222476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:30.225580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:30.228052 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72800a51-5d43-41af-bcc5-c43d791513ab tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 0.560761 Jul 20 10:49:30.239611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 447/937] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:29 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:30.416331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:30.417499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:30.432089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.432595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.433298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.433733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.451082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:30.451778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:30.464003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.464592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.465627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.466278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.720342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:30.837462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:30.845614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4855aa50-bd42-4311-a31c-a3a79e58bb9e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1542 microversion: 2.1 time: 0.398541 Jul 20 10:49:30.846197 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 448/938] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:30 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1542 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:30.869758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a6f1dbe4-16eb-4205-bbbd-cecaf66a11c5 req-af75c5a2-a810-471e-a5f2-5b6fe4a0af7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e633ca39-5368-44a8-ae5c-829663eb825c", "tag": "fa3c62ec-954a-4138-aa41-81928ecc6a5e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:30.893401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a6f1dbe4-16eb-4205-bbbd-cecaf66a11c5 req-af75c5a2-a810-471e-a5f2-5b6fe4a0af7c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.897308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a6f1dbe4-16eb-4205-bbbd-cecaf66a11c5 req-af75c5a2-a810-471e-a5f2-5b6fe4a0af7c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.928910 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a6f1dbe4-16eb-4205-bbbd-cecaf66a11c5 req-af75c5a2-a810-471e-a5f2-5b6fe4a0af7c service nova] Creating event network-changed:fa3c62ec-954a-4138-aa41-81928ecc6a5e for instance e633ca39-5368-44a8-ae5c-829663eb825c on n-h2-846219-10 Jul 20 10:49:30.929212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:30.943912 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38aa58e3-d3f1-4dd9-b15a-2f471e1ff9fc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1471 microversion: 2.1 time: 0.539278 Jul 20 10:49:30.945677 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 491/939] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:30 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1471 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:30.945980 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a6f1dbe4-16eb-4205-bbbd-cecaf66a11c5 req-af75c5a2-a810-471e-a5f2-5b6fe4a0af7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090539 Jul 20 10:49:30.946821 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 449/940] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:30.952536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:30.953298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:30.963352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.964575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:30.966027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:30.966720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:31.078268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:31.078975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:31.112714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:31.113174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:31.113953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:31.114420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:31.173882 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d3138ae-caf5-48a3-aecb-757982b9db91 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225903 Jul 20 10:49:31.181543 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 492/941] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:49:30 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:31.260209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:31.260836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:31.280089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:31.280535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:31.291628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:31.292271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:31.525421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:31.537453 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b94fdbb-a93e-4b37-b167-cbaab9bfde55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1275 microversion: 2.1 time: 0.466203 Jul 20 10:49:31.538583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 450/942] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:31 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1275 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:31.963759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:31.965379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:31.984324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:31.987387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:31.990110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:31.991438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:32.656211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:32.672475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:32.674318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:32.675835 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9e8f9630-3ff9-4f09-bc7e-6392d025043e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 1.431572 Jul 20 10:49:32.676909 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 493/943] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:31 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:32.692200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:32.693087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:32.711386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:32.712682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:32.713860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:32.714305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:33.036297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:33.047211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8313663e-3494-4e01-b36a-ef1f2562e349 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1471 microversion: 2.1 time: 1.089117 Jul 20 10:49:33.047826 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 451/944] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:31 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1471 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:33.695677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:33.697085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:33.715708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:33.716807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:33.717839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:33.724155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:33.846159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:33.855285 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57d04edd-5fb4-4276-93c9-706a2370dcab tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 1.177109 Jul 20 10:49:33.856473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 494/945] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:32 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:34.065943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:34.066544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:34.085350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:34.089913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:34.093680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:34.094396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:34.577045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:34.597944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:34.606249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:34.611134 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6904b677-3ebc-4130-91c4-b6aa95bdc2fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 0.919333 Jul 20 10:49:34.613204 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 452/946] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:33 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:34.754755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:34.786088 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c4195683-3722-4b52-a131-8775fafde420 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.719271 Jul 20 10:49:34.794574 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 495/947] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:34 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:34.889040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:34.891244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:34.906774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:34.908141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:34.909347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:34.910804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:34.924766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:35.296528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:35.311570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c55ea25-f961-4aa0-a81a-f30f0f4d1b23 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.429703 Jul 20 10:49:35.314239 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 453/948] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:34 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:35.590053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2e8d0b31-628f-4f0a-8b7d-eded73b4f62a req-2016e90b-696a-4ccf-ace3-ef35947fa6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:35.608695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2e8d0b31-628f-4f0a-8b7d-eded73b4f62a req-2016e90b-696a-4ccf-ace3-ef35947fa6d8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:35.609806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2e8d0b31-628f-4f0a-8b7d-eded73b4f62a req-2016e90b-696a-4ccf-ace3-ef35947fa6d8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:35.631820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:35.633275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:35.640522 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2e8d0b31-628f-4f0a-8b7d-eded73b4f62a req-2016e90b-696a-4ccf-ace3-ef35947fa6d8 service nova] Creating event network-changed:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:49:35.641255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:35.647725 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2e8d0b31-628f-4f0a-8b7d-eded73b4f62a req-2016e90b-696a-4ccf-ace3-ef35947fa6d8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062920 Jul 20 10:49:35.647977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:35.648680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:35.649149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:35.649830 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 496/949] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:35.772547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0fe5c9a1-eba4-4b71-b531-e670d83f03f0 req-1229a2e9-cd0f-428f-a616-4de17a2ec021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e633ca39-5368-44a8-ae5c-829663eb825c", "name": "network-vif-unplugged", "status": "completed", "tag": "fa3c62ec-954a-4138-aa41-81928ecc6a5e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:35.820871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0fe5c9a1-eba4-4b71-b531-e670d83f03f0 req-1229a2e9-cd0f-428f-a616-4de17a2ec021 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:35.821720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0fe5c9a1-eba4-4b71-b531-e670d83f03f0 req-1229a2e9-cd0f-428f-a616-4de17a2ec021 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:35.866212 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0fe5c9a1-eba4-4b71-b531-e670d83f03f0 req-1229a2e9-cd0f-428f-a616-4de17a2ec021 service nova] Creating event network-vif-unplugged:fa3c62ec-954a-4138-aa41-81928ecc6a5e for instance e633ca39-5368-44a8-ae5c-829663eb825c on n-h2-846219-10 Jul 20 10:49:35.910757 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0fe5c9a1-eba4-4b71-b531-e670d83f03f0 req-1229a2e9-cd0f-428f-a616-4de17a2ec021 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145299 Jul 20 10:49:35.913513 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 497/950] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:35.948079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:35.950369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:35.970915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:35.971784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:35.972756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:35.973651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:36.651793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:36.667538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:36.669046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:36.678442 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f7419ab-684d-478b-aa8c-45259ac1c825 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 1.050529 Jul 20 10:49:36.679732 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 454/951] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:35 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:36.700824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:36.701497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:36.718772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:36.718772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:36.719744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:36.720409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:36.994668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:37.020369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb8369f4-605d-4b61-8e40-4c3a3476c3ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 1.103487 Jul 20 10:49:37.020982 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 498/952] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:35 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:37.416586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:37.464916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:37.506126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:37.531962 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b72e8619-cd81-4cff-b12e-8e37a793bd1d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.840964 Jul 20 10:49:37.534756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 455/953] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:36 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:37.702940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:37.704082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:37.731976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:37.732276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:37.733084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:37.733514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:37.769274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:37.970170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-aadaf2fe-91b5-4d74-bf9c-c6589c806b3b req-6636a1b5-57b7-4ce8-aef4-63f3787cebed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df204a2-991d-446f-87bb-e3532004323e", "tag": "a651b00e-a780-4c2f-b1d2-f0227d0a7d43"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:38.004765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-aadaf2fe-91b5-4d74-bf9c-c6589c806b3b req-6636a1b5-57b7-4ce8-aef4-63f3787cebed service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:38.005502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-aadaf2fe-91b5-4d74-bf9c-c6589c806b3b req-6636a1b5-57b7-4ce8-aef4-63f3787cebed service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:38.052468 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-aadaf2fe-91b5-4d74-bf9c-c6589c806b3b req-6636a1b5-57b7-4ce8-aef4-63f3787cebed service nova] Creating event network-changed:a651b00e-a780-4c2f-b1d2-f0227d0a7d43 for instance 3df204a2-991d-446f-87bb-e3532004323e on n-h2-846219-10 Jul 20 10:49:38.063211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-aadaf2fe-91b5-4d74-bf9c-c6589c806b3b req-6636a1b5-57b7-4ce8-aef4-63f3787cebed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098632 Jul 20 10:49:38.064616 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 456/954] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:49:38.088589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:38.089758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:38.098769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:38.099649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:38.101573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:38.103431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:38.806540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:38.891656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:38.897425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:38.907358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e424ea3d-20f5-45b2-b4cb-3f4de4659169 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.836607 Jul 20 10:49:38.908311 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 457/955] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:38 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:38.911678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:38.917337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba580b2b-da45-42c8-81c0-8554767b534f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 1.219957 Jul 20 10:49:38.918943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:38.919603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:38.931106 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 499/956] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:37 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:38.935635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:38.936827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:38.938557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:38.939611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:39.785101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:39.801165 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-799ea2c5-9e02-44b1-a1fe-a9c3154948b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.885736 Jul 20 10:49:39.811837 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 458/957] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:38 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:39.933613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:39.935677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:39.951777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:39.954476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:39.954811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:39.955685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:39.956336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:39.965410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:40.016978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:40.017641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:40.018987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:40.019685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:41.184853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:41.226551 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3b7b3d8-1409-4a15-8abc-1f0020bccdaf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 1.282133 Jul 20 10:49:41.237051 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 500/958] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:39 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:41.253557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:41.279145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:41.280820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:41.309340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:41.311149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:41.315484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:41.317299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:41.324077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:41.334820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:41.346332 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4185b2ee-9c5b-485c-bcd1-bd58f95088bb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1568 microversion: 2.25 time: 1.395456 Jul 20 10:49:41.348634 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 459/959] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:39 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1568 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:49:41.827995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:41.840833 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f7ab8ce-bef8-4167-ab22-62e5771f39b2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.608172 Jul 20 10:49:41.843772 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 501/960] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:41 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:42.250112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:42.251609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:42.291732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:42.292662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:42.295560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:42.302427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:42.387217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:42.388109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:42.426416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:42.426865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:42.452120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:42.453972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:43.650025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:43.662037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:43.664640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:43.666993 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1d76662-6aa3-45b4-a9cd-dd57431d260a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1543 microversion: 2.25 time: 1.289505 Jul 20 10:49:43.668223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 502/961] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:42 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1543 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:43.674701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:43.675663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:43.683707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:43.684444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:43.685490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:43.686439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:43.725847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:43.740877 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ce7291ed-72fd-4ad5-9f12-0c900dc80480 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 1.498390 Jul 20 10:49:43.742928 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 460/962] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:42 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:44.032327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:44.060363 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9257f0d6-2461-4acf-84f9-7e3eceae0805 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.390743 Jul 20 10:49:44.061057 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 503/963] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:43 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:44.078840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d5a95dbc-a988-49d7-af24-ab4839fce400 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '.version_select at 0x7f2c3fa960d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:44.082117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d5a95dbc-a988-49d7-af24-ab4839fce400 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:44.082672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d5a95dbc-a988-49d7-af24-ab4839fce400 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:44.084319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1749648270", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "d931b5cb-b761-4e06-bc63-67e23c443217"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:44.112735 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d5a95dbc-a988-49d7-af24-ab4839fce400 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2809 microversion: 2.25 time: 0.050223 Jul 20 10:49:44.122688 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 504/964] 10.222.0.79 () {60 vars in 1183 bytes} [Wed Jul 20 10:49:44 2022] GET /compute/v2.1/os-migrations => generated 2809 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:44.139103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:44.139938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:44.168075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:44.169170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:44.170153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:44.174287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:44.186324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] validate_networks() for [('d931b5cb-b761-4e06-bc63-67e23c443217', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:49:44.563389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid e633ca39-5368-44a8-ae5c-829663eb825c {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:49:44.596967 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-577d48da-3562-449b-b4af-5b04f48954f3 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 2037 microversion: 2.25 time: 0.462438 Jul 20 10:49:44.598695 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 505/965] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:44 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 2037 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:49:44.626696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-56252a6d-0f5c-4e4c-bd9d-0e19a6994fbb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Action: 'create', calling method: .version_select at 0x7f2c3fa673a0>, body: {"keypair": {"name": "tempest-keypair-1239166117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1AHN0WZwrONjMwCtyz4CZhq9/+5NsAxltFIFppMrL1nIF7c/++m4mahpdmdvIA6Ck+5Z9umF0FMIO1R2L4EFrJ++ATFpWgXVlVtl2Fflyw+5S7eds0GwWX+xp39m6wUA=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:44.649845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-56252a6d-0f5c-4e4c-bd9d-0e19a6994fbb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:44.656887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-56252a6d-0f5c-4e4c-bd9d-0e19a6994fbb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for user cc3921f3f8264fb2aa9c95b86cf4dd9d and project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:44.695542 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-56252a6d-0f5c-4e4c-bd9d-0e19a6994fbb tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.073925 Jul 20 10:49:44.698320 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 506/966] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 10:49:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (3 switches on core 0) Jul 20 10:49:44.760399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:44.761298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:44.768462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:44.769321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:44.770400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:44.771353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:45.253361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:45.258879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:49:45.259841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:49:45.260065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:49:45.260687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:49:45.261254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:49:45.263870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:45.265389 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e314911a-470c-4a15-a0d1-0eb04412371a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.509551 Jul 20 10:49:45.266126 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 507/967] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:44 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:45.282578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:45.285256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:45.289195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:45.290029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:45.293382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:45.293889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:45.298835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:45.301381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:45.303366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:45.305562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:45.347733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Getting quotas for project 17bd54737b7a466ea634c0cfbfc0782e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:45.362949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Getting quotas for user 5683bc7a0b854d5a9779dcec39185812 and project 17bd54737b7a466ea634c0cfbfc0782e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:45.401356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:49:45.411468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:49:45.498046 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3bd19a8b-6b18-4989-9ddb-4e6c1e154308 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753162 Jul 20 10:49:45.499013 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 461/968] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:49:45.520932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d5c0bb5-4f67-40ad-9916-b54e18a0f22e tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:45.523983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d5c0bb5-4f67-40ad-9916-b54e18a0f22e tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:45.796330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d5c0bb5-4f67-40ad-9916-b54e18a0f22e tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:45.851928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d5c0bb5-4f67-40ad-9916-b54e18a0f22e tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1224 microversion: 2.1 time: 0.344841 Jul 20 10:49:45.855036 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 462/969] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:45 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1224 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:45.901743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:45.916529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-17e9a917-d7da-45c2-ba6e-7c2d75b8c01f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.644962 Jul 20 10:49:45.917868 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 508/970] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:45 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:46.284094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:46.285089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:46.305533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:46.306211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:46.307267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:46.308351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:46.677967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:46.693847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-075c323d-dde8-46e8-a8bb-b03a5e80e05d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.408951 Jul 20 10:49:46.699231 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 463/971] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:46 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:46.872970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:46.873593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:46.887225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:46.887691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:46.888485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:46.899924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:46.943289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:46.945870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:46.979141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:46.981094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:46.982931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:46.989210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:47.109835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:47.151422 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81266ccd-ef41-477c-8b40-a7d879aa1a24 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1220 microversion: 2.1 time: 0.261427 Jul 20 10:49:47.155337 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 509/972] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:46 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1220 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:47.401787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:47.415653 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-45e7213f-f4fa-45ff-8a43-068d116ccb55 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.477537 Jul 20 10:49:47.416515 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 464/973] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:46 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:47.716494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:47.717740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:47.735323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:47.736090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:47.744142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:47.744853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:48.146585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:48.162418 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c3a85e07-0ead-4b96-8877-9ca639458a32 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.450942 Jul 20 10:49:48.174921 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 510/974] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:47 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:48.175559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:48.176184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:48.191884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:48.197892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:48.202511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:48.207882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:48.348719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:48.371855 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ed1df0c-530a-45cd-8a97-bd7bab2f7ad8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1294 microversion: 2.1 time: 0.200194 Jul 20 10:49:48.391046 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 465/975] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:48 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:48.434304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:48.434972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:48.459712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:48.479056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:48.500135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:48.501220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:48.871508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-67febef3-9794-4a88-a4d4-263048612792 req-e4dd0812-762e-4b03-a407-6344d2fa078a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df204a2-991d-446f-87bb-e3532004323e", "name": "network-vif-plugged", "status": "completed", "tag": "a651b00e-a780-4c2f-b1d2-f0227d0a7d43"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:48.875815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:48.930150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-67febef3-9794-4a88-a4d4-263048612792 req-e4dd0812-762e-4b03-a407-6344d2fa078a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:48.931286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-67febef3-9794-4a88-a4d4-263048612792 req-e4dd0812-762e-4b03-a407-6344d2fa078a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:48.931798 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a592b77b-ae9c-4d5f-8c43-9e898621f162 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.482434 Jul 20 10:49:48.935806 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 511/976] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:48 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:48.968884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-67febef3-9794-4a88-a4d4-263048612792 req-e4dd0812-762e-4b03-a407-6344d2fa078a service nova] Creating event network-vif-plugged:a651b00e-a780-4c2f-b1d2-f0227d0a7d43 for instance 3df204a2-991d-446f-87bb-e3532004323e on n-h2-846219-10 Jul 20 10:49:48.984045 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-67febef3-9794-4a88-a4d4-263048612792 req-e4dd0812-762e-4b03-a407-6344d2fa078a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125147 Jul 20 10:49:48.985148 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 466/977] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:49.201734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:49.202358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:49.221181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:49.223087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:49.226940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:49.227702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:49.400666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:49.401900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:49.421111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:49.421742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:49.422902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:49.426783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:49.615532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:49.626322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:49.627998 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-45113144-f775-4e90-a2dd-d60aaf20fe00 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1282 microversion: 2.1 time: 0.234095 Jul 20 10:49:49.641539 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 467/978] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:49 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:49.649676 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-00d25ca1-4100-4a1c-945f-620249f1dc6e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.438466 Jul 20 10:49:49.671604 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 512/979] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:49 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:49.965690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:49.967581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:49.985126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:49.986252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:49.987387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:49.992755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:50.326999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:50.338326 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df521888-4dd0-4c23-b5a9-c078c444c86c tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1317 microversion: 2.1 time: 0.380813 Jul 20 10:49:50.339424 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 468/980] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:49 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:50.656742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:50.658332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:50.670998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:50.671800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:50.671948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:50.674728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:50.675624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:50.677710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:50.678474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:50.689088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:50.689786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:50.691329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:50.691989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:50.845296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:50.877460 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d614956a-f707-4215-be8c-8bd2994bf87f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1282 microversion: 2.1 time: 0.227614 Jul 20 10:49:50.880865 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 513/981] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:50 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:51.008870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:51.020081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f2ced868-8b4b-41ff-b9e8-8a66254b0512 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.352845 Jul 20 10:49:51.021040 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 469/982] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:50 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:51.357300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:51.357925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:51.373922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:51.376014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:51.377149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1514377534", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "91e8e2a5-7d79-4c89-b21c-e5ff9469e846"}], "security_groups": [{"name": "tempest-securitygroup--1165619727"}], "key_name": "tempest-keypair-1239166117", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:51.378243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:51.385442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:51.660601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] validate_networks() for [('91e8e2a5-7d79-4c89-b21c-e5ff9469e846', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:49:51.661608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:51.701394 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bf55d7af-1670-420e-bb45-ce2e91a89c27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1467 microversion: 2.1 time: 0.349115 Jul 20 10:49:51.706814 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 514/983] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:51 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:51.724954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:51.738893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:51.787563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:51.787563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:51.787563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:51.787563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.175805 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-488093e9-4623-4469-b622-a616b6626879 tempest-ServersOnMultiNodesTest-1051082725 tempest-ServersOnMultiNodesTest-1051082725-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1620 microversion: 2.1 time: 0.457868 Jul 20 10:49:52.176933 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 515/984] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:51 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1620 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:49:52.186246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:52.187095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:52.197478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:52.198310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.200113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:52.200820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.527460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:49:52.528047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:49:52.528452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:49:52.528870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:49:52.529868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:49:52.549086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:52.549850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.550933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:52.551874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.577126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:49:52.583500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for user cc3921f3f8264fb2aa9c95b86cf4dd9d and project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:49:52.583716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:52.594699 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-272efce7-ed6c-4569-b6b4-bb5ea16b695d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 0.416455 Jul 20 10:49:52.602520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:49:52.605111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:49:52.613586 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 516/985] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:52 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:52.623759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:52.624815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:52.635048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:52.636916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.647541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:52.650943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:52.660922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:52.710936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dcbfc8c8-a0c5-4497-a11f-ed463b207107 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.339169 Jul 20 10:49:52.718688 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 470/986] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:49:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:49:52.792779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e83e295b-df22-45e2-be44-180a8595da1c tempest-FloatingIPDetailsNegativeTestJSON-489145761 tempest-FloatingIPDetailsNegativeTestJSON-489145761-project] Calling method '.version_select at 0x7f2c3f44bd30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:53.093982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-e83e295b-df22-45e2-be44-180a8595da1c tempest-FloatingIPDetailsNegativeTestJSON-489145761 tempest-FloatingIPDetailsNegativeTestJSON-489145761-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8465289a-5533-4251-8f41-4eaea9d07915 could not be found", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:49:53.094930 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-e83e295b-df22-45e2-be44-180a8595da1c tempest-FloatingIPDetailsNegativeTestJSON-489145761 tempest-FloatingIPDetailsNegativeTestJSON-489145761-project] HTTP exception thrown: Floating IP not found for ID 8465289a-5533-4251-8f41-4eaea9d07915 Jul 20 10:49:53.097489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e83e295b-df22-45e2-be44-180a8595da1c tempest-FloatingIPDetailsNegativeTestJSON-489145761 tempest-FloatingIPDetailsNegativeTestJSON-489145761-project] Request method failure captured: Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-floating-ips/8465289a-5533-4251-8f41-4eaea9d07915 HTTP/1.1 Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi193PClkGs0RIFR-GnVg8LB6irB9pudZOSaQs0tn5SSbBLI7CKIbtImkNR--1TA90rKyJMMtYl7So24qmHPvGiQTe8Z9m82VufFZF4mC3qGo8FiKbTQ1vFOESEebc23WwwZDU-BhPjh4JUNtnipfw8GiUNiXVLLNzG7Q1WINwD1jSNeA Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 39fa834881104290a7185dee38b92514 Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-489145761 Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:49:53.100523 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_39fa834881104290a7185dee38b92514", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/39fa834881104290a7185dee38b92514"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/39fa834881104290a7185dee38b92514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/39fa834881104290a7185dee38b92514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-489145761 Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 39fa834881104290a7185dee38b92514 Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-489145761 Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-489145761-project Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: dbe80ee64b334a9da8d734fd5d9c4a41 Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-489145761-project Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: exception: Floating IP not found for ID 8465289a-5533-4251-8f41-4eaea9d07915 Jul 20 10:49:53.103525 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '8465289a-5533-4251-8f41-4eaea9d07915'} Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:53.104485 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8465289a-5533-4251-8f41-4eaea9d07915 could not be found Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bed42838-51be-42ee-b4c6-d07cfd93c349'] Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8465289a-5533-4251-8f41-4eaea9d07915. Jul 20 10:49:53.106153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8465289a-5533-4251-8f41-4eaea9d07915 Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:49:53.107783 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:49:53.109459 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:49:53.109459 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8465289a-5533-4251-8f41-4eaea9d07915 Jul 20 10:49:53.109459 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:49:53.109459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e83e295b-df22-45e2-be44-180a8595da1c tempest-FloatingIPDetailsNegativeTestJSON-489145761 tempest-FloatingIPDetailsNegativeTestJSON-489145761-project] Returning 404 to user: Floating IP not found for ID 8465289a-5533-4251-8f41-4eaea9d07915 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:49:53.109459 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e83e295b-df22-45e2-be44-180a8595da1c tempest-FloatingIPDetailsNegativeTestJSON-489145761 tempest-FloatingIPDetailsNegativeTestJSON-489145761-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/8465289a-5533-4251-8f41-4eaea9d07915" status: 404 len: 111 microversion: 2.1 time: 0.387892 Jul 20 10:49:53.115340 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 471/987] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:49:52 2022] GET /compute/v2.1/os-floating-ips/8465289a-5533-4251-8f41-4eaea9d07915 => generated 111 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:49:53.120468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:53.120977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:53.131255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-376b3960-25b8-4f3c-ab57-3dcce74a124f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.516258 Jul 20 10:49:53.132050 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 517/988] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:52 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:53.137549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ce5c1f90-652a-4ce2-b9cc-72270531951f req-a5b1ae55-8fe2-4705-b2a2-c4f0601e9597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:49:53.144078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.144542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.145606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.146054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.158942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ce5c1f90-652a-4ce2-b9cc-72270531951f req-a5b1ae55-8fe2-4705-b2a2-c4f0601e9597 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.159642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ce5c1f90-652a-4ce2-b9cc-72270531951f req-a5b1ae55-8fe2-4705-b2a2-c4f0601e9597 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.200160 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ce5c1f90-652a-4ce2-b9cc-72270531951f req-a5b1ae55-8fe2-4705-b2a2-c4f0601e9597 service nova] Creating event network-changed:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:49:53.220269 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ce5c1f90-652a-4ce2-b9cc-72270531951f req-a5b1ae55-8fe2-4705-b2a2-c4f0601e9597 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084744 Jul 20 10:49:53.222663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 518/989] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:49:53.232587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:49:53.240417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9476f228-be30-4ad8-a610-a3aa552f20ca tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:53.242935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9476f228-be30-4ad8-a610-a3aa552f20ca tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:53.352791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:49:53.398853 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-335f9019-098b-4007-aa1a-363eaf87d8a8 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 204 len: 0 microversion: 2.1 time: 0.281180 Jul 20 10:49:53.401115 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 472/990] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:49:53 2022] DELETE /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:49:53.409534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:53.410586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:53.424278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.425593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.427344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.428272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.466254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9476f228-be30-4ad8-a610-a3aa552f20ca tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:53.487931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9476f228-be30-4ad8-a610-a3aa552f20ca tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:53.492640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9476f228-be30-4ad8-a610-a3aa552f20ca tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:53.497363 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9476f228-be30-4ad8-a610-a3aa552f20ca tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1286 microversion: 2.25 time: 0.271440 Jul 20 10:49:53.501291 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 519/991] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:53 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:53.509760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:53.524076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:53.537837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:49:53.540941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.543228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.544246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.546811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.732481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b1d7332-e0cb-4e12-84db-e33b6a1a6834 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 204 len: 0 microversion: 2.1 time: 0.328925 Jul 20 10:49:53.734267 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 473/992] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:49:53 2022] DELETE /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:49:53.742409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:53.743080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:53.760678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.762200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.763601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:53.764883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:53.974469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:53.987893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d383d0d9-5576-4921-ae62-786670e790fa tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1473 microversion: 2.1 time: 0.484953 Jul 20 10:49:53.999089 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 520/993] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:53 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1473 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:54.004949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:54.005870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:54.014112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:54.014838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:54.016091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:54.017033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:54.977097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:54.989958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23eb91a3-f295-46ab-8ffb-fbb64c9ecf04 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 1.254025 Jul 20 10:49:54.990930 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 474/994] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:53 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:55.010018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:55.011119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:55.022099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:55.022765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:55.024601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:55.025571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:55.184942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:55.199831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-85694c40-9abf-4ec3-9b04-26831494ae41 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1713 microversion: 2.1 time: 1.197978 Jul 20 10:49:55.205385 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 521/995] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:53 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1713 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:55.222289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:55.223885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:55.232025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:55.232542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:55.233376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:55.233825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:55.395884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:55.443061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:55.450718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:55.465914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-131afdf2-0f91-4a8e-b20d-b66b239074b5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1344 microversion: 2.25 time: 0.239256 Jul 20 10:49:55.472322 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 522/996] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:55 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1344 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:55.511697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:55.513540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:55.533696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:55.534940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:55.536839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:55.537814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:55.645678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:55.661328 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-06b387ed-c1c7-4097-a797-ae8f926e1f57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.665933 Jul 20 10:49:55.668150 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 475/997] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:54 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:56.013020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:56.013960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:56.029855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.030943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.032379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.033416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.037703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:56.048314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8bcd73e9-d0f8-4cdf-a443-30eda28d6f1e tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1473 microversion: 2.1 time: 0.571249 Jul 20 10:49:56.050134 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 523/998] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:55 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1473 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:56.233988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:56.235736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:56.246321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.247706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.253744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.254491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.817200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:56.832580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eafb6732-cde2-435c-8c95-bdb335c0acb8 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 0.827275 Jul 20 10:49:56.846949 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 476/999] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:56 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:56.846949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:56.846949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:56.853340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:56.859005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.860383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.860604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.861276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.866539 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5dede20-80f4-4f59-876d-5f1a44d5604d tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1713 microversion: 2.1 time: 0.638432 Jul 20 10:49:56.878434 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 524/1000] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:56 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1713 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:56.898317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:56.899464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:56.913997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.914879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:56.915963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:56.916568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:57.865342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:57.881541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:57.884679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:57.888438 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e62a87c4-8c56-4d8b-9bac-c31ae17a5a45 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 1.049102 Jul 20 10:49:57.890098 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 477/1001] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:56 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:49:57.903510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:57.904208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:57.912189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:57.912522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:57.916335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:57.916588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:57.970224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:57.996725 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d12ea29c-476e-4ea1-b142-0f7c6ec8ef88 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 1.116489 Jul 20 10:49:58.002371 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 525/1002] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:56 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:58.011138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:58.016885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:58.036539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:58.037124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:58.044665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:58.045058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:59.521432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:59.546232 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-20219d83-0911-409b-a617-b83eb9d254c0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 200 len: 1473 microversion: 2.1 time: 1.653296 Jul 20 10:49:59.546895 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 478/1003] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:57 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 1473 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:59.576720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:49:59.586935 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f5a34d2-d17e-4b02-8ea0-965df2a15304 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 1.582547 Jul 20 10:49:59.591713 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 526/1004] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:58 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:49:59.596478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:59.601087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:49:59.601475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:59.608483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:49:59.630801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:59.635933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:59.637095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:59.639769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:59.646889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:59.649674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:49:59.650643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:49:59.654506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.216743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '860bf9c0b96a4f0996edbaa5a0a49977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f86bfd704a4e09873d14c9aa3f88dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:00.247349 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-71be9d40-84f1-442a-9180-ca83242be2ea tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 200 len: 1645 microversion: 2.1 time: 0.669517 Jul 20 10:50:00.252963 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 479/1005] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:49:59 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 1645 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:00.270941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:00.275551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:00.293643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.294296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.297134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.298198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.388082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:00.415343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:00.421641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:00.426770 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4809bfd7-b6ca-474d-8fd6-4a0c28307adc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.831069 Jul 20 10:50:00.429177 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 527/1006] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:49:59 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:00.441854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1e66f93c-58ac-4049-8dfc-189a3b1c9395 req-65182af5-01e4-4f30-98e0-e676419c3b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df204a2-991d-446f-87bb-e3532004323e", "name": "network-vif-deleted", "tag": "a651b00e-a780-4c2f-b1d2-f0227d0a7d43"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:00.452819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1e66f93c-58ac-4049-8dfc-189a3b1c9395 req-65182af5-01e4-4f30-98e0-e676419c3b3b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.453722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1e66f93c-58ac-4049-8dfc-189a3b1c9395 req-65182af5-01e4-4f30-98e0-e676419c3b3b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.485894 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1e66f93c-58ac-4049-8dfc-189a3b1c9395 req-65182af5-01e4-4f30-98e0-e676419c3b3b service nova] Creating event network-vif-deleted:a651b00e-a780-4c2f-b1d2-f0227d0a7d43 for instance 3df204a2-991d-446f-87bb-e3532004323e on n-h2-846219-10 Jul 20 10:50:00.508055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1e66f93c-58ac-4049-8dfc-189a3b1c9395 req-65182af5-01e4-4f30-98e0-e676419c3b3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072290 Jul 20 10:50:00.509724 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 528/1007] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:00.525734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a71ae461-ff8b-4b92-89e6-a64b1cace316 req-e64fceaf-1b7b-43b5-97ee-3b31ac30e11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d", "name": "network-vif-deleted", "tag": "3e13c0e2-943f-4d1e-80af-d6e976269473"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:00.540776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a71ae461-ff8b-4b92-89e6-a64b1cace316 req-e64fceaf-1b7b-43b5-97ee-3b31ac30e11f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.542199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a71ae461-ff8b-4b92-89e6-a64b1cace316 req-e64fceaf-1b7b-43b5-97ee-3b31ac30e11f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.565794 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a71ae461-ff8b-4b92-89e6-a64b1cace316 req-e64fceaf-1b7b-43b5-97ee-3b31ac30e11f service nova] Creating event network-vif-deleted:3e13c0e2-943f-4d1e-80af-d6e976269473 for instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d on n-h2-846219-10 Jul 20 10:50:00.576352 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a71ae461-ff8b-4b92-89e6-a64b1cace316 req-e64fceaf-1b7b-43b5-97ee-3b31ac30e11f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064503 Jul 20 10:50:00.582365 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 529/1008] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:00.594038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:00.600976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 3df204a2-991d-446f-87bb-e3532004323e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:00.634481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.636866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.638689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.640229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.659868 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance 3df204a2-991d-446f-87bb-e3532004323e could not be found. Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e HTTP/1.1 Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:00.662437 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 3df204a2-991d-446f-87bb-e3532004323e could not be found. Jul 20 10:50:00.664747 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3df204a2-991d-446f-87bb-e3532004323e'} Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df204a2-991d-446f-87bb-e3532004323e could not be found. Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:00.665846 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df204a2-991d-446f-87bb-e3532004323e could not be found. Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df204a2-991d-446f-87bb-e3532004323e could not be found. Jul 20 10:50:00.667927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:00.670425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance 3df204a2-991d-446f-87bb-e3532004323e could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:00.671519 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2857aedb-dbcd-4282-afd0-0c3f2fe18651 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e" status: 404 len: 111 microversion: 2.1 time: 0.085938 Jul 20 10:50:00.672593 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 530/1009] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:00 2022] GET /compute/v2.1/servers/3df204a2-991d-446f-87bb-e3532004323e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:00.679987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:00.680881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:00.687521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.688233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:00.689179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:00.690100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.110855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:01.128962 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a04134cf-5180-4fd2-bd24-3042e782c091 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.873416 Jul 20 10:50:01.131459 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 480/1010] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:00 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:01.145907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.153575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:01.193073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.193996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.198389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.199058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.220833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:01.254983 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b910f3b4-0fe8-40cf-b614-2f868d6db245 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 0.579702 Jul 20 10:50:01.266493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:01.266751 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 531/1011] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:00 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:01.281509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.282405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:01.297126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.298396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.299480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.300500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.332949 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d HTTP/1.1 Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:01.335393 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:01.337079 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d'} Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:01.337997 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:01.339261 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.341416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:01.347161 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36176c22-ac9c-4c4c-8172-1263400afc14 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 404 len: 111 microversion: 2.1 time: 0.079042 Jul 20 10:50:01.352227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 532/1012] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:01 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:01.358171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.358937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:01.365817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.366741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.367908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.368585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.385951 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 HTTP/1.1 Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:01.421796 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.424346 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fe91d9f2-c297-46cf-a70d-409e036899a2'} Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:01.425768 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.430310 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.443814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:01.443814 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cbeb1954-94d0-4a18-8b7d-b4e9afb0e2e7 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 404 len: 111 microversion: 2.1 time: 0.078629 Jul 20 10:50:01.443814 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 533/1013] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:01 2022] DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:01.465282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.466432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:01.500615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.501117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.502202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.503694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.543972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 HTTP/1.1 Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:01.548045 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.549455 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fe91d9f2-c297-46cf-a70d-409e036899a2'} Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:01.550190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:01.551504 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:01.558325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:01.559651 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f4d7c240-c076-4e68-b298-8fdcf5b9422f tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 404 len: 111 microversion: 2.1 time: 0.117086 Jul 20 10:50:01.561003 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 534/1014] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:01 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:01.574759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.575771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:01.588384 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4b87299-0cad-4b41-b163-0c79eb524343 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 204 len: 0 microversion: 2.1 time: 0.452861 Jul 20 10:50:01.590704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.594499 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 481/1015] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:01 2022] DELETE /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:01.605896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.607251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.608004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.626503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ceccabd8-7ea8-4b6a-ab1e-db96cd981070 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '.version_select at 0x7f2c3f404940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.729411 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ceccabd8-7ea8-4b6a-ab1e-db96cd981070 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046461815" status: 202 len: 0 microversion: 2.1 time: 0.132040 Jul 20 10:50:01.730464 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 482/1016] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 10:50:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046461815 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:01.745521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:01.760560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:01.787031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.789298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:01.794888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:01.796709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:02.222419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:02.236805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:02.239094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:02.240270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-18438a28-69af-424b-aa7f-869550626920 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.677702 Jul 20 10:50:02.240829 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 535/1017] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:01 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:02.268825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6cebd85b-6dc4-4807-b81c-1d3be12cd796 req-c8a125e8-a2ee-4a7c-8f79-04f3060d4db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "name": "network-vif-plugged", "status": "completed", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:02.289294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6cebd85b-6dc4-4807-b81c-1d3be12cd796 req-c8a125e8-a2ee-4a7c-8f79-04f3060d4db2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:02.289602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6cebd85b-6dc4-4807-b81c-1d3be12cd796 req-c8a125e8-a2ee-4a7c-8f79-04f3060d4db2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:02.347623 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6cebd85b-6dc4-4807-b81c-1d3be12cd796 req-c8a125e8-a2ee-4a7c-8f79-04f3060d4db2 service nova] Creating event network-vif-plugged:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:50:02.359770 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6cebd85b-6dc4-4807-b81c-1d3be12cd796 req-c8a125e8-a2ee-4a7c-8f79-04f3060d4db2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094706 Jul 20 10:50:02.367370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 536/1018] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:02.380717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:02.390146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:02.440012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:02.441001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:02.442877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:02.444046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:02.444775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:02.476341 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2365a00b-acef-49ac-971e-69a9dbe6cfbd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1472 microversion: 2.1 time: 0.737769 Jul 20 10:50:02.477232 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 483/1019] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:01 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1472 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:02.495453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:02.508267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:02.526512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:02.528493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:02.529530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:02.531689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:02.568517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:02.598379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:03.069614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:03.083209 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0bfa4ca9-73ef-4c26-ac80-2af94b891044 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1476 microversion: 2.1 time: 0.709667 Jul 20 10:50:03.084122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 537/1020] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:02 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1476 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:03.097627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8442967a-cab2-4931-8cd4-36feef7d710b req-cd50f15d-cb5f-4637-a737-db1708bcb288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:03.103298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:03.112289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8442967a-cab2-4931-8cd4-36feef7d710b req-cd50f15d-cb5f-4637-a737-db1708bcb288 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:03.113008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8442967a-cab2-4931-8cd4-36feef7d710b req-cd50f15d-cb5f-4637-a737-db1708bcb288 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:03.118761 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77a383f9-35cf-48be-8ad2-06bd747bc475 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 0.638153 Jul 20 10:50:03.119405 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 484/1021] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:02 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:03.133568 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8442967a-cab2-4931-8cd4-36feef7d710b req-cd50f15d-cb5f-4637-a737-db1708bcb288 service nova] Creating event network-changed:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h1-846219-10 Jul 20 10:50:03.140046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8442967a-cab2-4931-8cd4-36feef7d710b req-cd50f15d-cb5f-4637-a737-db1708bcb288 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051972 Jul 20 10:50:03.141192 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 538/1022] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:03.264417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:03.265383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:03.275937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:03.276738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:03.282651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:03.283588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:03.514140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:03.515262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:03.526026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:03.529696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:03.533169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:03.534021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:03.536880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:03.537692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:03.547264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:03.549620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:03.551023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f21d5c58-af7f-4f0a-ac69-1f61b8346350 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.296679 Jul 20 10:50:03.552405 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 485/1023] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:03 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:03.815562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:03.831415 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-046ac57d-8388-438b-87d9-1eb2596bcbbf tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1472 microversion: 2.1 time: 0.326274 Jul 20 10:50:03.833135 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 539/1024] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:03 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1472 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:04.116999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:04.118353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:04.139501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:04.140247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:04.152309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.153363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.155436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.170981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.207493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.208261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.223484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.223484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.768418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:04.778315 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21bf44e4-ba97-42fd-94e0-0375456987b7 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1475 microversion: 2.1 time: 0.673167 Jul 20 10:50:04.778924 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 486/1025] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:04 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1475 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:04.782136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:04.784457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:04.792722 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-23758b10-7ffd-4d8c-b0da-343590141e39 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1324 microversion: 2.1 time: 0.658617 Jul 20 10:50:04.793042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9eff26b2-ecc3-494a-8a54-4ff5c6be96f3 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:04.793515 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 540/1026] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:04 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1324 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:04.794260 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:50:04.794260 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:50:04.811710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:04.812338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:04.817950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:04.820751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.821578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.822872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.823963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.825660 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9eff26b2-ecc3-494a-8a54-4ff5c6be96f3 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1289318237" status: 202 len: 0 microversion: 2.1 time: 0.038336 Jul 20 10:50:04.829810 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 487/1027] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:50:04 2022] DELETE /compute/v2.1/flavors/1289318237 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:04.837540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8fb3d478-6474-47ed-a967-ba9b57a48c05 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:04.870889 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8fb3d478-6474-47ed-a967-ba9b57a48c05 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.038973 Jul 20 10:50:04.880019 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 488/1028] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:50:04 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:04.889444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:04.891092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:04.901525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.902755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.904011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:04.904950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:04.908602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:05.218001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:05.229535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:05.231697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:05.233501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:05.234883 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-759154e0-7d77-4bb9-a971-864d82869c0d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.439175 Jul 20 10:50:05.235733 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 541/1029] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:04 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:05.240527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c5a2d94-bb6a-4ae4-90b8-abbd5e3040e1 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.241709 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:50:05.241709 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:50:05.242756 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b110f179-1e57-4432-a872-1777640a750f tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1472 microversion: 2.1 time: 0.361372 Jul 20 10:50:05.243850 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 489/1030] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:04 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:05.264716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c5a2d94-bb6a-4ae4-90b8-abbd5e3040e1 tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1900604824" status: 202 len: 0 microversion: 2.1 time: 0.026544 Jul 20 10:50:05.265506 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 542/1031] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:50:05 2022] DELETE /compute/v2.1/flavors/1900604824 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:05.275578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8dc0841c-8b8b-4e23-96b8-f03cbfab070d tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.299985 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8dc0841c-8b8b-4e23-96b8-f03cbfab070d tempest-ServersWithSpecificFlavorTestJSON-84300644 tempest-ServersWithSpecificFlavorTestJSON-84300644-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029079 Jul 20 10:50:05.311134 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 490/1032] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:50:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:05.326795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.327491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:05.340616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.341220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.342955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.343662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.361598 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d HTTP/1.1 Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:05.363743 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.365259 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d'} Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:05.366576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.368681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.371780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:05.372737 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-25460f8b-1f83-4d32-970b-3e00e700edfb tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 404 len: 111 microversion: 2.1 time: 0.049550 Jul 20 10:50:05.372878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 543/1033] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:05 2022] DELETE /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:05.384078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.385876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:05.396649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.397188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.397987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.398429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.421972 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d HTTP/1.1 Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:05.423713 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.425009 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d'} Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:05.425727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. Jul 20 10:50:05.426884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.427972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance 7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:05.427972 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e085473-16a1-4f12-8ecf-ed051f52d3df tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d" status: 404 len: 111 microversion: 2.1 time: 0.047738 Jul 20 10:50:05.427972 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 491/1034] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:05 2022] GET /compute/v2.1/servers/7ef4f8ef-78d5-4cdd-a786-fd4e9db19a2d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:05.435423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.436285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:05.444407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.445806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.446868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.447823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.466182 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 HTTP/1.1 Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:05.469829 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.471679 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fe91d9f2-c297-46cf-a70d-409e036899a2'} Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:05.472397 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.473545 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.476738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:05.477873 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5408bfbc-ab63-4f9d-8c37-ee7f7d8f3648 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 404 len: 111 microversion: 2.1 time: 0.047216 Jul 20 10:50:05.478999 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 544/1035] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:05 2022] DELETE /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:05.490045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.492067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] [instance: fe91d9f2-c297-46cf-a70d-409e036899a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:05.504416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.507532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.509376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.512350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.532742 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] HTTP exception thrown: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Request method failure captured: Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 HTTP/1.1 Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190ibGt-LcfiXCNokIeTPPJUJF2ZfstxqtVgq6qIxNU_uWD-LxNcwc6s2puS0X-pVhLhYlld-OsidPLTbdA-QjdKarPH6uttaobAsuKe2nTIPVzXGg_QXCs9lFIk4Li1OJJ3U_mjF2UR0IL3uGmpH2X_WhSUy6ZA2GTafDdiZYoDDb8 Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:05.535612 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b1f86bfd704a4e09873d14c9aa3f88dc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b1f86bfd704a4e09873d14c9aa3f88dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b1f86bfd704a4e09873d14c9aa3f88dc Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990 Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 860bf9c0b96a4f0996edbaa5a0a49977 Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-109008990-project Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.536900 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fe91d9f2-c297-46cf-a70d-409e036899a2'} Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:05.538300 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. Jul 20 10:50:05.541742 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:05.546530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] Returning 404 to user: Instance fe91d9f2-c297-46cf-a70d-409e036899a2 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:05.548779 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7cbce5a6-da74-43e5-8546-bd5fec4dbff6 tempest-ServersWithSpecificFlavorTestJSON-109008990 tempest-ServersWithSpecificFlavorTestJSON-109008990-project] 10.222.0.79 "GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2" status: 404 len: 111 microversion: 2.1 time: 0.064341 Jul 20 10:50:05.550708 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 492/1036] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:05 2022] GET /compute/v2.1/servers/fe91d9f2-c297-46cf-a70d-409e036899a2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:50:05.800620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.801222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:05.809591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.810895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.812144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.813204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.818789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:05.821286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:05.828984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.829911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:05.831099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:05.831726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:06.538352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:06.547872 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92b74827-8176-478f-aa2b-2e49c0570095 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1520 microversion: 2.1 time: 0.733747 Jul 20 10:50:06.549684 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 493/1037] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:05 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1520 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:06.561823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:06.562880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:06.571089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:06.571701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:06.572478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:06.572910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:06.602267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:06.616790 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5ee8450f-4ad9-40a2-b230-678ab2884fd3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1475 microversion: 2.1 time: 0.819747 Jul 20 10:50:06.617989 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 545/1038] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:05 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1475 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:06.624279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:06.625164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:06.663347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:06.664134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:06.665590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:06.666623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:07.034971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:07.058649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:07.062014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:07.063678 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f495de6-7c44-4fa4-a9fc-30d720174e44 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.512873 Jul 20 10:50:07.064578 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 494/1039] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:06 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:07.072358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-88220a83-1cbb-440c-b816-a1b3a230f4d1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'create', calling method: .version_select at 0x7f2c3f42b550>, body: {"pool": null} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:07.236211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:07.247207 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a1f8796-72f3-44ec-a3d5-219adbb86e10 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1472 microversion: 2.1 time: 0.627897 Jul 20 10:50:07.247815 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 546/1040] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:06 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1472 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:07.265056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-959012625", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1009383f-cafa-436f-a818-c0fa90eb43a8"}], "security_groups": [{"name": "tempest-securitygroup--1699558793"}], "key_name": "tempest-keypair-882327533", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fc7133b1-6f6b-47a3-94fb-f55ef404610b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:07.654183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] validate_networks() for [('1009383f-cafa-436f-a818-c0fa90eb43a8', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:50:09.236849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Getting quotas for project e44c48be958e4d67aa16c3b0abbcfe13. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:09.244246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Getting quotas for user e5c3f91971e542f3a5c3d6d7ef1c29ca and project e44c48be958e4d67aa16c3b0abbcfe13. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:09.258654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:50:09.259088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:50:09.259604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:50:09.260023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:50:09.260446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:50:09.269821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:09.270530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:09.271423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:09.271873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:09.292092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Getting quotas for project e44c48be958e4d67aa16c3b0abbcfe13. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:09.297710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Getting quotas for user e5c3f91971e542f3a5c3d6d7ef1c29ca and project e44c48be958e4d67aa16c3b0abbcfe13. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:09.370104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:50:09.373498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc7133b1-6f6b-47a3-94fb-f55ef404610b',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:50:09.568223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:09.597302 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ca21e93-ce58-47e0-9842-d8eae0a33f2e tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.336681 Jul 20 10:50:09.598621 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 547/1041] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:50:07 2022] POST /compute/v2.1/servers => generated 407 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:50:09.801722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0a244c5-c164-4261-b630-b23ddac8c609 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f9c44c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVqRiaVAVpck3py52AY/CVJqxZ7/TmVg3vFsuR8xjmoxPfH05j/WFWJQOjtfGyMBixyW2cI9ZWDJX6pl29cnK5vPQIpQfzHCyhdk4vYDXr8g0P5ReIb/utEpvLpGqjw=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:09.807854 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a0a244c5-c164-4261-b630-b23ddac8c609 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0a244c5-c164-4261-b630-b23ddac8c609 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 257 Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:09.809859 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVqRiaVAVpck3py52AY/CVJqxZ7/TmVg3vFsuR8xjmoxPfH05j/WFWJQOjtfGyMBixyW2cI9ZWDJX6pl29cnK5vPQIpQfzHCyhdk4vYDXr8g0P5ReIb/utEpvLpGqjw=="}} Jul 20 10:50:09.811283 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0eVqRiaVAVpck3py52AY/CVJqxZ7/TmVg3vFsuR8xjmoxPfH05j/WFWJQOjtfGyMBixyW2cI9ZWDJX6pl29cnK5vPQIpQfzHCyhdk4vYDXr8g0P5ReIb/utEpvLpGqjw=='}}} Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 20 10:50:09.812191 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 10:50:09.813489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 20 10:50:09.814888 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:09.817221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0a244c5-c164-4261-b630-b23ddac8c609 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:09.818251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0a244c5-c164-4261-b630-b23ddac8c609 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.218244 Jul 20 10:50:09.824766 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 548/1042] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:50:09.829469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:09.830646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:09.838492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:09.838895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:09.839791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:09.840310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.183348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:10.194486 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dcf4b9b7-8717-4771-a031-59631112ba92 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1473 microversion: 2.1 time: 0.369954 Jul 20 10:50:10.197048 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 549/1043] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:09 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1473 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:10.207559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c2e0273a-54d4-4259-9f70-6613965f7a3a req-549560ae-3c4e-4083-b876-b68f6ef6551a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccb59b4-bd80-4718-9944-b4a51909a7f8", "name": "network-vif-deleted", "tag": "8389716e-3b45-4172-8e90-43445afb9e45"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:10.224437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c2e0273a-54d4-4259-9f70-6613965f7a3a req-549560ae-3c4e-4083-b876-b68f6ef6551a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.224932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c2e0273a-54d4-4259-9f70-6613965f7a3a req-549560ae-3c4e-4083-b876-b68f6ef6551a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.246994 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c2e0273a-54d4-4259-9f70-6613965f7a3a req-549560ae-3c4e-4083-b876-b68f6ef6551a service nova] Creating event network-vif-deleted:8389716e-3b45-4172-8e90-43445afb9e45 for instance fccb59b4-bd80-4718-9944-b4a51909a7f8 on n-h1-846219-10 Jul 20 10:50:10.261389 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c2e0273a-54d4-4259-9f70-6613965f7a3a req-549560ae-3c4e-4083-b876-b68f6ef6551a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059592 Jul 20 10:50:10.265349 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 550/1044] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:10.286506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:10.287685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:10.304425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.305209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.310951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.311776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.668164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:10.675652 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-88220a83-1cbb-440c-b816-a1b3a230f4d1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.609398 Jul 20 10:50:10.676955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 495/1045] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:50:07 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:10.685458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:10.686936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:10.688180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:10.690590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:10.698217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.698754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.699485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.699935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.700275 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3be3028d-59bd-4f0b-8c8a-7244a9659686 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.431576 Jul 20 10:50:10.701013 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 551/1046] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:10 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:10.719091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:10.719766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:10.727478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.728860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.731597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.732376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.757408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.757865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.758446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lazy-loading 'fault' on Instance uuid fccb59b4-bd80-4718-9944-b4a51909a7f8 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:50:10.833078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:10.846478 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a35530df-95f1-4c0e-babf-ce0036890ee6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1306 microversion: 2.1 time: 0.166946 Jul 20 10:50:10.847099 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 496/1047] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:10 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1306 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:10.851602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:10.858822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f478940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-793246193", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:10.863394 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d11e0178-ebdf-4886-8445-83b39d8b5316 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1218 microversion: 2.1 time: 0.161450 Jul 20 10:50:10.878000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:10.878249 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 552/1048] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:10 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:10.885467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for user b017a2cc9f354b1ba07c204a4ca787b4 and project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:10.893341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:10.899407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:10.907799 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:10.919841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.920757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.921992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:10.922615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 2166 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-793246193", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:50:10.926939 n-d-846219-10 devstack@n-api.service[125886]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-793246193', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:10.930599 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-da342616-bb27-40dc-9c3c-068e18470b9c tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.079515 Jul 20 10:50:10.933564 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 497/1049] 10.222.0.79 () {60 vars in 1159 bytes} [Wed Jul 20 10:50:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:50:10.960500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1781708525", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "d931b5cb-b761-4e06-bc63-67e23c443217"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:11.087860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] validate_networks() for [('d931b5cb-b761-4e06-bc63-67e23c443217', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:50:11.236610 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-924d7a3c-0db2-4d76-a2c6-24f37ab9fd8c tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1814 microversion: 2.1 time: 0.356788 Jul 20 10:50:11.238263 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 553/1050] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:10 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1814 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:11.251145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d692ce67-ab37-4ce2-ba62-f237fb9b6179 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f9f23a0>, body: {"keypair": {"name": "tempest-keypair-1642440074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz44aXIMmt4kdMvoWk3VOVAD/4k4g6lu4ZxzyJsndHxns3WR34Wn114VJh7NyOSVOTexDu4qWhkAbpMS0FO++lrbWolVmzJ5cmyMXt7BPCsfS/xGJicxYpsQtPEwLvASA=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:11.291668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d692ce67-ab37-4ce2-ba62-f237fb9b6179 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:11.306786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d692ce67-ab37-4ce2-ba62-f237fb9b6179 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for user b017a2cc9f354b1ba07c204a4ca787b4 and project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:11.356813 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d692ce67-ab37-4ce2-ba62-f237fb9b6179 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116513 Jul 20 10:50:11.359116 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 554/1051] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:11.379384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:11.380690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:11.396990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.397707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.398721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.399513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.705263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:11.717046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f341df55-7926-4922-84ce-f75d31a097cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1473 microversion: 2.1 time: 0.356390 Jul 20 10:50:11.717629 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 555/1052] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:11 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1473 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:11.732704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-becb36a9-dbce-48a7-abd7-710fbbb53e76 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:11.734026 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:50:11.734026 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:50:11.743494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-becb36a9-dbce-48a7-abd7-710fbbb53e76 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.744404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-becb36a9-dbce-48a7-abd7-710fbbb53e76 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.745652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-becb36a9-dbce-48a7-abd7-710fbbb53e76 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.746275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-becb36a9-dbce-48a7-abd7-710fbbb53e76 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.795810 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-becb36a9-dbce-48a7-abd7-710fbbb53e76 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.066955 Jul 20 10:50:11.796988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 556/1053] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:50:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:11.802482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f9d5b80>, body: {"keypair": {"name": "tempest-keypair-1642440074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpKL91h8UjopoTw1UxCOtq8UP2eB7IjNmxzR479E8uYji/2csEDlpVgzL9k0/ke27VqnvI8EaMW6xeo+Q0CWM3xysT6Fi8k2lWNoZIYSWxkrN0Hib06ybpVyUB8OF9HVQ=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:11.806564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:50:11.808546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:50:11.809460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:50:11.809943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:50:11.810426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:50:11.824706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.825308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.826218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.826764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.854482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Getting quotas for project 17bd54737b7a466ea634c0cfbfc0782e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:11.858946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:11.864818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Getting quotas for user 5683bc7a0b854d5a9779dcec39185812 and project 17bd54737b7a466ea634c0cfbfc0782e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:11.869842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for user b017a2cc9f354b1ba07c204a4ca787b4 and project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:11.892766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:50:11.898510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:50:11.919756 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] HTTP exception thrown: Key pair 'tempest-keypair-1642440074' already exists. Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 273 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: {"keypair": {"name": "tempest-keypair-1642440074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpKL91h8UjopoTw1UxCOtq8UP2eB7IjNmxzR479E8uYji/2csEDlpVgzL9k0/ke27VqnvI8EaMW6xeo+Q0CWM3xysT6Fi8k2lWNoZIYSWxkrN0Hib06ybpVyUB8OF9HVQ=="}} Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: exception: Key pair 'tempest-keypair-1642440074' already exists. Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1642440074', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpKL91h8UjopoTw1UxCOtq8UP2eB7IjNmxzR479E8uYji/2csEDlpVgzL9k0/ke27VqnvI8EaMW6xeo+Q0CWM3xysT6Fi8k2lWNoZIYSWxkrN0Hib06ybpVyUB8OF9HVQ=='}}} Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result.read() Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'b017a2cc9f354b1ba07c204a4ca787b4-tempest-keypair-1642440074' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 10:50:11.924615 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi session.flush() Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result.read() Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 20 10:50:11.930711 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'b017a2cc9f354b1ba07c204a4ca787b4-tempest-keypair-1642440074' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 20, 10, 50, 11, 911537), 'updated_at': None, 'name': 'tempest-keypair-1642440074', 'user_id': 'b017a2cc9f354b1ba07c204a4ca787b4', 'fingerprint': '15:9b:f3:08:ad:b2:c3:c3:7b:5d:89:85:a2:7a:6f:2f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpKL91h8UjopoTw1UxCOtq8UP2eB7IjNmxzR479E8uYji/2csEDlpVgzL9k0/ke27VqnvI8EaMW6xeo+Q0CWM3xysT6Fi8k2lWNoZIYSWxkrN0Hib06ybpVyUB8OF9HVQ==', 'type': 'ssh'}] Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi keypair.create() Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._create() Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1642440074' already exists. Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 20 10:50:11.935279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1642440074' already exists. Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1642440074' already exists. Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 409 to user: Key pair 'tempest-keypair-1642440074' already exists. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:11.942445 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab9ff594-fb47-42e7-85e7-980a88da7ed6 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.140730 Jul 20 10:50:11.948953 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 557/1054] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:11 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:50:11.956741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:11.957522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:11.968442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.968990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.969895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:11.970476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:11.990174 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25ca04b3-4f7c-48dc-86c0-e2b5a84cd87a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051320 Jul 20 10:50:11.991741 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 498/1055] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:50:11.997556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:11.998948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:12.007770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:12.008546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:12.009638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:12.010409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:12.129763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:12.133358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:12.139089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lazy-loading 'fault' on Instance uuid fccb59b4-bd80-4718-9944-b4a51909a7f8 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:50:12.555472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:12.596889 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2db601da-f06c-49cb-9628-be5991bb0ef7 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 200 len: 1306 microversion: 2.1 time: 0.601379 Jul 20 10:50:12.618145 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 499/1056] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:11 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 1306 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:12.648883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:12.661001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:12.704733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:12.707853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:12.718768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:12.721245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.113864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:13.136547 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b87e90a5-ac6d-4f13-8c0d-80180f60deec tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1236 microversion: 2.1 time: 0.516197 Jul 20 10:50:13.140889 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 500/1057] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:12 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1236 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:13.158570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-87786d10-8118-40d1-adf3-5ec21d0d1b79 req-a4dbeb46-a8cd-4f6d-af94-56afe9676db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "name": "network-vif-plugged", "status": "completed", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:13.191561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:13.193247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-87786d10-8118-40d1-adf3-5ec21d0d1b79 req-a4dbeb46-a8cd-4f6d-af94-56afe9676db4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.193782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-87786d10-8118-40d1-adf3-5ec21d0d1b79 req-a4dbeb46-a8cd-4f6d-af94-56afe9676db4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.214765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-87786d10-8118-40d1-adf3-5ec21d0d1b79 req-a4dbeb46-a8cd-4f6d-af94-56afe9676db4 service nova] Creating event network-vif-plugged:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h1-846219-10 Jul 20 10:50:13.222135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:13.222592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-87786d10-8118-40d1-adf3-5ec21d0d1b79 req-a4dbeb46-a8cd-4f6d-af94-56afe9676db4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076625 Jul 20 10:50:13.223774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 501/1058] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:13.229980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:13.231439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f1bb4bec-5275-4bc1-b69a-b0cde510f103 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Calling method '.version_select at 0x7f2c3f48fe50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:13.237590 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce7eb6b2-e758-4606-bc34-9e940df51cfc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 1.286821 Jul 20 10:50:13.239014 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 558/1059] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:11 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:13.260082 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f1bb4bec-5275-4bc1-b69a-b0cde510f103 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642440074" status: 202 len: 0 microversion: 2.1 time: 0.034682 Jul 20 10:50:13.261284 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 502/1060] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 10:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642440074 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:13.268073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:13.269726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:13.270810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff478e4b-834e-4e57-bbaa-eae6f2e1aab1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:13.273511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff478e4b-834e-4e57-bbaa-eae6f2e1aab1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:13.282394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.282850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.283846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.284443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.487885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff478e4b-834e-4e57-bbaa-eae6f2e1aab1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:13.501574 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff478e4b-834e-4e57-bbaa-eae6f2e1aab1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1224 microversion: 2.1 time: 0.251619 Jul 20 10:50:13.504399 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 559/1061] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:13 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1224 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:13.520135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b23fdf6b-e651-4783-a437-f24ebdb4f70a tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f9e9670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4YPNI76/RCtXMirsVVDctv6L9IF+dTF5mqAH0e70x8Z+ma4WS9OM49FBlen+r99eTRshFUBrMDHxTU8i8VgVAf8Bq/8Xa54pgrLAJfnbvgocM9QEDm3/2p1Tra+V5pJg=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b23fdf6b-e651-4783-a437-f24ebdb4f70a tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 247 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4YPNI76/RCtXMirsVVDctv6L9IF+dTF5mqAH0e70x8Z+ma4WS9OM49FBlen+r99eTRshFUBrMDHxTU8i8VgVAf8Bq/8Xa54pgrLAJfnbvgocM9QEDm3/2p1Tra+V5pJg=="}} Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4YPNI76/RCtXMirsVVDctv6L9IF+dTF5mqAH0e70x8Z+ma4WS9OM49FBlen+r99eTRshFUBrMDHxTU8i8VgVAf8Bq/8Xa54pgrLAJfnbvgocM9QEDm3/2p1Tra+V5pJg=='}}} Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '' Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:50:13.528045 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b23fdf6b-e651-4783-a437-f24ebdb4f70a tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b23fdf6b-e651-4783-a437-f24ebdb4f70a tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023812 Jul 20 10:50:13.536423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 560/1062] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:13 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:50:13.547453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3fa67700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2042623426", "public_key": " "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:13.606510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:13.620453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for user b017a2cc9f354b1ba07c204a4ca787b4 and project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:13.684742 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 95 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2042623426", "public_key": " "}} Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2042623426', 'public_key': ' '}}} Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.693170 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:13.707807 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9df976f9-3103-41e3-9ceb-d11aefb30bed tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.165414 Jul 20 10:50:13.714791 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 561/1063] 10.222.0.79 () {60 vars in 1157 bytes} [Wed Jul 20 10:50:13 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:50:13.735883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:13.740013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fccb59b4-bd80-4718-9944-b4a51909a7f8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:13.760157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.760599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.775802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.776844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.839650 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance fccb59b4-bd80-4718-9944-b4a51909a7f8 could not be found. Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 HTTP/1.1 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fccb59b4-bd80-4718-9944-b4a51909a7f8 could not be found. Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fccb59b4-bd80-4718-9944-b4a51909a7f8'} Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccb59b4-bd80-4718-9944-b4a51909a7f8 could not be found. Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccb59b4-bd80-4718-9944-b4a51909a7f8 could not be found. Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.863724 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccb59b4-bd80-4718-9944-b4a51909a7f8 could not be found. Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance fccb59b4-bd80-4718-9944-b4a51909a7f8 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:13.876945 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cab94dc6-c2c5-4160-8506-736b4c5db750 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8" status: 404 len: 111 microversion: 2.1 time: 0.162373 Jul 20 10:50:13.878111 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 562/1064] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:13 2022] GET /compute/v2.1/servers/fccb59b4-bd80-4718-9944-b4a51909a7f8 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:13.903450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4560f6fe-2d3e-468b-bc2a-9e00c1c63195 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f9f2430>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu4l6aSuvJJOflZyp6rJXHkH8ezsNLQfRkP05fDMpcgmIb8/5f8zuXRdWKpBop5hpRNsD7K9d30f0HNZ14CikP3YiOd3kzbHWjk9HQE8yK/ZmFoBgIb4/+UwAh+7oWLmg=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4560f6fe-2d3e-468b-bc2a-9e00c1c63195 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 507 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu4l6aSuvJJOflZyp6rJXHkH8ezsNLQfRkP05fDMpcgmIb8/5f8zuXRdWKpBop5hpRNsD7K9d30f0HNZ14CikP3YiOd3kzbHWjk9HQE8yK/ZmFoBgIb4/+UwAh+7oWLmg=="}} Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu4l6aSuvJJOflZyp6rJXHkH8ezsNLQfRkP05fDMpcgmIb8/5f8zuXRdWKpBop5hpRNsD7K9d30f0HNZ14CikP3YiOd3kzbHWjk9HQE8yK/ZmFoBgIb4/+UwAh+7oWLmg=='}}} Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 20 10:50:13.934570 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4560f6fe-2d3e-468b-bc2a-9e00c1c63195 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4560f6fe-2d3e-468b-bc2a-9e00c1c63195 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.058468 Jul 20 10:50:13.948381 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 563/1065] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:13 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:50:13.955202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:13.955202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:13.973295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.973767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:13.977429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:13.978722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:14.048934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:14.262234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-185aaf8f-33c2-495f-a6a6-3200defa3638 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 204 len: 0 microversion: 2.1 time: 0.319551 Jul 20 10:50:14.263521 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 564/1066] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:13 2022] DELETE /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:14.269316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Action: 'create', calling method: .version_select at 0x7f2c3f9d55e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-826488020", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:14.312492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:14.328889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Getting quotas for user b017a2cc9f354b1ba07c204a4ca787b4 and project dbd9cd294acf4fe2b583b63a8b8d8afc. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:14.409427 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 117 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-826488020", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: exception: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-826488020', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 20 10:50:14.414139 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 20 10:50:14.418400 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:14.426180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:14.430112 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1dc84e46-e719-4e44-a805-eae4521f1155 tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.164854 Jul 20 10:50:14.448435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 565/1067] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:50:14.462052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:14.462869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:14.479881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:14.480352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:14.481151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:14.485222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:15.297257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:15.314422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-34f1d92b-bf73-48db-b016-c08a38b3f953 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1470 microversion: 2.1 time: 2.051364 Jul 20 10:50:15.316411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 503/1068] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:13 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1470 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:15.324469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:15.325506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:15.335336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:15.336266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:15.337414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:15.338244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:15.681687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:15.693747 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-62518c27-84d2-4118-ba94-c19e676e9fe5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1304 microversion: 2.1 time: 1.248467 Jul 20 10:50:15.695985 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 566/1069] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:14 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1304 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:15.703947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:15.704801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:15.723558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:15.724120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:15.730484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:15.731261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:15.825474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:15.835861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:15.838006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:15.839678 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f35e829-9cf9-4f42-8d53-3f47a3953ba0 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1412 microversion: 2.25 time: 0.519634 Jul 20 10:50:15.850719 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 504/1070] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:15 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1412 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:15.856152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3dee29e2-b57f-431a-a29c-221a122bc5cf tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Calling method '.version_select at 0x7f2c3f3ee550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:15.868936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-3dee29e2-b57f-431a-a29c-221a122bc5cf tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2138534063 not found for user b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3dee29e2-b57f-431a-a29c-221a122bc5cf tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Request method failure captured: Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2138534063 HTTP/1.1 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi193fgbTimkPcrXmMN1QAmuTZp2kOJJ_TwlcNHyLODuxLAkTuQ4pZVHjYMHk9N2RwUSHykIj7R4ouKWLpChHH2FfpF-423zweAVcug_aGJzkPOIKApF-WQYa9cUxPbO2saGzKe2tA2yBC8tPMpi14Ga_tTCg_N60RaMK9nVyFR_Ydgt8 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dbd9cd294acf4fe2b583b63a8b8d8afc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dbd9cd294acf4fe2b583b63a8b8d8afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dbd9cd294acf4fe2b583b63a8b8d8afc Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1282548264 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1282548264-project Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: exception: Keypair tempest-keypair-non-existent-2138534063 not found for user b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'tempest-keypair-non-existent-2138534063'} Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2138534063 not found for user b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:15.871812 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2138534063 not found for user b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2138534063 not found for user b017a2cc9f354b1ba07c204a4ca787b4 Jul 20 10:50:15.875651 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:15.882145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3dee29e2-b57f-431a-a29c-221a122bc5cf tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2138534063 not found for user b017a2cc9f354b1ba07c204a4ca787b4 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:15.883465 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3dee29e2-b57f-431a-a29c-221a122bc5cf tempest-KeyPairsNegativeTestJSON-1282548264 tempest-KeyPairsNegativeTestJSON-1282548264-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2138534063" status: 404 len: 145 microversion: 2.1 time: 0.031164 Jul 20 10:50:15.884630 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 505/1071] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:50:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2138534063 => generated 145 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:15.892541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:15.893485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:15.903759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:15.904626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:15.905643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:15.906328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.230185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:16.249874 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a839623b-e728-4c20-94f7-cfa9a2d28ff2 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1282 microversion: 2.1 time: 0.363753 Jul 20 10:50:16.250392 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 506/1072] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:15 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:16.254985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fccd45c3-16c2-4ecf-b6e4-870419758357 req-28de1022-11fa-43a6-bf5b-0a69992f846e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ac7237-71ff-472f-bc87-9da4f2249221", "name": "network-vif-unplugged", "status": "completed", "tag": "24e47f7f-6301-495e-893e-49d3d309e0c0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:16.298081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fccd45c3-16c2-4ecf-b6e4-870419758357 req-28de1022-11fa-43a6-bf5b-0a69992f846e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.298560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fccd45c3-16c2-4ecf-b6e4-870419758357 req-28de1022-11fa-43a6-bf5b-0a69992f846e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.320788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fccd45c3-16c2-4ecf-b6e4-870419758357 req-28de1022-11fa-43a6-bf5b-0a69992f846e service nova] Creating event network-vif-unplugged:24e47f7f-6301-495e-893e-49d3d309e0c0 for instance c5ac7237-71ff-472f-bc87-9da4f2249221 on n-h1-846219-10 Jul 20 10:50:16.338792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-fccd45c3-16c2-4ecf-b6e4-870419758357 req-28de1022-11fa-43a6-bf5b-0a69992f846e service nova] Instance c5ac7237-71ff-472f-bc87-9da4f2249221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:50:16.345838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fccd45c3-16c2-4ecf-b6e4-870419758357 req-28de1022-11fa-43a6-bf5b-0a69992f846e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094229 Jul 20 10:50:16.347049 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 507/1073] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:16.354577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:16.355510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:16.362624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.363372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.364360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.364962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.478455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eac2b1c6-c6eb-4f27-96ab-ed645a568d50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221/action" status: 204 len: 0 microversion: 2.1 time: 0.129647 Jul 20 10:50:16.479473 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 508/1074] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:16 2022] POST /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221/action => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:16.492246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a80a50b8-2c23-4e2c-a348-a295bc63fec7", "device": "/dev/xvdb"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:16.498639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:16.507505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.508299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.509420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.510131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.551110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:16.571918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f01aca1-7051-4781-aff7-f1fee7a78ad6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1473 microversion: 2.1 time: 0.863622 Jul 20 10:50:16.574621 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 567/1075] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:15 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1473 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:16.597425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-fcdbadb2-bb39-430d-8f05-310f24aaf2d2 req-07d72b84-843d-4de8-b2a1-bca63f23ee24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc3b7d2-87d3-4486-b694-0a3a7fc27b61", "tag": "a755841b-df0e-4f06-88dd-4cb10308ea11"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:16.623621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fcdbadb2-bb39-430d-8f05-310f24aaf2d2 req-07d72b84-843d-4de8-b2a1-bca63f23ee24 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.626822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fcdbadb2-bb39-430d-8f05-310f24aaf2d2 req-07d72b84-843d-4de8-b2a1-bca63f23ee24 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.662172 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-fcdbadb2-bb39-430d-8f05-310f24aaf2d2 req-07d72b84-843d-4de8-b2a1-bca63f23ee24 service nova] Creating event network-changed:a755841b-df0e-4f06-88dd-4cb10308ea11 for instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 on n-h2-846219-10 Jul 20 10:50:16.683712 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-fcdbadb2-bb39-430d-8f05-310f24aaf2d2 req-07d72b84-843d-4de8-b2a1-bca63f23ee24 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100257 Jul 20 10:50:16.686792 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 568/1076] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:16.705748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:16.707216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:16.725058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.734334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.736802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:16.737648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:16.776061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:17.466895 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0b112d72-0105-4f48-9c48-994bda69cc16 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "POST /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968980 Jul 20 10:50:17.473083 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 509/1077] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 10:50:16 2022] POST /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:17.501174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:17.502027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:17.536549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:17.537011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:17.538464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:17.548234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:17.577246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:17.596447 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-175d8d78-74c4-456e-8c6c-b2b84b9a6d0a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1470 microversion: 2.1 time: 0.906130 Jul 20 10:50:17.599116 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 569/1078] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:16 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1470 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:17.612434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:17.613275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:17.627928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:17.632529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:17.633488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:17.634021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:17.648816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:18.330348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:18.336785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:18.343974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:18.347211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ea536a1d-4fc6-4133-84dc-b17e2c4ff88c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1304 microversion: 2.1 time: 0.868304 Jul 20 10:50:18.349611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:18.352596 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cda06c2e-a9c3-4a32-8d8c-9aa641d2e576 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1608 microversion: 2.25 time: 0.751159 Jul 20 10:50:18.353876 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 570/1079] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:50:17 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1608 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:50:18.357834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 510/1080] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:17 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1304 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:18.367578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:18.369652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:18.371578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:18.372202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:18.383892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:18.387318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:18.388089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:18.388282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:18.389101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:18.389499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:18.389969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:18.391304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:18.896551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:18.906040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffc6653f-a093-499b-bf24-7f513941fb1a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1473 microversion: 2.1 time: 0.546998 Jul 20 10:50:18.906653 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 511/1081] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:18 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1473 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:18.928817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5435b53a-6eaa-4011-a018-760c54a06570 req-669b6f61-217f-4777-80f3-7fd7b2784a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ac7237-71ff-472f-bc87-9da4f2249221", "name": "network-vif-plugged", "status": "completed", "tag": "24e47f7f-6301-495e-893e-49d3d309e0c0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:18.941667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5435b53a-6eaa-4011-a018-760c54a06570 req-669b6f61-217f-4777-80f3-7fd7b2784a26 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:18.942240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5435b53a-6eaa-4011-a018-760c54a06570 req-669b6f61-217f-4777-80f3-7fd7b2784a26 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:18.970327 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5435b53a-6eaa-4011-a018-760c54a06570 req-669b6f61-217f-4777-80f3-7fd7b2784a26 service nova] Creating event network-vif-plugged:24e47f7f-6301-495e-893e-49d3d309e0c0 for instance c5ac7237-71ff-472f-bc87-9da4f2249221 on n-h1-846219-10 Jul 20 10:50:18.980748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-5435b53a-6eaa-4011-a018-760c54a06570 req-669b6f61-217f-4777-80f3-7fd7b2784a26 service nova] Instance c5ac7237-71ff-472f-bc87-9da4f2249221 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:50:18.992658 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5435b53a-6eaa-4011-a018-760c54a06570 req-669b6f61-217f-4777-80f3-7fd7b2784a26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079833 Jul 20 10:50:18.993813 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 512/1082] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:19.000567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:19.001236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:19.010481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:19.012963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.015510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.016956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.017784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.023811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09cfae5f-1f6c-43cb-b037-831d08a374a4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.668855 Jul 20 10:50:19.025964 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 571/1083] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:18 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:19.040837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:19.043216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:19.058450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.059133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.059958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.060400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.329709 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-61dcfa1a-3bcf-4bf5-be6d-ea734fe4fed2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.334249 Jul 20 10:50:19.330333 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 513/1084] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 10:50:18 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:50:19.364339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:19.364964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:19.385263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.397359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.400257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.405394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.758360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:19.775769 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81015058-eaa2-410a-a6a3-42f9cdb6d72c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1470 microversion: 2.1 time: 0.744678 Jul 20 10:50:19.798174 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 572/1085] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:19 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1470 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:19.934775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:19.939110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:19.970781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.977409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:19.978849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:19.980187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:20.585997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:20.631607 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6848572b-f885-4bf8-8214-ac2c024b0fd0 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 200 len: 1431 microversion: 2.1 time: 0.702936 Jul 20 10:50:20.638224 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 573/1086] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:19 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 1431 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:20.669296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:20.671766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:20.685638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:20.690036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:20.697958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:20.698907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:20.859248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:20.875849 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ac9798e-700d-4a72-abf4-5387927d4912 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1304 microversion: 2.1 time: 1.514559 Jul 20 10:50:20.879905 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 514/1087] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:19 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1304 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:20.889633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-73e3822e-c502-4497-8332-2e24a3eab89d req-07d54af1-c530-4a88-88b3-153ad2d9fa4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87dade9-92b8-4c8c-82b5-676ef7f3bcc6", "name": "network-vif-deleted", "tag": "74643744-81fd-4302-844f-2bc1865c2326"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:20.912184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-73e3822e-c502-4497-8332-2e24a3eab89d req-07d54af1-c530-4a88-88b3-153ad2d9fa4b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:20.918206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-73e3822e-c502-4497-8332-2e24a3eab89d req-07d54af1-c530-4a88-88b3-153ad2d9fa4b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:20.981076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-73e3822e-c502-4497-8332-2e24a3eab89d req-07d54af1-c530-4a88-88b3-153ad2d9fa4b service nova] Creating event network-vif-deleted:74643744-81fd-4302-844f-2bc1865c2326 for instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 on n-h1-846219-10 Jul 20 10:50:21.001671 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-73e3822e-c502-4497-8332-2e24a3eab89d req-07d54af1-c530-4a88-88b3-153ad2d9fa4b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117150 Jul 20 10:50:21.003575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 515/1088] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:21.018584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:21.022924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:21.038784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.040180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.042474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.043026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.603603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:21.626682 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b0493db4-628f-4e63-9c6e-c8079f050cea tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.986251 Jul 20 10:50:21.628509 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 574/1089] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:20 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:21.656549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-692d63e2-2d29-49b1-9ec6-ca17e5b1574f req-68e7c41f-e515-4b67-b869-dc4179726729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df81c38-6b96-4e1f-b86c-e69acebd7e8a", "tag": "8c525d96-458f-4e39-9f8e-fad48afa68d0"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:21.680072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-692d63e2-2d29-49b1-9ec6-ca17e5b1574f req-68e7c41f-e515-4b67-b869-dc4179726729 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.681907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-692d63e2-2d29-49b1-9ec6-ca17e5b1574f req-68e7c41f-e515-4b67-b869-dc4179726729 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.716702 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-692d63e2-2d29-49b1-9ec6-ca17e5b1574f req-68e7c41f-e515-4b67-b869-dc4179726729 service nova] Creating event network-changed:8c525d96-458f-4e39-9f8e-fad48afa68d0 for instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a on n-h2-846219-10 Jul 20 10:50:21.724631 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-692d63e2-2d29-49b1-9ec6-ca17e5b1574f req-68e7c41f-e515-4b67-b869-dc4179726729 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078164 Jul 20 10:50:21.725675 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 575/1090] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:21.734359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:21.735396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a87dade9-92b8-4c8c-82b5-676ef7f3bcc6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:21.746789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.747636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.748779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.749766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.757226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:21.775735 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 could not be found. Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 HTTP/1.1 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 could not be found. Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a87dade9-92b8-4c8c-82b5-676ef7f3bcc6'} Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 could not be found. Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 could not be found. Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:21.796119 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 could not be found. Jul 20 10:50:21.801135 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:21.804454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:21.812398 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9c8b6117-46af-4ac2-8535-f385a04423dd tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6" status: 404 len: 111 microversion: 2.1 time: 0.078142 Jul 20 10:50:21.813334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 576/1091] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:21 2022] GET /compute/v2.1/servers/a87dade9-92b8-4c8c-82b5-676ef7f3bcc6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:21.822948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:21.824875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:21.838019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:21.840235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:21.843284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.847436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.851804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:21.852481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:21.878762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:21.939001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:22.155868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:22.169178 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fff10fa8-616b-436e-b694-dad5fe3afa3b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 204 len: 0 microversion: 2.1 time: 0.328454 Jul 20 10:50:22.174733 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 577/1092] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:21 2022] DELETE /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:22.180961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:22.191584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:22.194928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f0e7e13e-eb15-45b2-9acb-b8dd36169951 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1462 microversion: 2.1 time: 1.188601 Jul 20 10:50:22.198511 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 516/1093] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:21 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1462 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:22.221615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:22.222446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:22.225386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:22.226828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:22.229260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:22.230224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:22.246392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:22.248039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:22.251082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:22.252607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:22.313910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:22.450718 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b403d616-524d-492e-89a0-4106efd20e37 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 204 len: 0 microversion: 2.1 time: 0.249655 Jul 20 10:50:22.452070 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 517/1094] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:22 2022] DELETE /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:22.468505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:22.469230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:22.477058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:22.481975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:22.482694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:22.484099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:22.484816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:23.019849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:23.033979 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5338bc8f-b5f2-4f78-a363-a8d304ef6a68 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1304 microversion: 2.1 time: 0.856781 Jul 20 10:50:23.035265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 578/1095] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:22 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1304 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:23.054216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:23.055236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:23.075526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:23.076347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:23.077314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:23.078355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:23.207091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:23.217454 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a8479a71-d7b9-4268-98d3-34b5801137a0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1462 microversion: 2.1 time: 0.759464 Jul 20 10:50:23.223266 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 518/1096] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:22 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1462 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:23.228807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:23.238959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:23.255500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:23.261081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:23.262193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:23.262993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:23.612478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:23.629775 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-275dbcb6-c21b-4646-a068-afdcb4067ebb tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1475 microversion: 2.1 time: 0.580708 Jul 20 10:50:23.633768 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 579/1097] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:23 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:23.641080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-93ba444d-7fb8-4e0b-8700-f3f787833e05 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'create', calling method: .version_select at 0x7f2c3f9e9160>, body: {"keypair": {"name": "tempest-keypair-418046598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXMLe48ObkxeWTS0xBVQlT2JkfXKkEd9YFEOtGCT9KLa7N5JuDH/zv30kQevTFyys+uZ6KNg95ojoVeTMl6YAT2rMg6K3Ceeq3fUQCYwXUMxcQbYYFms2MvjeyaFpY84Q=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:23.660589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-93ba444d-7fb8-4e0b-8700-f3f787833e05 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:23.672144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-93ba444d-7fb8-4e0b-8700-f3f787833e05 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for user 14131c23a0e24e56bbf0ea1a167e256c and project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:23.707286 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-93ba444d-7fb8-4e0b-8700-f3f787833e05 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072051 Jul 20 10:50:23.708506 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 580/1098] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:50:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:23.755400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:23.778467 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-baae7447-18b5-42c8-9970-04b89b982d9d tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.553567 Jul 20 10:50:23.793418 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 519/1099] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:23 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:24.052709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:24.059409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:24.089562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:24.093965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:24.104439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:24.104895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:24.505310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2ce12e79-fd7e-4b56-9560-fabdf2721719 req-b8073456-740b-49fe-b4e3-49b1adda55b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:24.528241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2ce12e79-fd7e-4b56-9560-fabdf2721719 req-b8073456-740b-49fe-b4e3-49b1adda55b6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:24.530251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2ce12e79-fd7e-4b56-9560-fabdf2721719 req-b8073456-740b-49fe-b4e3-49b1adda55b6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:24.564451 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2ce12e79-fd7e-4b56-9560-fabdf2721719 req-b8073456-740b-49fe-b4e3-49b1adda55b6 service nova] Creating event network-changed:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h1-846219-10 Jul 20 10:50:24.575505 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2ce12e79-fd7e-4b56-9560-fabdf2721719 req-b8073456-740b-49fe-b4e3-49b1adda55b6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073844 Jul 20 10:50:24.576815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 520/1100] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:24.651112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:24.652095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:24.665215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:24.665925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:24.668031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:24.669534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:24.971369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:24.984593 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fb961234-e52d-42d5-a7eb-19e612fdce28 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 0.935803 Jul 20 10:50:24.985389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 581/1101] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:24 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:25.001017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:25.008721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:25.019137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:25.019876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:25.020878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:25.021485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:25.557292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:25.566310 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17c4c380-9656-4567-9625-ab93cf2adbe2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1475 microversion: 2.1 time: 0.919919 Jul 20 10:50:25.572682 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 521/1102] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:24 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1475 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:25.629653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:25.648218 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f9fb9f0-6994-4ea6-a571-fa3770263b94 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.661676 Jul 20 10:50:25.649473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 582/1103] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:24 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:26.005415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:26.006614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:26.019793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:26.020924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:26.024237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:26.028390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:26.589226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:26.589853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:26.603650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:26.604106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:26.604974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:26.605430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:27.433678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:27.446146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b72b2db-b65b-427d-8ec4-7cf2934c2964 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 1.444591 Jul 20 10:50:27.457938 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 522/1104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:25 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:27.485611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:27.486769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:27.496599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:27.498233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:27.501678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:27.502480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:28.601332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:28.611647 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d6eb893-9955-4019-b9d8-b14612894592 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1475 microversion: 2.1 time: 2.026025 Jul 20 10:50:28.618421 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 583/1105] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:26 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1475 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:28.629280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-25e97969-f80b-47ef-a6d0-82619e038283 req-e15edce4-bf02-40ca-945f-83dc849cad0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7853d70-d6d3-4beb-bff5-594f44c16beb", "name": "network-vif-deleted", "tag": "c570e27b-f54c-406c-aa54-34133e6d3bb5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:28.651067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-25e97969-f80b-47ef-a6d0-82619e038283 req-e15edce4-bf02-40ca-945f-83dc849cad0b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:28.651441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-25e97969-f80b-47ef-a6d0-82619e038283 req-e15edce4-bf02-40ca-945f-83dc849cad0b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:28.689027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-25e97969-f80b-47ef-a6d0-82619e038283 req-e15edce4-bf02-40ca-945f-83dc849cad0b service nova] Creating event network-vif-deleted:c570e27b-f54c-406c-aa54-34133e6d3bb5 for instance a7853d70-d6d3-4beb-bff5-594f44c16beb on n-h1-846219-10 Jul 20 10:50:28.734110 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-25e97969-f80b-47ef-a6d0-82619e038283 req-e15edce4-bf02-40ca-945f-83dc849cad0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109656 Jul 20 10:50:28.736095 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 584/1106] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:28.752021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:28.754886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:28.768836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:28.777374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:28.778674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:28.780300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:28.781367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:28.790259 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5e66ee5-1116-4c25-a300-a6089e7ce3e6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 1.329486 Jul 20 10:50:28.811571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 523/1107] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:27 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:29.212281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:29.227118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa704d5b-b884-4a93-b88f-addb9613aa3c tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 0.487798 Jul 20 10:50:29.227689 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 585/1108] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:28 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:29.669592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:29.671984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:29.687511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:29.688635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:29.690574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:29.691641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:29.825834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e9dde611-3757-4b02-b836-1806026d6ea9 req-d560ce5b-dee3-4abd-bb66-25b67a31827c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be79bf8-dce5-4535-8171-8b67b688223c", "name": "network-vif-deleted", "tag": "5ab052fc-41bd-403f-89a2-083ab8636f8a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:29.868214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e9dde611-3757-4b02-b836-1806026d6ea9 req-d560ce5b-dee3-4abd-bb66-25b67a31827c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:29.868549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e9dde611-3757-4b02-b836-1806026d6ea9 req-d560ce5b-dee3-4abd-bb66-25b67a31827c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:29.883804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e9dde611-3757-4b02-b836-1806026d6ea9 req-d560ce5b-dee3-4abd-bb66-25b67a31827c service nova] Creating event network-vif-deleted:5ab052fc-41bd-403f-89a2-083ab8636f8a for instance 2be79bf8-dce5-4535-8171-8b67b688223c on n-h2-846219-10 Jul 20 10:50:29.898425 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e9dde611-3757-4b02-b836-1806026d6ea9 req-d560ce5b-dee3-4abd-bb66-25b67a31827c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105132 Jul 20 10:50:29.899575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 586/1109] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:50:29.908824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:29.909822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:29.917249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:29.917955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:29.918572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:29.919047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:29.962522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:29.981801 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fbbe9ca4-790a-440f-b4cb-f85c6b3bc8a5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1433 microversion: 2.1 time: 0.354841 Jul 20 10:50:29.983122 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 524/1110] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:29 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1433 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:30.255859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:30.259439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:30.277067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:30.278217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:30.280021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:30.281063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:30.513361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:30.524864 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35a932ab-1110-46c2-86d1-a13e3a05b0e3 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.623083 Jul 20 10:50:30.526546 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 587/1111] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:29 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:30.786333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:30.800015 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ad5d96b-3e43-4d74-8a77-156606018fad tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 0.553831 Jul 20 10:50:30.801588 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 525/1112] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:30 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:30.884374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f5ac120-2f2c-4cd1-88fd-f3dab590574c tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '.version_select at 0x7f2c3f950ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:30.886921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f5ac120-2f2c-4cd1-88fd-f3dab590574c tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:30.887469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f5ac120-2f2c-4cd1-88fd-f3dab590574c tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:30.906314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:30.913238 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f5ac120-2f2c-4cd1-88fd-f3dab590574c tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.032323 Jul 20 10:50:30.914842 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 588/1113] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:50:30 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:30.935001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16d99070-a95e-4416-b5f6-4e41084e1695 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:30.943928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16d99070-a95e-4416-b5f6-4e41084e1695 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012187 Jul 20 10:50:30.944529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 526/1114] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:50:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:30.957231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-53701c4e-9762-47ca-85e8-a5d8ec19a126 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1369783399", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:30.959073 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:50:30.959073 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:50:30.990449 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-53701c4e-9762-47ca-85e8-a5d8ec19a126 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.038197 Jul 20 10:50:30.993000 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 589/1115] 10.222.0.79 () {60 vars in 1145 bytes} [Wed Jul 20 10:50:30 2022] POST /compute/v2.1/flavors => generated 499 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:50:31.001345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:31.002624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:31.011759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.012556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.012682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e6527916-54e4-493f-bb07-c0c4ea586461 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:31.013684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.014324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.031843 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e6527916-54e4-493f-bb07-c0c4ea586461 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026063 Jul 20 10:50:31.045774 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 590/1116] 10.222.0.79 () {58 vars in 1181 bytes} [Wed Jul 20 10:50:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:50:31.076374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.076845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.077360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lazy-loading 'fault' on Instance uuid 2be79bf8-dce5-4535-8171-8b67b688223c {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:50:31.138949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:31.155638 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-375c0bd2-71d6-486f-b4e6-6b05d8bac91a tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 200 len: 1309 microversion: 2.1 time: 0.158347 Jul 20 10:50:31.168489 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 527/1117] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:30 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 1309 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:31.241223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-57726001", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "13d401a5-c946-47eb-b3dd-c578559c5373"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:31.303922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:50:31.542952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:31.543813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:31.558228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.560537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.563758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.564315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.651548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:50:31.652366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:50:31.653083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:50:31.653499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:50:31.654074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:50:31.671282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:31.674320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.675102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.676152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.676754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.715975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:31.726542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for user 14131c23a0e24e56bbf0ea1a167e256c and project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:31.744282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:50:31.746918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:50:31.838801 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09aad44b-4955-4e4f-8588-d6f5bedc5ecc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605089 Jul 20 10:50:31.840237 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 591/1118] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:50:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:50:31.845698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:31.846507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:31.855869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.856582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.858170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:31.858822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:31.964365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:31.976721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d3b3257-a1c7-4bdf-b548-51839cc6def1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.436003 Jul 20 10:50:31.977518 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 528/1119] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:31 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:31.996236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef7f7472-2d55-43ae-a08d-06c0fe88ee50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.000125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef7f7472-2d55-43ae-a08d-06c0fe88ee50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:32.150791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef7f7472-2d55-43ae-a08d-06c0fe88ee50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:32.164146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef7f7472-2d55-43ae-a08d-06c0fe88ee50 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1277 microversion: 2.1 time: 0.184580 Jul 20 10:50:32.178411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 529/1120] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:31 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:32.185088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.186689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 2be79bf8-dce5-4535-8171-8b67b688223c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:32.199756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.200221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.201087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.201537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.225824 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance 2be79bf8-dce5-4535-8171-8b67b688223c could not be found. Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c HTTP/1.1 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2be79bf8-dce5-4535-8171-8b67b688223c could not be found. Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2be79bf8-dce5-4535-8171-8b67b688223c'} Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be79bf8-dce5-4535-8171-8b67b688223c could not be found. Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be79bf8-dce5-4535-8171-8b67b688223c could not be found. Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:32.230747 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be79bf8-dce5-4535-8171-8b67b688223c could not be found. Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.234897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance 2be79bf8-dce5-4535-8171-8b67b688223c could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:32.236057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e824a2b-c3cb-4f73-8b76-aae9fb888b75 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c" status: 404 len: 111 microversion: 2.1 time: 0.060451 Jul 20 10:50:32.241852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 530/1121] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:32 2022] GET /compute/v2.1/servers/2be79bf8-dce5-4535-8171-8b67b688223c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:32.253746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.255736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: a7853d70-d6d3-4beb-bff5-594f44c16beb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:32.272031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.272683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.275008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.275494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.302411 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance a7853d70-d6d3-4beb-bff5-594f44c16beb could not be found. Jul 20 10:50:32.303027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb HTTP/1.1 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance a7853d70-d6d3-4beb-bff5-594f44c16beb could not be found. Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a7853d70-d6d3-4beb-bff5-594f44c16beb'} Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7853d70-d6d3-4beb-bff5-594f44c16beb could not be found. Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7853d70-d6d3-4beb-bff5-594f44c16beb could not be found. Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:32.304429 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7853d70-d6d3-4beb-bff5-594f44c16beb could not be found. Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance a7853d70-d6d3-4beb-bff5-594f44c16beb could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78b0f458-e2b4-45f1-ac00-3a5cab75b832 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb" status: 404 len: 111 microversion: 2.1 time: 0.063158 Jul 20 10:50:32.313279 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 531/1122] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:32 2022] GET /compute/v2.1/servers/a7853d70-d6d3-4beb-bff5-594f44c16beb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:32.315381 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3bc20514-958e-40f0-9817-a6cc1f3b3c93 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 0.469133 Jul 20 10:50:32.315381 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 592/1123] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:31 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:32.319467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d13f007b-606c-475f-9cd6-014901b66c51 req-2ca1619c-6337-4218-aeb3-0e6fbf8ed1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df81c38-6b96-4e1f-b86c-e69acebd7e8a", "name": "network-vif-plugged", "status": "completed", "tag": "8c525d96-458f-4e39-9f8e-fad48afa68d0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:32.322042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-375568be-945b-4210-a0a6-ee173808e1ff tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.342157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d13f007b-606c-475f-9cd6-014901b66c51 req-2ca1619c-6337-4218-aeb3-0e6fbf8ed1cf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.343211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d13f007b-606c-475f-9cd6-014901b66c51 req-2ca1619c-6337-4218-aeb3-0e6fbf8ed1cf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.370512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-375568be-945b-4210-a0a6-ee173808e1ff tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/c7801ff6-e5f6-4bcd-8cf4-b7f7178f0053" status: 204 len: 0 microversion: 2.1 time: 0.052962 Jul 20 10:50:32.371785 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 593/1124] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:50:32 2022] DELETE /compute/v2.1/os-server-groups/c7801ff6-e5f6-4bcd-8cf4-b7f7178f0053 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:32.380677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.381920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d13f007b-606c-475f-9cd6-014901b66c51 req-2ca1619c-6337-4218-aeb3-0e6fbf8ed1cf service nova] Creating event network-vif-plugged:8c525d96-458f-4e39-9f8e-fad48afa68d0 for instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a on n-h2-846219-10 Jul 20 10:50:32.383245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:32.414114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d13f007b-606c-475f-9cd6-014901b66c51 req-2ca1619c-6337-4218-aeb3-0e6fbf8ed1cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105185 Jul 20 10:50:32.415490 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 532/1125] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:32.419992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.421513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.445863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.446684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.513042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:32.667495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7ad9ad3-0d24-4571-85d9-b1c4ee4af4b4 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 204 len: 0 microversion: 2.1 time: 0.291286 Jul 20 10:50:32.671752 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 594/1126] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:32 2022] DELETE /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 10:50:32.679034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.680816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:32.695732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.696186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.696970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.697406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.752824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:32.857933 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c56b10ef-72b9-4e3e-9cfd-19c5969b6c89 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 204 len: 0 microversion: 2.1 time: 0.183121 Jul 20 10:50:32.859491 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 533/1127] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:32 2022] DELETE /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:32.877100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.882596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:32.895217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.896265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.897910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:32.899188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:32.996780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:32.997500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:33.011402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:33.011853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:33.015555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:33.016205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:33.177294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:33.191914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2590ba88-6401-49ee-9234-f12c4fb6a24b tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 200 len: 1473 microversion: 2.1 time: 0.328307 Jul 20 10:50:33.192934 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 595/1128] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:32 2022] GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 1473 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:33.208565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:33.214683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:33.229275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:33.232324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:33.233353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:33.239302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:33.346044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:33.359427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02a599c9-5264-45ec-8a2a-d30099b35719 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1324 microversion: 2.1 time: 0.367674 Jul 20 10:50:33.359427 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 534/1129] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:32 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:33.375461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:33.376511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:33.392513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:33.392969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:33.393763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:33.394202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:33.423333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:33.434658 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e41c571c-3db1-46f7-9e10-4d8b6584621e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1281 microversion: 2.1 time: 0.229840 Jul 20 10:50:33.439873 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 596/1130] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:33 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:33.606932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:33.617623 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c92c15f8-a95d-47ee-9e33-f8848551b6fb tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 0.257934 Jul 20 10:50:33.618222 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 535/1131] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:33 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:34.210703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:34.212163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:34.235771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.236220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.237002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.237441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.488956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:34.500206 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2ca3c9af-87e9-4bac-a7cc-410200d72d27 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 200 len: 1473 microversion: 2.1 time: 0.293597 Jul 20 10:50:34.512078 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 536/1132] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:34 2022] GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:50:34.527192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:34.528228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:34.536006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13c8ce5a-5b55-4709-a73e-b07914311a7f tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f950430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-536322958", "description": "tempest-description-1596108560"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:34.541883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.542680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.543869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.544518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.843010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:34.855772 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5077fba7-b158-43cc-bb6b-c24877b2d3ae tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 200 len: 1521 microversion: 2.1 time: 0.342119 Jul 20 10:50:34.856410 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 537/1133] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:34 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:34.871751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:34.872485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:34.884727 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13c8ce5a-5b55-4709-a73e-b07914311a7f tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.869021 Jul 20 10:50:34.885468 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 597/1134] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:34 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:34.889666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.890252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.890945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.891417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.898866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:34.899469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:34.911703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.913241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:34.914336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:34.914872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:35.001503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:35.018512 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2350c43-fd42-49a7-bba0-fee208243237 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1281 microversion: 2.1 time: 0.159513 Jul 20 10:50:35.019113 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 538/1135] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:34 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:35.031281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'action', calling method: .version_select at 0x7f2c4e8cf940>, body: {"addFloatingIp": {"address": "172.25.0.92"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:35.034201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:35.045404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:35.046119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:35.047150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:35.047807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:35.145673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Acquired lock "refresh_cache-e9cc5cba-bbac-48ee-a745-858deddea463" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:50:35.275397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:35.284424 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-588c2ed3-5acd-4bd7-a000-5fd1bceae9f2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1292 microversion: 2.1 time: 0.390759 Jul 20 10:50:35.285009 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 598/1136] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:34 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1292 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:35.296991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-316a0e9e-a994-4807-9cc8-b952a3213542 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f953f70>, body: {"security_group_rule": {"parent_group_id": "d61a45f0-6dda-4883-83e1-021ed6181c6b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:35.947355 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-316a0e9e-a994-4807-9cc8-b952a3213542 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.657582 Jul 20 10:50:35.954772 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 599/1137] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 10:50:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:35.961595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:35.962221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:35.978697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:35.980782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:35.981628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:35.986011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:36.729719 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8dac2325-9f29-4b6b-96b4-6143f477ce45 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1860 microversion: 2.1 time: 0.773395 Jul 20 10:50:36.735674 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 600/1138] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:35 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1860 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:36.748549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:36.751339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:36.773944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:36.774933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:36.778030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:36.780576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:36.998577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:37.022129 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4bd9ba09-2bc4-44e7-bf19-6b0fddd302d5 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 200 len: 1431 microversion: 2.1 time: 0.283438 Jul 20 10:50:37.035718 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 601/1139] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:36 2022] GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 1431 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:37.086494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0135df31-7691-4078-8257-299643571f14 req-1bcac34c-4741-4ee9-a51d-e17ac11c1b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3b7d2-87d3-4486-b694-0a3a7fc27b61", "name": "network-vif-plugged", "status": "completed", "tag": "a755841b-df0e-4f06-88dd-4cb10308ea11"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:37.150507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0135df31-7691-4078-8257-299643571f14 req-1bcac34c-4741-4ee9-a51d-e17ac11c1b55 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:37.151406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0135df31-7691-4078-8257-299643571f14 req-1bcac34c-4741-4ee9-a51d-e17ac11c1b55 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:37.204682 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0135df31-7691-4078-8257-299643571f14 req-1bcac34c-4741-4ee9-a51d-e17ac11c1b55 service nova] Creating event network-vif-plugged:a755841b-df0e-4f06-88dd-4cb10308ea11 for instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 on n-h2-846219-10 Jul 20 10:50:37.230416 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0135df31-7691-4078-8257-299643571f14 req-1bcac34c-4741-4ee9-a51d-e17ac11c1b55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192315 Jul 20 10:50:37.244289 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 602/1140] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:37.282381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b570eedd-82c8-44b1-baaa-b29cc3e58040 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f9e93a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1815415043", "description": "tempest-description-448862441"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:37.817595 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b570eedd-82c8-44b1-baaa-b29cc3e58040 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.569179 Jul 20 10:50:37.818244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 603/1141] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:37.823506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:37.824506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:37.836996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:37.837457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:37.838759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:37.839864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:38.786727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Building network info cache for instance {{(pid=125886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:50:39.517192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:39.562086 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e59b02d-b0db-4446-817b-e287428636fd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1377 microversion: 2.1 time: 1.726947 Jul 20 10:50:39.564676 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 604/1142] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:37 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1377 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:39.586511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:39.587538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:39.605390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:39.607332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:39.608626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:39.609260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.124612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:40.156336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-95c3882d-2f75-48ba-ae25-2bb0e6537c21 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1482 microversion: 2.1 time: 0.589730 Jul 20 10:50:40.163017 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 605/1143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:39 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1482 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:40.290357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55f9b8b0-af74-44bb-a358-32a27bf65819 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Action: 'create', calling method: .version_select at 0x7f2c3f9093a0>, body: {"keypair": {"name": "tempest-keypair-1288643104", "type": "ssh", "user_id": "e8b73fea671d441b8abd529cc30ebad5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOA80kTh2E+yefqb222wJY2EanOU9v6Ia61ZP/Kgjha51q58p0rMxE4CmD7F8C6KKMkeghUTW1nzVGjJXeuWCHEnq5ildgoMpah50ZYRCm1nJCGgYaF4nD7T92g/LiOq4w=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:40.294435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Updating instance_info_cache with network_info: [{"id": "f6427aac-c6de-4363-bde5-e03207bdb82e", "address": "fa:16:3e:cd:6f:76", "network": {"id": "d931b5cb-b761-4e06-bc63-67e23c443217", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1368686924-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17bd54737b7a466ea634c0cfbfc0782e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf6427aac-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:50:40.310018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=39 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:40.315757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-55f9b8b0-af74-44bb-a358-32a27bf65819 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Getting quotas for project 1b4c2c14495f4d28911b3975ce3f20fe. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:40.325498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-55f9b8b0-af74-44bb-a358-32a27bf65819 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Getting quotas for user a8638726dda54cdfb5e62deee8d60f58 and project 1b4c2c14495f4d28911b3975ce3f20fe. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:40.327258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Releasing lock "refresh_cache-e9cc5cba-bbac-48ee-a745-858deddea463" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:50:40.330364 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6da9a85c-1d01-4d56-b05a-732ea87c7e67 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action" status: 202 len: 0 microversion: 2.1 time: 5.306811 Jul 20 10:50:40.331249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:40.332650 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 539/1144] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:35 2022] POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action => generated 0 bytes in 5311 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:50:40.351999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-10", "block_migration": true, "disk_over_commit": false}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:40.357115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:40.377223 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55f9b8b0-af74-44bb-a358-32a27bf65819 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.211740 Jul 20 10:50:40.378488 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 606/1145] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 10:50:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 10:50:40.386888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a5a46e4c-68c9-4af3-8e58-2dc0043c9d84 req-70a83c78-d775-42c9-9dda-ef2c6d409821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd8a1f5-0da1-47f2-8767-dd476d919da5", "name": "network-vif-deleted", "tag": "0033d629-ebb8-49e1-8ce2-712fe79ed7c5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:40.391783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.392650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.394026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.395916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.403688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a5a46e4c-68c9-4af3-8e58-2dc0043c9d84 req-70a83c78-d775-42c9-9dda-ef2c6d409821 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.404945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a5a46e4c-68c9-4af3-8e58-2dc0043c9d84 req-70a83c78-d775-42c9-9dda-ef2c6d409821 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.422127 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a5a46e4c-68c9-4af3-8e58-2dc0043c9d84 req-70a83c78-d775-42c9-9dda-ef2c6d409821 service nova] Creating event network-vif-deleted:0033d629-ebb8-49e1-8ce2-712fe79ed7c5 for instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 on n-h1-846219-10 Jul 20 10:50:40.428894 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a5a46e4c-68c9-4af3-8e58-2dc0043c9d84 req-70a83c78-d775-42c9-9dda-ef2c6d409821 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047966 Jul 20 10:50:40.430040 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 607/1146] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:40.431236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lazy-loading 'flavor' on Instance uuid f1d6eb03-c865-4b85-94fa-f0071dc885da {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:50:40.435925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38c7c509-d265-4f9b-98a5-93b73ddec73e tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f909430>, body: {"security_group_rule": {"parent_group_id": "8f9e2095-7611-461d-b9eb-9008165555a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:40.445923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Going to try to live migrate instance to n-h1-846219-10 {{(pid=125886) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:50:40.720920 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38c7c509-d265-4f9b-98a5-93b73ddec73e tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.289043 Jul 20 10:50:40.727047 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 608/1147] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 10:50:40 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:40.745907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:40.746917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: fdd8a1f5-0da1-47f2-8767-dd476d919da5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:40.772696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.773336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.774593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.775350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.804098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 could not be found. Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 HTTP/1.1 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 could not be found. Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fdd8a1f5-0da1-47f2-8767-dd476d919da5'} Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 could not be found. Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 could not be found. Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:40.806758 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 could not be found. Jul 20 10:50:40.811632 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:40.814850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance fdd8a1f5-0da1-47f2-8767-dd476d919da5 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:40.816227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3cece82f-1630-41d6-9e4a-e8565c3af099 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5" status: 404 len: 111 microversion: 2.1 time: 0.088161 Jul 20 10:50:40.816938 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 609/1148] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:40 2022] GET /compute/v2.1/servers/fdd8a1f5-0da1-47f2-8767-dd476d919da5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:40.822878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c3f12d2c-0f7c-4ea1-b535-d9944a210f4d req-adf6d621-f723-40b7-973a-7c4c193937e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11dc629c-81a7-45b0-93b7-fd3f394e0d8d", "name": "network-vif-deleted", "tag": "bbc6b72f-9345-49ed-9f5b-83aba0b1d14d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:40.834621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c3f12d2c-0f7c-4ea1-b535-d9944a210f4d req-adf6d621-f723-40b7-973a-7c4c193937e7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.835441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c3f12d2c-0f7c-4ea1-b535-d9944a210f4d req-adf6d621-f723-40b7-973a-7c4c193937e7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.852134 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c3f12d2c-0f7c-4ea1-b535-d9944a210f4d req-adf6d621-f723-40b7-973a-7c4c193937e7 service nova] Creating event network-vif-deleted:bbc6b72f-9345-49ed-9f5b-83aba0b1d14d for instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d on n-h1-846219-10 Jul 20 10:50:40.857450 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c3f12d2c-0f7c-4ea1-b535-d9944a210f4d req-adf6d621-f723-40b7-973a-7c4c193937e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Jul 20 10:50:40.858496 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 610/1149] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:40.869184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:40.870044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:40.877300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.878447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:40.880129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:40.881803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:41.086745 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-be241825-751e-4196-9b48-60e584a90cc3 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.226467 Jul 20 10:50:41.087202 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 611/1150] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:50:40 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:41.091999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'action', calling method: .version_select at 0x7f2c4e8d1940>, body: {"addFloatingIp": {"address": "172.25.0.92"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:41.093144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:41.103099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:41.103928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:41.105256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:41.109393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:41.291237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Acquired lock "refresh_cache-6df81c38-6b96-4e1f-b86c-e69acebd7e8a" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:50:41.694169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:42.156440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:44.064468 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.network.neutron [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] re-assign floating IP 172.25.0.92 from instance e9cc5cba-bbac-48ee-a745-858deddea463 Jul 20 10:50:44.110813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Building network info cache for instance {{(pid=125885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:50:44.624184 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-af31299e-3431-40af-b7de-1b69865c9ada tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/action" status: 202 len: 0 microversion: 2.1 time: 4.288520 Jul 20 10:50:44.628552 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 540/1151] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:40 2022] POST /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/action => generated 0 bytes in 4295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:44.635250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e8d38a3-617e-41c0-ac1d-5bd01fa8c77b tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Action: 'create', calling method: .version_select at 0x7f2c3f462790>, body: {"keypair": {"name": "tempest-keypair-1791834164", "type": "ssh", "user_id": "e8b73fea671d441b8abd529cc30ebad5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLF/uszMq3kVZ4CXbLwPQuUAJZX5U9KccqDjxM7v6TFYNyT9rAwBu0WNVywZWaPtX8YElD0SrldunB8cETtRE3ebzlD1J3u5W/hK+5KrZRACAtEdFQlt0xjh/qEAMgQCA=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:44.657480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-8e8d38a3-617e-41c0-ac1d-5bd01fa8c77b tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Getting quotas for project 1b4c2c14495f4d28911b3975ce3f20fe. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:44.672692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-8e8d38a3-617e-41c0-ac1d-5bd01fa8c77b tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Getting quotas for user a8638726dda54cdfb5e62deee8d60f58 and project 1b4c2c14495f4d28911b3975ce3f20fe. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:44.703931 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e8d38a3-617e-41c0-ac1d-5bd01fa8c77b tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.073660 Jul 20 10:50:44.704601 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 541/1152] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 10:50:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 10:50:44.709401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:44.710476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:44.719747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:44.720364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:44.721611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:44.722077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:44.795597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Updating instance_info_cache with network_info: [{"id": "f6427aac-c6de-4363-bde5-e03207bdb82e", "address": "fa:16:3e:cd:6f:76", "network": {"id": "d931b5cb-b761-4e06-bc63-67e23c443217", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1368686924-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17bd54737b7a466ea634c0cfbfc0782e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf6427aac-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:50:44.821971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Building network info cache for instance {{(pid=125885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:50:45.084974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:45.100618 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ea4fa66-fcdf-4138-b2fd-4e029464fe08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1377 microversion: 2.1 time: 0.393759 Jul 20 10:50:45.103916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 542/1153] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:44 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1377 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:45.110198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17da1671-105f-4047-8e71-04456cb02b04 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f2a6af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-79297812", "description": "tempest-description-774272401"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:45.773028 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17da1671-105f-4047-8e71-04456cb02b04 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.665545 Jul 20 10:50:45.781756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 543/1154] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:45 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:45.790100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:45.790766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 11dc629c-81a7-45b0-93b7-fd3f394e0d8d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:45.809920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:45.810465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:45.811509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:45.812356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:45.827948 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d could not be found. Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d HTTP/1.1 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d could not be found. Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '11dc629c-81a7-45b0-93b7-fd3f394e0d8d'} Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d could not be found. Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d could not be found. Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:45.829933 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d could not be found. Jul 20 10:50:45.834505 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:45.836638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance 11dc629c-81a7-45b0-93b7-fd3f394e0d8d could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:45.841774 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6286ba0b-2961-4184-a0f5-860ce3b204c6 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d" status: 404 len: 111 microversion: 2.1 time: 0.054269 Jul 20 10:50:45.841774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 544/1155] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:45 2022] GET /compute/v2.1/servers/11dc629c-81a7-45b0-93b7-fd3f394e0d8d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:45.848136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:45.848752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:45.856019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:45.856472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:45.857309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:45.857659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:45.964276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Updating instance_info_cache with network_info: [{"id": "8c525d96-458f-4e39-9f8e-fad48afa68d0", "address": "fa:16:3e:a9:7e:88", "network": {"id": "d931b5cb-b761-4e06-bc63-67e23c443217", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1368686924-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17bd54737b7a466ea634c0cfbfc0782e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c525d96-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:50:46.008150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Releasing lock "refresh_cache-6df81c38-6b96-4e1f-b86c-e69acebd7e8a" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:50:46.014208 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-607dcd6a-aa75-4b25-bb04-4caa035e6cef tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a/action" status: 202 len: 0 microversion: 2.1 time: 4.922085 Jul 20 10:50:46.029712 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 612/1156] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:41 2022] POST /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a/action => generated 0 bytes in 4942 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:50:46.040230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-db56333b-3631-43ce-affe-d2863c93b984 req-20b7595a-9f6c-466b-9ac1-9a4f89fe54c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}, {"name": "network-changed", "server_uuid": "ffc3b7d2-87d3-4486-b694-0a3a7fc27b61", "tag": "a755841b-df0e-4f06-88dd-4cb10308ea11"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:46.046161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:46.058660 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d679239-7c98-4584-8556-512e280e46c2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1482 microversion: 2.1 time: 0.217774 Jul 20 10:50:46.059611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 545/1157] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:45 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1482 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:46.062086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-db56333b-3631-43ce-affe-d2863c93b984 req-20b7595a-9f6c-466b-9ac1-9a4f89fe54c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.062921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-db56333b-3631-43ce-affe-d2863c93b984 req-20b7595a-9f6c-466b-9ac1-9a4f89fe54c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.070216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:46.073402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-02278a70-4a0e-450a-927c-9dd2933bdd32 req-3cf2862b-3f6e-4c6b-ae2d-11ba04a89905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:46.087576 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-db56333b-3631-43ce-affe-d2863c93b984 req-20b7595a-9f6c-466b-9ac1-9a4f89fe54c7 service nova] Creating event network-changed:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:50:46.088252 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-db56333b-3631-43ce-affe-d2863c93b984 req-20b7595a-9f6c-466b-9ac1-9a4f89fe54c7 service nova] Creating event network-changed:a755841b-df0e-4f06-88dd-4cb10308ea11 for instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 on n-h2-846219-10 Jul 20 10:50:46.089221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-02278a70-4a0e-450a-927c-9dd2933bdd32 req-3cf2862b-3f6e-4c6b-ae2d-11ba04a89905 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.089828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-02278a70-4a0e-450a-927c-9dd2933bdd32 req-3cf2862b-3f6e-4c6b-ae2d-11ba04a89905 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.096017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:46.104467 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-db56333b-3631-43ce-affe-d2863c93b984 req-20b7595a-9f6c-466b-9ac1-9a4f89fe54c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073198 Jul 20 10:50:46.105667 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 613/1158] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:46.112776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:46.113965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:46.124859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.125687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.135460 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-02278a70-4a0e-450a-927c-9dd2933bdd32 req-3cf2862b-3f6e-4c6b-ae2d-11ba04a89905 service nova] Creating event network-changed:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:50:46.139830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.142279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.144659 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-02278a70-4a0e-450a-927c-9dd2933bdd32 req-3cf2862b-3f6e-4c6b-ae2d-11ba04a89905 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082816 Jul 20 10:50:46.152027 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 546/1159] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:46.176144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cdaaa82f-4ed0-46ff-89c3-aa96ffe2b27a tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Calling method '.version_select at 0x7f2c3f41ec10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:46.198150 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cdaaa82f-4ed0-46ff-89c3-aa96ffe2b27a tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1288643104?user_id=e8b73fea671d441b8abd529cc30ebad5" status: 200 len: 513 microversion: 2.10 time: 0.044488 Jul 20 10:50:46.199204 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 547/1160] 10.222.0.79 () {60 vars in 1339 bytes} [Wed Jul 20 10:50:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1288643104?user_id=e8b73fea671d441b8abd529cc30ebad5 => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:50:46.205404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9f2c4a5-f5af-4f6a-a03c-4841f6a10189 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f2a6820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1938554093", "description": "tempest-description-50511657"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:46.425157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:46.439298 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf319fc9-665c-45aa-8fa9-5418d53e7a55 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.332124 Jul 20 10:50:46.453063 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 614/1161] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:46 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:46.466007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2afde412-8568-42b0-ab8b-ce7889703dc2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:46.545509 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d9f2c4a5-f5af-4f6a-a03c-4841f6a10189 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.343870 Jul 20 10:50:46.546784 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 548/1162] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:46.553551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'action', calling method: .version_select at 0x7f2c4e8cfe50>, body: {"removeFloatingIp": {"address": "172.25.0.92"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:46.554151 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2afde412-8568-42b0-ab8b-ce7889703dc2 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/96edb646-1686-4fd1-8062-c44bd883172b" status: 204 len: 0 microversion: 2.1 time: 0.095392 Jul 20 10:50:46.555697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 615/1163] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:50:46 2022] DELETE /compute/v2.1/os-server-groups/96edb646-1686-4fd1-8062-c44bd883172b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:46.569728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:46.570354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:46.588388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.588855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.595258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.596080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.812334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:46.829924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.830840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.832072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:46.832671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:46.902786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:46.913603 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-64791e29-71d8-4dbf-9f13-c1c341e47977 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1377 microversion: 2.1 time: 0.354619 Jul 20 10:50:46.914804 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 616/1164] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:46 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1377 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:46.920174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8b217da-b628-4454-a361-ec55cdcf9a38 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Action: 'create', calling method: .version_select at 0x7f2c3f9535e0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-393816769", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImiviQ76qRV0FqJlNa8bESRdaXos6AuzhO0EitaQ2XGPA8jGuYT/ls0S0M80AHizDKZR2msXpzdAS+/MJX0VZOmhYcu5YMKNdODDc/NSagDugyWQD91wK3gbSXqa8uA8Q=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:46.938265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-e8b217da-b628-4454-a361-ec55cdcf9a38 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Getting quotas for project 1b4c2c14495f4d28911b3975ce3f20fe. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:46.946806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-e8b217da-b628-4454-a361-ec55cdcf9a38 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Getting quotas for user a8638726dda54cdfb5e62deee8d60f58 and project 1b4c2c14495f4d28911b3975ce3f20fe. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:46.980070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8b217da-b628-4454-a361-ec55cdcf9a38 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.063302 Jul 20 10:50:46.981080 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 617/1165] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 10:50:46 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 10:50:46.987512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28309304-df6e-4d1b-a90a-67cc7cdae2d2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f950820>, body: {"security_group_rule": {"parent_group_id": "681bf449-4415-48c7-940e-ae01c96d24dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6091ed5e-70db-460f-ad7d-371fd87f959c"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:47.278081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] HTTP exception thrown: Floating IP 172.25.0.92 is not associated with instance e9cc5cba-bbac-48ee-a745-858deddea463. Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Request method failure captured: Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action HTTP/1.1 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 48 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi193Hkz9LAY28k0TtP4lCoWfXP221qSnezGu1WkPzKP0Aw2vSnoENJ3gsDfNrIy_kuWUov81NhvdPXx3Gnxje9GTiitT45r8XkuBy7UqcaCAeSSH13CHZYg2NiPUk7FtL5cGL_GDfSBbI8YKpxZk3Dip2kjDbFlSUHSMCljKjBHx_1zA Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_17bd54737b7a466ea634c0cfbfc0782e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 5683bc7a0b854d5a9779dcec39185812 Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: {"removeFloatingIp": {"address": "172.25.0.92"}} Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: exception: Floating IP 172.25.0.92 is not associated with instance e9cc5cba-bbac-48ee-a745-858deddea463. Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e9cc5cba-bbac-48ee-a745-858deddea463', 'body': {'removeFloatingIp': {'address': '172.25.0.92'}}} Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.92 is not associated with instance e9cc5cba-bbac-48ee-a745-858deddea463. Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.92 is not associated with instance e9cc5cba-bbac-48ee-a745-858deddea463. Jul 20 10:50:47.281183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:50:47.291462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Returning 409 to user: Floating IP 172.25.0.92 is not associated with instance e9cc5cba-bbac-48ee-a745-858deddea463. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:47.293165 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e1591d2c-8899-4dff-87cc-e698ef245f0a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action" status: 409 len: 145 microversion: 2.1 time: 0.744479 Jul 20 10:50:47.294702 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 549/1166] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:46 2022] POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action => generated 145 bytes in 747 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:50:47.305169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:47.306323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:47.321122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:47.322270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:47.324704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:47.325549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:47.381093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:47.499876 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28309304-df6e-4d1b-a90a-67cc7cdae2d2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.517073 Jul 20 10:50:47.500855 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 618/1167] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 10:50:46 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:47.517463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2dca0699-ead9-413c-a6a7-aa790ee7d874 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Calling method '.version_select at 0x7f2c3f909820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:47.529241 n-d-846219-10 devstack@n-api.service[125885]: WARNING oslo_db.sqlalchemy.utils [None req-2dca0699-ead9-413c-a6a7-aa790ee7d874 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 10:50:47.547038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2dca0699-ead9-413c-a6a7-aa790ee7d874 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs?user_id=e8b73fea671d441b8abd529cc30ebad5" status: 200 len: 726 microversion: 2.10 time: 0.044330 Jul 20 10:50:47.548720 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-060d14bb-2f15-4f5a-b67b-8980e44abf35 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 204 len: 0 microversion: 2.1 time: 0.251741 Jul 20 10:50:47.549442 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 550/1168] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:47 2022] DELETE /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:47.557974 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 619/1169] 10.222.0.79 () {60 vars in 1258 bytes} [Wed Jul 20 10:50:47 2022] GET /compute/v2.1/os-keypairs?user_id=e8b73fea671d441b8abd529cc30ebad5 => generated 726 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:50:47.564590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.92"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:47.567204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:47.573233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:47.593382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:47.594145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:47.595517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:47.596287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:47.875313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:47.886786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:47.892667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e747dfca-710e-4269-a0ea-b418417590ad tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.331120 Jul 20 10:50:47.896489 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 620/1170] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:47 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:47.898167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:47.898593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:47.899410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:47.899848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:47.906157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69f55fe2-5001-4825-89bf-2af50090c287 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f953d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-72956560", "description": "tempest-description-506079788"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:48.289247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Acquired lock "refresh_cache-6df81c38-6b96-4e1f-b86c-e69acebd7e8a" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:50:48.311310 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69f55fe2-5001-4825-89bf-2af50090c287 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.413094 Jul 20 10:50:48.312520 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 621/1171] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:47 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:48.324163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:48.325089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:48.332881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:48.333524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:48.334427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:48.335786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:48.618582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:48.632036 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e950d87a-e02c-4b48-a651-ad5ff9ccbb64 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1472 microversion: 2.1 time: 0.313274 Jul 20 10:50:48.642183 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 622/1172] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:48 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:48.642183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b31cae49-bb0d-4bb0-9301-40bf6c7000cf tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Calling method '.version_select at 0x7f2c3f950ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:48.661167 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b31cae49-bb0d-4bb0-9301-40bf6c7000cf tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-393816769" status: 204 len: 0 microversion: 2.10 time: 0.026364 Jul 20 10:50:48.661766 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 623/1173] 10.222.0.79 () {60 vars in 1321 bytes} [Wed Jul 20 10:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-393816769 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:50:48.670385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:48.670961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:48.677987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:48.678472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:48.679298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:48.679751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:48.938055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:48.947848 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-06888177-20ad-4151-b61b-7b2ccd3b5947 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1377 microversion: 2.1 time: 0.281368 Jul 20 10:50:48.948826 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 624/1174] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:48 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1377 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:48.963470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3870811b-109d-4c88-b88c-8142633532e6 req-798606a0-1489-4942-b942-4a19c7be2e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "name": "network-vif-plugged", "status": "completed", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:48.980105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3870811b-109d-4c88-b88c-8142633532e6 req-798606a0-1489-4942-b942-4a19c7be2e49 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:48.981920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3870811b-109d-4c88-b88c-8142633532e6 req-798606a0-1489-4942-b942-4a19c7be2e49 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:49.003719 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3870811b-109d-4c88-b88c-8142633532e6 req-798606a0-1489-4942-b942-4a19c7be2e49 service nova] Creating event network-vif-plugged:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:50:49.012895 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3870811b-109d-4c88-b88c-8142633532e6 req-798606a0-1489-4942-b942-4a19c7be2e49 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062343 Jul 20 10:50:49.020839 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 625/1175] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:49.029471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0bc4ebd2-5ff8-427f-ad07-dfee478652c5 req-8fc05ae4-5b71-4333-a8b8-f845956cfbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}, {"name": "network-changed", "server_uuid": "6df81c38-6b96-4e1f-b86c-e69acebd7e8a", "tag": "8c525d96-458f-4e39-9f8e-fad48afa68d0"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:49.042063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0bc4ebd2-5ff8-427f-ad07-dfee478652c5 req-8fc05ae4-5b71-4333-a8b8-f845956cfbc6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:49.043215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0bc4ebd2-5ff8-427f-ad07-dfee478652c5 req-8fc05ae4-5b71-4333-a8b8-f845956cfbc6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:49.085214 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0bc4ebd2-5ff8-427f-ad07-dfee478652c5 req-8fc05ae4-5b71-4333-a8b8-f845956cfbc6 service nova] Creating event network-changed:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:50:49.088588 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0bc4ebd2-5ff8-427f-ad07-dfee478652c5 req-8fc05ae4-5b71-4333-a8b8-f845956cfbc6 service nova] Creating event network-changed:8c525d96-458f-4e39-9f8e-fad48afa68d0 for instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a on n-h2-846219-10 Jul 20 10:50:49.111637 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0bc4ebd2-5ff8-427f-ad07-dfee478652c5 req-8fc05ae4-5b71-4333-a8b8-f845956cfbc6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088074 Jul 20 10:50:49.112967 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 626/1176] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:49.123211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d78bc96-65a1-4e5d-9fa8-b13b3d264e23 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f8441f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1604699727", "description": "tempest-description-1147191428"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:49.646092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Building network info cache for instance {{(pid=125886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:50:49.706687 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d78bc96-65a1-4e5d-9fa8-b13b3d264e23 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.591447 Jul 20 10:50:49.707323 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 627/1177] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:49 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:49.714116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba4202e2-c96f-4cfe-a261-4b2636a0cc19 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Calling method '.version_select at 0x7f2c3f9f2790>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:49.765468 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba4202e2-c96f-4cfe-a261-4b2636a0cc19 tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791834164?user_id=e8b73fea671d441b8abd529cc30ebad5" status: 204 len: 0 microversion: 2.10 time: 0.056382 Jul 20 10:50:49.767234 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 628/1178] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:50:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791834164?user_id=e8b73fea671d441b8abd529cc30ebad5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:50:49.775939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:49.779275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:49.801367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:49.804683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:49.811128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:49.811853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:50.081443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:50.101752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ad67c0a-508a-4d33-a326-7644b40e5d86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.333113 Jul 20 10:50:50.113947 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 629/1179] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:49 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:50.119619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:50.120246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:50.138449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:50.138928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:50.139767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:50.140210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:50.278170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec069dcf98464793c8b5822c40616b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abca5f8615aa4063b091fcfde64a48aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:50.289744 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-def126d6-2cf1-4334-b959-d3d1776ee98d tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 200 len: 1430 microversion: 2.1 time: 0.174547 Jul 20 10:50:50.290344 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 630/1180] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:50 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 1430 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:50.307321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1278251e-2d57-44dd-ae9e-dcfb9bbb75a6 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f90d430>, body: {"security_group_rule": {"parent_group_id": "0071f8d1-9c96-4f1b-a223-f757f6e446e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "33cbfdaf-f316-4b95-a096-2ee9a1cac0f1"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:51.441642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Updating instance_info_cache with network_info: [{"id": "8c525d96-458f-4e39-9f8e-fad48afa68d0", "address": "fa:16:3e:a9:7e:88", "network": {"id": "d931b5cb-b761-4e06-bc63-67e23c443217", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1368686924-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17bd54737b7a466ea634c0cfbfc0782e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8c525d96-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:50:51.463640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Releasing lock "refresh_cache-6df81c38-6b96-4e1f-b86c-e69acebd7e8a" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:50:51.466104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-954c0984-b447-4c25-9663-ed6cbb9eb810 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a/action" status: 202 len: 0 microversion: 2.1 time: 3.909132 Jul 20 10:50:51.468286 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 551/1181] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:47 2022] POST /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a/action => generated 0 bytes in 3918 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:50:51.476913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fa72ed0e-b41d-43d2-b017-598d5d29de0d tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] Calling method '.version_select at 0x7f2c3f2a64c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:51.500907 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fa72ed0e-b41d-43d2-b017-598d5d29de0d tempest-KeyPairsV210TestJSON-767789676 tempest-KeyPairsV210TestJSON-767789676-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288643104?user_id=e8b73fea671d441b8abd529cc30ebad5" status: 204 len: 0 microversion: 2.10 time: 0.030972 Jul 20 10:50:51.509755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 552/1182] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288643104?user_id=e8b73fea671d441b8abd529cc30ebad5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:50:51.516968 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1278251e-2d57-44dd-ae9e-dcfb9bbb75a6 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.225012 Jul 20 10:50:51.517673 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 631/1183] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 10:50:50 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:51.524096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:51.524703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:51.532348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:51.532985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:51.540865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.541305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.545038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.545038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.551888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.553071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.553977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.554425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.835955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:51.837425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:51.848836 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c0089e3-a3b2-4b1f-ae8e-22c312b7e06e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.329826 Jul 20 10:50:51.858998 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a58a806-dba2-4eb9-b870-7c27d5906117 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1527 microversion: 2.1 time: 0.334024 Jul 20 10:50:51.858998 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 553/1184] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:51 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1527 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:51.860493 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 632/1185] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:51 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:51.861222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5fd3043f-021a-4e68-a2ac-b21dad076ea0 req-18698416-dfe7-4434-9287-a4ed3e918883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df81c38-6b96-4e1f-b86c-e69acebd7e8a", "tag": "8c525d96-458f-4e39-9f8e-fad48afa68d0"}, {"server_uuid": "9bfeb30c-e126-4abd-9c33-c2ae07eec3e7", "name": "network-vif-deleted", "tag": "9e7bc227-f680-4766-b539-3d8116769482"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:51.867332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:51.868227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] [instance: 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:51.877446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.878190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.879284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.880005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.884342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5fd3043f-021a-4e68-a2ac-b21dad076ea0 req-18698416-dfe7-4434-9287-a4ed3e918883 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.884807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5fd3043f-021a-4e68-a2ac-b21dad076ea0 req-18698416-dfe7-4434-9287-a4ed3e918883 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.897425 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] HTTP exception thrown: Instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 could not be found. Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Request method failure captured: Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 HTTP/1.1 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19z5XNEIx1r2lcd9-kxe5J1AA0FKNdqnBl6L5TXhZj9WwC3cW6J5XVlWq7r4-pmrqyShRXll472LifjeRXCkGsawBO7nDBIqzx2bNNwXfCqObIydmM2s92go6toFxbsUMp0WTzZFB614De2paB4w434U44U2WyuoRz3ghkCPL6k0yLE Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_abca5f8615aa4063b091fcfde64a48aa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/abca5f8615aa4063b091fcfde64a48aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: abca5f8615aa4063b091fcfde64a48aa Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-59931435 Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 20ec069dcf98464793c8b5822c40616b Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersOnMultiNodesTest-59931435-project Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 could not be found. Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9bfeb30c-e126-4abd-9c33-c2ae07eec3e7'} Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 could not be found. Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 could not be found. Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:50:51.899394 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 could not be found. Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] Returning 404 to user: Instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:50:51.906633 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a346567-a25b-40d1-87e7-c781107cf984 tempest-ServersOnMultiNodesTest-59931435 tempest-ServersOnMultiNodesTest-59931435-project] 10.222.0.79 "GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7" status: 404 len: 111 microversion: 2.1 time: 0.038973 Jul 20 10:50:51.908714 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 633/1186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:51 2022] GET /compute/v2.1/servers/9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:50:51.913223 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5fd3043f-021a-4e68-a2ac-b21dad076ea0 req-18698416-dfe7-4434-9287-a4ed3e918883 service nova] Creating event network-changed:8c525d96-458f-4e39-9f8e-fad48afa68d0 for instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a on n-h2-846219-10 Jul 20 10:50:51.914427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5fd3043f-021a-4e68-a2ac-b21dad076ea0 req-18698416-dfe7-4434-9287-a4ed3e918883 service nova] Creating event network-vif-deleted:9e7bc227-f680-4766-b539-3d8116769482 for instance 9bfeb30c-e126-4abd-9c33-c2ae07eec3e7 on n-h2-846219-10 Jul 20 10:50:51.920689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:51.922745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:51.923196 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5fd3043f-021a-4e68-a2ac-b21dad076ea0 req-18698416-dfe7-4434-9287-a4ed3e918883 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068935 Jul 20 10:50:51.924972 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 554/1187] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:51.933179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff98e0c8-373f-40b4-a564-509161d09733 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f41e4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:51.937218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.953509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.954868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:51.958928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:51.998349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:50:52.153927 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bbe6c6fc-7204-441f-926f-e007e48f64e1 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 204 len: 0 microversion: 2.1 time: 0.243139 Jul 20 10:50:52.155229 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 634/1188] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:51 2022] DELETE /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:50:52.167415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:52.169008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:52.178325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:52.179369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:52.180372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:52.181016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:52.390131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff98e0c8-373f-40b4-a564-509161d09733 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/33cbfdaf-f316-4b95-a096-2ee9a1cac0f1" status: 202 len: 0 microversion: 2.1 time: 0.463603 Jul 20 10:50:52.390805 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 555/1189] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:50:51 2022] DELETE /compute/v2.1/os-security-groups/33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:52.398263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.92"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:52.401710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:52.410224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:52.428668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:52.429824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:52.432123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:52.434762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:52.450297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:52.461733 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69baa2b1-56dd-4043-b466-6919d8536877 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1527 microversion: 2.1 time: 0.304358 Jul 20 10:50:52.478490 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 635/1190] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:52 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1527 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:52.485320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Acquired lock "refresh_cache-e9cc5cba-bbac-48ee-a745-858deddea463" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:50:52.493516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a213d0d9-cc48-40a7-a691-5398cf711020 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f8443a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:52.608308 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a213d0d9-cc48-40a7-a691-5398cf711020 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/0071f8d1-9c96-4f1b-a223-f757f6e446e8" status: 200 len: 245 microversion: 2.1 time: 0.128315 Jul 20 10:50:52.610557 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 636/1191] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:50:52 2022] GET /compute/v2.1/os-security-groups/0071f8d1-9c96-4f1b-a223-f757f6e446e8 => generated 245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:52.615985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2248bb01-9b8e-4f11-8997-87f6b3dfbb25 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:52.617081 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:50:52.617081 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:50:52.644969 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2248bb01-9b8e-4f11-8997-87f6b3dfbb25 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/13d401a5-c946-47eb-b3dd-c578559c5373" status: 202 len: 0 microversion: 2.1 time: 0.032839 Jul 20 10:50:52.649716 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 637/1192] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:50:52 2022] DELETE /compute/v2.1/flavors/13d401a5-c946-47eb-b3dd-c578559c5373 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:52.656325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35d529a6-4de2-4546-a9b0-6fc7d5f1fe86 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f9f2040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-594131342", "description": "tempest-description-1645729741"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:53.207515 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35d529a6-4de2-4546-a9b0-6fc7d5f1fe86 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.555781 Jul 20 10:50:53.208140 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 638/1193] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:50:52 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:53.219409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8868d88-d9e1-4319-8191-dd48e1b0080a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:53.269267 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b8868d88-d9e1-4319-8191-dd48e1b0080a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058934 Jul 20 10:50:53.272854 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 639/1194] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:53.285143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:53.286013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:53.295858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:53.296342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:53.297475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:53.298232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:53.585693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:53.609564 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08ada18f-1faa-492d-be9f-e5e27c62f1d1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.335351 Jul 20 10:50:53.612693 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 640/1195] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:53 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:53.627386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-75880048-8222-44d4-887b-51d687ef42b6 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3f909430>, body: {"security_group_rule": {"parent_group_id": "b5608226-73fb-4a49-8ca7-fbe7a2aed38b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:54.470647 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-75880048-8222-44d4-887b-51d687ef42b6 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.855586 Jul 20 10:50:54.482128 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 641/1196] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 10:50:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:54.490530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:54.494797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:54.512307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:54.512773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:54.513591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:54.514126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:54.556327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:54.565434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Old instance type tempest-test_resize_flavor_-1369783399, new instance type m1.heat {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 10:50:54.576544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:50:54.577648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:50:54.578448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:50:54.579093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:50:54.580251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:50:54.682237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:54.687343 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f3c1a65-a1e9-4e75-995b-092fb6f408bd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb/action" status: 202 len: 0 microversion: 2.1 time: 0.203189 Jul 20 10:50:54.688377 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 642/1197] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:54 2022] POST /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:54.699621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6747703b-3000-4797-a3bb-b92abbea2985 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Action: 'create', calling method: .version_select at 0x7f2c3fa3a9d0>, body: {"security_group_rule": {"parent_group_id": "b5608226-73fb-4a49-8ca7-fbe7a2aed38b", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:55.219809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Building network info cache for instance {{(pid=125886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:50:55.651292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6747703b-3000-4797-a3bb-b92abbea2985 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.961589 Jul 20 10:50:55.653160 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 643/1198] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 10:50:54 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:55.663645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:55.665690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:55.696053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:55.699459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:55.700835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:55.701497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:55.748063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:56.509534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:56.538660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d17dcb28-5fab-4cbe-afcf-efde1684f59f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.884076 Jul 20 10:50:56.540132 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 644/1199] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:55 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:56.557905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:56.559572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:56.571581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:56.572352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:56.573467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:56.574099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:56.955734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:56.960335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=7 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:56.966044 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ca95d46-7125-4d28-9342-aabee6dc4075 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1536 microversion: 2.1 time: 0.424637 Jul 20 10:50:56.966643 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 645/1200] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:56 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1536 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:56.984573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-347d70a5-4b9a-4897-a4ad-e28c77daef07 req-cc83a691-85a5-41d9-9336-127f9aff7b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df81c38-6b96-4e1f-b86c-e69acebd7e8a", "name": "network-vif-deleted", "tag": "8c525d96-458f-4e39-9f8e-fad48afa68d0"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:56.995630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:50:57.013470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-347d70a5-4b9a-4897-a4ad-e28c77daef07 req-cc83a691-85a5-41d9-9336-127f9aff7b96 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:57.014155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-347d70a5-4b9a-4897-a4ad-e28c77daef07 req-cc83a691-85a5-41d9-9336-127f9aff7b96 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:57.024480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Updating instance_info_cache with network_info: [{"id": "f6427aac-c6de-4363-bde5-e03207bdb82e", "address": "fa:16:3e:cd:6f:76", "network": {"id": "d931b5cb-b761-4e06-bc63-67e23c443217", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1368686924-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17bd54737b7a466ea634c0cfbfc0782e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf6427aac-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:50:57.041321 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-347d70a5-4b9a-4897-a4ad-e28c77daef07 req-cc83a691-85a5-41d9-9336-127f9aff7b96 service nova] Creating event network-vif-deleted:8c525d96-458f-4e39-9f8e-fad48afa68d0 for instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a on n-h2-846219-10 Jul 20 10:50:57.049972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-347d70a5-4b9a-4897-a4ad-e28c77daef07 req-cc83a691-85a5-41d9-9336-127f9aff7b96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081940 Jul 20 10:50:57.051423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 646/1201] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:57.053765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Releasing lock "refresh_cache-e9cc5cba-bbac-48ee-a745-858deddea463" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:50:57.056378 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c3fb2f9-e613-4f12-bdf6-8527c858ace6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action" status: 202 len: 0 microversion: 2.1 time: 4.663278 Jul 20 10:50:57.057692 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 556/1202] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:52 2022] POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action => generated 0 bytes in 4666 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:50:57.058892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7a8ffd4-0ab4-4782-9de2-be633523c33b tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f953af0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:57.067348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f15f3ba-a62a-4be4-9a4a-01b55107502a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '.version_select at 0x7f2c3f2bedc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:57.246854 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7a8ffd4-0ab4-4782-9de2-be633523c33b tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/b5608226-73fb-4a49-8ca7-fbe7a2aed38b" status: 200 len: 664 microversion: 2.1 time: 0.193320 Jul 20 10:50:57.248269 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 647/1203] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:50:57 2022] GET /compute/v2.1/os-security-groups/b5608226-73fb-4a49-8ca7-fbe7a2aed38b => generated 664 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:57.267499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fc78e9c4-b30d-4813-8cae-4452e4eef9d3 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f9f2a60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:57.558573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f15f3ba-a62a-4be4-9a4a-01b55107502a tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/18de333e-e043-4c61-9962-42fe40646be4" status: 200 len: 183 microversion: 2.1 time: 0.495583 Jul 20 10:50:57.567539 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 557/1204] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:50:57 2022] GET /compute/v2.1/os-floating-ips/18de333e-e043-4c61-9962-42fe40646be4 => generated 183 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:50:57.576395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:57.580425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:57.598988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:57.603810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:57.608790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:57.617201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:57.694179 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fc78e9c4-b30d-4813-8cae-4452e4eef9d3 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/4681be6a-67bd-4976-b21b-311c3ee9daa7" status: 202 len: 0 microversion: 2.1 time: 0.431416 Jul 20 10:50:57.695515 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 648/1205] 10.222.0.79 () {58 vars in 1286 bytes} [Wed Jul 20 10:50:57 2022] DELETE /compute/v2.1/os-security-group-rules/4681be6a-67bd-4976-b21b-311c3ee9daa7 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:50:57.703688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Action: 'action', calling method: .version_select at 0x7f2c4e8d1e50>, body: {"removeFloatingIp": {"address": "172.25.0.92"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:57.941294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:57.948184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:57.959844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:57.961319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:57.962897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:57.963619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:57.964326 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ca89ff7-cdc4-4b80-8ffa-045a5724d710 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.394721 Jul 20 10:50:57.965220 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 558/1206] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:57 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:58.144257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1797079989", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:58.234428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:50:58.280807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Acquired lock "refresh_cache-e9cc5cba-bbac-48ee-a745-858deddea463" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:50:58.751413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:50:58.752309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:50:58.753192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:50:58.753807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:50:58.754344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:50:58.765170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:58.765694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:58.766710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:58.767408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:58.789261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Getting quotas for project 6ed41f29a0fe4ebba18c8d24c7f513bf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:50:58.795578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Getting quotas for user 61aca4c4632f40a0b2eb6425fdcbd55e and project 6ed41f29a0fe4ebba18c8d24c7f513bf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:50:58.812737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:50:58.816670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:50:58.885594 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c6970a2a-ebcd-4b77-b0fa-56c894baefdf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918724 Jul 20 10:50:58.897848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 559/1207] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:50:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:50:58.905479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05df52b3-88d1-44ae-9155-e11ae246b9f3 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f205310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:59.394528 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05df52b3-88d1-44ae-9155-e11ae246b9f3 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/b5608226-73fb-4a49-8ca7-fbe7a2aed38b" status: 202 len: 0 microversion: 2.1 time: 0.493008 Jul 20 10:50:59.396979 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 560/1208] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:50:58 2022] DELETE /compute/v2.1/os-security-groups/b5608226-73fb-4a49-8ca7-fbe7a2aed38b => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:50:59.403240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:50:59.404107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:50:59.418755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:59.419802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:59.420803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:50:59.422570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:50:59.491703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Building network info cache for instance {{(pid=125885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:50:59.780836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:50:59.794237 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6aa50a5f-664e-40bd-94c5-1989bd93a186 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1536 microversion: 2.1 time: 0.395934 Jul 20 10:50:59.795839 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 561/1209] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:50:59 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1536 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:50:59.807696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1942910342", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:50:59.910221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:51:01.162976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:51:01.164450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:51:01.165621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:51:01.166491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:51:01.167403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:51:01.191291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.192183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.193828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.194590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.216641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Getting quotas for project 6ed41f29a0fe4ebba18c8d24c7f513bf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:51:01.223038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Getting quotas for user 61aca4c4632f40a0b2eb6425fdcbd55e and project 6ed41f29a0fe4ebba18c8d24c7f513bf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:51:01.238250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:51:01.242231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:51:01.285468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Updating instance_info_cache with network_info: [{"id": "f6427aac-c6de-4363-bde5-e03207bdb82e", "address": "fa:16:3e:cd:6f:76", "network": {"id": "d931b5cb-b761-4e06-bc63-67e23c443217", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1368686924-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17bd54737b7a466ea634c0cfbfc0782e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf6427aac-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:51:01.302651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Releasing lock "refresh_cache-e9cc5cba-bbac-48ee-a745-858deddea463" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:51:01.303855 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f065daf9-4ac6-4dce-a5cf-029978f03608 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506751 Jul 20 10:51:01.304642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a7fcb76-9342-4b8e-a96a-5d41b2ed3019 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action" status: 202 len: 0 microversion: 2.1 time: 3.607303 Jul 20 10:51:01.305560 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 562/1210] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:51:01.311294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:01.312726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:01.318388 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 649/1211] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:50:57 2022] POST /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463/action => generated 0 bytes in 3622 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:51:01.322559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.323620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.324746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.326102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.327513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2fcdfbd3-5883-43c0-a362-ea6c2c42a488 req-e0687362-e139-4519-9551-cb05c6b481ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:01.348844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2fcdfbd3-5883-43c0-a362-ea6c2c42a488 req-e0687362-e139-4519-9551-cb05c6b481ac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.349956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2fcdfbd3-5883-43c0-a362-ea6c2c42a488 req-e0687362-e139-4519-9551-cb05c6b481ac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.372598 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2fcdfbd3-5883-43c0-a362-ea6c2c42a488 req-e0687362-e139-4519-9551-cb05c6b481ac service nova] Creating event network-changed:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:51:01.385439 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2fcdfbd3-5883-43c0-a362-ea6c2c42a488 req-e0687362-e139-4519-9551-cb05c6b481ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065670 Jul 20 10:51:01.388005 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 650/1212] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:01.400186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f9f2e50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:01.520359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:51:01.521936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Neutron security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:51:01.527914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] HTTP exception thrown: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.527914 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Request method failure captured: Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-security-groups/33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 HTTP/1.1 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1935UOyG9RfQt9VJnjdbXJ1ImNJI4l7LC_Dco3NAqhPFF7FLB4vm4IsX0bec1LbXVYW4kNami_XUiT65MZm7SSLDb42_LHaOvUyzzVlAEJDP3CW5i7ms7aW9YPzM4Ni-QUaQgJBQr5zUR5Xm4lnw1Z0DfhU9Um-ElbSOnLBnjPY-XMk Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8869f40666be4330a9107cd01958f3c1 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-663223502 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8869f40666be4330a9107cd01958f3c1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8869f40666be4330a9107cd01958f3c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8869f40666be4330a9107cd01958f3c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8869f40666be4330a9107cd01958f3c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupRulesTestJSON-663223502 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8869f40666be4330a9107cd01958f3c1 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-663223502 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupRulesTestJSON-663223502-project Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 40af674dd8a04a168d435e1527011a7e Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupRulesTestJSON-663223502-project Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '33cbfdaf-f316-4b95-a096-2ee9a1cac0f1'} Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:51:01.531387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Returning 404 to user: Security group 33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 does not exist Jul 20 10:51:01.535658 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-f8df7455-ac0a-4461-ba04-79923f6dd148'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:51:01.542586 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f4472fa6-a102-4ae7-a8cd-183c01a16ae2 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/33cbfdaf-f316-4b95-a096-2ee9a1cac0f1" status: 404 len: 194 microversion: 2.1 time: 0.141058 Jul 20 10:51:01.542586 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 651/1213] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:51:01 2022] DELETE /compute/v2.1/os-security-groups/33cbfdaf-f316-4b95-a096-2ee9a1cac0f1 => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:51:01.550217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:01.551792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:01.569508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.569990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.571296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:01.571749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:01.941372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:01.955743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f872fd4-cdc2-40b1-9bd6-197415a6c919 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.648650 Jul 20 10:51:01.961274 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 563/1214] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:01 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:01.974048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80c820cc-d77b-4429-9308-5ba31035b390 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:01.977142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-80c820cc-d77b-4429-9308-5ba31035b390 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:02.183998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:02.201190 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fc808cd7-bf45-4e5f-b1b9-815ee45511f5 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1536 microversion: 2.1 time: 0.661909 Jul 20 10:51:02.208008 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 652/1215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:01 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1536 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:02.223577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:02.225641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:02.239275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:02.252208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:02.253074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:02.253523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:02.312854 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] HTTP exception thrown: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Request method failure captured: Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a HTTP/1.1 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193Hkz9LAY28k0TtP4lCoWfXP221qSnezGu1WkPzKP0Aw2vSnoENJ3gsDfNrIy_kuWUov81NhvdPXx3Gnxje9GTiitT45r8XkuBy7UqcaCAeSSH13CHZYg2NiPUk7FtL5cGL_GDfSBbI8YKpxZk3Dip2kjDbFlSUHSMCljKjBHx_1zA Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_17bd54737b7a466ea634c0cfbfc0782e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 5683bc7a0b854d5a9779dcec39185812 Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6df81c38-6b96-4e1f-b86c-e69acebd7e8a'} Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:51:02.318164 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.322817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Returning 404 to user: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:51:02.324532 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b1f81f18-f2b3-4c51-9215-dbdc0621fa1c tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 404 len: 111 microversion: 2.1 time: 0.113022 Jul 20 10:51:02.326087 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 653/1216] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:51:02 2022] DELETE /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:51:02.356160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6159b12e-14ee-425f-a75d-2bf3b63797f9 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f909670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:02.559026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-80c820cc-d77b-4429-9308-5ba31035b390 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:02.573324 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80c820cc-d77b-4429-9308-5ba31035b390 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1214 microversion: 2.1 time: 0.609423 Jul 20 10:51:02.573996 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 564/1217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:01 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1214 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:02.581967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:02.586821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: 6df81c38-6b96-4e1f-b86c-e69acebd7e8a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:02.602584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:02.604585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:02.605583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:02.609667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:02.639083 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] HTTP exception thrown: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Request method failure captured: Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a HTTP/1.1 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi193Hkz9LAY28k0TtP4lCoWfXP221qSnezGu1WkPzKP0Aw2vSnoENJ3gsDfNrIy_kuWUov81NhvdPXx3Gnxje9GTiitT45r8XkuBy7UqcaCAeSSH13CHZYg2NiPUk7FtL5cGL_GDfSBbI8YKpxZk3Dip2kjDbFlSUHSMCljKjBHx_1zA Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_17bd54737b7a466ea634c0cfbfc0782e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 5683bc7a0b854d5a9779dcec39185812 Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '6df81c38-6b96-4e1f-b86c-e69acebd7e8a'} Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.648451 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. Jul 20 10:51:02.653357 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:02.654923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Returning 404 to user: Instance 6df81c38-6b96-4e1f-b86c-e69acebd7e8a could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:51:02.659151 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83f85319-f371-4827-b93d-1b83f074e966 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a" status: 404 len: 111 microversion: 2.1 time: 0.083761 Jul 20 10:51:02.660520 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 565/1218] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:02 2022] GET /compute/v2.1/servers/6df81c38-6b96-4e1f-b86c-e69acebd7e8a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:51:02.782655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fe2d403f-c94d-4f37-9399-bb2a87208a1a req-7039fc2e-b876-4bd1-bc7c-bff89abcfc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "name": "network-vif-unplugged", "status": "completed", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:02.798686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fe2d403f-c94d-4f37-9399-bb2a87208a1a req-7039fc2e-b876-4bd1-bc7c-bff89abcfc05 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:02.800535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fe2d403f-c94d-4f37-9399-bb2a87208a1a req-7039fc2e-b876-4bd1-bc7c-bff89abcfc05 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:02.825215 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fe2d403f-c94d-4f37-9399-bb2a87208a1a req-7039fc2e-b876-4bd1-bc7c-bff89abcfc05 service nova] Creating event network-vif-unplugged:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:51:02.843818 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fe2d403f-c94d-4f37-9399-bb2a87208a1a req-7039fc2e-b876-4bd1-bc7c-bff89abcfc05 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177620 Jul 20 10:51:02.844672 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 566/1219] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:02.855429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c2930ba-1d0e-4f05-a628-507e61d718d4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '.version_select at 0x7f2c3f205e50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:03.979825 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6159b12e-14ee-425f-a75d-2bf3b63797f9 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/0071f8d1-9c96-4f1b-a223-f757f6e446e8" status: 202 len: 0 microversion: 2.1 time: 1.648168 Jul 20 10:51:03.980722 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 654/1220] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:51:02 2022] DELETE /compute/v2.1/os-security-groups/0071f8d1-9c96-4f1b-a223-f757f6e446e8 => generated 0 bytes in 1650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:03.986269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:03.986955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:04.000896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:04.001375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:04.004951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:04.005420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:04.594855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:04.619101 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce30b286-e447-4152-a812-c5ab3e3a2ae8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.634620 Jul 20 10:51:04.623347 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 655/1221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:03 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:04.650342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:04.650342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:04.658980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:04.660842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:04.662455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:04.663123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:05.523759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:05.531922 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0cf404d-0c40-4e04-bde4-566cd0db266a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.910004 Jul 20 10:51:05.532625 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 656/1222] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:04 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:05.542168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7412cfb2-2d05-4b81-a6d1-43084bc38dae req-19c6e351-61ea-4ad8-bae5-e5c9dfc14b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:05.547888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7412cfb2-2d05-4b81-a6d1-43084bc38dae req-19c6e351-61ea-4ad8-bae5-e5c9dfc14b5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:05.548661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7412cfb2-2d05-4b81-a6d1-43084bc38dae req-19c6e351-61ea-4ad8-bae5-e5c9dfc14b5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:05.561273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7412cfb2-2d05-4b81-a6d1-43084bc38dae req-19c6e351-61ea-4ad8-bae5-e5c9dfc14b5b service nova] Creating event network-changed:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:51:05.567126 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7412cfb2-2d05-4b81-a6d1-43084bc38dae req-19c6e351-61ea-4ad8-bae5-e5c9dfc14b5b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033189 Jul 20 10:51:05.569007 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 657/1223] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:05.574860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:05.575623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:05.582768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:05.583399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:05.584836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:05.585386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:05.761181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:05.769160 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-054ded06-a3fd-43f5-a28d-9f0b9713f780 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1272 microversion: 2.1 time: 0.198623 Jul 20 10:51:05.769981 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 658/1224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:05 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:05.775631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34bd9771-b5f4-456f-b915-2cffd0569361 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f909430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:06.422518 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c2930ba-1d0e-4f05-a628-507e61d718d4 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/18de333e-e043-4c61-9962-42fe40646be4" status: 202 len: 0 microversion: 2.1 time: 3.576214 Jul 20 10:51:06.424519 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 567/1225] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:51:02 2022] DELETE /compute/v2.1/os-floating-ips/18de333e-e043-4c61-9962-42fe40646be4 => generated 0 bytes in 3579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:06.431849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7c7b0e75-a3c2-4353-a29d-07a079bef37d req-da25820b-6fa0-488b-8a87-02bead28a354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:06.448374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7c7b0e75-a3c2-4353-a29d-07a079bef37d req-da25820b-6fa0-488b-8a87-02bead28a354 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:06.448852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7c7b0e75-a3c2-4353-a29d-07a079bef37d req-da25820b-6fa0-488b-8a87-02bead28a354 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:06.461827 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7c7b0e75-a3c2-4353-a29d-07a079bef37d req-da25820b-6fa0-488b-8a87-02bead28a354 service nova] Creating event network-changed:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:51:06.467363 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7c7b0e75-a3c2-4353-a29d-07a079bef37d req-da25820b-6fa0-488b-8a87-02bead28a354 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040999 Jul 20 10:51:06.468725 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 568/1226] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:06.475136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:06.475904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:06.497248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:06.498130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:06.498641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:06.499056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.106849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:07.129483 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5da8171-d137-463a-a8d5-867027acf0d4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.659283 Jul 20 10:51:07.131916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 569/1227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:06 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:07.146181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:07.147298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:07.155002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:07.155992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.157021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:07.157693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.181473 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-34bd9771-b5f4-456f-b915-2cffd0569361 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/6091ed5e-70db-460f-ad7d-371fd87f959c" status: 202 len: 0 microversion: 2.1 time: 1.410573 Jul 20 10:51:07.183028 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 659/1228] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:51:05 2022] DELETE /compute/v2.1/os-security-groups/6091ed5e-70db-460f-ad7d-371fd87f959c => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:07.188450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:07.189374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:07.197941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:07.198689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.200391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:07.201145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.205534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:51:07.312154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:07.415455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-13cf4b28-d0c2-4193-ad1f-3d1a4d08eb13 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 204 len: 0 microversion: 2.1 time: 0.280850 Jul 20 10:51:07.417025 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 570/1229] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:51:07 2022] DELETE /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:51:07.429518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:07.433259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:07.443446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:07.444198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.445158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:07.445747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:07.852944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:07.862186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0d9b4ca7-1468-40cc-93f8-a7bde16fdb08 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.677265 Jul 20 10:51:07.862887 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 660/1230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:07 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:07.871320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c60c071f-5e32-4c07-8f14-961d318e4505 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3fa3aaf0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:08.274576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:08.282996 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50c78bdb-e43c-42af-bdd3-7a9abe7ddde6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 0.864456 Jul 20 10:51:08.283686 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 571/1231] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:07 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:08.289600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:08.290217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:08.296651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:08.297059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:08.297870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:08.298308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:08.663310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:08.677938 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-73b38afc-d161-449e-919b-2b6f1aeef0f6 tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1526 microversion: 2.1 time: 0.391886 Jul 20 10:51:08.681750 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 572/1232] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:08 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1526 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:08.696621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:08.697716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:08.723190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:08.726497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:08.729248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:08.731494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:09.260728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c60c071f-5e32-4c07-8f14-961d318e4505 tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/681bf449-4415-48c7-940e-ae01c96d24dd" status: 202 len: 0 microversion: 2.1 time: 1.395929 Jul 20 10:51:09.264815 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 661/1233] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:51:07 2022] DELETE /compute/v2.1/os-security-groups/681bf449-4415-48c7-940e-ae01c96d24dd => generated 0 bytes in 1401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:09.269651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-155a2116-5860-45ad-a983-da54e90447cb req-5ed722ea-ced1-4064-9866-bc65b0779322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad902bf1-8b58-4faa-a43e-fcd38fb52208", "tag": "fe5d6cc4-deb4-4e11-b2ba-6e37a2a915c2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:09.297897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-155a2116-5860-45ad-a983-da54e90447cb req-5ed722ea-ced1-4064-9866-bc65b0779322 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:09.299873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-155a2116-5860-45ad-a983-da54e90447cb req-5ed722ea-ced1-4064-9866-bc65b0779322 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:09.350536 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-155a2116-5860-45ad-a983-da54e90447cb req-5ed722ea-ced1-4064-9866-bc65b0779322 service nova] Creating event network-changed:fe5d6cc4-deb4-4e11-b2ba-6e37a2a915c2 for instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 on n-h2-846219-10 Jul 20 10:51:09.366698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-155a2116-5860-45ad-a983-da54e90447cb req-5ed722ea-ced1-4064-9866-bc65b0779322 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098109 Jul 20 10:51:09.367505 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 662/1234] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:09.389745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:09.391190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:09.410529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:09.413819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:09.416780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:09.421124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:09.423336 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-32acf6f9-5e25-4b64-a2c4-caaf28ca0d43 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.737916 Jul 20 10:51:09.424369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:09.434838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 573/1235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:08 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:09.440730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be2d12fb-3bd6-4b28-b9a3-268a93e43ffa tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f4781f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:10.154282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:10.186995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f3be486-adfd-45f8-b2a9-07bb7d0e26de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.815425 Jul 20 10:51:10.191663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 663/1236] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:09 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:10.235064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:10.236415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:10.256669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.262809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.268797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.270108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.470687 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be2d12fb-3bd6-4b28-b9a3-268a93e43ffa tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/8f9e2095-7611-461d-b9eb-9008165555a8" status: 202 len: 0 microversion: 2.1 time: 1.034252 Jul 20 10:51:10.471697 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 574/1237] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:51:09 2022] DELETE /compute/v2.1/os-security-groups/8f9e2095-7611-461d-b9eb-9008165555a8 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:10.481758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:10.482757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:10.545164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.555265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.560680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.561752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.655035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.655518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.655980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lazy-loading 'fault' on Instance uuid e9cc5cba-bbac-48ee-a745-858deddea463 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:51:10.840183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5683bc7a0b854d5a9779dcec39185812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bd54737b7a466ea634c0cfbfc0782e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:10.855981 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f07b9500-580b-4b2e-aa13-7bb452de39cf tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 200 len: 1314 microversion: 2.1 time: 0.382051 Jul 20 10:51:10.870254 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 575/1238] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:10 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:10.883045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-52cbdc17-a768-4ff3-af0d-459ee0266e1a req-50ebf2a9-6373-4232-bfda-5aa3d83b54f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:10.904251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-52cbdc17-a768-4ff3-af0d-459ee0266e1a req-50ebf2a9-6373-4232-bfda-5aa3d83b54f4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.904840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-52cbdc17-a768-4ff3-af0d-459ee0266e1a req-50ebf2a9-6373-4232-bfda-5aa3d83b54f4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.932433 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-52cbdc17-a768-4ff3-af0d-459ee0266e1a req-50ebf2a9-6373-4232-bfda-5aa3d83b54f4 service nova] Creating event network-changed:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:51:10.938517 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-52cbdc17-a768-4ff3-af0d-459ee0266e1a req-50ebf2a9-6373-4232-bfda-5aa3d83b54f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066756 Jul 20 10:51:10.940897 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 576/1239] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:10.948423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:10.951332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:10.965025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.965958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.967509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:10.968208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:10.980066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:10.992420 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3c4f39f-d9d1-46c4-b6bd-9f03e9239600 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 0.795143 Jul 20 10:51:11.007280 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 664/1240] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:10 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:11.032970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8c70058-b936-4411-aaf6-89e0a8f58f0e tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] Calling method '.version_select at 0x7f2c3f9f2310>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:11.210128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:11.467233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:11.495816 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-51d5239e-8c9e-4d28-a68d-66fb7e121560 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.549657 Jul 20 10:51:11.499040 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 577/1241] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:10 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:11.512925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:11.518665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:11.534225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:11.534636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:11.535603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:11.536693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:11.795346 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8c70058-b936-4411-aaf6-89e0a8f58f0e tempest-SecurityGroupRulesTestJSON-663223502 tempest-SecurityGroupRulesTestJSON-663223502-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d61a45f0-6dda-4883-83e1-021ed6181c6b" status: 202 len: 0 microversion: 2.1 time: 0.774576 Jul 20 10:51:11.796551 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 665/1242] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:51:11 2022] DELETE /compute/v2.1/os-security-groups/d61a45f0-6dda-4883-83e1-021ed6181c6b => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:11.837768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f1cd96a2-9063-4d1d-bc89-07288a7f6b48 req-900467b3-bd8c-465c-976a-076348edf676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc5cba-bbac-48ee-a745-858deddea463", "name": "network-vif-deleted", "tag": "f6427aac-c6de-4363-bde5-e03207bdb82e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:11.879986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f1cd96a2-9063-4d1d-bc89-07288a7f6b48 req-900467b3-bd8c-465c-976a-076348edf676 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:11.880259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f1cd96a2-9063-4d1d-bc89-07288a7f6b48 req-900467b3-bd8c-465c-976a-076348edf676 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:11.968063 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f1cd96a2-9063-4d1d-bc89-07288a7f6b48 req-900467b3-bd8c-465c-976a-076348edf676 service nova] Creating event network-vif-deleted:f6427aac-c6de-4363-bde5-e03207bdb82e for instance e9cc5cba-bbac-48ee-a745-858deddea463 on n-h2-846219-10 Jul 20 10:51:11.981288 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f1cd96a2-9063-4d1d-bc89-07288a7f6b48 req-900467b3-bd8c-465c-976a-076348edf676 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171277 Jul 20 10:51:11.984158 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 666/1243] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:12.000271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:12.002478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] [instance: e9cc5cba-bbac-48ee-a745-858deddea463] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:12.035431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:12.036987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:12.040420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:12.042610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:12.062012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:12.082211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be890043-8b36-4107-9970-16752dd16114 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.580906 Jul 20 10:51:12.083430 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 578/1244] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:11 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:12.097628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:12.097755 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] HTTP exception thrown: Instance e9cc5cba-bbac-48ee-a745-858deddea463 could not be found. Jul 20 10:51:12.098236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Request method failure captured: Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 HTTP/1.1 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi193Hkz9LAY28k0TtP4lCoWfXP221qSnezGu1WkPzKP0Aw2vSnoENJ3gsDfNrIy_kuWUov81NhvdPXx3Gnxje9GTiitT45r8XkuBy7UqcaCAeSSH13CHZYg2NiPUk7FtL5cGL_GDfSBbI8YKpxZk3Dip2kjDbFlSUHSMCljKjBHx_1zA Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_17bd54737b7a466ea634c0cfbfc0782e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/17bd54737b7a466ea634c0cfbfc0782e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 17bd54737b7a466ea634c0cfbfc0782e Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-388069771 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 5683bc7a0b854d5a9779dcec39185812 Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-388069771-project Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance e9cc5cba-bbac-48ee-a745-858deddea463 could not be found. Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'e9cc5cba-bbac-48ee-a745-858deddea463'} Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cc5cba-bbac-48ee-a745-858deddea463 could not be found. Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cc5cba-bbac-48ee-a745-858deddea463 could not be found. Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:12.102063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cc5cba-bbac-48ee-a745-858deddea463 could not be found. Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] Returning 404 to user: Instance e9cc5cba-bbac-48ee-a745-858deddea463 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:51:12.107363 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-993ef585-a5ec-4427-8115-883d7ce2e34f tempest-FloatingIPsAssociationTestJSON-388069771 tempest-FloatingIPsAssociationTestJSON-388069771-project] 10.222.0.79 "GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463" status: 404 len: 111 microversion: 2.1 time: 0.118141 Jul 20 10:51:12.109132 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 667/1245] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:11 2022] GET /compute/v2.1/servers/e9cc5cba-bbac-48ee-a745-858deddea463 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:51:12.139718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:12.140182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:12.141066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:12.141643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:12.539083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:12.541357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:12.554326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:12.555072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:12.556634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:12.557083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:12.564349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:12.867564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:12.877543 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8edb7f99-8a78-4c1f-9f85-b6cfbd2d1cc7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 0.792608 Jul 20 10:51:12.881896 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 579/1246] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:12 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:13.070114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:13.081085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df204e9d-e44c-4aab-953e-81eee28524ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.547848 Jul 20 10:51:13.092923 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 668/1247] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:12 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:13.112929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:13.113568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:13.124153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:13.124837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:13.125912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:13.126577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:13.564487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:13.584946 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb5b87ac-a3d2-4000-9f1c-dc158a037445 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.473898 Jul 20 10:51:13.586858 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 580/1248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:13 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:13.908132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:13.909113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:13.931371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:13.932341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:13.935731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:13.936718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:14.123608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:14.124348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:14.136703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:14.141660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:14.142610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:14.143070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:14.988932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:15.015107 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0071b8a7-bf2a-4bb6-8a52-d653d81b08c7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.884832 Jul 20 10:51:15.018661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 581/1249] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:14 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:15.033627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:15.034436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:15.042883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:15.044002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:15.046605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:15.047666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:15.390723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:15.404206 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0559843a-2421-4b1b-a736-2579c69f2106 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 1.506579 Jul 20 10:51:15.405178 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 669/1250] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:13 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:15.445863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:15.455970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-55e71808-33b9-499e-8df5-886da7d4bb7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.434289 Jul 20 10:51:15.457242 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 582/1251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:15 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:16.035688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:16.036362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:16.056374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:16.057233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:16.062974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:16.064842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:16.430036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:16.430769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:16.444288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:16.446657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:16.450424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:16.451095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:16.678607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:16.690719 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b091a097-610b-427c-a64c-7a27c6d41f96 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.658780 Jul 20 10:51:16.703415 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 670/1252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:16 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:16.709812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:16.710728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:16.725415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:16.726440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:16.730335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:16.731078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:17.083318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:17.101055 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5a1b3b18-cb75-40e1-bbab-43d0dac90bf7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 0.672671 Jul 20 10:51:17.105680 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 583/1253] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:16 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:17.138063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:17.141783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:17.150979 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef0934db-5ddf-4192-9b71-13ef0919c88b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.445909 Jul 20 10:51:17.151852 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 671/1254] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:16 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:17.719443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:17.720166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:17.737033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:17.737741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:17.738704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:17.739365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:18.002477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f26a823f-7fcb-4f52-8464-b5b2152c3cda req-dfe10461-7124-488d-9742-aa7bd2db73df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad902bf1-8b58-4faa-a43e-fcd38fb52208", "name": "network-vif-plugged", "status": "completed", "tag": "fe5d6cc4-deb4-4e11-b2ba-6e37a2a915c2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:18.022999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f26a823f-7fcb-4f52-8464-b5b2152c3cda req-dfe10461-7124-488d-9742-aa7bd2db73df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:18.024568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f26a823f-7fcb-4f52-8464-b5b2152c3cda req-dfe10461-7124-488d-9742-aa7bd2db73df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:18.052262 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f26a823f-7fcb-4f52-8464-b5b2152c3cda req-dfe10461-7124-488d-9742-aa7bd2db73df service nova] Creating event network-vif-plugged:fe5d6cc4-deb4-4e11-b2ba-6e37a2a915c2 for instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 on n-h2-846219-10 Jul 20 10:51:18.057920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f26a823f-7fcb-4f52-8464-b5b2152c3cda req-dfe10461-7124-488d-9742-aa7bd2db73df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.534092 Jul 20 10:51:18.059117 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 584/1255] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:18.131145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:18.134300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:18.138519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:18.150365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:18.152395 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f5cb1363-88e9-4128-9235-455e987fab0e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.442629 Jul 20 10:51:18.154298 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 672/1256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:17 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:18.159533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:18.164187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:18.166240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:18.178823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:18.182197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:18.204367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:18.205594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:18.208422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:18.210518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:18.429381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:18.437239 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be743eb6-deab-4f0b-b4fc-f24716ad800c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 0.315048 Jul 20 10:51:18.437835 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 585/1257] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:18 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:18.581006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:18.589870 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d3e42e9-0446-4b2c-9cb0-a4795d2f7c99 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.419622 Jul 20 10:51:18.591023 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 673/1258] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:18 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:19.003970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b3b74881-1769-4207-9fe5-15005af332ee req-29633466-96a6-4c4c-b734-e9db2597d0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "name": "network-vif-unplugged", "status": "completed", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:19.018161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b3b74881-1769-4207-9fe5-15005af332ee req-29633466-96a6-4c4c-b734-e9db2597d0f9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.024311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b3b74881-1769-4207-9fe5-15005af332ee req-29633466-96a6-4c4c-b734-e9db2597d0f9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.041896 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b3b74881-1769-4207-9fe5-15005af332ee req-29633466-96a6-4c4c-b734-e9db2597d0f9 service nova] Creating event network-vif-unplugged:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:51:19.050042 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b3b74881-1769-4207-9fe5-15005af332ee req-29633466-96a6-4c4c-b734-e9db2597d0f9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055553 Jul 20 10:51:19.052116 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 586/1259] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:19.189163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:19.189163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:19.190538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.191862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.192785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.193397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.396528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:19.411041 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9773c436-e651-4acf-885b-ef41c0040a4d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.238060 Jul 20 10:51:19.424698 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 674/1260] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:19 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:19.456127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:19.456830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:19.467777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.468240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.469040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.469520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.608835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:19.610099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:19.632316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.632776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.647271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:19.647727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:19.718982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:19.734365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f892007e-2e84-4690-b3fd-b5f030aab846 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1314 microversion: 2.1 time: 0.282410 Jul 20 10:51:19.734980 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 587/1261] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:19 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:19.888893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:19.920906 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69bbfc4b-ad85-4291-b9fa-fbd2f21cf529 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.316986 Jul 20 10:51:19.921650 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 675/1262] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:19 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:20.190832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ae65f226-abe5-4f3a-af2f-98c1d74c283c req-1dcc7923-5952-4995-8325-1bfc30c56d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "name": "network-vif-unplugged", "status": "completed", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:20.206538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ae65f226-abe5-4f3a-af2f-98c1d74c283c req-1dcc7923-5952-4995-8325-1bfc30c56d3a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.206984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ae65f226-abe5-4f3a-af2f-98c1d74c283c req-1dcc7923-5952-4995-8325-1bfc30c56d3a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.224984 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ae65f226-abe5-4f3a-af2f-98c1d74c283c req-1dcc7923-5952-4995-8325-1bfc30c56d3a service nova] Creating event network-vif-unplugged:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h2-846219-10 Jul 20 10:51:20.233359 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ae65f226-abe5-4f3a-af2f-98c1d74c283c req-1dcc7923-5952-4995-8325-1bfc30c56d3a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046131 Jul 20 10:51:20.234363 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 588/1263] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:20.432963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:20.433623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:20.443485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.444266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.445273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.446958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.678807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:20.688082 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9bdac4c5-9d28-4a9c-86cb-e994bce6cbd9 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.258918 Jul 20 10:51:20.688862 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 676/1264] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:20 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:20.752136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:20.753031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:20.760270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.760781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.761744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.762258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.922087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:20.932764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-73c0c4c8-efab-4658-8797-741d54639b1e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1464 microversion: 2.1 time: 0.185072 Jul 20 10:51:20.933504 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 589/1265] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:20 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:20.949120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:20.949864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:20.956504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:20.957277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:20.957475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.957858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.959065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.959591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.972566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.973316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:20.974415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:20.975037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:21.238731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:21.247335 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7770436d-2bbb-41c1-8cc9-3bfd07e74282 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.302442 Jul 20 10:51:21.248400 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 677/1266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:20 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:21.324059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:21.327237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:21.335675 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50dfb820-358d-4f52-827d-2631e6466f37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1314 microversion: 2.1 time: 0.385320 Jul 20 10:51:21.336996 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 590/1267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:20 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:21.727481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:21.732315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:21.750322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:21.751647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:21.754525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:21.755402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:21.867795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:21.871982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:21.873301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Searching by: {'deleted': False, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:51:21.884297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:21.886826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:21.887675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:21.889970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:21.890614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:21.942624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:51:21.992828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9dbccfb7-42d5-4667-917e-a52d7d2dae04 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.131109 Jul 20 10:51:22.001839 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 591/1268] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 10:51:21 2022] GET /compute/v2.1/servers => generated 343 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:22.015402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:22.021627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:22.022427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Searching by: {'deleted': False, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:51:22.028666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.029331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.030445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.030894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.135249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:51:22.230531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:22.237171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:22.239925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.240714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.249831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2863e46-ef3d-4af2-9780-574518bc9572 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1717 microversion: 2.1 time: 0.547138 Jul 20 10:51:22.255018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 678/1269] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:21 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1717 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:22.262608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f2b80abd-c9ff-4500-a96d-1a85bfdf0b44 req-8113210e-153b-4766-bbf3-4eb00f47e727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "name": "network-vif-plugged", "status": "completed", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:22.286672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f2b80abd-c9ff-4500-a96d-1a85bfdf0b44 req-8113210e-153b-4766-bbf3-4eb00f47e727 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.287151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f2b80abd-c9ff-4500-a96d-1a85bfdf0b44 req-8113210e-153b-4766-bbf3-4eb00f47e727 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.382868 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f2b80abd-c9ff-4500-a96d-1a85bfdf0b44 req-8113210e-153b-4766-bbf3-4eb00f47e727 service nova] Creating event network-vif-plugged:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:51:22.389200 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f2b80abd-c9ff-4500-a96d-1a85bfdf0b44 req-8113210e-153b-4766-bbf3-4eb00f47e727 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130338 Jul 20 10:51:22.394548 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 679/1270] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:22.410226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:22.417505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:22.443435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.447391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.448785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.449631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.703691 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d5599f9-c244-45df-ab9d-e5ecaad86ab6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.700343 Jul 20 10:51:22.705505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 592/1271] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:51:22 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:22.712361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:22.713133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:22.728740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.730807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.733491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:22.734205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:22.975997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:22.984862 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f8a72684-81d6-45ef-860e-f628f4f3986c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.588225 Jul 20 10:51:22.995581 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 680/1272] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:22 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:23.009049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b985dd74-e023-4d83-b60c-a944c6776768 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:23.038518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b985dd74-e023-4d83-b60c-a944c6776768 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041708 Jul 20 10:51:23.046100 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 681/1273] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:51:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:23.148980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:23.168031 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-316ceb07-9692-496b-9cb9-43724ffd4041 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1314 microversion: 2.1 time: 0.462230 Jul 20 10:51:23.170640 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 593/1274] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:22 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:23.286870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:23.287669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:23.302165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:23.303482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:23.304633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:23.310572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:23.368448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:23.369464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:23.412009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:23.415583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:23.420239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:23.425776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:23.494750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:51:23.756376 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf6744a4-c1e7-4a24-9a1c-45e598677342 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 204 len: 0 microversion: 2.1 time: 0.393137 Jul 20 10:51:23.763589 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 594/1275] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:51:23 2022] DELETE /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:51:23.776063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:23.779919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:23.789340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:23.790432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:23.791741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:23.792540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:24.306385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:24.318420 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-40a4de38-345e-4362-bdc6-6bd3085795f3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1707 microversion: 2.1 time: 1.034518 Jul 20 10:51:24.319025 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 682/1276] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:23 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1707 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:24.337577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:24.338385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:24.358036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:24.358925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:24.359943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:24.363992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:24.414577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:24.433693 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eadf3de8-95a6-4b0e-a1a0-d4d9b60626d5 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1606 microversion: 2.1 time: 0.657695 Jul 20 10:51:24.449851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 595/1277] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:23 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1606 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:24.467986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:24.474165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:24.507936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:24.510443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:24.512253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:24.513634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:24.990004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:25.024665 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a08a7a66-fd5e-495a-aded-5fb8b4f83034 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.700404 Jul 20 10:51:25.040128 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 683/1278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:24 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:25.059158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ac2f179-50bb-4c10-b927-9ff0c4c341c3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '.version_select at 0x7f2c3f8444c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:25.065910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ac2f179-50bb-4c10-b927-9ff0c4c341c3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.072228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ac2f179-50bb-4c10-b927-9ff0c4c341c3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:25.107316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ac2f179-50bb-4c10-b927-9ff0c4c341c3 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 3145 microversion: 2.1 time: 0.063690 Jul 20 10:51:25.111254 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 684/1279] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:51:25 2022] GET /compute/v2.1/os-migrations => generated 3145 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:25.129221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:25.132672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:25.158161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.162765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:25.165962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.166671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:25.725232 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0843b88-9eed-4a58-a194-6caefda02201 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1860 microversion: 2.1 time: 0.603039 Jul 20 10:51:25.743250 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 685/1280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:25 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1860 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:25.767135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:25.771566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:25.789223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.793981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:25.799211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.800429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:25.852133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:25.878496 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-109ad979-b500-4017-a5fe-bb0169896930 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1314 microversion: 2.1 time: 1.427132 Jul 20 10:51:25.887834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 596/1281] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:24 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1314 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:25.904999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:25.906153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:25.932331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.940826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:25.944330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:25.949832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:26.455946 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b6f44962-41ad-4c61-8809-f9a02f3f75cc tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1860 microversion: 2.1 time: 0.561682 Jul 20 10:51:26.458618 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 597/1282] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:25 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1860 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:26.478201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:26.478393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:26.484739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:26.499764 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-880eb4ae-ada3-4dfe-994e-00036411c26f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1606 microversion: 2.1 time: 0.754659 Jul 20 10:51:26.516042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:26.516869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:26.518199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:26.518861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:26.524820 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 686/1283] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:25 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1606 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:26.613076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:26.614209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:26.623118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:26.623822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:26.624786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:26.625591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:26.869964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lazy-loading 'services' on Instance uuid f1d6eb03-c865-4b85-94fa-f0071dc885da {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:51:27.117376 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ff6ced5-60a5-4b88-8ad2-8668cdadb770 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments/a80a50b8-2c23-4e2c-a348-a295bc63fec7" status: 202 len: 0 microversion: 2.1 time: 0.508576 Jul 20 10:51:27.127566 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 687/1284] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 10:51:26 2022] DELETE /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments/a80a50b8-2c23-4e2c-a348-a295bc63fec7 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:27.138408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:27.144219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:27.153790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=68 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:27.157658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:27.161196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:27.162487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:27.165088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:27.322601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:27.344513 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9c232998-659a-4123-bcd1-4e71864182e1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.882447 Jul 20 10:51:27.351484 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 598/1285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:26 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:27.395672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:27.396825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:27.438100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:27.438603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:27.440609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:27.441731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:27.550996 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4e960bbb-de57-42aa-8b5a-44f60531a7cc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185610 Jul 20 10:51:27.557308 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 599/1286] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:27 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:27.573750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:27.575905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:27.596721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:27.602568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:27.603951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:27.604628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:27.789979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:27.805107 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a31565f6-e322-48fa-9a80-8cecd606a991 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1538 microversion: 2.1 time: 0.246356 Jul 20 10:51:27.817741 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 600/1287] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:27 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1538 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:27.892909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:27.902804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df1c2889-3068-4081-8c54-65e6730f02e2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1463 microversion: 2.1 time: 0.773008 Jul 20 10:51:27.907262 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 688/1288] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:27 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1463 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:28.285998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-571630228", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ac4a4890-3d11-4186-8d89-69ca4c410ed3"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:28.368759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:28.369686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:28.378289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:28.381859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:28.383532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:28.387814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:28.424858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:51:29.172028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:29.189228 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ab197c7-bee4-45da-9861-4008ea55bfdc tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1541 microversion: 2.1 time: 0.824919 Jul 20 10:51:29.202867 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 689/1289] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:28 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1541 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:29.220492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:29.224712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:29.249307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:29.251419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:29.253114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:29.255434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:29.266422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:29.355248 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c6f0295-3173-4851-b93f-5c010abb5428 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149597 Jul 20 10:51:29.356395 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 690/1290] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:29 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:29.370652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:29.371855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:29.384978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:29.387980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:29.388346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:29.388803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:29.604104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:29.617850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:51:29.619942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:51:29.620696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:51:29.621615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:51:29.622294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:51:29.626545 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dba9aea0-2152-4163-a73f-135ce7ce6862 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1538 microversion: 2.1 time: 0.268554 Jul 20 10:51:29.639386 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 691/1291] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:29 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1538 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:29.648968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:29.650957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:29.652474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:29.653226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:29.710449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Getting quotas for project 6ed41f29a0fe4ebba18c8d24c7f513bf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:51:29.726357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Getting quotas for user 61aca4c4632f40a0b2eb6425fdcbd55e and project 6ed41f29a0fe4ebba18c8d24c7f513bf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:51:29.766868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:51:29.786228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:51:29.897053 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94a15d42-4bfa-4950-9448-72446ec650cb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615063 Jul 20 10:51:29.898489 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 601/1292] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:51:29.909008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5a0266b-4e24-421f-a06a-08bfd231bf43 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:29.910196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5a0266b-4e24-421f-a06a-08bfd231bf43 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:30.072998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5a0266b-4e24-421f-a06a-08bfd231bf43 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:30.091730 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5a0266b-4e24-421f-a06a-08bfd231bf43 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1213 microversion: 2.1 time: 0.181256 Jul 20 10:51:30.106622 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 692/1293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:29 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:30.216877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:30.217986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:30.230240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.240463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.243213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.245017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.367605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:30.369239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:30.424468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.426102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.428501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.438644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.591365 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db51a6ac-5a3d-458c-92a1-fef7113b1e11 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227086 Jul 20 10:51:30.593267 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 693/1294] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:30 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:51:30.642745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2aaee320-7aec-4cc4-8643-f5bdda9b9e47 req-ea09e52b-aa15-4954-98aa-78ca9c2e94ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc3b7d2-87d3-4486-b694-0a3a7fc27b61", "name": "network-vif-deleted", "tag": "a755841b-df0e-4f06-88dd-4cb10308ea11"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:30.684359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2aaee320-7aec-4cc4-8643-f5bdda9b9e47 req-ea09e52b-aa15-4954-98aa-78ca9c2e94ce service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.684742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2aaee320-7aec-4cc4-8643-f5bdda9b9e47 req-ea09e52b-aa15-4954-98aa-78ca9c2e94ce service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.743564 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2aaee320-7aec-4cc4-8643-f5bdda9b9e47 req-ea09e52b-aa15-4954-98aa-78ca9c2e94ce service nova] Creating event network-vif-deleted:a755841b-df0e-4f06-88dd-4cb10308ea11 for instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 on n-h2-846219-10 Jul 20 10:51:30.775518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2aaee320-7aec-4cc4-8643-f5bdda9b9e47 req-ea09e52b-aa15-4954-98aa-78ca9c2e94ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132442 Jul 20 10:51:30.776907 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 694/1295] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:30.795934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:30.805015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:30.832921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:30.840306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.842576 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62b2cc40-f01c-4794-8103-3eb4afa4914e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1540 microversion: 2.1 time: 0.629919 Jul 20 10:51:30.843623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.845988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:30.858211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:30.880268 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 602/1296] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:30 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1540 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:31.111664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:31.112727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:31.130411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:31.137213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:31.138285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:31.139635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:31.187116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:31.216618 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bfff443b-3784-4f2d-92d1-bbe20f9c8e91 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.436848 Jul 20 10:51:31.227545 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 695/1297] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:30 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:31.347727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:31.357014 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3bf0a7b6-2a68-4342-a861-de04860ce4cf tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1217 microversion: 2.1 time: 0.250714 Jul 20 10:51:31.373319 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 603/1298] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:31 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:31.607667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:31.608616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:31.642939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:31.647927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:31.649579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:31.656022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:31.759409 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9512358b-979b-403c-b354-2221360e82b3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158766 Jul 20 10:51:31.767238 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 696/1299] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:31 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:31.884400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:31.885774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:31.902325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:31.908738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:31.916606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:31.917420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:32.241330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:32.242652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:32.259883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:32.261261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:32.262354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:32.263291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:32.595451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:32.606050 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94089738-1f19-46f5-ac00-46e17aa326a6 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.369017 Jul 20 10:51:32.610320 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 697/1300] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:32 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:32.617028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:32.617996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:32.624484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:32.625267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:32.626291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:32.639321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:33.006399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:33.018433 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fecb336d-e2ca-4c84-85cc-e18d61a1cbd1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1283 microversion: 2.1 time: 0.403945 Jul 20 10:51:33.030195 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 698/1301] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:32 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1283 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:33.044815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:33.046145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:33.055916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:33.056757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:33.057767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:33.058894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:33.115783 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-23dda058-7c6f-4f68-a9f6-3b6d410c84ff tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076443 Jul 20 10:51:33.117959 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 699/1302] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:33 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:33.124954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b1480662-c587-40af-8fd0-90ca7bb3a9d8 req-52298fb3-3b8c-4952-9638-a38590fd7d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "name": "network-vif-unplugged", "status": "completed", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:33.140430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b1480662-c587-40af-8fd0-90ca7bb3a9d8 req-52298fb3-3b8c-4952-9638-a38590fd7d29 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:33.141200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b1480662-c587-40af-8fd0-90ca7bb3a9d8 req-52298fb3-3b8c-4952-9638-a38590fd7d29 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:33.184485 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b1480662-c587-40af-8fd0-90ca7bb3a9d8 req-52298fb3-3b8c-4952-9638-a38590fd7d29 service nova] Creating event network-vif-unplugged:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:51:33.192423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-b1480662-c587-40af-8fd0-90ca7bb3a9d8 req-52298fb3-3b8c-4952-9638-a38590fd7d29 service nova] Instance beb87096-6ce1-4efa-969d-a105784743cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:51:33.201923 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b1480662-c587-40af-8fd0-90ca7bb3a9d8 req-52298fb3-3b8c-4952-9638-a38590fd7d29 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082118 Jul 20 10:51:33.204840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 700/1303] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:33.604751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:33.623251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8b138e1-237c-4af4-89c3-71abdc6d3618 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1540 microversion: 2.1 time: 1.741199 Jul 20 10:51:33.632215 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 604/1304] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:31 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1540 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:33.634867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:33.639372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:33.646658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:33.647149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:33.647985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:33.654231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:34.043821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:34.044770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:34.063407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:34.065051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:34.068504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:34.073250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:34.185039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:34.378433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:34.391667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d6746dc0-2de5-4d34-96f3-c8f961e77861 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.769158 Jul 20 10:51:34.392265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 701/1305] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:33 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:34.409393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:34.416103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:34.432533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:34.435543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:34.437222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:34.437850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:34.529890 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b98200db-0c02-43de-89fc-f924314dfc60 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129268 Jul 20 10:51:34.534950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 702/1306] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:34 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:34.647654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:34.648331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:34.666768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:34.667658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:34.669932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:34.670547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:35.156778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:35.173401 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-140718a1-371d-4e25-8608-6777a29c77f2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1271 microversion: 2.1 time: 1.134306 Jul 20 10:51:35.175877 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 605/1307] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:34 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1271 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:35.409595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:35.410218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:35.422518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:35.422978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:35.428046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:35.445245 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-129f1486-1da0-436c-a257-ee8b5c652856 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1472 microversion: 2.1 time: 0.802060 Jul 20 10:51:35.445853 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 703/1308] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:34 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1472 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:35.450210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:35.451028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:35.543117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:35.544391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:35.568008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:35.571065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:35.572405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:35.573027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:35.686537 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0762f21-d9ad-427b-9f4b-97cc105b0d9b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147548 Jul 20 10:51:35.691365 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 704/1309] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:35 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:51:35.849140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:35.858049 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe10af6f-8c8e-4728-93a6-c833df04a41a tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.452953 Jul 20 10:51:35.872306 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 606/1310] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:35 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:36.200802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:36.203303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:36.213814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.214830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.216810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.217551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.367358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:36.395642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e862ad1b-ab93-4706-a994-618a612fcf37 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1271 microversion: 2.1 time: 0.198821 Jul 20 10:51:36.396239 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 705/1311] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:36 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:36.465956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:36.466572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:36.479778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.480255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.484669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.485197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.704167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:36.705793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:36.721079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.721834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.722893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.734276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.799954 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e963977c-8740-4362-b4eb-1a3b47d19c68 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099949 Jul 20 10:51:36.800752 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 706/1312] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:36 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:51:36.901902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:36.903079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:36.911553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.918747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:36.919907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:36.920628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:37.398831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:37.403725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:37.409735 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7cb5bea4-d409-4104-b9ee-0ba3c7693c6b tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.511608 Jul 20 10:51:37.416961 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-37457fd5-4e20-4de1-9a6b-b3e875e50ddf tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1472 microversion: 2.1 time: 0.954813 Jul 20 10:51:37.417940 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 707/1313] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:36 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:37.430154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:37.431054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:37.431850 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 607/1314] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:36 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1472 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:37.448017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:37.452349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:37.453465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:37.453918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:37.680062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:37.685156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:37.700748 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1d6af4d-c1f2-495d-8d5f-722a7799db11 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1271 microversion: 2.1 time: 0.281329 Jul 20 10:51:37.711612 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 708/1315] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:37 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:37.812999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:37.814146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:37.823864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:37.824577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:37.828055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:37.828850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:37.928110 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f34dbd8-0ad7-41e6-9352-14f2ee0fb3b6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119428 Jul 20 10:51:37.929897 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 608/1316] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:37 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:38.434728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:38.435401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:38.439079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:38.439965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:38.453490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:38.453999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:38.454469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:38.455307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:38.456916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:38.458858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:38.464871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:38.465385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:38.740951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:38.753286 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c330ebfe-4c2c-4057-ba4a-e69502dcade2 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.321438 Jul 20 10:51:38.763211 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 709/1317] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:38 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:38.766846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:38.767188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:38.795299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:38.795771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:38.796586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:38.797033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.249338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:39.259971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7a3d946f-ddd1-4ad7-8c28-045bcf30872e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1469 microversion: 2.1 time: 0.824956 Jul 20 10:51:39.275403 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 609/1318] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:38 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1469 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:39.292595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:39.293634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:39.298658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:39.305340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.305814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.312492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.315005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.318146 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-831a0ee3-247b-4c6a-bd0b-002dfc664a77 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1271 microversion: 2.1 time: 0.560931 Jul 20 10:51:39.322064 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 710/1319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:38 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1271 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:39.349134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:39.349879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:39.367418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.367871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.368665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.369102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.389850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e5e54f3-86c3-4d0d-9ec2-218d04089c0b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121554 Jul 20 10:51:39.390448 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 610/1320] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:51:39 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:51:39.427631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.428001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.428837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.429596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.506497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:51:39.513041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for user 14131c23a0e24e56bbf0ea1a167e256c and project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:51:39.733091 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30e05ff7-4511-416b-88fd-3b60bc32f6da tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb/action" status: 202 len: 0 microversion: 2.1 time: 0.395325 Jul 20 10:51:39.737033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 711/1321] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:51:39 2022] POST /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:39.745512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:39.745730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:39.748218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:39.750173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:39.769191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.771302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.772163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.774561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.781171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:39.784113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:39.818636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.819544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:39.824472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:39.827398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:40.078551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:40.231773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:40.240981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c022aea7-7fa7-44cf-8f7a-e5b76a651899 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.469589 Jul 20 10:51:40.248324 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 712/1322] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:39 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:40.339354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:40.340230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:40.351827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:40.354442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:40.355462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:40.356069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:40.509233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:40.528390 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c62029d-95d1-415e-b558-bfdc1538356f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 0.788148 Jul 20 10:51:40.530305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 611/1323] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:39 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:40.978470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:41.006674 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4b21d7f3-73ac-4520-856b-c1dad6538efc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.672370 Jul 20 10:51:41.015081 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 713/1324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:40 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:41.269372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:41.270243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:41.296810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:41.297270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:41.298066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:41.298512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:41.535813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:41.546717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:41.549135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:41.575470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:41.583620 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-237f2b7e-3c63-4afa-a4ec-dc12aec0bb0f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.321127 Jul 20 10:51:41.589395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:41.590263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:41.590712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:41.595582 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 612/1325] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:41 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:42.039246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:42.039869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:42.064526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:42.065786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:42.072972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:42.074417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:42.728367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:42.729978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5593263f-5394-4ef4-a24c-dd3373cf156c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 1.187431 Jul 20 10:51:42.743336 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 714/1326] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:41 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:42.773077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:42.773904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:42.790415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:42.803644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:42.808386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:42.812092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:43.204320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:43.217686 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efeba100-f0c6-401c-95de-29243560a48f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.470877 Jul 20 10:51:43.220845 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 715/1327] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:42 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:43.340930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:43.357141 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cba1ab27-fabd-4670-add4-2f3e17f6a4e7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 1.320890 Jul 20 10:51:43.364436 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 613/1328] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:42 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:43.472119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d2067aeb-b7c4-479f-9d93-5edc892c6dd8 req-b64c02db-18c9-4049-85ba-3fe66d4f49d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "name": "network-vif-plugged", "status": "completed", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:43.512572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d2067aeb-b7c4-479f-9d93-5edc892c6dd8 req-b64c02db-18c9-4049-85ba-3fe66d4f49d6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:43.513274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d2067aeb-b7c4-479f-9d93-5edc892c6dd8 req-b64c02db-18c9-4049-85ba-3fe66d4f49d6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:43.562740 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d2067aeb-b7c4-479f-9d93-5edc892c6dd8 req-b64c02db-18c9-4049-85ba-3fe66d4f49d6 service nova] Creating event network-vif-plugged:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:51:43.584622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-d2067aeb-b7c4-479f-9d93-5edc892c6dd8 req-b64c02db-18c9-4049-85ba-3fe66d4f49d6 service nova] Instance beb87096-6ce1-4efa-969d-a105784743cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:51:43.601426 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d2067aeb-b7c4-479f-9d93-5edc892c6dd8 req-b64c02db-18c9-4049-85ba-3fe66d4f49d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133322 Jul 20 10:51:43.606183 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 716/1329] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:51:43.748204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:43.749661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:43.768862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:43.772714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:43.774006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:43.777032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:44.261300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:44.276672 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b840e159-6840-4097-96ed-09bb97ce7096 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 0.526633 Jul 20 10:51:44.278866 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 614/1330] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:43 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:44.286171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:44.299280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:44.339197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:44.341625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:44.345871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:44.346609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:44.617983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:44.634697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-906b396b-dca4-4b15-a661-cc0bb10e09fc req-b2a9e788-3ceb-435e-b6f1-71ba0dee4325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00cb2df-37c8-49f3-8049-f4ea07bb78f9", "tag": "6b51e28e-124f-4a7f-975b-1e0bdcd85de9"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:44.636346 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e597b9a3-0452-4b2e-9156-79beb7b53eca tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.355915 Jul 20 10:51:44.640227 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 615/1331] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:44 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:44.656548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-906b396b-dca4-4b15-a661-cc0bb10e09fc req-b2a9e788-3ceb-435e-b6f1-71ba0dee4325 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:44.657088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-906b396b-dca4-4b15-a661-cc0bb10e09fc req-b2a9e788-3ceb-435e-b6f1-71ba0dee4325 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:44.680606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:44.687887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:44.688949 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-906b396b-dca4-4b15-a661-cc0bb10e09fc req-b2a9e788-3ceb-435e-b6f1-71ba0dee4325 service nova] Creating event network-changed:6b51e28e-124f-4a7f-975b-1e0bdcd85de9 for instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 on n-h1-846219-10 Jul 20 10:51:44.708820 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-906b396b-dca4-4b15-a661-cc0bb10e09fc req-b2a9e788-3ceb-435e-b6f1-71ba0dee4325 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.676660 Jul 20 10:51:44.711928 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 717/1332] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:44.725179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:44.727630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:44.730312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:44.744585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:45.298879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:45.300047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:45.319068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:45.328114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:45.336163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:45.336975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:45.361349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:45.373972 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48c5cb12-1e8d-4de9-82b4-22ea8b080cc6 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.729040 Jul 20 10:51:45.377386 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 616/1333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:44 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:45.657869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:45.658119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:45.673556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:45.674863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:45.675782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:45.676240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:45.933871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:45.943652 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec24695e-e263-4bf9-a4e4-4e06b37510bd tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.290739 Jul 20 10:51:45.944731 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 617/1334] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:45 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:45.970197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:45.991155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eff8c66a-df06-4828-a95f-f4a57de47670 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 0.698668 Jul 20 10:51:46.013335 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 718/1335] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:45 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:46.393427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:46.397710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:46.419855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:46.422999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:46.428651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:46.429878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:46.836559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:46.869728 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23c09442-c1cc-47ea-9a67-ac994fcf4d8b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.481369 Jul 20 10:51:46.890823 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 618/1336] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:46 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:46.966160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:46.967813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:46.987432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:46.998503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:47.026902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:47.027885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:47.032347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:47.035224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:47.053751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:47.057232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:47.058410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:47.059622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:47.238279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:47.271148 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7aad4bd-9f13-4db3-a1db-7b470b527092 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.308634 Jul 20 10:51:47.277416 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 719/1337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:46 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:47.565742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:47.594138 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5867703d-2898-419e-bc5d-d22726db5e57 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 0.572385 Jul 20 10:51:47.612390 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 619/1338] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:47 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:47.889167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:47.890323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:47.909290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:47.912026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:47.915984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:47.916656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:48.250262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:48.266766 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92d8b568-0778-486f-a54d-e6493c76c0f7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.381759 Jul 20 10:51:48.267392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 720/1339] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:47 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:48.291568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:48.292494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:48.300464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:48.302367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:48.303559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:48.304253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:48.428649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:48.441573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0488cd18-ab6b-4b79-b760-9557ccdbc7bc tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.156290 Jul 20 10:51:48.453253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 620/1340] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:48 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:48.631701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:48.632234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:48.654421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:48.654875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:48.662078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:48.662711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:49.147659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d236774d-38d8-48b1-9246-44cb6e8ee0e4 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Action: 'create', calling method: .version_select at 0x7f2c3f2e8670>, body: {"keypair": {"name": "tempest-keypair-1179493770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD+pkFWmeRaJRTTu7yqT9KnFutI/I48t1iLZjGybXag+8bb29JAvSK5VWTUyoUTeshSfJAcxdmfLIJGAJcZXrXpIZG4/QKJ6zcH+7PXfDHLbGHO/kEKmuUQB6kndnwU0A=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:49.172484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:49.209264 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6b950af-ba97-4a65-9b9a-34e6b0259ac1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 0.579415 Jul 20 10:51:49.228287 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 721/1341] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:48 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:49.267288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d236774d-38d8-48b1-9246-44cb6e8ee0e4 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Getting quotas for project 357640b5ae0b4d22ab428d85f8fac338. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:51:49.290433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:49.291226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:49.313971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:49.315753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d236774d-38d8-48b1-9246-44cb6e8ee0e4 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Getting quotas for user 49e253c41f7d41c8a153cacb50e2f26f and project 357640b5ae0b4d22ab428d85f8fac338. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:51:49.323692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:49.332310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:49.335672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:49.442994 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d236774d-38d8-48b1-9246-44cb6e8ee0e4 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.484466 Jul 20 10:51:49.444436 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 621/1342] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:51:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:49.471034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:49.494450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:49.495558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:49.539814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:49.547265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:49.551618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:49.557557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:49.928420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5c3f91971e542f3a5c3d6d7ef1c29ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e44c48be958e4d67aa16c3b0abbcfe13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:49.979247 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffc2abbe-8131-4008-9492-00d7daced573 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 200 len: 1251 microversion: 2.1 time: 0.521071 Jul 20 10:51:49.983782 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 622/1343] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:49 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 1251 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:50.048599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:50.068558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9443b6f2-3081-4dc6-b5a2-9759bbf505fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.788599 Jul 20 10:51:50.070377 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 722/1344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:49 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:51:50.248883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:50.250506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:50.273359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:50.280161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:50.282989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:50.286838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:50.434607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:50.960486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac4d2aec-1b47-4a21-a230-6c2060d028eb tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Action: 'create', calling method: .version_select at 0x7f2c3f8740d0>, body: {"pool": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:51.314720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:51.345262 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52b97d84-6087-47f3-8307-993dd63fcb04 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1468 microversion: 2.1 time: 1.097761 Jul 20 10:51:51.349526 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 623/1345] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:50 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1468 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:51.366805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:51.368249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] [instance: ffc3b7d2-87d3-4486-b694-0a3a7fc27b61] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:51.379720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:51.380217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:51.380980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:51.381575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:51.417765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] HTTP exception thrown: Instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 could not be found. Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Request method failure captured: Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 HTTP/1.1 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi192vCXSJ7hhsLbZwPPNFFxnLEPWeoRfJNoTwuRmwtDFLrvc-C-laMeWAOUF3zbup5SrIso3OpmFYJ8Bf8Ni8pizIyyNqxXuWVyNGNqEgt0TA33j0j8fdtKC1AAXxdwMNnvynKW1uuKJD2l4jPQxpk66Aaumc2Ye3qMoDTLDgVIjwWKM Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: e44c48be958e4d67aa16c3b0abbcfe13 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestBootFromVolume-1035648746 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e44c48be958e4d67aa16c3b0abbcfe13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e44c48be958e4d67aa16c3b0abbcfe13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e44c48be958e4d67aa16c3b0abbcfe13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e44c48be958e4d67aa16c3b0abbcfe13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestBootFromVolume-1035648746 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: e44c48be958e4d67aa16c3b0abbcfe13 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1035648746 Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestBootFromVolume-1035648746-project Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: e5c3f91971e542f3a5c3d6d7ef1c29ca Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestBootFromVolume-1035648746-project Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 could not be found. Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ffc3b7d2-87d3-4486-b694-0a3a7fc27b61'} Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 could not be found. Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 could not be found. Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:51:51.419517 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 could not be found. Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Returning 404 to user: Instance ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:51:51.423890 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6740146d-d2a1-4951-b4d2-14a9eeca0c98 tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61" status: 404 len: 111 microversion: 2.1 time: 0.069891 Jul 20 10:51:51.437872 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 624/1346] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:51 2022] GET /compute/v2.1/servers/ffc3b7d2-87d3-4486-b694-0a3a7fc27b61 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:51:51.460914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:51.462330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:51.483240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:51.523686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:51.524168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:51.529413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:51.533544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:53.453201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:53.491225 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7a40dbe-a3b7-485c-9d74-b7575f0d435e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 2.047558 Jul 20 10:51:53.492289 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 625/1347] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:51 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:53.521908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95a6d2ed-94a4-4a9f-bc2b-627b5bb5975f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] Calling method '.version_select at 0x7f2c3f2e8550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:53.591076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95a6d2ed-94a4-4a9f-bc2b-627b5bb5975f tempest-ServersTestBootFromVolume-1035648746 tempest-ServersTestBootFromVolume-1035648746-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882327533" status: 202 len: 0 microversion: 2.1 time: 0.095069 Jul 20 10:51:53.599746 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 626/1348] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 10:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882327533 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:51:53.636316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:53.637025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:53.674841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:53.683470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:53.687614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:53.688114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:54.852111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:54.861076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a7f9b4aa-785b-459b-baad-0fe402dc0ee0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1534 microversion: 2.1 time: 1.255719 Jul 20 10:51:54.861665 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 627/1349] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:53 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1534 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:54.879637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:54.898575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:54.931630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:54.933215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:54.935256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:54.940170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:56.147780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:56.156446 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52898bb1-f7e7-4bbb-bdf6-60342f53cadb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 1.287617 Jul 20 10:51:56.167394 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 628/1350] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:54 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:56.194247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:56.194867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:56.244659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:56.245283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:56.246110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:56.246555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:56.987452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ac4d2aec-1b47-4a21-a230-6c2060d028eb tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.179993 Jul 20 10:51:56.988966 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 723/1351] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:51:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:57.000410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5e28879-112d-49ed-9e7f-2448210637e7 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Action: 'create', calling method: .version_select at 0x7f2c3f761280>, body: {"pool": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:57.576375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:57.599070 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eea8199d-ff2f-445f-9334-580cca1ec794 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1534 microversion: 2.1 time: 1.414696 Jul 20 10:51:57.601362 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 629/1352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:56 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1534 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:57.620012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:57.626298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:57.650201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:57.650659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:57.651491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:57.651937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:58.717035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:51:58.754078 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c79d0700-75b6-423b-8641-c28af10af02a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 1.150542 Jul 20 10:51:58.767023 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 630/1353] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:57 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:51:58.796652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3c73f45d-de65-4766-bdd8-c1cc5babd447 req-598c813b-a2a1-4cfc-9b03-2d7d6fd09baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00cb2df-37c8-49f3-8049-f4ea07bb78f9", "name": "network-vif-plugged", "status": "completed", "tag": "6b51e28e-124f-4a7f-975b-1e0bdcd85de9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:51:58.850285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c73f45d-de65-4766-bdd8-c1cc5babd447 req-598c813b-a2a1-4cfc-9b03-2d7d6fd09baf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:58.853624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c73f45d-de65-4766-bdd8-c1cc5babd447 req-598c813b-a2a1-4cfc-9b03-2d7d6fd09baf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:58.883593 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3c73f45d-de65-4766-bdd8-c1cc5babd447 req-598c813b-a2a1-4cfc-9b03-2d7d6fd09baf service nova] Creating event network-vif-plugged:6b51e28e-124f-4a7f-975b-1e0bdcd85de9 for instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 on n-h1-846219-10 Jul 20 10:51:58.897431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3c73f45d-de65-4766-bdd8-c1cc5babd447 req-598c813b-a2a1-4cfc-9b03-2d7d6fd09baf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128275 Jul 20 10:51:58.901943 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 631/1354] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:51:58.916915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:51:58.918007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:51:58.936077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:58.937325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:58.939511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:51:58.942069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:51:59.307085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:51:59.365001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:00.060527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:00.341434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:00.357063 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0028c459-4f03-43f7-b6d8-684a1c8d34be tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1534 microversion: 2.1 time: 1.451759 Jul 20 10:52:00.360167 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 632/1355] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:51:58 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1534 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:00.369806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:00.370846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:00.379401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:00.380127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:00.381399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:00.382003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:00.661248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:00.673222 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8afc82d2-3406-4088-b5cd-142cc2cfa2cd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.311119 Jul 20 10:52:00.674566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 633/1356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:00 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:00.681231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-210771091", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "81950d94-8fc6-4ae2-92c9-536c8efed7fc"}], "security_groups": [{"name": "tempest-securitygroup--526914307"}], "key_name": "tempest-keypair-1179493770", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:01.842051 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5e28879-112d-49ed-9e7f-2448210637e7 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.846253 Jul 20 10:52:01.848558 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 724/1357] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:51:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:01.849132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e590826b-1ac4-49ca-b377-6019f23066a3 req-28239a96-2082-4d35-84f1-70198d1d0986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "name": "network-vif-unplugged", "status": "completed", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:01.860169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e590826b-1ac4-49ca-b377-6019f23066a3 req-28239a96-2082-4d35-84f1-70198d1d0986 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:01.860617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e590826b-1ac4-49ca-b377-6019f23066a3 req-28239a96-2082-4d35-84f1-70198d1d0986 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:01.875872 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e590826b-1ac4-49ca-b377-6019f23066a3 req-28239a96-2082-4d35-84f1-70198d1d0986 service nova] Creating event network-vif-unplugged:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:52:01.883363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-e590826b-1ac4-49ca-b377-6019f23066a3 req-28239a96-2082-4d35-84f1-70198d1d0986 service nova] Instance beb87096-6ce1-4efa-969d-a105784743cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:52:01.897322 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e590826b-1ac4-49ca-b377-6019f23066a3 req-28239a96-2082-4d35-84f1-70198d1d0986 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052693 Jul 20 10:52:01.903248 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 725/1358] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:01.916461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:01.917182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:01.937257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:01.937800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:01.938597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:01.939350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:02.197998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:02.211597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f204505a-e01b-4598-9a9a-4e665de7d7e0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1534 microversion: 2.1 time: 0.306875 Jul 20 10:52:02.222849 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 726/1359] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:01 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1534 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:02.228385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:02.231631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:02.239943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:02.240712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:02.241672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:02.242272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:02.418502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:02.432270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4829de64-ff23-4b7c-bc73-1dfc261e3cdb tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1313 microversion: 2.1 time: 0.207743 Jul 20 10:52:02.443201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 727/1360] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:02 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:02.448798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb437c75-98c4-47d3-9a38-9f1661975f17 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Action: 'create', calling method: .version_select at 0x7f2c3f9f29d0>, body: {"pool": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:04.683422 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb437c75-98c4-47d3-9a38-9f1661975f17 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.238735 Jul 20 10:52:04.684072 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 728/1361] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:52:02 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:04.689589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:04.691405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:04.703393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:04.704127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:04.705352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:04.705992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:04.964434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:04.974870 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4edf57b5-5e7b-4abe-82a3-785fb904abf1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1527 microversion: 2.1 time: 0.289654 Jul 20 10:52:04.987356 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 729/1362] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:04 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1527 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:04.998284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:05.002729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:05.010660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:05.011426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:05.013607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:05.014547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:05.336678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] validate_networks() for [('81950d94-8fc6-4ae2-92c9-536c8efed7fc', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:52:05.397821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:05.406013 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-961f97ea-0726-49de-a921-1d1ab11e44d8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1463 microversion: 2.1 time: 0.412094 Jul 20 10:52:05.406612 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 730/1363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:04 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1463 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:05.416237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa5c710a-8d19-4303-887d-4710be7f31f4 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Action: 'create', calling method: .version_select at 0x7f2c3f797d30>, body: {"pool": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:06.633917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Getting quotas for project 357640b5ae0b4d22ab428d85f8fac338. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:06.651393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Getting quotas for user 49e253c41f7d41c8a153cacb50e2f26f and project 357640b5ae0b4d22ab428d85f8fac338. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:06.674344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:06.675070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:06.677393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:06.678193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:06.678849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:06.693085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:06.702302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:06.703481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:06.704048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:06.726458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Getting quotas for project 357640b5ae0b4d22ab428d85f8fac338. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:06.733132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Getting quotas for user 49e253c41f7d41c8a153cacb50e2f26f and project 357640b5ae0b4d22ab428d85f8fac338. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:06.748416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:52:06.750936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:52:06.804787 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6463c27c-7ab2-4e75-82fe-3b4f3a628e01 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.128096 Jul 20 10:52:06.806423 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 634/1364] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:52:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 6131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:52:06.812545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:06.813430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:06.829326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:06.829935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:06.830851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:06.832559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:07.009993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:07.028850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f252b74-9e76-47b6-a99f-0fb57c2b5623 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1527 microversion: 2.1 time: 0.218726 Jul 20 10:52:07.029909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 635/1365] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:06 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1527 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:07.380875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:07.387145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'deleted': False, 'project_id': '597df0be8dbe4122bbf9c793f1bf7bce'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:07.422768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:07.424479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:07.426413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:07.427028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:07.465913 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f6ec7fb-b265-4395-9d3f-3a9959e2ffe9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.411780 Jul 20 10:52:07.467127 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 636/1366] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:52:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:52:07.475497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:07.478289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:07.486575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:07.487453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:07.489157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:07.489806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:07.811350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cca9a22d-eefc-4a46-8eea-54c393552ac0 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:52:07.835303 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80ebf3dd-1b98-4873-859b-e7bab8be0a2a tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 2348 microversion: 2.25 time: 0.366635 Jul 20 10:52:07.836771 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 637/1367] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:07 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 2348 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:08.121232 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa5c710a-8d19-4303-887d-4710be7f31f4 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.708639 Jul 20 10:52:08.122336 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 731/1368] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:52:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:08.127123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b556233f-d9a3-49fa-a1ed-12627d2bdba9 req-71004759-2741-482b-ad0a-57e65668020c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "name": "network-vif-plugged", "status": "completed", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:08.147251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b556233f-d9a3-49fa-a1ed-12627d2bdba9 req-71004759-2741-482b-ad0a-57e65668020c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.147706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b556233f-d9a3-49fa-a1ed-12627d2bdba9 req-71004759-2741-482b-ad0a-57e65668020c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.161336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b556233f-d9a3-49fa-a1ed-12627d2bdba9 req-71004759-2741-482b-ad0a-57e65668020c service nova] Creating event network-vif-plugged:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:52:08.167233 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b556233f-d9a3-49fa-a1ed-12627d2bdba9 req-71004759-2741-482b-ad0a-57e65668020c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043653 Jul 20 10:52:08.171226 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 732/1369] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:08.177776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:08.178505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:08.188124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.188733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.189740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.190350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.201980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b415ccd-4d0f-47d5-be18-f2657104b0cc tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Action: 'create', calling method: .version_select at 0x7f2c3f3290d0>, body: {"keypair": {"name": "tempest-keypair-84482541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxmlP3XEn8+5d/3D2TCcAViRThPZqrYjB6JdCQxTYiETLfiB1Vvv8vvbCuuIFkkPwX0QpdrDRrO947e/kNjWi9rXQNYieiyJU/Pq4NNpLsPVY1tsZlyZI2mKTBDZ8rkkw=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:08.238898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-9b415ccd-4d0f-47d5-be18-f2657104b0cc tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Getting quotas for project 3c30c5b0c0ee4b78afb0206701192a3b. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:08.250536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-9b415ccd-4d0f-47d5-be18-f2657104b0cc tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Getting quotas for user c4031d68fdd34d04885cf9cc999bf4d1 and project 3c30c5b0c0ee4b78afb0206701192a3b. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:08.291885 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b415ccd-4d0f-47d5-be18-f2657104b0cc tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.453598 Jul 20 10:52:08.292664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 638/1370] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:52:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:08.301992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:08.306477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25c27d37-702f-4f37-915f-ac73b57e391a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:08.307828 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:52:08.307828 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:52:08.310737 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-18ffaa08-472d-4664-a106-04bef990b023 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1329 microversion: 2.1 time: 0.138099 Jul 20 10:52:08.321253 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 733/1371] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:08 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1329 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:08.327859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:08.333500 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-25c27d37-702f-4f37-915f-ac73b57e391a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] HTTP exception thrown: Flavor 13d401a5-c946-47eb-b3dd-c578559c5373 could not be found. Jul 20 10:52:08.342182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'deleted': False} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25c27d37-702f-4f37-915f-ac73b57e391a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Request method failure captured: Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/flavors/13d401a5-c946-47eb-b3dd-c578559c5373 HTTP/1.1 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191KUjoe5fSAyAzce4NoAiAnPDPlVC1iofQTbb0d9gB4HQ_coYYSGIk3q7EsTXzdOnVVOoteLA7Rll_-3mZL0plXJaTK53y7uJ29oPN7pcdn5bA2-p0gq4eJMzX_2h9gXcod0W7VT3gE6a_A_vYKO_klFPImGdTtjLVO6SKA9DazRQw Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d874be1613274eeaa476b5049c093157 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MigrationsAdminTest-1423048136 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d874be1613274eeaa476b5049c093157", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d874be1613274eeaa476b5049c093157"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d874be1613274eeaa476b5049c093157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d874be1613274eeaa476b5049c093157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MigrationsAdminTest-1423048136 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d874be1613274eeaa476b5049c093157 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MigrationsAdminTest-1423048136 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MigrationsAdminTest-1423048136-project-admin Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8a00230248c642b2adf1648f2803eaf5 Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MigrationsAdminTest-1423048136-project-admin Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: exception: Flavor 13d401a5-c946-47eb-b3dd-c578559c5373 could not be found. Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '13d401a5-c946-47eb-b3dd-c578559c5373'} Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 13d401a5-c946-47eb-b3dd-c578559c5373 could not be found. Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 13d401a5-c946-47eb-b3dd-c578559c5373 could not be found. Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:08.344236 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 13d401a5-c946-47eb-b3dd-c578559c5373 could not be found. Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25c27d37-702f-4f37-915f-ac73b57e391a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Returning 404 to user: Flavor 13d401a5-c946-47eb-b3dd-c578559c5373 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:52:08.349833 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25c27d37-702f-4f37-915f-ac73b57e391a tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/13d401a5-c946-47eb-b3dd-c578559c5373" status: 404 len: 109 microversion: 2.1 time: 0.052051 Jul 20 10:52:08.350886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.350988 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 639/1372] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:52:08 2022] DELETE /compute/v2.1/flavors/13d401a5-c946-47eb-b3dd-c578559c5373 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:52:08.351077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.351077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.362224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.379024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f693358-51ba-4897-9602-02bf48039e10 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:08.381317 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:52:08.381317 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:52:08.382696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f693358-51ba-4897-9602-02bf48039e10 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.387446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f693358-51ba-4897-9602-02bf48039e10 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.388440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f693358-51ba-4897-9602-02bf48039e10 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:08.388892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f693358-51ba-4897-9602-02bf48039e10 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:08.454942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0f693358-51ba-4897-9602-02bf48039e10 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.098339 Jul 20 10:52:08.456854 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 640/1373] 10.222.0.79 () {60 vars in 1216 bytes} [Wed Jul 20 10:52:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:52:08.467819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9169159-4c10-4afd-ab2c-7930ebbe6507 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f3294c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:08.673625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:52:08.961195 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9169159-4c10-4afd-ab2c-7930ebbe6507 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/809a1fad-45b8-4fa4-b6cb-a1f70e914e65" status: 200 len: 142 microversion: 2.1 time: 0.503239 Jul 20 10:52:08.961814 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 641/1374] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:52:08 2022] GET /compute/v2.1/os-floating-ips/809a1fad-45b8-4fa4-b6cb-a1f70e914e65 => generated 142 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:08.971900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-91674015", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:09.148874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:52:09.232691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:09.233260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:10.564264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:10.565376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:10.569129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:10.571942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:10.573451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:10.596640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:10.597784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:10.600172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:10.601856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33a75c4c-c772-4617-9e98-42527c04a229 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21404 microversion: 2.1 time: 2.279082 Jul 20 10:52:10.602328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:10.617947 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 734/1375] 10.222.0.79 () {58 vars in 1170 bytes} [Wed Jul 20 10:52:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21404 bytes in 2296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:52:10.636000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:10.637822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33ec8925-2ddc-4378-a2d5-8e0a939e074b tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f9093a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:10.656807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Getting quotas for user 14131c23a0e24e56bbf0ea1a167e256c and project 905746ae8ae74012bd4c19dd4fed75e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:10.677030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:52:10.679666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:52:10.740444 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1c1849b-fe78-4677-a7bd-993271417e31 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.777323 Jul 20 10:52:10.745929 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 642/1376] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:52:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:52:10.747735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:10.748368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:10.757935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:10.758310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:10.770912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:10.772165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:11.261945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:11.310112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25ac0333-51e7-4c5e-a5aa-032e4e50d111 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1402 microversion: 2.1 time: 0.549277 Jul 20 10:52:11.322020 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 643/1377] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:10 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1402 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:11.338050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:11.350887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'deleted': False, 'project_id': '597df0be8dbe4122bbf9c793f1bf7bce'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:11.379456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:11.383272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:11.384623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:11.384623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:11.495742 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-caa88b92-d149-4aa3-8335-fb8fc985d2ab tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?tenant_id=6ed41f29a0fe4ebba18c8d24c7f513bf" status: 200 len: 15 microversion: 2.1 time: 0.171618 Jul 20 10:52:11.496799 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 644/1378] 10.222.0.79 () {58 vars in 1230 bytes} [Wed Jul 20 10:52:11 2022] GET /compute/v2.1/servers/detail?tenant_id=6ed41f29a0fe4ebba18c8d24c7f513bf => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:52:11.522155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8ad8c657-2a06-4d89-8b51-43e00d6c3969 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:11.522694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8ad8c657-2a06-4d89-8b51-43e00d6c3969 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:11.735831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ad8c657-2a06-4d89-8b51-43e00d6c3969 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:11.750194 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8ad8c657-2a06-4d89-8b51-43e00d6c3969 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1211 microversion: 2.1 time: 0.251556 Jul 20 10:52:11.752321 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 645/1379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:11 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1211 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:11.766833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:11.790895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'tenant_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'deleted': False} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:11.809383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:11.809883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:11.810957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:11.811638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:11.879796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:52:11.974801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:11.985690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:11.986269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:12.220475 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ca6d8fb-5220-4de0-be1a-eca036a196f8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6ed41f29a0fe4ebba18c8d24c7f513bf" status: 200 len: 4832 microversion: 2.1 time: 0.465544 Jul 20 10:52:12.227556 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 646/1380] 10.222.0.79 () {58 vars in 1256 bytes} [Wed Jul 20 10:52:11 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6ed41f29a0fe4ebba18c8d24c7f513bf => generated 4832 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:12.263591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1162389b-9bcc-4355-b565-1f19929dfe9c", "device": "/dev/xvdb"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:12.278604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:12.305782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:12.306253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:12.307910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:12.308841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:12.751766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:12.864287 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33ec8925-2ddc-4378-a2d5-8e0a939e074b tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/809a1fad-45b8-4fa4-b6cb-a1f70e914e65" status: 202 len: 0 microversion: 2.1 time: 2.244447 Jul 20 10:52:12.865781 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 735/1381] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:52:10 2022] DELETE /compute/v2.1/os-floating-ips/809a1fad-45b8-4fa4-b6cb-a1f70e914e65 => generated 0 bytes in 2247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:12.872962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:12.915904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'tenant_id': '597df0be8dbe4122bbf9c793f1bf7bce', 'deleted': False} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:12.936397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:12.939982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:12.944030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:12.949870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:13.125128 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-274d09c4-e374-497e-aaa9-53b1e9b094c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "POST /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.891287 Jul 20 10:52:13.135873 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 647/1382] 10.222.0.79 () {62 vars in 1363 bytes} [Wed Jul 20 10:52:12 2022] POST /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:52:13.174070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7790b7ec-ba00-47ed-9902-ac51b708f2ce req-53324c0f-c919-448f-bfb1-4139b6d64853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84916937-f7a0-4d95-940a-d3de80a3fcb9", "tag": "c84ae959-1c81-43c3-9d92-5de435dff542"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:13.213195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7790b7ec-ba00-47ed-9902-ac51b708f2ce req-53324c0f-c919-448f-bfb1-4139b6d64853 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:13.213900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7790b7ec-ba00-47ed-9902-ac51b708f2ce req-53324c0f-c919-448f-bfb1-4139b6d64853 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:13.227222 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de7cc4e6-ecd5-487f-9575-7e809ba565d4 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=597df0be8dbe4122bbf9c793f1bf7bce" status: 200 len: 15 microversion: 2.1 time: 0.360002 Jul 20 10:52:13.230419 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 736/1383] 10.222.0.79 () {58 vars in 1256 bytes} [Wed Jul 20 10:52:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=597df0be8dbe4122bbf9c793f1bf7bce => generated 15 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:52:13.239598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:13.241614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7790b7ec-ba00-47ed-9902-ac51b708f2ce req-53324c0f-c919-448f-bfb1-4139b6d64853 service nova] Creating event network-changed:c84ae959-1c81-43c3-9d92-5de435dff542 for instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 on n-h2-846219-10 Jul 20 10:52:13.242315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:13.254075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7790b7ec-ba00-47ed-9902-ac51b708f2ce req-53324c0f-c919-448f-bfb1-4139b6d64853 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110237 Jul 20 10:52:13.259090 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 648/1384] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:13.265663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:13.266479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:13.267566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:13.271288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:13.283827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:13.283827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:13.328126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:13.335937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:13.337338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:13.338210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:13.696057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:13.710027 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-578ad4c9-7152-4353-b4ac-af9d4c568986 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1269 microversion: 2.1 time: 0.448098 Jul 20 10:52:13.720916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 649/1385] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:13 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1269 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:13.726086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-42575be7-95de-420f-a440-56ee57f0ce20 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f462f70>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:13.889657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:13.899936 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7a4d3f70-44b1-426b-8719-3325a512ee46 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1402 microversion: 2.1 time: 0.668182 Jul 20 10:52:13.901384 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 737/1386] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:13 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1402 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:13.906440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d20ed309-cfbd-484d-bcf0-2821ea8e45d9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:13.912517 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d20ed309-cfbd-484d-bcf0-2821ea8e45d9 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009744 Jul 20 10:52:13.926357 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 738/1387] 10.222.0.79 () {58 vars in 1188 bytes} [Wed Jul 20 10:52:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:52:13.932755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-299517004", "imageRef": "d8002fd3-4dce-4c0b-b560-acd8c02b1cbf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4eb675af-2384-43e0-beb7-3da60b83a108"}], "security_groups": [{"name": "tempest-securitygroup--1674091286"}], "key_name": "tempest-keypair-84482541", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:14.539053 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-42575be7-95de-420f-a440-56ee57f0ce20 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.824806 Jul 20 10:52:14.540364 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 650/1388] 10.222.0.79 () {58 vars in 1163 bytes} [Wed Jul 20 10:52:13 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:52:14.549761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:14.551916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:14.578431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:14.579576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:14.580870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:14.581711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:14.631690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] validate_networks() for [('4eb675af-2384-43e0-beb7-3da60b83a108', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:52:14.707046 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9ddd3be-b839-42dd-92da-2ca63c63722f tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.164575 Jul 20 10:52:14.707993 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 651/1389] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:52:14 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:14.714574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b875d552-a538-4790-9a87-f85ff7419758 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f2e8c10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:15.893057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b875d552-a538-4790-9a87-f85ff7419758 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 1.183767 Jul 20 10:52:15.894977 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 652/1390] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 10:52:14 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:15.900009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:15.904370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:15.923904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:15.943469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:15.944218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:15.945222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:15.945838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:16.093724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:52:16.264206 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3e773258-6725-4878-b5c8-a43cc4f9af7c tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.366921 Jul 20 10:52:16.270972 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 653/1391] 10.222.0.79 () {58 vars in 1149 bytes} [Wed Jul 20 10:52:15 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:16.276016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:16.276655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:16.287573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:16.288038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:16.288838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:16.289283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:16.634443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:16.646728 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9edb283f-8d95-471a-8138-1fee602cc70b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1311 microversion: 2.1 time: 0.374469 Jul 20 10:52:16.656693 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 654/1392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:16 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1311 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:16.662586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:16.663224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:16.671649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:16.672100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:16.673322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:16.673322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:17.056264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:17.067755 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-10ec0377-a82b-461e-b933-f759bdf5d2fd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1402 microversion: 2.1 time: 0.409625 Jul 20 10:52:17.077679 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 655/1393] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:16 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1402 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:17.084108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1677181325", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "896bfaeb-a0b5-419b-bf8d-148d7d420fcc"}], "block_device_mapping_v2": [{"uuid": "f8038687-fea8-412d-ab33-a9a0ed37fff8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:17.096391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:17.097473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:17.098399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:17.098999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:17.099106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:17.117410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:17.118035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:17.119668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:17.122363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:17.150674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Getting quotas for project 3c30c5b0c0ee4b78afb0206701192a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:17.157848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Getting quotas for user c4031d68fdd34d04885cf9cc999bf4d1 and project 3c30c5b0c0ee4b78afb0206701192a3b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:17.176866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:52:17.180364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d8002fd3-4dce-4c0b-b560-acd8c02b1cbf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:52:17.200951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] validate_networks() for [('896bfaeb-a0b5-419b-bf8d-148d7d420fcc', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:52:17.254866 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ea3adcf-e7cc-4dbd-8d1c-1d19e1223238 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.326087 Jul 20 10:52:17.256123 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 739/1394] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:52:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 3329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:52:17.263019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7dfff31b-ec33-4293-8156-f7ca52fb2241 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f901280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:19.248290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:19.249255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:19.249976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:19.250546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:19.251268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:19.270876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:19.273562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:19.274868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:19.275363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:19.333944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:19.346305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Getting quotas for user 90200241ccaf4904a4b973e0351fdff6 and project 985736ff3ec5477c99f3b0bdf3c9c4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:19.482759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:52:19.485739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8038687-fea8-412d-ab33-a9a0ed37fff8',volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:52:19.811258 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c0be78c7-4307-42f8-8bd6-f50e8b14b1e5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.730765 Jul 20 10:52:19.820915 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 656/1395] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:52:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:52:19.828240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:19.829650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:19.841966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:19.842966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:19.844767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:19.845480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:20.178843 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d17adf0d-058b-4a4e-82d5-5a99965decb1 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.355268 Jul 20 10:52:20.179681 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 657/1396] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:52:19 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:20.185420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:20.186035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:20.206808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:20.207331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:20.208219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:20.211089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:20.718798 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7dfff31b-ec33-4293-8156-f7ca52fb2241 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/059ca5ad-8606-44c6-91b9-0eef887f1e82" status: 202 len: 0 microversion: 2.1 time: 3.461243 Jul 20 10:52:20.719535 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 740/1397] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:52:17 2022] DELETE /compute/v2.1/os-floating-ips/059ca5ad-8606-44c6-91b9-0eef887f1e82 => generated 0 bytes in 3463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:20.725449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:20.726411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:20.755111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:20.762634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:20.763885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:20.767903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:20.827692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:20.838373 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d8ea888-57f3-4993-877c-1fa02ebdb839 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.657258 Jul 20 10:52:20.840420 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 658/1398] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:20 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:20.865718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:20.867739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:20.888033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:20.889567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:20.890838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:20.891707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:21.552501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:21.561971 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cecda8e5-39dd-4253-b4f6-c0e5490b74b0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1311 microversion: 2.1 time: 0.840902 Jul 20 10:52:21.567986 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 741/1399] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:20 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1311 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:21.578885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8283ca01-191b-4067-92f1-ddc21086114e req-5260b520-9198-4b9e-b1d4-d9b1ab126061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84916937-f7a0-4d95-940a-d3de80a3fcb9", "name": "network-vif-plugged", "status": "completed", "tag": "c84ae959-1c81-43c3-9d92-5de435dff542"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:21.600972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8283ca01-191b-4067-92f1-ddc21086114e req-5260b520-9198-4b9e-b1d4-d9b1ab126061 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:21.601742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8283ca01-191b-4067-92f1-ddc21086114e req-5260b520-9198-4b9e-b1d4-d9b1ab126061 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:21.632170 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8283ca01-191b-4067-92f1-ddc21086114e req-5260b520-9198-4b9e-b1d4-d9b1ab126061 service nova] Creating event network-vif-plugged:c84ae959-1c81-43c3-9d92-5de435dff542 for instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 on n-h2-846219-10 Jul 20 10:52:21.638877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:21.649057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5bbc82ea-19da-485c-8a7e-e483d4033a1a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1402 microversion: 2.1 time: 0.806529 Jul 20 10:52:21.653730 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8283ca01-191b-4067-92f1-ddc21086114e req-5260b520-9198-4b9e-b1d4-d9b1ab126061 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083148 Jul 20 10:52:21.654625 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 659/1400] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:20 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1402 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:21.656954 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 742/1401] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:21.666750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:21.667090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-89c5d07a-f290-406a-b72a-a31fe208bfa8 req-1927fee4-a5f4-49b5-8b02-42d28cd94fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:21.674328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:21.688292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:21.689518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:21.689677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-89c5d07a-f290-406a-b72a-a31fe208bfa8 req-1927fee4-a5f4-49b5-8b02-42d28cd94fac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:21.690307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-89c5d07a-f290-406a-b72a-a31fe208bfa8 req-1927fee4-a5f4-49b5-8b02-42d28cd94fac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:21.694016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:21.695925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:21.772276 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-89c5d07a-f290-406a-b72a-a31fe208bfa8 req-1927fee4-a5f4-49b5-8b02-42d28cd94fac service nova] Creating event network-changed:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h2-846219-10 Jul 20 10:52:21.795788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-89c5d07a-f290-406a-b72a-a31fe208bfa8 req-1927fee4-a5f4-49b5-8b02-42d28cd94fac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138974 Jul 20 10:52:21.802324 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 660/1402] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:21.822785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:21.823601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:21.853560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:21.854178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:21.858968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:21.859448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:22.021500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:22.039313 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c849adfe-3d8e-48c7-ad0d-c1b2e02842d5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1151 microversion: 2.1 time: 0.380461 Jul 20 10:52:22.041367 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 743/1403] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:21 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1151 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:22.060040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-80389209-5787-49f3-b5a6-26b62f68b0fc tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f901e50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:22.576760 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c2bc94fd-068f-42c1-b857-eaa43ee66873 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1616 microversion: 2.1 time: 0.772984 Jul 20 10:52:22.577373 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 661/1404] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:21 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1616 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:22.586945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:22.587622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:22.605206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:22.605692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:22.606639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:22.607145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:23.181842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:23.198722 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ec08c9b-5bec-4f44-acca-3fa991c52223 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.620166 Jul 20 10:52:23.199683 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 662/1405] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:22 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:23.223434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:23.224820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:23.233043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:23.233778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:23.235066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:23.235946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:24.509604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:24.521389 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76f10794-a121-4f77-9207-d8943bf07ebb tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1311 microversion: 2.1 time: 1.320034 Jul 20 10:52:24.536098 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 663/1406] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:23 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1311 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:24.569347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:24.570155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:24.586322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:24.588269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:24.589595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:24.596827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:24.653550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:24.876688 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-80389209-5787-49f3-b5a6-26b62f68b0fc tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/0b2d87ab-02b1-448e-892d-7cda757da09e" status: 202 len: 0 microversion: 2.1 time: 2.833951 Jul 20 10:52:24.877379 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 744/1407] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:52:22 2022] DELETE /compute/v2.1/os-floating-ips/0b2d87ab-02b1-448e-892d-7cda757da09e => generated 0 bytes in 2835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:24.888021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:24.900440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:24.925487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:24.927293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:24.933665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:24.935021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:26.007288 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0aadc60-acd6-4849-912f-179bb21738c6 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1616 microversion: 2.1 time: 1.468464 Jul 20 10:52:26.023872 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 664/1408] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:24 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1616 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:26.029061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:26.029785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:26.051104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:26.051728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:26.053956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:26.054379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:26.132750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:26.160162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2124d5be-3071-434c-a6b5-1f2defbd7ac1 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1402 microversion: 2.1 time: 1.279620 Jul 20 10:52:26.180232 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 745/1409] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:24 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1402 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:26.211516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:26.218872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:26.236390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:26.247697 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09011861-abfd-4031-b8e5-38c8fac09440 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1169 microversion: 2.1 time: 0.222534 Jul 20 10:52:26.252578 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 665/1410] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:26 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1169 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:26.258909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:26.262444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:26.266602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:26.269811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f14b7bcb-6c23-43df-b9a1-db2611da0777 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] Calling method '.version_select at 0x7f2c3f4824c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:26.270125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:27.024685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:27.043230 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ceac767a-12cb-4355-90b2-8dae190d4e9b tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.844469 Jul 20 10:52:27.046750 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 746/1411] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:26 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:27.091310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:27.092338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:27.121141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:27.129500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:27.132959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:27.133522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:27.275997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:27.301752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:28.089226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:28.111987 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c4d43e11-e59b-4967-a464-9b01b3569d8e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1311 microversion: 2.1 time: 1.060593 Jul 20 10:52:28.130486 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 747/1412] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:27 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1311 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:28.136484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:28.142244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'host': 'n-h1-846219-10', 'deleted': False} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:28.150456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.151690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.153027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.154058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.389032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:52:28.704030 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1f3b658c-577c-4964-acb1-e71bf02cc0b8 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=n-h1-846219-10&all_tenants=1" status: 200 len: 2967 microversion: 2.1 time: 0.571634 Jul 20 10:52:28.715815 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 748/1413] 10.222.0.79 () {58 vars in 1191 bytes} [Wed Jul 20 10:52:28 2022] GET /compute/v2.1/servers?host=n-h1-846219-10&all_tenants=1 => generated 2967 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:28.729132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-92570d89-90d3-4771-8ba9-3874ab199b82 req-d34b0e80-ef95-4a7b-b787-dcb057ddfe18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f172f524-ae19-4718-848e-2c6c601750df", "tag": "8d779160-fbcd-44f4-898a-2ddcbded933d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:28.768361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-92570d89-90d3-4771-8ba9-3874ab199b82 req-d34b0e80-ef95-4a7b-b787-dcb057ddfe18 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.770175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-92570d89-90d3-4771-8ba9-3874ab199b82 req-d34b0e80-ef95-4a7b-b787-dcb057ddfe18 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.802955 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-92570d89-90d3-4771-8ba9-3874ab199b82 req-d34b0e80-ef95-4a7b-b787-dcb057ddfe18 service nova] Creating event network-changed:8d779160-fbcd-44f4-898a-2ddcbded933d for instance f172f524-ae19-4718-848e-2c6c601750df on n-h1-846219-10 Jul 20 10:52:28.823098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-92570d89-90d3-4771-8ba9-3874ab199b82 req-d34b0e80-ef95-4a7b-b787-dcb057ddfe18 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105621 Jul 20 10:52:28.825323 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 749/1414] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:28.834776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f14b7bcb-6c23-43df-b9a1-db2611da0777 tempest-FloatingIPDetailsTestJSON-1084470538 tempest-FloatingIPDetailsTestJSON-1084470538-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/084bf9bf-f6e7-4ac4-b7a3-0d380639bd42" status: 202 len: 0 microversion: 2.1 time: 2.578517 Jul 20 10:52:28.835418 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 666/1415] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:52:26 2022] DELETE /compute/v2.1/os-floating-ips/084bf9bf-f6e7-4ac4-b7a3-0d380639bd42 => generated 0 bytes in 2580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:28.845997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:28.847244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:28.847678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:28.849058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:28.882251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.885688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.885912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.886647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.888062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.888564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:28.891890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.892487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:28.914310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:29.305791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=16 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:29.375307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=30 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:30.204379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:30.228924 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df3c440a-5e8b-4834-9bbb-46351492b4b2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1589 microversion: 2.1 time: 1.401924 Jul 20 10:52:30.232601 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 750/1416] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:28 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1589 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:30.259668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:30.260641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:30.292962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:30.306425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:30.307003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:30.308126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:30.308700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:30.830514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:30.864742 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2476e094-2776-45d2-a305-37639072587b tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1211 microversion: 2.1 time: 2.022994 Jul 20 10:52:30.870992 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 667/1417] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:28 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1211 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:30.894012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:30.912143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:52:30.920833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:30.921787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:30.924059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:30.928452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:31.132435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:31.146713 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e7b3895-8cae-43be-9704-40cebb307385 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.912730 Jul 20 10:52:31.157154 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9bc8a293-96af-49b2-837b-f4f74ffbbf57 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.289921 Jul 20 10:52:31.165887 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 751/1418] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:30 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:31.166815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 668/1419] 10.222.0.79 () {58 vars in 1195 bytes} [Wed Jul 20 10:52:30 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:52:31.209817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7e8f9a4e-fc1b-45b1-8f29-a8bb70fba3e4 req-9332ee94-464f-4d95-9caa-5277a8f60f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "name": "network-vif-plugged", "status": "completed", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:31.246240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7e8f9a4e-fc1b-45b1-8f29-a8bb70fba3e4 req-9332ee94-464f-4d95-9caa-5277a8f60f3e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:31.247647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7e8f9a4e-fc1b-45b1-8f29-a8bb70fba3e4 req-9332ee94-464f-4d95-9caa-5277a8f60f3e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:31.305627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7e8f9a4e-fc1b-45b1-8f29-a8bb70fba3e4 req-9332ee94-464f-4d95-9caa-5277a8f60f3e service nova] Creating event network-vif-plugged:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h2-846219-10 Jul 20 10:52:31.329472 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7e8f9a4e-fc1b-45b1-8f29-a8bb70fba3e4 req-9332ee94-464f-4d95-9caa-5277a8f60f3e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159166 Jul 20 10:52:31.336955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 669/1420] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:31.380907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:31.381780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:31.410308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:31.411078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:31.420230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:31.420827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:31.475677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-610411195", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "977f881e-87a7-4d1b-8815-431372c58e96"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:31.582770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] validate_networks() for [('977f881e-87a7-4d1b-8815-431372c58e96', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:52:32.101688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:32.112947 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be907df2-03b9-4635-bddc-be69ce510271 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1311 microversion: 2.1 time: 0.767246 Jul 20 10:52:32.118350 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 670/1421] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:31 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1311 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:32.126637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:32.136329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:32.155034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.155524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:32.156454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.156894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:32.578750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cca9a22d-eefc-4a46-8eea-54c393552ac0 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:52:32.639058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5435f157-2aa0-4f9b-8175-5471e463fd2d tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 2426 microversion: 2.25 time: 0.519328 Jul 20 10:52:32.640570 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 671/1422] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:32 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 2426 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:32.649527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:32.650023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:32.684411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.687800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:32.693618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.694687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:32.917120 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c9ec0588-9aef-40c5-95d4-affd87f1391a tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.276407 Jul 20 10:52:32.917965 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 672/1423] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:52:32 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:32.949409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a800554e-f50e-4962-90c5-1b28f880f1a8 req-edd3c638-fc8d-4646-8db6-70c325ee65ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf1c0b2-b3ca-452b-bf03-d36f55019d0a", "tag": "b7e29330-5a03-4253-84a0-568c80dee39a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:32.958815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:32.960199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:32.961065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:32.961656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:32.962265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:32.986023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a800554e-f50e-4962-90c5-1b28f880f1a8 req-edd3c638-fc8d-4646-8db6-70c325ee65ce service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.987401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.987864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:32.988707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:32.989118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:32.989591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a800554e-f50e-4962-90c5-1b28f880f1a8 req-edd3c638-fc8d-4646-8db6-70c325ee65ce service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:33.034897 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a800554e-f50e-4962-90c5-1b28f880f1a8 req-edd3c638-fc8d-4646-8db6-70c325ee65ce service nova] Creating event network-changed:b7e29330-5a03-4253-84a0-568c80dee39a for instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a on n-h2-846219-10 Jul 20 10:52:33.043788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a800554e-f50e-4962-90c5-1b28f880f1a8 req-edd3c638-fc8d-4646-8db6-70c325ee65ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111783 Jul 20 10:52:33.045925 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 673/1424] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:33.057828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:33.060449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:33.068879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Getting quotas for project 042c6b70c582444a8bbf747145814cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:33.074410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:33.074927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:33.075971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:33.076508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:33.123757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Getting quotas for user 31e507de9dfa4ab7aeea7d7f510be3da and project 042c6b70c582444a8bbf747145814cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:33.217771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:52:33.227265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:52:33.338923 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-990cd6ce-2a8b-4b56-980a-fa0d3ceff4b9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.172006 Jul 20 10:52:33.341523 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 752/1425] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:52:33.352881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:33.355142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:33.386908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:33.394399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:33.396241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:33.400383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:33.470997 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-40a2a784-6a3b-4146-b98b-f978d83efc94 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.419798 Jul 20 10:52:33.477548 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 674/1426] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:52:33 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:33.500620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:33.503429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:33.529024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:33.529494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:33.537776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:33.542898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:34.342820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:34.357426 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96592426-822e-4722-829d-5c2637f68553 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.876446 Jul 20 10:52:34.374948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:34.375563 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 675/1427] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:33 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:34.384301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-10", "block_migration": "auto"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:34.386344 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d788c6b-0467-4db1-883a-d1f405cfe7f2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1211 microversion: 2.1 time: 1.043474 Jul 20 10:52:34.387188 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 753/1428] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:33 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1211 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:34.388539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:34.406390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:34.406919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:34.407782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:34.408246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:34.421938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:34.422832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:34.449549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:34.451836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:34.452888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:34.454686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:34.530231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'flavor' on Instance uuid cca9a22d-eefc-4a46-8eea-54c393552ac0 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:52:34.576201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Going to try to live migrate instance to n-h2-846219-10 {{(pid=125886) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:52:35.340781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:35.354015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9761b8b4-4b97-4db9-9a86-d1e528e582c2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1461 microversion: 2.1 time: 0.949581 Jul 20 10:52:35.354944 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 754/1429] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:34 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1461 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:35.359900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:35.360245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:35.390066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.390735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.392759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.393476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.507654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:35.523400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:35.526988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:35.528184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efe2a484-8642-4fb8-b053-ae0e8834fc68 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1262 microversion: 2.21 time: 0.172253 Jul 20 10:52:35.528843 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 755/1430] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:35 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1262 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:35.544463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:35.546297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:35.565062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.565952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.567343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.568157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.690199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:35.691285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:35.692407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:35.693103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:35.693711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:35.767245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:35.775140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.776125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.777288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.777999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.809120 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6eb51cee-e020-4844-a706-e0db09ddf8e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 1067 microversion: 2.1 time: 0.279301 Jul 20 10:52:35.810138 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 756/1431] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:52:35 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 1067 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 10:52:35.816034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:35.817192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:35.828928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.829483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:35.830653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:35.831487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.099264 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bfc835df-4662-4ae8-af23-7edaeffecad7 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1614 microversion: 2.1 time: 0.287271 Jul 20 10:52:36.100309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 757/1432] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:35 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1614 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:36.105495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:36.106330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:36.114109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.114818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.115956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.116585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.395646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:36.406088 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a399a6a7-8cf0-4ff7-9a71-36d8f1346386 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.304546 Jul 20 10:52:36.407219 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 758/1433] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:36 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:36.412522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:36.413226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:36.419959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.420525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.421374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.421889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.758565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:36.768130 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d28caca-eee2-4c33-9f9a-bd474ddc5936 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.359646 Jul 20 10:52:36.769058 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 759/1434] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:36 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:36.774800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:36.776594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:36.782166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.782631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.783459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.784105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.936562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:36.946793 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec8e254f-d239-47dd-a301-cc78dadd557f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.176380 Jul 20 10:52:36.947701 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 760/1435] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:36 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:36.952898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:36.953721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:36.962340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.963051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:36.963892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:36.964335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.136255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:37.145243 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e270ee46-4033-4946-b88a-81b10245edef tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1589 microversion: 2.1 time: 0.196250 Jul 20 10:52:37.146122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 761/1436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:36 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1589 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:37.154201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-736a4c21-7fe9-42d1-9378-1b67642e776c req-110aa409-a9d2-4b3a-b226-511fe669bba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84916937-f7a0-4d95-940a-d3de80a3fcb9", "tag": "c84ae959-1c81-43c3-9d92-5de435dff542"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:37.166980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-736a4c21-7fe9-42d1-9378-1b67642e776c req-110aa409-a9d2-4b3a-b226-511fe669bba4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.167745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-736a4c21-7fe9-42d1-9378-1b67642e776c req-110aa409-a9d2-4b3a-b226-511fe669bba4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.182114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-736a4c21-7fe9-42d1-9378-1b67642e776c req-110aa409-a9d2-4b3a-b226-511fe669bba4 service nova] Creating event network-changed:c84ae959-1c81-43c3-9d92-5de435dff542 for instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 on n-h2-846219-10 Jul 20 10:52:37.188783 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-736a4c21-7fe9-42d1-9378-1b67642e776c req-110aa409-a9d2-4b3a-b226-511fe669bba4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041177 Jul 20 10:52:37.191488 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 762/1437] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:37.197777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:37.198458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:37.208743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.209664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.210643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.211350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.276629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8a00230248c642b2adf1648f2803eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd874be1613274eeaa476b5049c093157', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:37.277234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] flavor_id is None. Assuming migration. {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 10:52:37.278096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 10:52:37.465727 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42aefeef-4f02-4c20-98b4-15b83aca1e74 tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a/action" status: 202 len: 0 microversion: 2.1 time: 0.272953 Jul 20 10:52:37.466550 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 763/1438] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:52:37 2022] POST /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:37.471759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:37.472427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:37.479557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.480671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.481927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.482423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.513117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:37.575149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:37.587556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:37.589150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:37.590718 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ae9d1293-2d88-4d41-b91f-6602252808ef tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1254 microversion: 2.21 time: 0.123178 Jul 20 10:52:37.591663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 764/1439] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:37 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1254 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:37.620559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:37.622475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:37.641851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.642865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.643927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.646560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.856439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:37.866946 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8963f01-a877-4250-9d67-58f4a338b3bf tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.274015 Jul 20 10:52:37.876954 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 765/1440] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:37 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:37.881308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:37.881988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:37.888567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.889013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:37.889829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:37.890256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.296388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:38.311760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-456e6b10-18c2-4331-af55-5241caae2c41 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1470 microversion: 2.1 time: 0.432277 Jul 20 10:52:38.317266 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 766/1441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:37 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1470 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:38.334524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:38.336130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:38.352586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.353201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.354954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.356146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.493400 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-649479b2-a72e-4b81-81ed-ff9b0d73f128 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/action" status: 202 len: 0 microversion: 2.25 time: 4.117187 Jul 20 10:52:38.494569 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 676/1442] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:52:34 2022] POST /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/action => generated 0 bytes in 4119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:52:38.501006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:38.504923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:38.521445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.521983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.522696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.527104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.614631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:38.627794 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc0027aa-a082-4a87-bcd3-3b3f6aafdcbe tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.297376 Jul 20 10:52:38.628862 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 767/1443] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:38 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:38.633605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:38.642780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:38.654004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.654727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.655720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.656305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.945288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:38.953328 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b05c7509-d64b-43fd-b82a-e2be34ed1fba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.457577 Jul 20 10:52:38.954002 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 677/1444] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:38 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:38.959105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:38.959819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:38.965814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.966273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.967059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.967531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.971133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:38.981286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:38.982733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:38.983888 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f357ec5c-b74b-4f74-8e42-55d1b1b56833 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.353964 Jul 20 10:52:38.985132 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 768/1445] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:38 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:38.989894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:38.990695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:38.998291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:38.998947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:38.999919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.000515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:39.040742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:39.050677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:39.054536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:39.054536 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e328f6f4-65d5-4de6-90a5-b5be6a91b72d tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1310 microversion: 2.21 time: 0.098552 Jul 20 10:52:39.054536 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 678/1446] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:38 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:39.264195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:39.271851 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-21029aca-8375-4237-8a6e-f7bd69579505 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.285503 Jul 20 10:52:39.272469 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 769/1447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:38 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:39.541774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:39.543339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:39.554406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.554903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:39.555744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.556186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:39.646634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:39.648341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:39.655004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.655764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:39.656748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.657589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:39.771116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:39.778890 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-130d3c63-6829-4faa-a61c-28692f456796 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1470 microversion: 2.1 time: 0.447651 Jul 20 10:52:39.789104 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 679/1448] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:39 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:39.832819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:39.841117 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e0cdfe8-482b-4472-84e9-b0f7b83f8163 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.199222 Jul 20 10:52:39.841710 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 770/1449] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:39 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:39.972018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:39.972676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:39.979992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.980510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:39.981221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:39.981666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.002083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:40.004934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.005747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:40.013716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.014927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.016526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.017320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.219609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.238718 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0ffc5fd9-11e9-4827-b4ce-1b01966d4281 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.270932 Jul 20 10:52:40.239399 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 680/1450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:39 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:40.254224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.254764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:40.257757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.263378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.263895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.264982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.265598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.272085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.273675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.275397 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d6e7cc3-b364-429f-ae5b-e50c6fcab5ed tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.276160 Jul 20 10:52:40.275991 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 771/1451] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:39 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:40.292055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.292928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:40.301218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.301460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.302247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.302692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.363697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.379018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.381649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.384382 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77932d4f-b23a-4987-927c-ee7f2cf0e135 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1310 microversion: 2.21 time: 0.134377 Jul 20 10:52:40.385149 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 681/1452] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:40 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1310 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:40.483035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:40.491853 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bcf3fdc5-cbcb-4324-8b7f-f574a35bc811 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.205648 Jul 20 10:52:40.492873 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 772/1453] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:40 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:40.680526 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-557f098d-5b45-41df-8450-d8993de43a4b tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] 10.222.0.79 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.136215 Jul 20 10:52:40.681394 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 682/1454] 10.222.0.79 () {58 vars in 1127 bytes} [Wed Jul 20 10:52:40 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 10:52:40.691748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b439bb1b-f6f8-4091-974f-1dbcbd2b8600 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Calling method '.version_select at 0x7f2c3f90d040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.738707 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b439bb1b-f6f8-4091-974f-1dbcbd2b8600 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] HTTP exception thrown: Image not found. Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b439bb1b-f6f8-4091-974f-1dbcbd2b8600 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Request method failure captured: Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1954PyXZPh9WVNMwY9jppdXnK8kRLvn35ECgiIVLDeEMr4dp9QnPO31vitRTOYfskR1p2hieg-dBOLpcQ6wUiswA7uRV3cto8KS5UK2jr1V_PPaHlLvdsnrRwjaY4J8e9VUI6BtyEYOJiY0qJbJ0unO_V9hPhxE3YRsituec369FLGI Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11cb68c880484066ae86b972b9995943", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11cb68c880484066ae86b972b9995943"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 6d15cecc400b4727ad91a3a8a86e820b Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '-1'} Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.772697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b439bb1b-f6f8-4091-974f-1dbcbd2b8600 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b439bb1b-f6f8-4091-974f-1dbcbd2b8600 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] 10.222.0.79 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.087226 Jul 20 10:52:40.778175 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 773/1455] 10.222.0.79 () {58 vars in 1133 bytes} [Wed Jul 20 10:52:40 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:52:40.786696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-096609f2-79ef-418c-8d2e-630f42deebc7 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Calling method '.version_select at 0x7f2c4dcc2700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.797622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.798244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:40.810608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.811085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.812196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.812380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.814186 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-096609f2-79ef-418c-8d2e-630f42deebc7 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] HTTP exception thrown: Image not found. Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-096609f2-79ef-418c-8d2e-630f42deebc7 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Request method failure captured: Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/images/d3a5afd8-ab72-436d-a3be-b9cfa8a459ej HTTP/1.1 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1954PyXZPh9WVNMwY9jppdXnK8kRLvn35ECgiIVLDeEMr4dp9QnPO31vitRTOYfskR1p2hieg-dBOLpcQ6wUiswA7uRV3cto8KS5UK2jr1V_PPaHlLvdsnrRwjaY4J8e9VUI6BtyEYOJiY0qJbJ0unO_V9hPhxE3YRsituec369FLGI Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11cb68c880484066ae86b972b9995943", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11cb68c880484066ae86b972b9995943"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6d15cecc400b4727ad91a3a8a86e820b Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'd3a5afd8-ab72-436d-a3be-b9cfa8a459ej'} Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d3a5afd8-ab72-436d-a3be-b9cfa8a459ej to delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d3a5afd8-ab72-436d-a3be-b9cfa8a459ej could not be found. Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.818094 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-096609f2-79ef-418c-8d2e-630f42deebc7 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-096609f2-79ef-418c-8d2e-630f42deebc7 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] 10.222.0.79 "DELETE /compute/v2.1/images/d3a5afd8-ab72-436d-a3be-b9cfa8a459ej" status: 404 len: 62 microversion: 2.1 time: 0.038570 Jul 20 10:52:40.822841 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 683/1456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:40 2022] DELETE /compute/v2.1/images/d3a5afd8-ab72-436d-a3be-b9cfa8a459ej => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:52:40.829894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7d24aba-e33e-4c68-b00d-164e9e4df1a1 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Calling method '.version_select at 0x7f2c3f21a1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.849358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d7d24aba-e33e-4c68-b00d-164e9e4df1a1 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] HTTP exception thrown: Image not found. Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7d24aba-e33e-4c68-b00d-164e9e4df1a1 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Request method failure captured: Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/images/ef4b1e91-a3c1-4906-b48a-9951b1ca408e1 HTTP/1.1 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1954PyXZPh9WVNMwY9jppdXnK8kRLvn35ECgiIVLDeEMr4dp9QnPO31vitRTOYfskR1p2hieg-dBOLpcQ6wUiswA7uRV3cto8KS5UK2jr1V_PPaHlLvdsnrRwjaY4J8e9VUI6BtyEYOJiY0qJbJ0unO_V9hPhxE3YRsituec369FLGI Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11cb68c880484066ae86b972b9995943", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11cb68c880484066ae86b972b9995943"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6d15cecc400b4727ad91a3a8a86e820b Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ef4b1e91-a3c1-4906-b48a-9951b1ca408e1'} Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ef4b1e91-a3c1-4906-b48a-9951b1ca408e1 to delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef4b1e91-a3c1-4906-b48a-9951b1ca408e1 could not be found. Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.852424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7d24aba-e33e-4c68-b00d-164e9e4df1a1 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:52:40.856965 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7d24aba-e33e-4c68-b00d-164e9e4df1a1 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] 10.222.0.79 "DELETE /compute/v2.1/images/ef4b1e91-a3c1-4906-b48a-9951b1ca408e1" status: 404 len: 62 microversion: 2.1 time: 0.028593 Jul 20 10:52:40.859225 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 684/1457] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:52:40 2022] DELETE /compute/v2.1/images/ef4b1e91-a3c1-4906-b48a-9951b1ca408e1 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 10:52:40.865863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:40.866504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:40.873069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.873530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.874306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:40.874746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:40.996412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:41.001713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.010597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1fd5ef3-cc15-41e8-bc11-867a343bd70a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1470 microversion: 2.1 time: 0.217640 Jul 20 10:52:41.011213 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 774/1458] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:40 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:52:41.025985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31e825e5-64c1-4c46-8126-c79c14113227 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Calling method '.version_select at 0x7f2c3f7bcaf0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:41.048221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.048592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-31e825e5-64c1-4c46-8126-c79c14113227 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] HTTP exception thrown: Image not found. Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31e825e5-64c1-4c46-8126-c79c14113227 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Request method failure captured: Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/tempest-invalid-1504912119 HTTP/1.1 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1954PyXZPh9WVNMwY9jppdXnK8kRLvn35ECgiIVLDeEMr4dp9QnPO31vitRTOYfskR1p2hieg-dBOLpcQ6wUiswA7uRV3cto8KS5UK2jr1V_PPaHlLvdsnrRwjaY4J8e9VUI6BtyEYOJiY0qJbJ0unO_V9hPhxE3YRsituec369FLGI Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11cb68c880484066ae86b972b9995943", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11cb68c880484066ae86b972b9995943"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 6d15cecc400b4727ad91a3a8a86e820b Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'tempest-invalid-1504912119'} Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1504912119 to delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1504912119 could not be found. Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.051024 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31e825e5-64c1-4c46-8126-c79c14113227 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31e825e5-64c1-4c46-8126-c79c14113227 tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] 10.222.0.79 "DELETE /compute/v2.1/images/tempest-invalid-1504912119" status: 404 len: 62 microversion: 2.1 time: 0.040316 Jul 20 10:52:41.056227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 775/1459] 10.222.0.79 () {58 vars in 1205 bytes} [Wed Jul 20 10:52:41 2022] DELETE /compute/v2.1/images/tempest-invalid-1504912119 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:52:41.065856 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c12007e8-0187-4c61-8871-25cda2a1f49f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.204622 Jul 20 10:52:41.066078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b860e9b-1005-4348-bcad-86b82153293f tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Calling method '.version_select at 0x7f2c3fb6f820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:41.066569 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 685/1460] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:40 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:41.088463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9b860e9b-1005-4348-bcad-86b82153293f tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] HTTP exception thrown: Image not found. Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b860e9b-1005-4348-bcad-86b82153293f tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Request method failure captured: Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/3b6d6e27-dee3-4655-bc79-993a9e3b8d89 HTTP/1.1 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1954PyXZPh9WVNMwY9jppdXnK8kRLvn35ECgiIVLDeEMr4dp9QnPO31vitRTOYfskR1p2hieg-dBOLpcQ6wUiswA7uRV3cto8KS5UK2jr1V_PPaHlLvdsnrRwjaY4J8e9VUI6BtyEYOJiY0qJbJ0unO_V9hPhxE3YRsituec369FLGI Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11cb68c880484066ae86b972b9995943", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11cb68c880484066ae86b972b9995943"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11cb68c880484066ae86b972b9995943"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 11cb68c880484066ae86b972b9995943 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456 Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 6d15cecc400b4727ad91a3a8a86e820b Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2015750456-project Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3b6d6e27-dee3-4655-bc79-993a9e3b8d89'} Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3b6d6e27-dee3-4655-bc79-993a9e3b8d89 to delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b6d6e27-dee3-4655-bc79-993a9e3b8d89 could not be found. Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:41.090227 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b860e9b-1005-4348-bcad-86b82153293f tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b860e9b-1005-4348-bcad-86b82153293f tempest-ImagesDeleteNegativeTestJSON-2015750456 tempest-ImagesDeleteNegativeTestJSON-2015750456-project] 10.222.0.79 "DELETE /compute/v2.1/images/3b6d6e27-dee3-4655-bc79-993a9e3b8d89" status: 404 len: 62 microversion: 2.1 time: 0.030484 Jul 20 10:52:41.094995 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 776/1461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:41 2022] DELETE /compute/v2.1/images/3b6d6e27-dee3-4655-bc79-993a9e3b8d89 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 10:52:41.257444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:41.258072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:41.264188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.264643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.265426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.265864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.297571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:41.298304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:41.316675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.317131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.317913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.318358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.464084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.472953 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5c4e5db-45a1-4fd3-95de-2bcae499d68f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.219115 Jul 20 10:52:41.473802 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 686/1462] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:41 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:41.479120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:41.479884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:41.486073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.486653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.488813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.489357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.502167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.517936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.520198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.521592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b774d90b-41ac-492e-adaf-ef31dc414c63 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.228545 Jul 20 10:52:41.522181 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 777/1463] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:41 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:41.527095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:41.527863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:41.535524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.536142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.537043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:41.537594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:41.559084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.568266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.569791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.571125 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b0937cb-7c99-439e-9814-643be14fec3f tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1310 microversion: 2.21 time: 0.096168 Jul 20 10:52:41.571779 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 687/1464] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:41 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:41.691040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:41.702983 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-40560929-cd9b-4b5f-8fb3-eee404ee544a tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.179357 Jul 20 10:52:41.706612 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 778/1465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:41 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:42.030458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:42.031806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:42.035818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:42.043636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.044376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.045245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.045914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.086317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:42.088186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:42.108199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.108943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.112163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.117463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.394979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:42.404720 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c00a2a9-f237-442e-954f-bf24dab77fe2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1470 microversion: 2.1 time: 0.378964 Jul 20 10:52:42.405521 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 688/1466] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:42 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1470 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:42.489774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:42.494416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:42.495489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:42.502476 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9ae2eecc-c008-432d-9649-081a05e7c107 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.422904 Jul 20 10:52:42.508752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.509529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.510878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.511597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.514872 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 779/1467] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:42 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:42.542436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:42.543056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:42.557390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.558173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:42.559153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:42.560823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.021752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:43.185444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:43.306808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.322618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.324823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.327253 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9fde2436-329e-43b9-9eb1-8f14c62376b1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.788136 Jul 20 10:52:43.341417 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 780/1468] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:42 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:52:43.347318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:43.347853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.348788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:43.357901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.358544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.359561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.360169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.363287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f51e1c7-587c-423a-a363-8ee53d39007a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.876845 Jul 20 10:52:43.366560 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 689/1469] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:42 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:52:43.390951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:43.396225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:43.409111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.410762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.412889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.413692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.858662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.875986 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7951a5c1-176c-426f-ab2b-2ff547f5e788 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.507182 Jul 20 10:52:43.876605 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 690/1470] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:43 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:43.882403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:43.887567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:43.896193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.910439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.920600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:43.921808 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4b17050d-f854-436f-b5be-fbf843db57b8 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.579048 Jul 20 10:52:43.922394 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 781/1471] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:43 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:43.925692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.926290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.929758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.930215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.934692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:43.935364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:43.955800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.956405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:43.957276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:43.957728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:44.372380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:44.386217 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2e669a7-3c9e-4b47-b4e6-2cfa2b9e9f2c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1470 microversion: 2.1 time: 0.507788 Jul 20 10:52:44.390357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 691/1472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:43 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1470 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:44.404804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:44.405718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:44.434872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:44.436034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:44.436590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:44.437494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:44.439426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:44.451884 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9491e1fe-16eb-4606-b64e-1eb7b93385cd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.528403 Jul 20 10:52:44.452806 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 782/1473] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:43 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:44.465498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:44.466122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:44.478147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:44.478147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:44.478935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:44.484415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:44.943634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:44.959710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:44.968546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:44.970062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:44.975710 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73eb6a54-b7f6-46dd-aa5d-5eaa001618bd tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.521739 Jul 20 10:52:44.976545 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 783/1474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:44 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:44.981694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:44.982309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:44.985356 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66a03001-42c9-42e9-9461-fb38b14e9500 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.592090 Jul 20 10:52:44.986242 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 692/1475] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:44 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:44.997085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:44.997701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:45.007580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.008039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.013111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.013600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.021653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.022125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.022916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.031649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:45.032226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.437251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:45.452059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:45.453511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:45.454867 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eca610e3-c691-49f3-8ce9-fc4be2ab5e92 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.467097 Jul 20 10:52:45.457725 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 693/1476] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:44 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:45.471814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:45.472835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:45.480075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:45.489965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.493004 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9ca2c40e-67f5-47f5-91a8-c4605fcfacb2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.513276 Jul 20 10:52:45.493732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.493877 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 784/1477] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:44 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:45.494850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.495470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.515625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:45.518514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:45.540647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.543447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.544654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:45.545335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:45.869128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:45.880491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d86e8d70-c89e-4f45-8298-70ec2cd8b08c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.421481 Jul 20 10:52:45.887617 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 694/1478] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:45 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:45.993817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:45.995935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:46.004106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:46.012587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36119b32-0f9b-4291-99a6-0d3f3301d4e8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.516377 Jul 20 10:52:46.013067 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 785/1479] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:45 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:46.014047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.014871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.015884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.016718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.039749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:46.040699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:46.054907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.055393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.056199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.056631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.592273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:46.606169 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-158c33ad-48e8-4d08-b43f-03574e5b7faa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 0.616169 Jul 20 10:52:46.607302 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 695/1480] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:45 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:52:46.620060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4070cf23-e510-46bc-b3bf-aaf483fe9722 req-ee0cb7c6-9ebe-41c2-ae68-2df8b75094f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf7a4bc-f988-48da-9273-277e561ddd31", "tag": "47b4ab89-7a9a-4f22-95ff-660cf6daa6e8"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:46.635923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4070cf23-e510-46bc-b3bf-aaf483fe9722 req-ee0cb7c6-9ebe-41c2-ae68-2df8b75094f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.639242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4070cf23-e510-46bc-b3bf-aaf483fe9722 req-ee0cb7c6-9ebe-41c2-ae68-2df8b75094f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.682947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:46.686388 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4070cf23-e510-46bc-b3bf-aaf483fe9722 req-ee0cb7c6-9ebe-41c2-ae68-2df8b75094f1 service nova] Creating event network-changed:47b4ab89-7a9a-4f22-95ff-660cf6daa6e8 for instance fcf7a4bc-f988-48da-9273-277e561ddd31 on n-h1-846219-10 Jul 20 10:52:46.692675 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4070cf23-e510-46bc-b3bf-aaf483fe9722 req-ee0cb7c6-9ebe-41c2-ae68-2df8b75094f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083881 Jul 20 10:52:46.697399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:46.698897 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 696/1481] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:46.699493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:46.715437 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-392113f2-bd20-4fad-b07f-b974fd1688b9 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.677790 Jul 20 10:52:46.718060 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 786/1482] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:46 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:46.724807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:46.725781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:46.731424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:46.732146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:46.733313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.733778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.734943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.735434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.741307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.741957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:46.742941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:46.743605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.025698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:47.030547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:47.039048 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bceff9a9-e9de-42c2-85e1-25e478cb1c18 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.319535 Jul 20 10:52:47.043121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:47.044015 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 787/1483] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:46 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:47.052865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:47.059221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:47.060144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:47.060715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79a730c2-413c-431d-a4ab-eae76e1b51a9 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.359916 Jul 20 10:52:47.061338 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 697/1484] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:46 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:47.069533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:47.070562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:47.075471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.076173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.077365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.077994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.092393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.097453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.098874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.099369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.416560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:47.429736 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1741dd03-df71-46cb-a96d-ee678caca43e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.384115 Jul 20 10:52:47.430044 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 788/1485] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:47 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:47.443141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-12081521-481f-4bcc-9e2d-da81b6b460b4 req-c8a2f9a6-a8ab-4cc2-acd3-68448eb326df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf1c0b2-b3ca-452b-bf03-d36f55019d0a", "name": "network-vif-plugged", "status": "completed", "tag": "b7e29330-5a03-4253-84a0-568c80dee39a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:47.452103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-12081521-481f-4bcc-9e2d-da81b6b460b4 req-c8a2f9a6-a8ab-4cc2-acd3-68448eb326df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.452547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-12081521-481f-4bcc-9e2d-da81b6b460b4 req-c8a2f9a6-a8ab-4cc2-acd3-68448eb326df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.464960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-12081521-481f-4bcc-9e2d-da81b6b460b4 req-c8a2f9a6-a8ab-4cc2-acd3-68448eb326df service nova] Creating event network-vif-plugged:b7e29330-5a03-4253-84a0-568c80dee39a for instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a on n-h2-846219-10 Jul 20 10:52:47.470847 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-12081521-481f-4bcc-9e2d-da81b6b460b4 req-c8a2f9a6-a8ab-4cc2-acd3-68448eb326df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036534 Jul 20 10:52:47.472523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:47.475226 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 789/1486] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:47.485442 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-028134e1-e062-4730-975f-28b5ecc07154 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.421517 Jul 20 10:52:47.488796 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 698/1487] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:47 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:47.626054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:47.627027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:47.639101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.645775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.646935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.647412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.737880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:47.739597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:47.746521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.747471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:47.748508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:47.749913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:48.678558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:48.695960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e2e1a555-b134-42ac-a8c2-9f80e9b928c8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1471 microversion: 2.1 time: 1.074464 Jul 20 10:52:48.696903 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 790/1488] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:47 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1471 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:48.701884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:48.702517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:48.719101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:48.719964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:48.722675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:48.724563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:48.946112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:48.957454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:48.961879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:48.965431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-42c58683-f8dd-4b6b-bd55-8a071ba9c751 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 1.232529 Jul 20 10:52:48.966041 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 699/1489] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:47 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:48.976799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:48.977721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:48.984999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:48.985685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:48.986764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:48.988207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.274619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:49.284403 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59890115-0a2c-4e0f-a91d-de88ab716849 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.585425 Jul 20 10:52:49.285601 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 791/1490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:48 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:49.291096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:49.292424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:49.298901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.299418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.300349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.300789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.359674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:49.364201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:49.371466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:49.373368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:49.374925 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e4e6dd9e-6316-46c5-baee-787badb36701 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.402349 Jul 20 10:52:49.376077 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 700/1491] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:48 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:49.381518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:49.382360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:49.389165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.389615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.390903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.391546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.578128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:49.590812 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a329b884-604b-4992-83ba-4f400db3fe91 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.303548 Jul 20 10:52:49.602961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 792/1492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:49 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:49.609917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9a1f85e5-1f79-4477-842d-f18b1d1c7022 req-ca569a56-9730-4585-9f49-f07fe4065143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f172f524-ae19-4718-848e-2c6c601750df", "name": "network-vif-plugged", "status": "completed", "tag": "8d779160-fbcd-44f4-898a-2ddcbded933d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:49.624913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9a1f85e5-1f79-4477-842d-f18b1d1c7022 req-ca569a56-9730-4585-9f49-f07fe4065143 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.625687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9a1f85e5-1f79-4477-842d-f18b1d1c7022 req-ca569a56-9730-4585-9f49-f07fe4065143 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.639982 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9a1f85e5-1f79-4477-842d-f18b1d1c7022 req-ca569a56-9730-4585-9f49-f07fe4065143 service nova] Creating event network-vif-plugged:8d779160-fbcd-44f4-898a-2ddcbded933d for instance f172f524-ae19-4718-848e-2c6c601750df on n-h1-846219-10 Jul 20 10:52:49.650032 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9a1f85e5-1f79-4477-842d-f18b1d1c7022 req-ca569a56-9730-4585-9f49-f07fe4065143 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045440 Jul 20 10:52:49.661645 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 793/1493] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:49.670661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:49.685482 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-011ab139-ce3a-486f-af4c-3e08c8b888ae tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1199 microversion: 2.1 time: 0.308126 Jul 20 10:52:49.686712 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 701/1494] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:49 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1199 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:49.717587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:49.718733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:49.725568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:49.742604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.743109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.745409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.745863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.987345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:49.988074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:49.998118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.998383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:49.999113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:49.999572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.048400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.060145 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-04e2d0a8-fb91-4b11-b18f-5faae0914771 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.347080 Jul 20 10:52:50.074870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 794/1495] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:49 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:50.258850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.269239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.270810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.272289 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cc90357d-5324-45d7-bf18-a293ff3f71f2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.289560 Jul 20 10:52:50.272863 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 702/1496] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:49 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:52:50.305229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:50.306570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:50.313529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.314340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.315928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.316437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.393988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:50.394673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:50.401433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.401877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.402661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.403098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.710765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.719979 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a3dd97a-47f7-4fb6-9b9f-605fa272efb8 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.422176 Jul 20 10:52:50.720895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.730472 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 795/1497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:50 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:52:50.735739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:50.736356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:50.744641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.745091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.748128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.749373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.749681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:50.749829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.750839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-631dacd5-120a-4bfd-b610-2c0a4ffe96bd tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.361028 Jul 20 10:52:50.752689 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 703/1498] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:50 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:52:50.757994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:50.758610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:50.767192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.767683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:50.769268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:50.769645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.034125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:51.044462 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a81e937c-4691-4e7e-a366-ba202cb8db3a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.312818 Jul 20 10:52:51.045264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:51.046110 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 796/1499] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:50 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:51.055846 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-43dd791f-64d8-4c93-8694-055cb008b451 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1382 microversion: 2.1 time: 0.301922 Jul 20 10:52:51.056462 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 704/1500] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:50 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1382 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:51.080119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.082710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:51.089417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.090172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.090965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.091439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.271939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:51.280590 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c94dd83-325e-417d-89f9-dc02293f4396 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.204776 Jul 20 10:52:51.281647 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 705/1501] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:52:51.292127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.293111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:51.301069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.301838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.302857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.303419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.309812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.310496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:51.318709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.319160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.319964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.320408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.532265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:51.546864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:51.547097 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e65380b-a6f3-4a2e-a11e-64bc8c652b1d tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1535 microversion: 2.1 time: 0.478933 Jul 20 10:52:51.550927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:51.556073 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e58b6bed-7b3e-41ab-91e6-2cd2c56a214d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.266952 Jul 20 10:52:51.558248 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 706/1502] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:52:51.559459 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 797/1503] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1535 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:51.571884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.572949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:51.579805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.580287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.581065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.581690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.728616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-649c539c-d7ed-4a53-a95b-f712b4739143 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1535 microversion: 2.1 time: 0.167764 Jul 20 10:52:51.729264 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 707/1504] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1535 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:51.746636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.747483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:51.752933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17fd8ae3-c2cb-4e8f-95f2-e3ee576501ad tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.754585 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:52:51.754585 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:52:51.755062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.755610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.755941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fd8ae3-c2cb-4e8f-95f2-e3ee576501ad tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.756435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fd8ae3-c2cb-4e8f-95f2-e3ee576501ad tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.757245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fd8ae3-c2cb-4e8f-95f2-e3ee576501ad tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.757403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.757673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fd8ae3-c2cb-4e8f-95f2-e3ee576501ad tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.758342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.784109 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17fd8ae3-c2cb-4e8f-95f2-e3ee576501ad tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.037484 Jul 20 10:52:51.785423 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 708/1505] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:51.790296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:51.790964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:51.797292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.797746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:51.798757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:51.800079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.031736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:52.041515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:52.051440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:52.057075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:52.057517 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3d8739b8-6943-42d3-8015-07d2e6b88d98 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.270225 Jul 20 10:52:52.057837 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7f2c864e-e607-43b1-8bc4-4b3f6251ec89 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.315961 Jul 20 10:52:52.058571 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 798/1507] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:52.064231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846219-10", "block_migration": false, "disk_over_commit": false}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:52.065936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:52.068670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 709/1507] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:51 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:52.075559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:52.076433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:52.084132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.085297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.086543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.087154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.103434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.105041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.110956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.111573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.153742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lazy-loading 'flavor' on Instance uuid ebf1c0b2-b3ca-452b-bf03-d36f55019d0a {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:52:52.184209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Going to try to live migrate instance to n-h1-846219-10 {{(pid=125885) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:52:52.397966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:52.409826 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c451d7f7-e1c1-4ca0-8658-f45ac6d4673f tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.339710 Jul 20 10:52:52.427572 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 710/1508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:52 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:52.434739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:52.435638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:52.445800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.446761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.448253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.448937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.787760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:52.800395 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97034d0c-cf0c-4b6a-afc2-08404eca29fa tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.369488 Jul 20 10:52:52.801278 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 711/1509] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:52 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:52.824156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:52.824779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:52.837664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.838118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:52.839194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:52.839699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:53.078686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.090679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.092254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.093437 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e3606b32-49df-4c7f-b0db-6f5d3fdbca04 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.290968 Jul 20 10:52:53.094007 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 712/1510] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:52 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:53.116566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:53.117334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:53.144797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:53.145661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:53.149451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:53.150252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:53.334097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.342275 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b106f470-09a3-46cb-8db4-77fe5fb9e702 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.247233 Jul 20 10:52:53.343029 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 713/1511] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:53 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:53.350641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:53.351456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:53.358021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:53.358529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:53.359529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:53.359970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:53.509195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.518251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.519994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:53.521225 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df9dc7fc-df06-4f4b-aca4-09ee360bca2b tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.176680 Jul 20 10:52:53.521883 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 714/1512] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:53 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:53.536968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1271043289", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "40b05c8d-1def-4285-9a0c-3b216850ec2d"}, {"uuid": "f7c79489-36b4-454d-bb0b-028cce39cc1b"}, {"uuid": "40b05c8d-1def-4285-9a0c-3b216850ec2d"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:53.597665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] validate_networks() for [('40b05c8d-1def-4285-9a0c-3b216850ec2d', None, None, None, None, None), ('f7c79489-36b4-454d-bb0b-028cce39cc1b', None, None, None, None, None), ('40b05c8d-1def-4285-9a0c-3b216850ec2d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:52:54.834684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:52:54.835313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:52:54.835644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:52:54.836204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:52:54.836628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:52:54.847968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:54.848433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:54.849288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:54.849738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:54.875992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Getting quotas for project 7f6480dcf785424b827d35f7cbfa6ddf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:52:54.883588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Getting quotas for user 8b622b3ec37f48e49ae295acd6d1c34a and project 7f6480dcf785424b827d35f7cbfa6ddf. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:52:54.899936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:52:54.902311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:52:54.962681 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52e825ac-0c5f-43be-8444-dcc4378f25a2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430526 Jul 20 10:52:54.964304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 715/1513] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:52:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:52:54.973950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-811deccc-ebd0-4932-994e-30a7193c636f req-fe979428-1f5f-40f5-9aa3-1090efc14d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "name": "network-vif-unplugged", "status": "completed", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:54.984492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-811deccc-ebd0-4932-994e-30a7193c636f req-fe979428-1f5f-40f5-9aa3-1090efc14d9f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:54.985281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-811deccc-ebd0-4932-994e-30a7193c636f req-fe979428-1f5f-40f5-9aa3-1090efc14d9f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.002970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-811deccc-ebd0-4932-994e-30a7193c636f req-fe979428-1f5f-40f5-9aa3-1090efc14d9f service nova] Creating event network-vif-unplugged:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:52:55.013607 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-811deccc-ebd0-4932-994e-30a7193c636f req-fe979428-1f5f-40f5-9aa3-1090efc14d9f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047647 Jul 20 10:52:55.014221 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 716/1514] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:55.034646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:55.036017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:55.043504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:55.043963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.044786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:55.045225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.269963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:55.317888 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f25ad37a-1aba-4bcb-8aef-c48766196541 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.302140 Jul 20 10:52:55.318526 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 717/1515] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:55 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:55.328995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:55.329637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:55.369153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:55.376961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.379112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:55.379779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.790209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:55.809638 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e6eb9ce3-540b-4ecb-9803-e46d792a9de9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.489279 Jul 20 10:52:55.811243 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 718/1516] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:55 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:55.817001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:55.817617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:55.824573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:55.824870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.825656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:55.826284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:55.863986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:56.073471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.084473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.086106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.089184 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8cb2194e-1518-4d37-a43b-b2ae66836105 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.276376 Jul 20 10:52:56.099202 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 719/1517] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:55 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:56.099202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:56.099202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:56.103302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.103621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.104627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.105192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.380433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.388438 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-777cecb8-11a8-4a43-ab94-45a717ef0afa tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1369 microversion: 2.1 time: 0.297210 Jul 20 10:52:56.389033 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 720/1518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:56 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1369 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:56.394978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:56.396318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:56.406162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.406769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.407744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.408916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.599832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.609806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.612322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.613504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3104fdce-0686-449c-8eb0-c4e5d626f9ae tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.223227 Jul 20 10:52:56.624364 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 721/1519] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:56 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:56.630704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:56.631655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:56.639024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.639903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.640706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.641149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.723874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:56.734482 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1ddfcc7-4140-4f26-bef3-fa6fcdbd8304 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1265 microversion: 2.1 time: 0.108037 Jul 20 10:52:56.735683 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 722/1520] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:56 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:56.751420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:56.752630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:56.762287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.763118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:56.764143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:56.764590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:57.419335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:57.432166 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f18c2ac1-f01e-460a-8e70-fda7900b07c3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.695037 Jul 20 10:52:57.433082 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 723/1521] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:56 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:57.443359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:57.443974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:57.460974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:57.461437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:57.462428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:57.462869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.028054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:58.039674 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d19b0c02-6139-41fb-af68-05b067d5c375 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.605420 Jul 20 10:52:58.040286 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 724/1522] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:57 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:58.055921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:58.058274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:58.070822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:58.073767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.074809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:58.075286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.482761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:58.505223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:58.510909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:58.516868 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2927147c-ebc4-4fac-8622-0ebb330c9d96 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.474676 Jul 20 10:52:58.539765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 725/1523] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:58 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:58.560824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:58.562561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:58.593406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:58.595340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.597011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:58.601888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.609247 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c88472fb-460d-4938-893a-30c6780cffe1 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a/action" status: 202 len: 0 microversion: 2.1 time: 6.547242 Jul 20 10:52:58.617512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 799/1524] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:52:52 2022] POST /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a/action => generated 0 bytes in 6558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:52:58.632069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:58.634362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:58.674010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:58.674481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.679306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:58.679721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:58.740533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:52:59.244483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:59.259743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4871b28-ea10-4c3c-84b6-0d85089e2d40 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1555 microversion: 2.1 time: 0.717591 Jul 20 10:52:59.260766 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 726/1525] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:58 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1555 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:59.276192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:59.279128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:59.292950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.293986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.296692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.297451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.355368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:59.376001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:59.387772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:59.389474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2377e167-944c-4049-9f8d-38090ca72730 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.768981 Jul 20 10:52:59.405533 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 800/1526] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:52:58 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:52:59.411762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ed14f5bf-3954-4232-bd86-ab8d061bb49b req-9c9a8020-fa3c-4bf2-ba6b-192db59b6a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "name": "network-vif-unplugged", "status": "completed", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:52:59.434849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ed14f5bf-3954-4232-bd86-ab8d061bb49b req-9c9a8020-fa3c-4bf2-ba6b-192db59b6a6d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.435395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ed14f5bf-3954-4232-bd86-ab8d061bb49b req-9c9a8020-fa3c-4bf2-ba6b-192db59b6a6d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.452298 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ed14f5bf-3954-4232-bd86-ab8d061bb49b req-9c9a8020-fa3c-4bf2-ba6b-192db59b6a6d service nova] Creating event network-vif-unplugged:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h1-846219-10 Jul 20 10:52:59.460818 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ed14f5bf-3954-4232-bd86-ab8d061bb49b req-9c9a8020-fa3c-4bf2-ba6b-192db59b6a6d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053467 Jul 20 10:52:59.461974 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 801/1527] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:52:59.468751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:59.472589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:59.481875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.482513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.484128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.484763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.710151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:59.721238 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2ae5a29-58a1-4932-83d6-d3c5b038b827 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1334 microversion: 2.1 time: 0.458483 Jul 20 10:52:59.733549 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 727/1528] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:59 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1334 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:59.740986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:59.742858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:59.754718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.755750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.759108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.760002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.811093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:52:59.820294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58c3c47d-e146-42f9-8bc6-0777a02b8f5c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.356539 Jul 20 10:52:59.831592 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 802/1529] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:59 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:52:59.837682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:52:59.838181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:52:59.851536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.852257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:52:59.853348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:52:59.860724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.169000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.178669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5830d6c-71f4-4fe3-8761-45fed7887875 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.442709 Jul 20 10:53:00.179653 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 728/1530] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:59 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:00.185393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:00.186259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:00.197769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.198496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.199485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.200092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.220215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.232877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1d7e0bb-ca46-4df1-8b97-473c7bc31a60 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.398640 Jul 20 10:53:00.238169 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 803/1531] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:52:59 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:00.249251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:00.250199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:00.261782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.263430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.264475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.265150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.401132 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d697a64-20b8-45aa-a76a-e1e86af898f7 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217696 Jul 20 10:53:00.403386 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 729/1532] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:53:00 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:00.412333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e6cfffb5-7f9a-4f56-b206-920096fe5c96 req-9bcc9f8a-2c3c-4c6f-9868-1d96f616dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "name": "network-vif-plugged", "status": "completed", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:00.416988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:00.424559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e6cfffb5-7f9a-4f56-b206-920096fe5c96 req-9bcc9f8a-2c3c-4c6f-9868-1d96f616dbc5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.425423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e6cfffb5-7f9a-4f56-b206-920096fe5c96 req-9bcc9f8a-2c3c-4c6f-9868-1d96f616dbc5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.440172 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e6cfffb5-7f9a-4f56-b206-920096fe5c96 req-9bcc9f8a-2c3c-4c6f-9868-1d96f616dbc5 service nova] Creating event network-vif-plugged:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:53:00.445625 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e6cfffb5-7f9a-4f56-b206-920096fe5c96 req-9bcc9f8a-2c3c-4c6f-9868-1d96f616dbc5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040706 Jul 20 10:53:00.446352 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 730/1533] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:00.452954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:00.454176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:00.461556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.462342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.463405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.464584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.576971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.623243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.624810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.627029 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-20f1d446-9e17-4666-a385-a12da605b0f4 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.387492 Jul 20 10:53:00.627945 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 804/1534] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:00 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:00.702105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.726602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.731313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:00.735290 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-503e7d2e-f830-4e9b-85b7-e4731d514f3a tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.285633 Jul 20 10:53:00.739966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:00.740614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:00.749848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 731/1535] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:00 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:00.753999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.754700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.755727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.756470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.844710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:00.845471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:00.855618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.863577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:00.864649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:00.865303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.084330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:01.105148 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-80b8762f-6810-404b-b093-825e0ec65f58 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.365420 Jul 20 10:53:01.119536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:01.119536 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3e6ce554-bc73-4586-82bc-74fa0e882e7a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.278378 Jul 20 10:53:01.119536 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 732/1536] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:00 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:01.122025 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 805/1537] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:00 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:01.203049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:01.204635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:01.217541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.218389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.219563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.220442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.252853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:01.253640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:01.265012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.265463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.266493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.272033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.492392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:01.507536 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8cdefbc-336d-4383-a62c-bc90f8ceafa5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.310060 Jul 20 10:53:01.508885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 733/1538] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:01 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:01.516305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8460032e-ef60-4ade-8920-06f1a6529e2f req-ae07b2ac-f332-4b89-8889-0734d5d6240f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:01.529775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8460032e-ef60-4ade-8920-06f1a6529e2f req-ae07b2ac-f332-4b89-8889-0734d5d6240f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.530641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8460032e-ef60-4ade-8920-06f1a6529e2f req-ae07b2ac-f332-4b89-8889-0734d5d6240f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.554768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:01.560795 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8460032e-ef60-4ade-8920-06f1a6529e2f req-ae07b2ac-f332-4b89-8889-0734d5d6240f service nova] Creating event network-changed:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h1-846219-10 Jul 20 10:53:01.570189 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ffd5d51a-ba21-4cc3-a22b-392152ecc58e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1477 microversion: 2.1 time: 0.321298 Jul 20 10:53:01.572909 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 806/1539] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:01 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:01.584274 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8460032e-ef60-4ade-8920-06f1a6529e2f req-ae07b2ac-f332-4b89-8889-0734d5d6240f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073498 Jul 20 10:53:01.585728 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 734/1540] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:01.649724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:01.650466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:01.660042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.660541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.661505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.661963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.770684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:01.771463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:01.790135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.790883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:01.791833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:01.792421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:02.336583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:02.353555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:02.355330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:02.356705 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a01c81b-8377-452a-a365-343dd72d39c8 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.712407 Jul 20 10:53:02.357691 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 807/1541] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:01 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:53:02.366274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-165a0f4c-4cb5-4302-a551-b330cfba36d2 req-b824b226-08de-4740-ae8f-427007ce1a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "tag": "07e09f1b-cf1d-44aa-b9ae-425f9cde6f35"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:02.379036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:02.387853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-165a0f4c-4cb5-4302-a551-b330cfba36d2 req-b824b226-08de-4740-ae8f-427007ce1a41 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:02.389499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-165a0f4c-4cb5-4302-a551-b330cfba36d2 req-b824b226-08de-4740-ae8f-427007ce1a41 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:02.397709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:02.399748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:02.401391 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e34ddfa3-e38e-4dfe-80a0-e41ce6d66708 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.639535 Jul 20 10:53:02.403044 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 735/1542] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:01 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:53:02.408546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:02.409546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:02.418131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:02.419362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:02.420457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:02.420697 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-165a0f4c-4cb5-4302-a551-b330cfba36d2 req-b824b226-08de-4740-ae8f-427007ce1a41 service nova] Creating event network-changed:07e09f1b-cf1d-44aa-b9ae-425f9cde6f35 for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:02.421384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:02.427480 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-165a0f4c-4cb5-4302-a551-b330cfba36d2 req-b824b226-08de-4740-ae8f-427007ce1a41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064161 Jul 20 10:53:02.428739 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 808/1543] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:02.437005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:02.438119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:02.450608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:02.451467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:02.452750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:02.453848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:02.991012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:03.006018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5548dd56-8ac0-4f44-9ef1-d2098d6a479b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.601094 Jul 20 10:53:03.007347 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 736/1544] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:02 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:03.015052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6e67f24a-c0a5-4000-ace8-6896f05224b1 req-c4176e91-cc9c-4592-ba9d-674b7748209f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf7a4bc-f988-48da-9273-277e561ddd31", "name": "network-vif-plugged", "status": "completed", "tag": "47b4ab89-7a9a-4f22-95ff-660cf6daa6e8"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:03.047663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6e67f24a-c0a5-4000-ace8-6896f05224b1 req-c4176e91-cc9c-4592-ba9d-674b7748209f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.048374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6e67f24a-c0a5-4000-ace8-6896f05224b1 req-c4176e91-cc9c-4592-ba9d-674b7748209f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:03.087040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6e67f24a-c0a5-4000-ace8-6896f05224b1 req-c4176e91-cc9c-4592-ba9d-674b7748209f service nova] Creating event network-vif-plugged:47b4ab89-7a9a-4f22-95ff-660cf6daa6e8 for instance fcf7a4bc-f988-48da-9273-277e561ddd31 on n-h1-846219-10 Jul 20 10:53:03.094287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6e67f24a-c0a5-4000-ace8-6896f05224b1 req-c4176e91-cc9c-4592-ba9d-674b7748209f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085336 Jul 20 10:53:03.095213 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 737/1545] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:03.102494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:03.108282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:03.124991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.125739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:03.127470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.129150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:03.188247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:03.332213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:03.349511 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f4689a3e-0dd4-477f-8e9c-831caae963df tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.918409 Jul 20 10:53:03.352148 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 809/1546] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:02 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:03.365001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:03.365968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:03.383690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.384481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:03.385626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.396010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:03.774444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:03.784123 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4fdafc8d-0fec-4fe4-a302-3fc35a4b42bf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.687405 Jul 20 10:53:03.796344 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 738/1547] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:03 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:03.803229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:03.804227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:03.812488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.813338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:03.814516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:03.815293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.091428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.108774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97c70fc8-a943-410b-ae23-02cd18939064 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1463 microversion: 2.1 time: 0.755275 Jul 20 10:53:04.113050 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 810/1548] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:03 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1463 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:04.129009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:04.129594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:04.139854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.140600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.141590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.142200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.291851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.308352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.312611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.314064 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aa61db98-d6db-45c5-a09c-58001e0bd6dc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.516299 Jul 20 10:53:04.316408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 739/1549] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:03 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:04.329801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:04.331609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:04.347820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.348366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.349232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.349741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.577902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.588161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.589799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.590970 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-640263fc-7800-433c-b2a5-da08900e5b9e tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1358 microversion: 2.21 time: 0.476857 Jul 20 10:53:04.591590 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 811/1550] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:04 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1358 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:04.612312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:04.612736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:04.613446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:04.621383 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b19e7cc5-3a35-4f1c-9de1-7d8243dc9b30 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.300987 Jul 20 10:53:04.623637 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 740/1551] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:04 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:04.624036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.624701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.625726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.626239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.655446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:04.656297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:04.666871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.667526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.668644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:04.669201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:04.858765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:04.893142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:05.239771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:05.248129 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-852c14ee-a1a6-4b19-9533-8a60ec57d6af tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.619388 Jul 20 10:53:05.248812 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 741/1552] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:04 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:05.260392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a3f69a05-e250-47eb-b5b2-fd768d801cd3 req-626b5dae-90cd-45d4-b43f-64e55b139637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f172f524-ae19-4718-848e-2c6c601750df", "tag": "8d779160-fbcd-44f4-898a-2ddcbded933d"}, {"name": "network-changed", "server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "tag": "c50360e4-93d2-41a4-b5ef-6f5d94dd732c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:05.262295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:05.272724 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7101aca-7268-49ac-a033-f817c02e05dc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1463 microversion: 2.1 time: 0.678997 Jul 20 10:53:05.272893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a3f69a05-e250-47eb-b5b2-fd768d801cd3 req-626b5dae-90cd-45d4-b43f-64e55b139637 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.273359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a3f69a05-e250-47eb-b5b2-fd768d801cd3 req-626b5dae-90cd-45d4-b43f-64e55b139637 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.274281 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 812/1553] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:04 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1463 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:05.281575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:05.291471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:05.293178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Searching by: {'deleted': False, 'project_id': '357640b5ae0b4d22ab428d85f8fac338'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:53:05.293591 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a3f69a05-e250-47eb-b5b2-fd768d801cd3 req-626b5dae-90cd-45d4-b43f-64e55b139637 service nova] Creating event network-changed:8d779160-fbcd-44f4-898a-2ddcbded933d for instance f172f524-ae19-4718-848e-2c6c601750df on n-h1-846219-10 Jul 20 10:53:05.305888 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a3f69a05-e250-47eb-b5b2-fd768d801cd3 req-626b5dae-90cd-45d4-b43f-64e55b139637 service nova] Creating event network-changed:c50360e4-93d2-41a4-b5ef-6f5d94dd732c for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:05.310122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.310588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.315819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.319696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.326237 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a3f69a05-e250-47eb-b5b2-fd768d801cd3 req-626b5dae-90cd-45d4-b43f-64e55b139637 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075186 Jul 20 10:53:05.327146 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 742/1554] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:05.344224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:05.346528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:05.362609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.363341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.364228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.364780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.368876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:53:05.433459 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-384c6dca-182d-4fc9-a5b8-27628b78cd90 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.157423 Jul 20 10:53:05.434432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 813/1555] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 10:53:05 2022] GET /compute/v2.1/servers => generated 339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:05.441267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:05.443531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:05.456359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.457410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.458446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.459080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.669597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:53:05.670751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:53:05.671555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:53:05.672141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:53:05.672740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:53:05.843959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:05.861883 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a5e9593-04fc-45d2-a351-3dd2e77baaa4 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.529198 Jul 20 10:53:05.863870 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 743/1556] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:05 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:05.882337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:05.885301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:05.889582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:05.891801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.892265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.893566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.894021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.910904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.911889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.913516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.914367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.947077 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2676ed5a-471e-46a6-86b1-a29258e2cb2e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 1067 microversion: 2.1 time: 0.510090 Jul 20 10:53:05.951192 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 814/1557] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:53:05 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 1067 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 10:53:05.956215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:05.961618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:05.962405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Searching by: {'deleted': False, 'project_id': '357640b5ae0b4d22ab428d85f8fac338'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:53:05.969000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.970230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:05.971152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:05.971624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.009390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:53:06.034284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:06.098387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.107500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.108900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.299614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.310912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.312859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.315994 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0cd9208a-1681-4b9e-9a06-3d8e30471767 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.450108 Jul 20 10:53:06.316895 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 744/1558] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:05 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:06.328474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:06.329349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:06.337023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.337897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.338867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.339516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.352435 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-405acfae-df8a-4424-98ed-69f8a31ffefc tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.399100 Jul 20 10:53:06.364355 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 815/1559] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:53:05 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:06.369629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:06.375627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:06.386453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.387326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.390216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.391020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.747557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.758141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.760099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.761686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-29bec820-8889-4e8c-9635-97349969f317 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1552 microversion: 2.21 time: 0.443478 Jul 20 10:53:06.775121 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 745/1560] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:06 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1552 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:06.775121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:06.775121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:06.775121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.775709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.776592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.777389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.792370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:06.804918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-84fff45c-95c5-4d6f-a03e-4d77dbffe651 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.438813 Jul 20 10:53:06.806604 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 816/1561] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:06 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:06.812027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:06.812977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:06.822899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.824042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:06.825097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:06.825751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.094169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.098174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.104014 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a515e9b4-9e68-4d85-b698-32b47285d97f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.340455 Jul 20 10:53:07.105060 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 746/1562] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:06 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:07.106443 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5ebf1cf5-fd51-4626-9f72-7435e313ca89 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1475 microversion: 2.1 time: 0.298036 Jul 20 10:53:07.116229 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 817/1563] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:06 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:07.116229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.116229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.119642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.120101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.120884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.121326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.122287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f1a386e-1d94-419b-8f70-7d90e127de30 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.137746 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f1a386e-1d94-419b-8f70-7d90e127de30 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030906 Jul 20 10:53:07.139038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 747/1564] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:53:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:07.147412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.148334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.162073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.168882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.168882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.168882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.175627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:53:07.350012 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-183c8b62-a41a-40a6-8248-81a227d084a2 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 204 len: 0 microversion: 2.21 time: 0.240564 Jul 20 10:53:07.354377 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 818/1565] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:53:07 2022] DELETE /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:53:07.362388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.363553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.372697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.375344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.376223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.376775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.424620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.443778 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b8278c1-e5f5-4d5d-854e-141c80726948 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.299828 Jul 20 10:53:07.445101 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 748/1566] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:07 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:07.459042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-439d8fcb-1480-47ae-9bfe-4c3f06b349fd req-607ff772-9c6e-4596-82f1-56bd363bea71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "tag": "0c55debb-411e-41f8-bb0a-6d682f9f9ce2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:07.479438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-439d8fcb-1480-47ae-9bfe-4c3f06b349fd req-607ff772-9c6e-4596-82f1-56bd363bea71 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.480173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-439d8fcb-1480-47ae-9bfe-4c3f06b349fd req-607ff772-9c6e-4596-82f1-56bd363bea71 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.506171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-439d8fcb-1480-47ae-9bfe-4c3f06b349fd req-607ff772-9c6e-4596-82f1-56bd363bea71 service nova] Creating event network-changed:0c55debb-411e-41f8-bb0a-6d682f9f9ce2 for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:07.520365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-439d8fcb-1480-47ae-9bfe-4c3f06b349fd req-607ff772-9c6e-4596-82f1-56bd363bea71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068563 Jul 20 10:53:07.522191 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 749/1567] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:07.534620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.536250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.549988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.551325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.552812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.554113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.648422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.660450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.663066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.665102 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e3dae900-0678-43f7-ab68-152609e1abc1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 0.312228 Jul 20 10:53:07.680650 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 819/1568] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:07 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:07.688004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.691261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.700847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.701851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.702911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.703593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.738992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:53:07.838859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.848769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.850491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:07.852604 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-043a91c1-8bc7-42bf-a4d2-f8ff486f10ac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1558 microversion: 2.21 time: 0.328205 Jul 20 10:53:07.864963 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 750/1569] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:07 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1558 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:07.870761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.871747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.881222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.881684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.883745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.884237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.925694 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5100d656-e812-45d1-9aa1-66e11507b375 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "DELETE /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 204 len: 0 microversion: 2.1 time: 0.240588 Jul 20 10:53:07.927219 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 820/1570] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:53:07 2022] DELETE /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:53:07.942991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:07.944370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:07.956285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.957154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:07.959209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:07.959366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.136246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:08.147338 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0616bace-a41d-4afc-a515-a78d42663fd3 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.280964 Jul 20 10:53:08.152230 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 751/1571] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:07 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:08.156567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:08.157916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:08.168858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.169322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.170129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.170739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.192601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:08.202184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b0d5dfa-ea73-43c0-86e4-23351103f68d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1714 microversion: 2.1 time: 0.267647 Jul 20 10:53:08.203580 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 821/1572] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:07 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1714 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:08.217376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:08.218655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:08.226787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.227432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.228245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.228681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.397148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:08.405463 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4da720ef-8e8a-4a46-8e5b-17c85c2de3b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1474 microversion: 2.1 time: 0.252936 Jul 20 10:53:08.406176 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 752/1573] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:08 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1474 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:08.434442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:08.443319 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df97c3d0-7ff0-4771-8dff-3e52bb5885b7 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.238272 Jul 20 10:53:08.443978 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 822/1574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:08 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:08.471445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:08.472067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:08.479158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.480114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.481236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.481967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.686442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:08.687686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:08.698971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.699447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:08.700234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:08.700673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.288561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.298741 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9731ae8d-1f65-4b54-bfe2-31d36a150498 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.831442 Jul 20 10:53:09.299538 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 753/1575] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:08 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:09.307282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:09.307282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:09.315861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.316322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.317115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.317558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.672765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.684875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.687341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.690148 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b8ff2cb3-8ae8-4c6f-b466-e9cf58293f9b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 1.006739 Jul 20 10:53:09.690911 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 823/1576] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:08 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:53:09.695622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e1c5c782-48e6-40a3-ba96-f3a01f23b618 req-4996c0ec-ab29-473e-9e37-06cd14feff92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "name": "network-vif-unplugged", "status": "completed", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:09.704770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e1c5c782-48e6-40a3-ba96-f3a01f23b618 req-4996c0ec-ab29-473e-9e37-06cd14feff92 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.705363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e1c5c782-48e6-40a3-ba96-f3a01f23b618 req-4996c0ec-ab29-473e-9e37-06cd14feff92 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.725439 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e1c5c782-48e6-40a3-ba96-f3a01f23b618 req-4996c0ec-ab29-473e-9e37-06cd14feff92 service nova] Creating event network-vif-unplugged:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h1-846219-10 Jul 20 10:53:09.734405 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e1c5c782-48e6-40a3-ba96-f3a01f23b618 req-4996c0ec-ab29-473e-9e37-06cd14feff92 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041618 Jul 20 10:53:09.736713 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 824/1577] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:09.756656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:09.757731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:09.769089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.769536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.770793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.771282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.869885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.891986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.895491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31e507de9dfa4ab7aeea7d7f510be3da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '042c6b70c582444a8bbf747145814cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:09.902293 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3fb06578-5513-43f8-b920-4dd611630d30 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 200 len: 1558 microversion: 2.21 time: 0.600580 Jul 20 10:53:09.905536 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 754/1578] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:09 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 1558 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:09.924263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:09.926426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:09.934726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.935619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:09.936661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:09.937306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:10.301688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:10.310887 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a4ce206-a3fa-4d50-8015-125572bad1e0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.573483 Jul 20 10:53:10.311833 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 825/1579] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:09 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:10.327375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:10.328347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:10.335050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:10.335566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:10.336670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:10.338377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:10.490441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:10.508290 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8acc5154-08de-4fb6-aad8-b27b493217f2 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1714 microversion: 2.1 time: 0.596509 Jul 20 10:53:10.526492 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 755/1580] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:09 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1714 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:10.537222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:10.539301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:10.552271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:10.553209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:10.555006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:10.555789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.063589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:11.083049 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19019190-05b0-4b8f-a857-a09095368343 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1474 microversion: 2.1 time: 0.768866 Jul 20 10:53:11.084110 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 826/1581] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:10 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1474 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:11.103426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:11.104484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:11.113429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.114402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.115868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.116770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.402761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:11.417177 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9bd4e9bc-21a1-4dd6-ad3e-8d80d9233992 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.888777 Jul 20 10:53:11.418016 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 756/1582] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:10 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:11.439680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ffef9598-95b1-4626-83df-3f6a1b43f63d req-e3874add-496d-4402-8bd1-e0462808c289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "name": "network-vif-unplugged", "status": "completed", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:11.456904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ffef9598-95b1-4626-83df-3f6a1b43f63d req-e3874add-496d-4402-8bd1-e0462808c289 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.457364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ffef9598-95b1-4626-83df-3f6a1b43f63d req-e3874add-496d-4402-8bd1-e0462808c289 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.495140 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ffef9598-95b1-4626-83df-3f6a1b43f63d req-e3874add-496d-4402-8bd1-e0462808c289 service nova] Creating event network-vif-unplugged:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h1-846219-10 Jul 20 10:53:11.505717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:11.519534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-ffef9598-95b1-4626-83df-3f6a1b43f63d req-e3874add-496d-4402-8bd1-e0462808c289 service nova] Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:53:11.538650 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ffef9598-95b1-4626-83df-3f6a1b43f63d req-e3874add-496d-4402-8bd1-e0462808c289 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118758 Jul 20 10:53:11.540173 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 757/1583] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:11.546070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0cf4750d-7577-4304-b4e9-bd1be2e0b7d6 req-be02fda0-ca5d-475b-b51f-a4e15292fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf7a4bc-f988-48da-9273-277e561ddd31", "name": "network-vif-deleted", "tag": "47b4ab89-7a9a-4f22-95ff-660cf6daa6e8"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:11.561070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:11.562017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0cf4750d-7577-4304-b4e9-bd1be2e0b7d6 req-be02fda0-ca5d-475b-b51f-a4e15292fbf9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.562669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0cf4750d-7577-4304-b4e9-bd1be2e0b7d6 req-be02fda0-ca5d-475b-b51f-a4e15292fbf9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.572050 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4068e845-1969-40f0-a195-c336b73fbb86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.475404 Jul 20 10:53:11.583023 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 827/1584] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:11 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:11.588675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:11.591374 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0cf4750d-7577-4304-b4e9-bd1be2e0b7d6 req-be02fda0-ca5d-475b-b51f-a4e15292fbf9 service nova] Creating event network-vif-deleted:47b4ab89-7a9a-4f22-95ff-660cf6daa6e8 for instance fcf7a4bc-f988-48da-9273-277e561ddd31 on n-h1-846219-10 Jul 20 10:53:11.596078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:11.599963 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0cf4750d-7577-4304-b4e9-bd1be2e0b7d6 req-be02fda0-ca5d-475b-b51f-a4e15292fbf9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056791 Jul 20 10:53:11.602876 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 758/1585] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:11.613771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.614535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.615660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.616268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.618020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:11.620100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:11.637863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.638512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.639526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.640161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.682240 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] HTTP exception thrown: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Request method failure captured: Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 HTTP/1.1 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi195s1HAwEAlSouIsM_FIvxyOQPb5BtD5X2e_x9Lw6qJhHojNu73DyqimC9o7H_Q_Js8iXn02JvdHA6BjTqr0xS35Ie_NPk4nqqYo1yNmsCj_nltZ6Bfw7J9W6bg-O05-6HEJelGKO8kJlF8j3CGf39YWewA1yIeadhTYTDoUpXi6cLU Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 042c6b70c582444a8bbf747145814cb1 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_042c6b70c582444a8bbf747145814cb1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 042c6b70c582444a8bbf747145814cb1 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-InstanceActionsV221TestJSON-599710191-project Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 31e507de9dfa4ab7aeea7d7f510be3da Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-InstanceActionsV221TestJSON-599710191-project Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fcf7a4bc-f988-48da-9273-277e561ddd31'} Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:11.685232 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:11.690965 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:11.696055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Returning 404 to user: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:11.697221 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3a50f21e-c91c-4434-9639-0cbd4417f27c tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 404 len: 111 microversion: 2.21 time: 0.092972 Jul 20 10:53:11.699194 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 759/1586] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:11 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:11.708503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:11.710011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:11.718440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.719516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:11.721300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:11.721944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.583470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:12.595860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:12.598074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:12.599878 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bce0a5df-7df8-4ee4-9376-b77a7bcda5ba tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1815 microversion: 2.25 time: 1.014943 Jul 20 10:53:12.600994 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 828/1587] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:11 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1815 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:12.606272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:12.607262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:12.616318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.618803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.619854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.620082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:12.621208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.626779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:12.633918 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0664a45b-d78e-4f07-9dbf-485c82f1c579 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.929364 Jul 20 10:53:12.634886 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 760/1588] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:11 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:12.639710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '.version_select at 0x7f2c3f65d4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:12.648291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:12.663552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.667982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.669039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.671128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.787971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-14e03363-97b4-4b2d-b8f3-57c4df81e8ca tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.151914 Jul 20 10:53:12.796806 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 761/1589] 10.222.0.79 () {60 vars in 1336 bytes} [Wed Jul 20 10:53:12 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31/os-instance-actions => generated 611 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:12.803115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:12.804268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:12.812289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.812939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.813930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.815083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.828648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49e253c41f7d41c8a153cacb50e2f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357640b5ae0b4d22ab428d85f8fac338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:12.844004 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1aac571e-36ff-4d5f-8532-b7e259074c4d tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 200 len: 1647 microversion: 2.1 time: 0.241750 Jul 20 10:53:12.855589 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 829/1590] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:12 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 1647 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:12.860725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:12.862224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:12.869270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.870067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:12.871052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:12.871716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.472433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:13.487556 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0fae6d22-665b-4735-b812-86501e4f6c76 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1474 microversion: 2.1 time: 0.689153 Jul 20 10:53:13.494036 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 762/1591] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:12 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1474 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:13.504519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:13.505425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:13.518453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.519752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.522521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.522749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:13.522972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.531876 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c9fe3109-c5dd-45d4-9a3e-99097a613bac tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.674918 Jul 20 10:53:13.534239 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 830/1592] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:12 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:13.545100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:13.547740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:13.571459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.572625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.575969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.576905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.598203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] HTTP exception thrown: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Request method failure captured: Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 HTTP/1.1 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi195s1HAwEAlSouIsM_FIvxyOQPb5BtD5X2e_x9Lw6qJhHojNu73DyqimC9o7H_Q_Js8iXn02JvdHA6BjTqr0xS35Ie_NPk4nqqYo1yNmsCj_nltZ6Bfw7J9W6bg-O05-6HEJelGKO8kJlF8j3CGf39YWewA1yIeadhTYTDoUpXi6cLU Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 042c6b70c582444a8bbf747145814cb1 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_042c6b70c582444a8bbf747145814cb1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 042c6b70c582444a8bbf747145814cb1 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-InstanceActionsV221TestJSON-599710191-project Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 31e507de9dfa4ab7aeea7d7f510be3da Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-InstanceActionsV221TestJSON-599710191-project Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fcf7a4bc-f988-48da-9273-277e561ddd31'} Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:13.600785 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.606146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.608473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Returning 404 to user: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:13.609608 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a67eb5c-556a-41bd-bd88-837aeef50eac tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 404 len: 111 microversion: 2.21 time: 0.074102 Jul 20 10:53:13.610721 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 831/1593] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:53:13 2022] DELETE /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:13.617129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}, {"server_uuid": "84916937-f7a0-4d95-940a-d3de80a3fcb9", "name": "network-vif-deleted", "tag": "c84ae959-1c81-43c3-9d92-5de435dff542"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:13.631509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.632255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.654443 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] Creating event network-changed:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h1-846219-10 Jul 20 10:53:13.654443 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] Creating event network-vif-deleted:c84ae959-1c81-43c3-9d92-5de435dff542 for instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 on n-h2-846219-10 Jul 20 10:53:13.661603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:53:13.675552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f33c238d-0422-4a0e-817b-9aaa4227ed79 req-b0ca6c53-dc2a-4734-90cb-40c8a6f2aede service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062886 Jul 20 10:53:13.676679 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 832/1594] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:13.682791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:13.683606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] [instance: fcf7a4bc-f988-48da-9273-277e561ddd31] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:13.692460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.693062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.694524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.695092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.712484 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] HTTP exception thrown: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Request method failure captured: Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 HTTP/1.1 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi195s1HAwEAlSouIsM_FIvxyOQPb5BtD5X2e_x9Lw6qJhHojNu73DyqimC9o7H_Q_Js8iXn02JvdHA6BjTqr0xS35Ie_NPk4nqqYo1yNmsCj_nltZ6Bfw7J9W6bg-O05-6HEJelGKO8kJlF8j3CGf39YWewA1yIeadhTYTDoUpXi6cLU Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.21 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 042c6b70c582444a8bbf747145814cb1 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_042c6b70c582444a8bbf747145814cb1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/042c6b70c582444a8bbf747145814cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 042c6b70c582444a8bbf747145814cb1 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-599710191 Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-InstanceActionsV221TestJSON-599710191-project Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 31e507de9dfa4ab7aeea7d7f510be3da Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-InstanceActionsV221TestJSON-599710191-project Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fcf7a4bc-f988-48da-9273-277e561ddd31'} Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.714218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] Returning 404 to user: Instance fcf7a4bc-f988-48da-9273-277e561ddd31 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8f14f65-5558-4be7-9b18-22943658e4c4 tempest-InstanceActionsV221TestJSON-599710191 tempest-InstanceActionsV221TestJSON-599710191-project] 10.222.0.79 "GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31" status: 404 len: 111 microversion: 2.21 time: 0.038015 Jul 20 10:53:13.719370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 833/1595] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:13 2022] GET /compute/v2.1/servers/fcf7a4bc-f988-48da-9273-277e561ddd31 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:13.731535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:13.731982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:13.735124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:13.739719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.740179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.740973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.743017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:13.743621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.754687 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-93aace3c-3067-4f1b-a396-dda1284a284d tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.258563 Jul 20 10:53:13.764513 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 763/1596] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:13 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:13.770438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:13.771158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:13.778267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.778770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:13.781280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:13.781802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.309195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:14.327749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:14.329667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:14.331053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:14.332783 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-01fd3697-3cf7-4ef4-9bbd-a6b4b337039e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1805 microversion: 2.25 time: 0.615359 Jul 20 10:53:14.337633 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b4414c3c-36c6-4c5b-b457-81c3d16efe47 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.571960 Jul 20 10:53:14.338930 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 764/1597] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:13 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:14.341708 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 834/1598] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:13 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1805 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:14.345626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.346565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] [instance: 84916937-f7a0-4d95-940a-d3de80a3fcb9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:14.353146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4d3f028-4cf0-4eb5-ac38-d6eb194ac508 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '.version_select at 0x7f2c3f9e9af0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.356111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4d3f028-4cf0-4eb5-ac38-d6eb194ac508 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.356815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4d3f028-4cf0-4eb5-ac38-d6eb194ac508 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.362204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.362673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.363536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.363998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.375632 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4d3f028-4cf0-4eb5-ac38-d6eb194ac508 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 5188 microversion: 2.25 time: 0.026526 Jul 20 10:53:14.386413 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 835/1599] 10.222.0.79 () {60 vars in 1183 bytes} [Wed Jul 20 10:53:14 2022] GET /compute/v2.1/os-migrations => generated 5188 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:14.391446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.391570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] HTTP exception thrown: Instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 could not be found. Jul 20 10:53:14.392098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Request method failure captured: Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 HTTP/1.1 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi195Ew1CGrSoKBggE2OGY3uksNUDwbtwQt-e8kobNzdHSgTumdNbohTCQRUEKssI50HribJh9HBsgtv34pLs7IH9p_BQQX87gaAp7wZMsM7kwc7-OyuZ4Geex00yo-NSmcjPGjwqg_Lq5iCgXYDT9hydCnQ2LBq39rgk77U9STQLt_LE Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 357640b5ae0b4d22ab428d85f8fac338 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestManualDisk-698071782 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_357640b5ae0b4d22ab428d85f8fac338", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/357640b5ae0b4d22ab428d85f8fac338"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/357640b5ae0b4d22ab428d85f8fac338"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/357640b5ae0b4d22ab428d85f8fac338"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestManualDisk-698071782 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 357640b5ae0b4d22ab428d85f8fac338 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestManualDisk-698071782 Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestManualDisk-698071782-project Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 49e253c41f7d41c8a153cacb50e2f26f Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestManualDisk-698071782-project Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 could not be found. Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '84916937-f7a0-4d95-940a-d3de80a3fcb9'} Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 could not be found. Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 could not be found. Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:14.393122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 could not be found. Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Returning 404 to user: Instance 84916937-f7a0-4d95-940a-d3de80a3fcb9 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:14.399040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9bd5083b-f235-48fb-b954-d4db73f8ce60 tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9" status: 404 len: 111 microversion: 2.1 time: 0.054396 Jul 20 10:53:14.400682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.400682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.400682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.400986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.403107 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 765/1600] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:14 2022] GET /compute/v2.1/servers/84916937-f7a0-4d95-940a-d3de80a3fcb9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:53:14.410806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0337433-7f28-49a6-9e76-7bba32ffb9dd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] Calling method '.version_select at 0x7f2c3fe38af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.446349 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0337433-7f28-49a6-9e76-7bba32ffb9dd tempest-ServersTestManualDisk-698071782 tempest-ServersTestManualDisk-698071782-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179493770" status: 202 len: 0 microversion: 2.1 time: 0.040509 Jul 20 10:53:14.450122 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 766/1601] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 10:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179493770 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:53:14.514470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.515829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:14.531892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.532654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.534446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.535101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.903208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cca9a22d-eefc-4a46-8eea-54c393552ac0 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:53:14.919265 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69f573eb-49e6-41d6-a711-41daf17ee548 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 2426 microversion: 2.25 time: 0.531490 Jul 20 10:53:14.919863 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 836/1602] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:14 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 2426 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:14.943360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.944492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:14.954592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.955148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.956712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:14.957150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:14.969291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:14.981858 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-37596002-da12-4109-8d07-afe061fc1603 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1474 microversion: 2.1 time: 0.471437 Jul 20 10:53:14.995322 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 767/1603] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:14 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:14.995322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:14.995771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:15.006212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:15.006979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:15.007969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:15.008566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:15.407092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:15.415253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:15.424383 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d352b89-93ed-4f28-923d-cb25a9e2d3d6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.437754 Jul 20 10:53:15.425630 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 768/1604] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:14 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:15.436175 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d4d7e21-57f8-440e-b168-b06de9604f5d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.491030 Jul 20 10:53:15.436944 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 837/1605] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:14 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:15.443063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:15.444043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:15.449721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:15.450481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:15.464719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:15.465482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:15.466382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:15.466544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:15.467701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:15.468388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:15.469472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:15.470125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:15.977875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:16.081523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cca9a22d-eefc-4a46-8eea-54c393552ac0 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:53:16.094762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:16.097118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:16.106571 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-345107b2-27e5-464a-a706-adf27a57e063 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.668212 Jul 20 10:53:16.108960 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-143d558d-b55a-4cbd-a840-414985471419 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 2426 microversion: 2.25 time: 0.682252 Jul 20 10:53:16.120156 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 769/1606] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:53:15 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 2426 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:53:16.120756 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 838/1607] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:15 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:16.121136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b20f8f44-1a82-4d46-bc14-d06f99b6ddb1 req-4ae657e6-c8e4-425f-bf6e-868910036630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "name": "network-vif-plugged", "status": "completed", "tag": "c50360e4-93d2-41a4-b5ef-6f5d94dd732c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:16.130380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:16.131081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:16.138464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.139525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.140994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.141594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.144253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b20f8f44-1a82-4d46-bc14-d06f99b6ddb1 req-4ae657e6-c8e4-425f-bf6e-868910036630 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.154775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b20f8f44-1a82-4d46-bc14-d06f99b6ddb1 req-4ae657e6-c8e4-425f-bf6e-868910036630 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.201211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b20f8f44-1a82-4d46-bc14-d06f99b6ddb1 req-4ae657e6-c8e4-425f-bf6e-868910036630 service nova] Creating event network-vif-plugged:c50360e4-93d2-41a4-b5ef-6f5d94dd732c for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:16.212316 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b20f8f44-1a82-4d46-bc14-d06f99b6ddb1 req-4ae657e6-c8e4-425f-bf6e-868910036630 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100965 Jul 20 10:53:16.213686 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 770/1608] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:16.219557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:16.220945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:16.228121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.228972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.229885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.230706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.386558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:16.400978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad5913b6-4c74-4629-826f-a2c321d14f72 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1472 microversion: 2.1 time: 0.278525 Jul 20 10:53:16.400978 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 839/1609] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:16 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:16.442980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:16.443777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:16.450382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.451009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.451625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lazy-loading 'services' on Instance uuid cca9a22d-eefc-4a46-8eea-54c393552ac0 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:53:16.452051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.452602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.595979 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5b75bef-cbb9-4e94-9433-79b953e70d1a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments/1162389b-9bcc-4355-b565-1f19929dfe9c" status: 202 len: 0 microversion: 2.25 time: 0.380523 Jul 20 10:53:16.597062 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 771/1610] 10.222.0.79 () {60 vars in 1456 bytes} [Wed Jul 20 10:53:16 2022] DELETE /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments/1162389b-9bcc-4355-b565-1f19929dfe9c => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:53:16.611812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:16.612928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:16.620970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.621563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.622696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.623801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.640336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:16.656091 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8b0145a-9f77-4e7e-be09-f92d8eb1a3df tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.217443 Jul 20 10:53:16.656761 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 840/1611] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:16 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:16.663135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:16.664551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:16.675896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.676711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.677665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:16.678270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:16.739194 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e394d1bd-e905-4434-9d96-1bd6301ad8c2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080142 Jul 20 10:53:16.743844 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 841/1612] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:16 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:16.837573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:16.846938 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-347d7399-6a82-4237-9f71-9e80aa4641c3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.248487 Jul 20 10:53:16.847940 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 772/1613] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:16 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:17.129027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:17.130402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:17.137470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.137921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.138763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.139233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.419660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:17.420395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:17.432067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.436774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.437795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.438477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.523947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:17.536366 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4638c45-1ccb-46d5-bbcb-223a404209f2 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.412192 Jul 20 10:53:17.541530 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 842/1614] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:17 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:17.675907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:17.676876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:17.688539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.689983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.691232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.691929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.826059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:17.837247 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec7e886e-5daf-423f-a077-8b671bcc9a56 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1472 microversion: 2.1 time: 0.421393 Jul 20 10:53:17.839426 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 773/1615] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:17 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:17.850628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:17.851872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:17.875272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.878167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.883363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:17.883363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:17.984687 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d3b406b1-c6a2-433f-9ac6-63e3002d63fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.143350 Jul 20 10:53:18.002881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 774/1616] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:17 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:18.011435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:18.012626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:18.020890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:18.035037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.035891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:18.037367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.038163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:18.041656 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c139b062-212a-40a8-810b-1cfe099ff37f tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.371508 Jul 20 10:53:18.042376 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 843/1617] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:17 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:18.246886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-cdaa3551-cb05-4b18-ad9a-73aafabb6716 req-4ef0fe7b-7dbe-4bc5-82f7-c398dc45decb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "name": "network-vif-plugged", "status": "completed", "tag": "0c55debb-411e-41f8-bb0a-6d682f9f9ce2"}, {"server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "name": "network-vif-plugged", "status": "completed", "tag": "07e09f1b-cf1d-44aa-b9ae-425f9cde6f35"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:18.280463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-cdaa3551-cb05-4b18-ad9a-73aafabb6716 req-4ef0fe7b-7dbe-4bc5-82f7-c398dc45decb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.281103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-cdaa3551-cb05-4b18-ad9a-73aafabb6716 req-4ef0fe7b-7dbe-4bc5-82f7-c398dc45decb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:18.306125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:18.319016 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0677eb5e-c3c1-4acc-8bad-a23121b3306a tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.311439 Jul 20 10:53:18.326402 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 775/1618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:18 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:18.327315 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-cdaa3551-cb05-4b18-ad9a-73aafabb6716 req-4ef0fe7b-7dbe-4bc5-82f7-c398dc45decb service nova] Creating event network-vif-plugged:0c55debb-411e-41f8-bb0a-6d682f9f9ce2 for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:18.328078 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-cdaa3551-cb05-4b18-ad9a-73aafabb6716 req-4ef0fe7b-7dbe-4bc5-82f7-c398dc45decb service nova] Creating event network-vif-plugged:07e09f1b-cf1d-44aa-b9ae-425f9cde6f35 for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:18.342329 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-cdaa3551-cb05-4b18-ad9a-73aafabb6716 req-4ef0fe7b-7dbe-4bc5-82f7-c398dc45decb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099158 Jul 20 10:53:18.343842 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 844/1619] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:53:18.576015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:18.578617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:18.592940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.593710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:18.594847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.596482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:18.855906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:18.857928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:18.895914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.896406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:18.897254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:18.897694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.383525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:19.403139 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-785fb304-10a6-4bc2-9f2a-4ec96769263c tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.848897 Jul 20 10:53:19.403913 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 776/1620] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:18 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:19.429241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:19.430841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:19.441455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:19.443204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.445155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:19.445898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.472994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:19.502278 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a2d5b452-0aa6-4338-ba00-042520bb707e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078570 Jul 20 10:53:19.503847 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 777/1621] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:19 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:19.508988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:19.509600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:19.517435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:19.517980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.518769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:19.519235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.758422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:19.769259 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f39aee9-6cff-48e9-8dd5-3053150fadb0 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1472 microversion: 2.1 time: 0.918786 Jul 20 10:53:19.773991 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 845/1622] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:18 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1472 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:19.778759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:19.779519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:19.793849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:19.797760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.806999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:19.806999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:19.826835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:19.844741 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b6c86104-7982-46dc-aee1-71e602474cbf tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.339752 Jul 20 10:53:19.861773 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 778/1623] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:19 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:20.106747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:20.114714 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3e39257-b7c9-4f27-b6f5-484ef3ae9b7b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.339646 Jul 20 10:53:20.115247 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 846/1624] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:19 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:20.425177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:20.425800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:20.434397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:20.436482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:20.436935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:20.437719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:20.438155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:20.514391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:20.515602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:20.525027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:20.525644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:20.526658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:20.527425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:20.591884 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da1d9dba-0d8f-4318-b3fd-2d6a36bb54fc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081282 Jul 20 10:53:20.593105 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 847/1625] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:20 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 10:53:20.790072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:20.790706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:20.796788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:20.797244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:20.798021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:20.798551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:20.874320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:21.287057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:21.305162 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b960dd48-3b3b-452d-8a67-bd81adae7ab0 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1355 microversion: 2.1 time: 0.881834 Jul 20 10:53:21.308344 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 779/1626] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:20 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1355 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:21.331829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1cd19e9c-22d1-41d7-9399-06fafff52689 req-9feb24dd-386d-461e-8ed3-cf67d40e8324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf1c0b2-b3ca-452b-bf03-d36f55019d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "b7e29330-5a03-4253-84a0-568c80dee39a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:21.349416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1cd19e9c-22d1-41d7-9399-06fafff52689 req-9feb24dd-386d-461e-8ed3-cf67d40e8324 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:21.352636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1cd19e9c-22d1-41d7-9399-06fafff52689 req-9feb24dd-386d-461e-8ed3-cf67d40e8324 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:21.385378 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1cd19e9c-22d1-41d7-9399-06fafff52689 req-9feb24dd-386d-461e-8ed3-cf67d40e8324 service nova] Creating event network-vif-unplugged:b7e29330-5a03-4253-84a0-568c80dee39a for instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a on n-h2-846219-10 Jul 20 10:53:21.395538 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1cd19e9c-22d1-41d7-9399-06fafff52689 req-9feb24dd-386d-461e-8ed3-cf67d40e8324 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083734 Jul 20 10:53:21.396865 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 780/1627] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:21.403374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:21.404962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:21.417366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:21.422400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:21.431005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:21.431870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.013345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:22.024791 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1ab4ed8-0305-45ae-9bf9-26dd1b1387ef tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1472 microversion: 2.1 time: 1.238514 Jul 20 10:53:22.037994 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 848/1628] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:20 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1472 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:22.046410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:22.047783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:22.073712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.074449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.081524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.082364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.161287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:22.190719 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-42ef0931-fd10-4413-b958-bc88508f6fcc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.792026 Jul 20 10:53:22.193454 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 781/1629] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:21 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:22.210461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:22.211826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:22.218992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.221576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.224660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.225216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.288512 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b2ca1fc-faf1-4a8f-8a08-a1f299f461e7 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.093453 Jul 20 10:53:22.290895 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 782/1630] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:22 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:22.337134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:22.339530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:22.357614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.358722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.362267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.363310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.504230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:22.513565 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3503d1d6-6b9c-464b-9ecd-5b6de47b54d4 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.473826 Jul 20 10:53:22.519094 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 849/1631] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:22 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:22.787119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:22.797582 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1b08f105-9f40-4378-8051-9ab253bdbf19 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1806 microversion: 2.1 time: 0.472236 Jul 20 10:53:22.800903 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 783/1632] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:22 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1806 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:22.825564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:22.826260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:22.835883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.836665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.837707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.838359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.941122 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-85e71cd0-f074-4cfe-8285-d6c7c3e68a1a tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834/ips" status: 200 len: 219 microversion: 2.1 time: 0.120571 Jul 20 10:53:22.942293 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 850/1633] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 10:53:22 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834/ips => generated 219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:22.959550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:22.960436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:22.993261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.994049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:22.995844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:22.996679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.053932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:23.055037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:23.098662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.099786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.101268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.104032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.138826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:53:23.366631 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d1012a9c-673f-484a-96d8-af3deff965b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 204 len: 0 microversion: 2.1 time: 0.414804 Jul 20 10:53:23.370949 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 784/1634] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:53:22 2022] DELETE /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:53:23.387251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:23.391909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:23.422294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.426799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.429402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.430752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.543945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:23.582805 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-91ec800d-5464-4c08-b7bd-2486c5e573ee tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1469 microversion: 2.1 time: 0.536009 Jul 20 10:53:23.589616 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 851/1635] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:23 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1469 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:23.613857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:23.627009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:23.650916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.651483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.655197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.656161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.719785 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa15c5c5-2085-459e-8353-b09428b39c4b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122850 Jul 20 10:53:23.723793 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 852/1636] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:23 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:23.727500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:23.728978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:23.735546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.736560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:23.737612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:23.738167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.043522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:24.077519 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1bc83b76-5009-47ff-a5b3-532af69078ec tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.702883 Jul 20 10:53:24.080869 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 785/1637] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:23 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:24.092616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e37d646b-c03d-4586-ae7f-50621cb05040 req-1b2d7bb5-4161-4101-b248-db87955feca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf1c0b2-b3ca-452b-bf03-d36f55019d0a", "tag": "b7e29330-5a03-4253-84a0-568c80dee39a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:24.114684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e37d646b-c03d-4586-ae7f-50621cb05040 req-1b2d7bb5-4161-4101-b248-db87955feca2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.115130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e37d646b-c03d-4586-ae7f-50621cb05040 req-1b2d7bb5-4161-4101-b248-db87955feca2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.152615 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e37d646b-c03d-4586-ae7f-50621cb05040 req-1b2d7bb5-4161-4101-b248-db87955feca2 service nova] Creating event network-changed:b7e29330-5a03-4253-84a0-568c80dee39a for instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a on n-h2-846219-10 Jul 20 10:53:24.171880 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e37d646b-c03d-4586-ae7f-50621cb05040 req-1b2d7bb5-4161-4101-b248-db87955feca2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088925 Jul 20 10:53:24.172537 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 786/1638] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:24.189376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:24.200743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:24.222382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.223269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:24.224396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.225297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.225750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.249883 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2fd5610-d75f-4aa3-ad7f-2476bf9d8af7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1812 microversion: 2.1 time: 0.526230 Jul 20 10:53:24.252109 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 853/1639] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:23 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1812 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:24.262348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:24.266787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:24.285425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.285889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.289285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.291262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.485958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:24.495949 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fc041f8d-d848-47b8-9acc-5f1671fe8810 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.321202 Jul 20 10:53:24.500005 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 787/1640] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:24 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:24.582729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bdbf4a6c-1bea-48b4-9bee-b9cbc1845709 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "POST /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a/action" status: 202 len: 0 microversion: 2.1 time: 0.328747 Jul 20 10:53:24.591870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 854/1641] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:53:24 2022] POST /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:53:24.595540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:24.596733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:24.606584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.607893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.609261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.610349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.741395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:24.744025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:24.768965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.770070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.773733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:24.774542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:24.885362 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3d385a35-413b-49ba-9a84-1082921af29c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152009 Jul 20 10:53:24.889435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 855/1642] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:24 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 10:53:25.037401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:25.046896 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97255c03-1f61-402f-bd50-03cc6d8a2ac4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 0.458047 Jul 20 10:53:25.052303 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 788/1643] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:24 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:25.097529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:25.098520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:25.113480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:25.114457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:25.115714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:25.116379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:25.217889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fb90669-6e45-4cc8-a854-637771864ce1 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-926044108", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:25.219824 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4fb90669-6e45-4cc8-a854-637771864ce1 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] HTTP exception thrown: min_count must be <= max_count Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fb90669-6e45-4cc8-a854-637771864ce1 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Request method failure captured: Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 183 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196kh-zj4CANUXVfbtq5_HzZmBzfhIkCxM7s43RRDaeH-ZdjoDrbboSoILYWhvTc3A2zJgt5PHy76SSogiWZ9vgKHsqZKktEVAB2uZ5OR77HoQ91FjGunRe-ybTuwIjBO1wMKc6PhzD1IY_4ximLFrxU99k5iWY8eBCixJmgUKKaqto Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03c36eeb872f427bbb902cacb753c484", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 50160cb60f3b4307810f6df50d46e4be Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-926044108", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: exception: min_count must be <= max_count Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-926044108', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 20 10:53:25.222549 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.228740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fb90669-6e45-4cc8-a854-637771864ce1 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Returning 400 to user: min_count must be <= max_count {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:25.229820 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4fb90669-6e45-4cc8-a854-637771864ce1 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.339168 Jul 20 10:53:25.240929 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 856/1644] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:53:24 2022] POST /compute/v2.1/servers => generated 74 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 10:53:25.277599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:25.282538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:25.291434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:25.292282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:25.293379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:25.294040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:25.612988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:25.628976 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3f9b9f4c-912e-46d4-a3b3-31eedcd28c86 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.536482 Jul 20 10:53:25.629594 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 789/1645] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:25 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:25.648275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6dd2d8f-9fbb-417f-9f41-03aa6d486d59 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1837215425", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "max_count": 0}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6dd2d8f-9fbb-417f-9f41-03aa6d486d59 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Request method failure captured: Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 168 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi196kh-zj4CANUXVfbtq5_HzZmBzfhIkCxM7s43RRDaeH-ZdjoDrbboSoILYWhvTc3A2zJgt5PHy76SSogiWZ9vgKHsqZKktEVAB2uZ5OR77HoQ91FjGunRe-ybTuwIjBO1wMKc6PhzD1IY_4ximLFrxU99k5iWY8eBCixJmgUKKaqto Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03c36eeb872f427bbb902cacb753c484", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 50160cb60f3b4307810f6df50d46e4be Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1837215425", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "max_count": 0}} Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1837215425', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'max_count': 0}}} Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 0 Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:53:25.653019 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 20 10:53:25.659027 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.663397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6dd2d8f-9fbb-417f-9f41-03aa6d486d59 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:25.664713 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6dd2d8f-9fbb-417f-9f41-03aa6d486d59 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023053 Jul 20 10:53:25.665944 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 790/1646] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:53:25 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:25.683806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:25.685475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:25.707049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:25.708233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:25.710167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:25.716846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:25.920000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:25.932589 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b619a532-6348-4fa8-958f-67dc05414a01 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1812 microversion: 2.1 time: 0.661295 Jul 20 10:53:25.942159 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 857/1647] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:25 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1812 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:25.947357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5383b92-c12a-47f9-8afb-e64b0ea7fd56 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-431556142", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "max_count": 2.5}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5383b92-c12a-47f9-8afb-e64b0ea7fd56 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Request method failure captured: Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 169 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196kh-zj4CANUXVfbtq5_HzZmBzfhIkCxM7s43RRDaeH-ZdjoDrbboSoILYWhvTc3A2zJgt5PHy76SSogiWZ9vgKHsqZKktEVAB2uZ5OR77HoQ91FjGunRe-ybTuwIjBO1wMKc6PhzD1IY_4ximLFrxU99k5iWY8eBCixJmgUKKaqto Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03c36eeb872f427bbb902cacb753c484", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 50160cb60f3b4307810f6df50d46e4be Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-431556142", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "max_count": 2.5}} Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-431556142', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'max_count': 2.5}}} Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:53:25.950704 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5383b92-c12a-47f9-8afb-e64b0ea7fd56 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:25.956014 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5383b92-c12a-47f9-8afb-e64b0ea7fd56 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010039 Jul 20 10:53:25.964134 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 858/1648] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:53:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:25.970962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:25.978024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:26.003768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.010502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.011793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.013028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.067673 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da2fbb3e-d3a1-472b-a36e-e85352a78f75 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.101774 Jul 20 10:53:26.071319 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 859/1649] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 10:53:25 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:26.091299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:26.094138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:26.122534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.126079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.127512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.130124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.366916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:26.378976 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2ca07c5d-49f8-468f-ada5-d99f1331e472 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.708789 Jul 20 10:53:26.383627 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 791/1650] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:25 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:26.408014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a6c4778-6c21-47f6-8bb2-3346a5bf3b14 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1898315040", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 0}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a6c4778-6c21-47f6-8bb2-3346a5bf3b14 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Request method failure captured: Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 168 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi196kh-zj4CANUXVfbtq5_HzZmBzfhIkCxM7s43RRDaeH-ZdjoDrbboSoILYWhvTc3A2zJgt5PHy76SSogiWZ9vgKHsqZKktEVAB2uZ5OR77HoQ91FjGunRe-ybTuwIjBO1wMKc6PhzD1IY_4ximLFrxU99k5iWY8eBCixJmgUKKaqto Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03c36eeb872f427bbb902cacb753c484", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 50160cb60f3b4307810f6df50d46e4be Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1898315040", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 0}} Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1898315040', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'min_count': 0}}} Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 0 Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:53:26.421990 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a6c4778-6c21-47f6-8bb2-3346a5bf3b14 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a6c4778-6c21-47f6-8bb2-3346a5bf3b14 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.038224 Jul 20 10:53:26.428524 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 792/1651] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:53:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:26.434215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-81ecc698-b3f6-44ea-b4fa-f79b0c988675 req-ae5daae9-3999-419f-b9f6-0bf7168335ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "name": "network-vif-plugged", "status": "completed", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:26.480306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-81ecc698-b3f6-44ea-b4fa-f79b0c988675 req-ae5daae9-3999-419f-b9f6-0bf7168335ab service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.480752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-81ecc698-b3f6-44ea-b4fa-f79b0c988675 req-ae5daae9-3999-419f-b9f6-0bf7168335ab service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.498087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:26.510996 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2f42b6ff-9185-42be-a90c-9b6e2481660a tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 0.436450 Jul 20 10:53:26.512215 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 860/1652] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:26 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:26.525351 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-81ecc698-b3f6-44ea-b4fa-f79b0c988675 req-ae5daae9-3999-419f-b9f6-0bf7168335ab service nova] Creating event network-vif-plugged:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h1-846219-10 Jul 20 10:53:26.540062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-81ecc698-b3f6-44ea-b4fa-f79b0c988675 req-ae5daae9-3999-419f-b9f6-0bf7168335ab service nova] Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:53:26.607018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-482ee3fa-6b17-47bf-b0ea-181a7bff5619 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-92042456", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 2.5}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-482ee3fa-6b17-47bf-b0ea-181a7bff5619 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Request method failure captured: Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 168 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196kh-zj4CANUXVfbtq5_HzZmBzfhIkCxM7s43RRDaeH-ZdjoDrbboSoILYWhvTc3A2zJgt5PHy76SSogiWZ9vgKHsqZKktEVAB2uZ5OR77HoQ91FjGunRe-ybTuwIjBO1wMKc6PhzD1IY_4ximLFrxU99k5iWY8eBCixJmgUKKaqto Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_03c36eeb872f427bbb902cacb753c484", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/03c36eeb872f427bbb902cacb753c484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 03c36eeb872f427bbb902cacb753c484 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-493038807 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 50160cb60f3b4307810f6df50d46e4be Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-493038807-project Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-92042456", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 2.5}} Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-92042456', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'min_count': 2.5}}} Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 2.5 Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:53:26.611269 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-482ee3fa-6b17-47bf-b0ea-181a7bff5619 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-482ee3fa-6b17-47bf-b0ea-181a7bff5619 tempest-MultipleCreateNegativeTestJSON-493038807 tempest-MultipleCreateNegativeTestJSON-493038807-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011371 Jul 20 10:53:26.630413 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 861/1653] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:53:26 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:26.647481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:26.648498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:26.661255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.665712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.667005 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-81ecc698-b3f6-44ea-b4fa-f79b0c988675 req-ae5daae9-3999-419f-b9f6-0bf7168335ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228705 Jul 20 10:53:26.668405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.668978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.674727 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 793/1654] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:26.769622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9eb328da-700b-4453-8b3a-15386f252de0 req-89193f0f-bb14-4eb7-aeeb-6d91ca58d809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "name": "network-vif-deleted", "tag": "07e09f1b-cf1d-44aa-b9ae-425f9cde6f35"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:26.801832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9eb328da-700b-4453-8b3a-15386f252de0 req-89193f0f-bb14-4eb7-aeeb-6d91ca58d809 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.810518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9eb328da-700b-4453-8b3a-15386f252de0 req-89193f0f-bb14-4eb7-aeeb-6d91ca58d809 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.842723 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9eb328da-700b-4453-8b3a-15386f252de0 req-89193f0f-bb14-4eb7-aeeb-6d91ca58d809 service nova] Creating event network-vif-deleted:07e09f1b-cf1d-44aa-b9ae-425f9cde6f35 for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:26.882482 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9eb328da-700b-4453-8b3a-15386f252de0 req-89193f0f-bb14-4eb7-aeeb-6d91ca58d809 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112350 Jul 20 10:53:26.885654 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 794/1655] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:53:26.953587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:26.955455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:26.964891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.965667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:26.970739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:26.974750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:27.139350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:27.148206 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-99f4b544-fca6-4ec1-986c-3970ce885de2 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.506006 Jul 20 10:53:27.171711 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 862/1656] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:26 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:27.400276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:27.400969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:27.410337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:27.410920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:27.411419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:27.412151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:27.412870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:27.436409 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c2cc009c-5e52-403d-a219-5926e3050eba tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1676 microversion: 2.1 time: 0.487002 Jul 20 10:53:27.445877 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 795/1657] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:26 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1676 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:27.534392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:27.536230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:27.547424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:27.548835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:27.550200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:27.550821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:27.572891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:28.138458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:28.171352 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3f7fc04-8d64-4ed4-b784-97fa6993c77c tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 0.644312 Jul 20 10:53:28.178941 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 796/1658] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:27 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:28.196497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:28.198925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:28.212161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:28.214738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:28.215613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:28.217063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:28.217996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:28.231066 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92ab4bb2-ee5b-4142-be3b-650f15a07f57 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.833315 Jul 20 10:53:28.234286 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 863/1659] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:27 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:28.460378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:28.460995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:28.477431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:28.478178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:28.479137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:28.479765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:28.772969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:28.786825 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31c3365a-f67a-4eee-9d0d-e7d2e89d344e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 200 len: 1613 microversion: 2.1 time: 0.330186 Jul 20 10:53:28.792408 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 864/1660] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:28 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 1613 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:28.933554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4b08c4f3-a2e0-4827-a1af-c5a4afd45d23 req-50b29aae-557d-4b56-b2a4-fba7b9bff1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "name": "network-vif-deleted", "tag": "c50360e4-93d2-41a4-b5ef-6f5d94dd732c"}, {"server_uuid": "dd22ae96-f5fd-47f7-b21b-bcb7946f2834", "name": "network-vif-deleted", "tag": "0c55debb-411e-41f8-bb0a-6d682f9f9ce2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:28.933687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:28.949493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4b08c4f3-a2e0-4827-a1af-c5a4afd45d23 req-50b29aae-557d-4b56-b2a4-fba7b9bff1f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:28.950393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4b08c4f3-a2e0-4827-a1af-c5a4afd45d23 req-50b29aae-557d-4b56-b2a4-fba7b9bff1f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:28.953509 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8b438e1c-22a5-4f5d-8af9-11b10edd580e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.772861 Jul 20 10:53:28.955584 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 797/1661] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:28 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:28.988272 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4b08c4f3-a2e0-4827-a1af-c5a4afd45d23 req-50b29aae-557d-4b56-b2a4-fba7b9bff1f1 service nova] Creating event network-vif-deleted:c50360e4-93d2-41a4-b5ef-6f5d94dd732c for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:28.988779 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4b08c4f3-a2e0-4827-a1af-c5a4afd45d23 req-50b29aae-557d-4b56-b2a4-fba7b9bff1f1 service nova] Creating event network-vif-deleted:0c55debb-411e-41f8-bb0a-6d682f9f9ce2 for instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 on n-h2-846219-10 Jul 20 10:53:29.004431 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4b08c4f3-a2e0-4827-a1af-c5a4afd45d23 req-50b29aae-557d-4b56-b2a4-fba7b9bff1f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075439 Jul 20 10:53:29.006277 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 865/1662] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:53:29.196391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:29.203106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:29.218807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:29.219708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:29.223288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:29.223955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:29.256939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:29.258186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:29.287904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:29.288636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:29.292761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:29.293476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:29.983594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:29.994966 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94d43583-fa52-4613-90e6-c6195a9ef474 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 0.803555 Jul 20 10:53:29.995612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 798/1663] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:29 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:30.009909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7650e1c3-8429-4150-976e-c5c731d11414 req-370e7bba-812e-4706-bdc3-61d6038d7439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf1c0b2-b3ca-452b-bf03-d36f55019d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "b7e29330-5a03-4253-84a0-568c80dee39a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:30.022768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:30.030042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7650e1c3-8429-4150-976e-c5c731d11414 req-370e7bba-812e-4706-bdc3-61d6038d7439 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:30.030490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7650e1c3-8429-4150-976e-c5c731d11414 req-370e7bba-812e-4706-bdc3-61d6038d7439 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:30.051199 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-07dc4765-d532-4fb9-9366-0aca2425e614 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.802103 Jul 20 10:53:30.052445 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 866/1664] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:29 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:30.058761 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7650e1c3-8429-4150-976e-c5c731d11414 req-370e7bba-812e-4706-bdc3-61d6038d7439 service nova] Creating event network-vif-unplugged:b7e29330-5a03-4253-84a0-568c80dee39a for instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a on n-h2-846219-10 Jul 20 10:53:30.072068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:30.073317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:30.074458 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7650e1c3-8429-4150-976e-c5c731d11414 req-370e7bba-812e-4706-bdc3-61d6038d7439 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077606 Jul 20 10:53:30.075091 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 799/1665] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:30.083503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:30.083960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:30.084746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:30.085176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:30.086344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:30.087158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:30.101143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:30.105598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:30.107001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:30.109740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:30.118267 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] HTTP exception thrown: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Request method failure captured: Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 HTTP/1.1 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196DYCFMlu1GM5HcIJa1w_4cpSl6a4OatlIgHbv57yl-7IjtD5yzSdfBrnnm-DHhy8Dmk6oZecArQS8MhIkSk8vjMP2WMeSMV5_fP01phf7Rg94R6lVMp3eXVeHS2ryctvLPHmvsCCg4sE6DLDpSFK1SwI68iy8NbNrDdY2amQNtLjk Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f6480dcf785424b827d35f7cbfa6ddf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestMultiNic-1542454738 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8b622b3ec37f48e49ae295acd6d1c34a Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'dd22ae96-f5fd-47f7-b21b-bcb7946f2834'} Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:30.133213 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Returning 404 to user: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97a3cad8-1914-49d2-9438-fcb963f66baa tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 404 len: 111 microversion: 2.1 time: 0.080812 Jul 20 10:53:30.137696 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 867/1666] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:30 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:53:30.498363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:30.507478 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9e94e75f-d6fe-4be3-b4ea-b77b9d5f29d3 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.430946 Jul 20 10:53:30.511386 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 800/1667] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:30 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:31.023677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:31.024310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:31.038426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:31.038897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:31.039738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:31.040186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:31.082980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:31.083592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:31.088618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:31.099456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:31.100039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:31.100883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:31.101327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:31.495494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:31.514904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-473dd01f-3fb0-4775-ace8-8936eeae7769 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.439253 Jul 20 10:53:31.534606 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 801/1668] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:31 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:31.545604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:31.554196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:31.578005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:31.587495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:31.588997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:31.590212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:31.989641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:32.002822 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8064ca6f-cc11-4a29-a825-6d176f963651 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 0.982879 Jul 20 10:53:32.006259 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 868/1669] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:31 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:32.015073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8c6d1906-d65e-4e22-9eca-bfb0f8aa4281 req-26c72381-e224-419b-bc20-f72c5aa04b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "name": "network-vif-unplugged", "status": "completed", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:32.048163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8c6d1906-d65e-4e22-9eca-bfb0f8aa4281 req-26c72381-e224-419b-bc20-f72c5aa04b06 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:32.051648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8c6d1906-d65e-4e22-9eca-bfb0f8aa4281 req-26c72381-e224-419b-bc20-f72c5aa04b06 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:32.112814 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8c6d1906-d65e-4e22-9eca-bfb0f8aa4281 req-26c72381-e224-419b-bc20-f72c5aa04b06 service nova] Creating event network-vif-unplugged:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h2-846219-10 Jul 20 10:53:32.157217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-8c6d1906-d65e-4e22-9eca-bfb0f8aa4281 req-26c72381-e224-419b-bc20-f72c5aa04b06 service nova] Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:53:32.203343 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8c6d1906-d65e-4e22-9eca-bfb0f8aa4281 req-26c72381-e224-419b-bc20-f72c5aa04b06 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194213 Jul 20 10:53:32.210813 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 869/1670] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:32.549862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:32.552212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:32.563539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:32.564149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:32.565552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:32.566206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:32.630080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:32.654671 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a50c942c-769b-4b79-bbe2-38f3c28bee20 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 1.104878 Jul 20 10:53:32.666463 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 802/1671] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:31 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:33.028078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:33.028711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:33.041991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:33.057661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:33.058027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:33.069228 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6773f7ff-a76c-4acc-8a6d-92fe29345440 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.525117 Jul 20 10:53:33.070207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:33.070851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:33.072405 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 870/1672] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:32 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:33.675998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:33.677042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:33.705192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:33.706347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:33.711345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:33.712408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:33.792423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:33.814971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-10817cbe-f759-403c-a73e-8af5d197133e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 0.792377 Jul 20 10:53:33.816089 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 803/1673] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:33 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:34.094550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:34.096409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:34.111336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:34.113021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:34.115521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:34.116288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:34.250271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:34.264985 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f56e3360-b2f5-405b-b54b-132083e648b7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.595509 Jul 20 10:53:34.272139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 871/1674] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:33 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:34.277448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-05b645f7-cb1d-428a-8e8b-48ebd280d682 req-387dec63-e932-424e-96f4-80705945c567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:34.300059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-05b645f7-cb1d-428a-8e8b-48ebd280d682 req-387dec63-e932-424e-96f4-80705945c567 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:34.301851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-05b645f7-cb1d-428a-8e8b-48ebd280d682 req-387dec63-e932-424e-96f4-80705945c567 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:34.335643 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-05b645f7-cb1d-428a-8e8b-48ebd280d682 req-387dec63-e932-424e-96f4-80705945c567 service nova] Creating event network-changed:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h2-846219-10 Jul 20 10:53:34.344364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-05b645f7-cb1d-428a-8e8b-48ebd280d682 req-387dec63-e932-424e-96f4-80705945c567 service nova] Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 10:53:34.362155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-05b645f7-cb1d-428a-8e8b-48ebd280d682 req-387dec63-e932-424e-96f4-80705945c567 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088248 Jul 20 10:53:34.363579 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 872/1675] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:34.829268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:34.842294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:34.844005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:34.866034 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1235a652-d59d-4587-b0c1-082cf44c7ab1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.781750 Jul 20 10:53:34.881847 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 804/1676] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:34 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:34.883487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:34.884254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:34.886204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:34.887767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:35.289788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:35.292955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:35.301358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:35.302144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:35.303140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:35.303771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:35.900248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:35.921737 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-373a7361-4741-409c-be6a-29e7f02546cd tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 1.090099 Jul 20 10:53:35.923878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 873/1677] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:34 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:35.933850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:35.934488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:35.958639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:35.959110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:35.959950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:35.960400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:36.180660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:36.212118 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d8176484-ad88-4203-904f-2fc5b9be801a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 0.911915 Jul 20 10:53:36.216651 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 805/1678] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:35 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:36.435020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:36.464000 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-616f34d1-d13c-46d4-918c-33739215598d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.534823 Jul 20 10:53:36.465098 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 874/1679] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:35 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:36.958138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:36.964614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:37.004363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:37.009292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:37.023482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:37.033476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:37.231741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:37.233196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:37.253796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:37.262916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:37.266754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:37.268677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:38.690546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:38.696250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:38.701369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-acab59af-4481-4592-9a49-5fa49ce0fef7 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1392 microversion: 2.1 time: 1.473912 Jul 20 10:53:38.706570 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 875/1680] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:37 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1392 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:38.712926 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-916ad737-8f03-41f1-a7d6-c04043c2d8b4 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1468 microversion: 2.1 time: 1.766953 Jul 20 10:53:38.714305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:38.715202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:38.718456 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 806/1681] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:36 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1468 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:38.751731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:38.752260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:38.755912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:38.756412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:39.637730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:39.650164 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e1f733c-06dc-4233-b8b2-050de7864978 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.942179 Jul 20 10:53:39.651888 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 876/1682] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:38 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:39.729394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:39.730832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:39.740858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:39.743546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:39.749662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:39.753016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:39.757650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:39.759054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:39.764652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:39.767005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:39.768315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:39.769569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.203515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:40.235219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2c1beb8-9fff-4a62-a62c-9eb8dfabf017 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1382 microversion: 2.1 time: 0.509073 Jul 20 10:53:40.237394 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 807/1683] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:39 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1382 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:40.256385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7de0d6db-96a5-4c49-b97d-13af77acd733 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '.version_select at 0x7f2c3fbc83a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:40.265716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7de0d6db-96a5-4c49-b97d-13af77acd733 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.267774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7de0d6db-96a5-4c49-b97d-13af77acd733 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.275063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:40.290639 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1df956d-91a6-48a5-a798-d92ff65d8817 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1461 microversion: 2.1 time: 0.556336 Jul 20 10:53:40.291582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 877/1684] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:39 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1461 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:40.321116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7de0d6db-96a5-4c49-b97d-13af77acd733 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 4318 microversion: 2.1 time: 0.071486 Jul 20 10:53:40.324382 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 808/1685] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:53:40 2022] GET /compute/v2.1/os-migrations => generated 4318 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:40.338219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:40.338837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:40.357968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.359323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.364805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.366958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.779202 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6a5d6170-f70a-4d75-b25d-7cb931361438 tempest-LiveMigrationTest-46504406 tempest-LiveMigrationTest-46504406-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1535 microversion: 2.1 time: 0.444556 Jul 20 10:53:40.780502 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 809/1686] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:40 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1535 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:40.814401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:40.815605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:40.822400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.823708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.825463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.828416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.873302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:40.875288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:40.910152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.910703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:40.911950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:40.912526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:41.675659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:41.691799 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b0b454d-b40c-4207-8e6d-00cb4113758d tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1472 microversion: 2.1 time: 0.908679 Jul 20 10:53:41.694881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 810/1687] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:40 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1472 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:41.709668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:41.710360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:41.722526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:41.727002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:41.728383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:41.729366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:41.814838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:53:41.938664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36a9e0ad-0ca5-4c75-8abd-b12ad6e4b8de tempest-MigrationsAdminTest-1423048136 tempest-MigrationsAdminTest-1423048136-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1614 microversion: 2.1 time: 1.620842 Jul 20 10:53:41.939636 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 878/1688] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:40 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1614 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:41.969186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:41.980951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:42.004354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.004814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.005607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.006044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.127668 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21ea968d-d1d2-48eb-a12c-de62edebe71e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 204 len: 0 microversion: 2.1 time: 0.430701 Jul 20 10:53:42.128270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 811/1689] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:53:41 2022] DELETE /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:53:42.140338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:53:42.149991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:42.160591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:42.181664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.185385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.186525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.187136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.316628 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-06f6e52b-2717-476b-9887-efd91ab905de tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 204 len: 0 microversion: 2.1 time: 0.350972 Jul 20 10:53:42.317693 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 879/1690] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:53:41 2022] DELETE /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:53:42.335267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:42.336823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:42.358422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.360263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.364628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.366221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.896764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:42.905154 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-24c389d5-fae5-416a-98e0-27020a7f191e tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1467 microversion: 2.1 time: 0.581152 Jul 20 10:53:42.917112 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 880/1691] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:42 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1467 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:42.929920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0fd22dce-01c7-41a9-ad79-759f58b71461 req-d29c69ae-e4f8-48ef-a176-df6e95f57181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "name": "network-vif-plugged", "status": "completed", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:42.944997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:42.953036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:42.959453 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1771a700-3603-4a2c-888e-4f1666033ce5 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1388 microversion: 2.1 time: 0.818095 Jul 20 10:53:42.966689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0fd22dce-01c7-41a9-ad79-759f58b71461 req-d29c69ae-e4f8-48ef-a176-df6e95f57181 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:42.967375 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 812/1692] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:42 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1388 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:42.972245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0fd22dce-01c7-41a9-ad79-759f58b71461 req-d29c69ae-e4f8-48ef-a176-df6e95f57181 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:42.976341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:42.988558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:43.014975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0fd22dce-01c7-41a9-ad79-759f58b71461 req-d29c69ae-e4f8-48ef-a176-df6e95f57181 service nova] Creating event network-vif-plugged:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h2-846219-10 Jul 20 10:53:43.015781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:43.016704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:43.017840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:43.019709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:43.030797 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0fd22dce-01c7-41a9-ad79-759f58b71461 req-d29c69ae-e4f8-48ef-a176-df6e95f57181 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112173 Jul 20 10:53:43.035485 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 881/1693] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:43.461911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:43.474512 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1444e0a-120d-4b25-af61-be63ccd88edc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.505779 Jul 20 10:53:43.475118 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 813/1694] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:42 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:43.923895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:43.924714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:43.927492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:43.951396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:43.951901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:43.952724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:43.956370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:43.983151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:43.986320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:44.021140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:44.022057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:44.027419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:44.034690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:44.422356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:44.456764 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8da0646-1490-46d6-90af-78c8cb7a155b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1467 microversion: 2.1 time: 0.537585 Jul 20 10:53:44.459021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:44.469050 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0261af72-8840-4d9d-9c31-f6f59d47d0b8 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1388 microversion: 2.1 time: 0.489778 Jul 20 10:53:44.474559 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 882/1695] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:43 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1467 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:44.483316 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 814/1696] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:43 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1388 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:44.503078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:44.503746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:44.519580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:44.521515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:44.523456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:44.524855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:45.003159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:45.019975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f8c852fe-fed9-4694-9acd-dcbcbcaead38 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.525790 Jul 20 10:53:45.032033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 883/1697] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:44 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:45.495249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:45.497406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:45.501505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:45.505761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:45.544676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:45.547376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:45.554773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:45.555027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:45.556073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:45.558358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:45.561054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:45.569227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:45.643273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:46.020200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:46.061885 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65eaa26e-4489-4d8b-82d5-e7bab682f6a6 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1425 microversion: 2.1 time: 0.580498 Jul 20 10:53:46.087200 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 815/1698] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:45 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1425 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:46.101773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:46.102215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:46.145154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:46.151729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:46.154321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:46.157240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:46.475904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:46.500305 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13c9f6f5-8c5b-411d-abf5-15ec1a6563b0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1388 microversion: 2.1 time: 1.009975 Jul 20 10:53:46.515830 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 884/1699] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:45 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1388 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:46.818020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:46.838967 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4cb1f170-45cb-4507-814a-f01539848138 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.748420 Jul 20 10:53:46.840238 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 816/1700] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:46 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:46.868286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-62ac804d-6d7e-4ab4-98a6-c430185960eb req-95eb93ad-a5dc-4b41-aaaf-26c061272a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c855c36-a33d-42e4-95e0-e58bb9e2060a", "name": "network-vif-deleted", "tag": "0f38990d-91c6-4e8a-ab29-593480b10f12"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:46.933681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-62ac804d-6d7e-4ab4-98a6-c430185960eb req-95eb93ad-a5dc-4b41-aaaf-26c061272a5f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:46.942468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-62ac804d-6d7e-4ab4-98a6-c430185960eb req-95eb93ad-a5dc-4b41-aaaf-26c061272a5f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:47.005881 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-62ac804d-6d7e-4ab4-98a6-c430185960eb req-95eb93ad-a5dc-4b41-aaaf-26c061272a5f service nova] Creating event network-vif-deleted:0f38990d-91c6-4e8a-ab29-593480b10f12 for instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a on n-h2-846219-10 Jul 20 10:53:47.036401 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-62ac804d-6d7e-4ab4-98a6-c430185960eb req-95eb93ad-a5dc-4b41-aaaf-26c061272a5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194820 Jul 20 10:53:47.041042 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 885/1701] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:53:47.102310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:47.107204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:47.149375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:47.175508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:47.180394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:47.181254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:47.253132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1459312036", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "384871a1-0b37-4e76-8880-7344e75ee402"}, {"uuid": "876c3bf9-1526-4094-a777-384ec9ea7ed0"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:47.304034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:47.304456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:47.304927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lazy-loading 'fault' on Instance uuid 4c855c36-a33d-42e4-95e0-e58bb9e2060a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:53:47.494428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] validate_networks() for [('384871a1-0b37-4e76-8880-7344e75ee402', None, None, None, None, None), ('876c3bf9-1526-4094-a777-384ec9ea7ed0', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:53:47.661573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:47.677705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a9d1141-614a-4276-ab05-884c11f37ab8 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 200 len: 1301 microversion: 2.1 time: 0.588355 Jul 20 10:53:47.678313 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 817/1702] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:47 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 1301 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:47.706054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:47.706723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:47.737141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:47.748405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:47.749931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:47.751491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:48.634058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:48.650363 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2aa0ccf4-f626-4059-af17-6e7350bc6e40 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1388 microversion: 2.1 time: 0.964411 Jul 20 10:53:48.656937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 818/1703] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:47 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1388 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:48.666601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:48.672981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:48.705275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:48.705739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:48.706544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:48.712223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:49.934466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:49.946591 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e812d6f1-5371-46b0-b7e6-c301417940e8 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 1.286722 Jul 20 10:53:49.947425 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 819/1704] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:48 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:49.961546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fafd3ff1-a30b-4d11-a291-78519ffe573e req-c38c6246-122d-4393-8b8d-6170c9872fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "name": "network-vif-unplugged", "status": "completed", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:49.973649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fafd3ff1-a30b-4d11-a291-78519ffe573e req-c38c6246-122d-4393-8b8d-6170c9872fb4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:49.974451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fafd3ff1-a30b-4d11-a291-78519ffe573e req-c38c6246-122d-4393-8b8d-6170c9872fb4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:50.007478 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fafd3ff1-a30b-4d11-a291-78519ffe573e req-c38c6246-122d-4393-8b8d-6170c9872fb4 service nova] Creating event network-vif-unplugged:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:53:50.021058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fafd3ff1-a30b-4d11-a291-78519ffe573e req-c38c6246-122d-4393-8b8d-6170c9872fb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071834 Jul 20 10:53:50.022816 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 820/1705] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:50.031681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:50.032835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 4c855c36-a33d-42e4-95e0-e58bb9e2060a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:50.041483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:50.042213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:50.046034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:50.046947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:50.082022 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] HTTP exception thrown: Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a could not be found. Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Request method failure captured: Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a HTTP/1.1 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191JhNxvpvS-L-N5TbSTnJqgkiQTXI0FqUL1cyOD7iBsHFgYOWLtx2VYBePTs53c5AvFKG4qLDAbvjK_3eNN6PkfftZ7nO2iJCBbabCwq89Ak9euXK7dpSKXY-WKLiS6P5drOrYvCqOXsug2IRCDqxrC5Wi_ySHTZ82w8Uo0P3whwn8 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_905746ae8ae74012bd4c19dd4fed75e4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MigrationsAdminTest-320815572 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MigrationsAdminTest-320815572-project Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 14131c23a0e24e56bbf0ea1a167e256c Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MigrationsAdminTest-320815572-project Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a could not be found. Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '4c855c36-a33d-42e4-95e0-e58bb9e2060a'} Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a could not be found. Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a could not be found. Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:50.084116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a could not be found. Jul 20 10:53:50.089460 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:50.092507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Returning 404 to user: Instance 4c855c36-a33d-42e4-95e0-e58bb9e2060a could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:50.093818 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6d1e0ce-fa46-49e8-a113-cedc511b822d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a" status: 404 len: 111 microversion: 2.1 time: 0.066593 Jul 20 10:53:50.094804 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 821/1706] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:50 2022] GET /compute/v2.1/servers/4c855c36-a33d-42e4-95e0-e58bb9e2060a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:53:50.100438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:50.101398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:50.108695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:50.109299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:50.110932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:50.112086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:50.330149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:50.384509 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1d0d9e6-f197-4066-9628-c327def799dc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1346 microversion: 2.1 time: 0.287998 Jul 20 10:53:50.385116 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 822/1707] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:50 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1346 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:50.924604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d372e1d-a626-4fd1-8010-04de901c2c5d tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Action: 'create', calling method: .version_select at 0x7f2c3f1dc8b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:50.944808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:50.972963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5d372e1d-a626-4fd1-8010-04de901c2c5d tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Getting quotas for project 3aa07378b29240708a9ac66307971ed8. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:53:50.994870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5d372e1d-a626-4fd1-8010-04de901c2c5d tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Getting quotas for user 2a7d58f87259464aafa65d94ab14a81f and project 3aa07378b29240708a9ac66307971ed8. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:53:51.114406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5d372e1d-a626-4fd1-8010-04de901c2c5d tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Getting quotas for project 3aa07378b29240708a9ac66307971ed8. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:53:51.123495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5d372e1d-a626-4fd1-8010-04de901c2c5d tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Getting quotas for user 2a7d58f87259464aafa65d94ab14a81f and project 3aa07378b29240708a9ac66307971ed8. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:53:51.177743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d372e1d-a626-4fd1-8010-04de901c2c5d tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.791524 Jul 20 10:53:51.187549 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 823/1708] 10.222.0.79 () {62 vars in 1213 bytes} [Wed Jul 20 10:53:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:51.192660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:51.198245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:51.214457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.217386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.218797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.220335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.294850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:53:51.369219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:53:51.369857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:53:51.370245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:53:51.370656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:53:51.371069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:53:51.427374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.435247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.441397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.472647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.519136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83f5ef00-adf2-4544-a214-4ebee76715ce tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 204 len: 0 microversion: 2.1 time: 0.329922 Jul 20 10:53:51.519764 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 824/1709] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:53:51 2022] DELETE /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:53:51.531425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3b33cc25-934c-473b-9e63-9826defacc84 req-0c07a9bf-0359-4e03-a647-75e06ea9a65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf1c0b2-b3ca-452b-bf03-d36f55019d0a", "name": "network-vif-deleted", "tag": "b7e29330-5a03-4253-84a0-568c80dee39a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:51.543840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3b33cc25-934c-473b-9e63-9826defacc84 req-0c07a9bf-0359-4e03-a647-75e06ea9a65c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.544788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3b33cc25-934c-473b-9e63-9826defacc84 req-0c07a9bf-0359-4e03-a647-75e06ea9a65c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.560722 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3b33cc25-934c-473b-9e63-9826defacc84 req-0c07a9bf-0359-4e03-a647-75e06ea9a65c service nova] Creating event network-vif-deleted:b7e29330-5a03-4253-84a0-568c80dee39a for instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a on n-h1-846219-10 Jul 20 10:53:51.576873 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3b33cc25-934c-473b-9e63-9826defacc84 req-0c07a9bf-0359-4e03-a647-75e06ea9a65c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054755 Jul 20 10:53:51.577825 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 825/1710] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:53:51.584041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:51.584860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:51.598337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Getting quotas for project 7f6480dcf785424b827d35f7cbfa6ddf. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:53:51.613106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.613803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.614798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.615598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.617142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Getting quotas for user 8b622b3ec37f48e49ae295acd6d1c34a and project 7f6480dcf785424b827d35f7cbfa6ddf. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:53:51.649829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:53:51.652947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:53:51.825755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:51.835274 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3d5aa4da-bd25-4009-8139-d5fd141d89be tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.256180 Jul 20 10:53:51.837556 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 826/1711] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:51 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:51.842565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72f25f7a-2cc6-41c0-8c7e-f94e5c7f6a49 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:51.858061 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72f25f7a-2cc6-41c0-8c7e-f94e5c7f6a49 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018865 Jul 20 10:53:51.859204 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 827/1712] 10.222.0.79 () {60 vars in 1192 bytes} [Wed Jul 20 10:53:51 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:51.866484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:51.867511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:51.883339 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af2561c1-869a-480f-80bd-dd74ac6daaf9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.636555 Jul 20 10:53:51.886310 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 886/1713] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:53:51.897626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:51.901625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:51.901885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.919715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.921290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.921869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.923028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.925091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:51.925091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:51.928326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:52.202823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:52.241559 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7a22ca86-3465-4d32-9076-f99c17c4559a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.380293 Jul 20 10:53:52.242054 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 828/1714] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:51 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:52.255599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c7cebc8-3859-4eec-95b2-d2804976e432 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:52.295947 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c7cebc8-3859-4eec-95b2-d2804976e432 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd" status: 200 len: 235 microversion: 2.64 time: 0.052525 Jul 20 10:53:52.303909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 829/1715] 10.222.0.79 () {60 vars in 1303 bytes} [Wed Jul 20 10:53:52 2022] GET /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd => generated 235 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:53:52.316015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8dc71401-2c10-492f-be03-797a80bbd657 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:52.318266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8dc71401-2c10-492f-be03-797a80bbd657 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:52.350963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:52.363424 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b0f3215-8e4e-4762-8046-39c89633eb49 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1533 microversion: 2.1 time: 0.474556 Jul 20 10:53:52.372936 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 887/1716] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:51 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1533 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:52.397353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31380245-2049-4310-89f0-41a4aaf37ca1 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:52.451077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8dc71401-2c10-492f-be03-797a80bbd657 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:52.474527 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8dc71401-2c10-492f-be03-797a80bbd657 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1213 microversion: 2.1 time: 0.167669 Jul 20 10:53:52.475757 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 830/1717] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:52 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:52.477096 n-d-846219-10 devstack@n-api.service[125885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-31380245-2049-4310-89f0-41a4aaf37ca1 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] [a013ddbf-3a73-4197-b042-914dd44d7757] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 10:53:52.862923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:52.863832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:52.879962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:52.880996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:52.883435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:52.887087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.252257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:53.261694 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66acd1d5-a165-4d88-b853-a030858c3eb9 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.403342 Jul 20 10:53:53.262916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 831/1718] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:52 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:53.269279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:53.270013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:53.276825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:53.277445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.278334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:53.278902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.477015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:53.489450 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [None req-31380245-2049-4310-89f0-41a4aaf37ca1 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] [a013ddbf-3a73-4197-b042-914dd44d7757] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36700. Jul 20 10:53:53.497859 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31380245-2049-4310-89f0-41a4aaf37ca1 tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd" status: 204 len: 0 microversion: 2.64 time: 1.123769 Jul 20 10:53:53.498795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 888/1719] 10.222.0.79 () {60 vars in 1306 bytes} [Wed Jul 20 10:53:52 2022] DELETE /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:53:53.510380 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e38c04f-2691-47b1-a124-d5a5bbffa220 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.245944 Jul 20 10:53:53.513677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:53.514883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:53.524489 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 832/1720] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:53 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:53.550122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:53.551643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:53.571148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:53.572107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.575712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:53.576528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.590554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:53.591572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.592722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:53.602573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:53.640330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:53:54.019009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:54.033184 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68a253f2-c50f-4c29-aef7-d5f37e335441 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1209 microversion: 2.1 time: 0.506628 Jul 20 10:53:54.033788 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 833/1721] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:53 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1209 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:54.060885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0430c415-e15f-4968-9652-a62d6ab9d00a tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:54.081111 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0430c415-e15f-4968-9652-a62d6ab9d00a tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] HTTP exception thrown: Instance group c02f6873-e439-4e00-947d-01607c468dfd could not be found. Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0430c415-e15f-4968-9652-a62d6ab9d00a tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Request method failure captured: Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd HTTP/1.1 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1969R855MItMFHllMexLUmtbAaxnDfzM-5fi2gnMB5l4nFiNjsaa9U7-dAUBdLHFovx3MKnzOa0fGNU2fsb8vhor_3tUoKrMqk-r9gK6nBzedBbH7MBo-uXrswCPcm6mzC6felHcZFlPvRTI01U00rIM8QAKnxoz6SaqgtoqAyCsX5c Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.64 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 3aa07378b29240708a9ac66307971ed8 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerGroup264TestJSON-1859677393 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3aa07378b29240708a9ac66307971ed8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa07378b29240708a9ac66307971ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3aa07378b29240708a9ac66307971ed8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3aa07378b29240708a9ac66307971ed8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerGroup264TestJSON-1859677393 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 3aa07378b29240708a9ac66307971ed8 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1859677393 Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerGroup264TestJSON-1859677393-project Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2a7d58f87259464aafa65d94ab14a81f Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerGroup264TestJSON-1859677393-project Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance group c02f6873-e439-4e00-947d-01607c468dfd could not be found. Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c02f6873-e439-4e00-947d-01607c468dfd'} Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c02f6873-e439-4e00-947d-01607c468dfd could not be found. Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c02f6873-e439-4e00-947d-01607c468dfd could not be found. Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:54.099912 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c02f6873-e439-4e00-947d-01607c468dfd could not be found. Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0430c415-e15f-4968-9652-a62d6ab9d00a tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] Returning 404 to user: Instance group c02f6873-e439-4e00-947d-01607c468dfd could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0430c415-e15f-4968-9652-a62d6ab9d00a tempest-ServerGroup264TestJSON-1859677393 tempest-ServerGroup264TestJSON-1859677393-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd" status: 404 len: 117 microversion: 2.64 time: 0.061842 Jul 20 10:53:54.104977 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 834/1722] 10.222.0.79 () {60 vars in 1306 bytes} [Wed Jul 20 10:53:54 2022] DELETE /compute/v2.1/os-server-groups/c02f6873-e439-4e00-947d-01607c468dfd => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:53:54.305125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:54.307511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:54.364083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:54.364536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:54.365326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:54.365763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:54.550636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:54.561853 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9cd8543-125f-4ca7-b9c6-430233e511a2 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1533 microversion: 2.1 time: 1.061518 Jul 20 10:53:54.572023 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 889/1723] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:53 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1533 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:54.600742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:54.601598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:54.632630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:54.636703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:54.643156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:54.644083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.120779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:55.134918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3ccc931-917b-421a-b3c5-672845e23f92 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.558836 Jul 20 10:53:55.135670 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 890/1724] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:54 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:55.154128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:55.157484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:55.184411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:55.186468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.188405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:55.189204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.387685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:55.405949 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-56d87563-0590-4a90-9450-128288025d22 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1271 microversion: 2.1 time: 0.260584 Jul 20 10:53:55.417611 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 891/1725] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:55 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:55.440371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-569ca40f-4693-425c-b007-adc290aa164e req-77d9d96f-21c6-4575-ab7a-3351d5350f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb87096-6ce1-4efa-969d-a105784743cb", "name": "network-vif-deleted", "tag": "36e8f259-fdc3-42f3-bccb-568b930b8930"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:53:55.468073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-569ca40f-4693-425c-b007-adc290aa164e req-77d9d96f-21c6-4575-ab7a-3351d5350f7e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:55.468523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-569ca40f-4693-425c-b007-adc290aa164e req-77d9d96f-21c6-4575-ab7a-3351d5350f7e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.540828 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-569ca40f-4693-425c-b007-adc290aa164e req-77d9d96f-21c6-4575-ab7a-3351d5350f7e service nova] Creating event network-vif-deleted:36e8f259-fdc3-42f3-bccb-568b930b8930 for instance beb87096-6ce1-4efa-969d-a105784743cb on n-h1-846219-10 Jul 20 10:53:55.569165 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-569ca40f-4693-425c-b007-adc290aa164e req-77d9d96f-21c6-4575-ab7a-3351d5350f7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135115 Jul 20 10:53:55.575319 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 892/1726] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:53:55.596458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:55.607710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:55.633602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:55.637492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.642819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:55.650647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:55.660669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.673293 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33985ec2-8429-4ec4-a1cf-32dfc0b8e0fc tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 1.393129 Jul 20 10:53:55.677218 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 835/1727] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:54 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:55.772861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:55.775744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:55.776351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lazy-loading 'fault' on Instance uuid beb87096-6ce1-4efa-969d-a105784743cb {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:53:55.868882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:55.883995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8c7905c7-3c8b-4ea6-af24-643499385d3d tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 200 len: 1367 microversion: 2.1 time: 0.300389 Jul 20 10:53:55.885282 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 893/1728] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:55 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:56.176269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:56.178110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:56.199438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.200281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.201287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.204160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.380555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:56.399698 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee9a5dd8-255f-4839-9bba-5961e4c648ee tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.228052 Jul 20 10:53:56.405611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 836/1729] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:56 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:53:56.427221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:56.428206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:56.453022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.453510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.457266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.457732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.641278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:56.658167 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-46b63a50-42cf-4660-9e2b-5a0e7657a363 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1271 microversion: 2.1 time: 0.236598 Jul 20 10:53:56.658874 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 894/1730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:56 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:56.714965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:56.715898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:56.731494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.732026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.732869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.734478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.908353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:56.909504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: beb87096-6ce1-4efa-969d-a105784743cb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:56.954319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.955731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:56.957314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:56.958261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:57.013140 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] HTTP exception thrown: Instance beb87096-6ce1-4efa-969d-a105784743cb could not be found. Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Request method failure captured: Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb HTTP/1.1 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi191JhNxvpvS-L-N5TbSTnJqgkiQTXI0FqUL1cyOD7iBsHFgYOWLtx2VYBePTs53c5AvFKG4qLDAbvjK_3eNN6PkfftZ7nO2iJCBbabCwq89Ak9euXK7dpSKXY-WKLiS6P5drOrYvCqOXsug2IRCDqxrC5Wi_ySHTZ82w8Uo0P3whwn8 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_905746ae8ae74012bd4c19dd4fed75e4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-MigrationsAdminTest-320815572 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-MigrationsAdminTest-320815572-project Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 14131c23a0e24e56bbf0ea1a167e256c Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-MigrationsAdminTest-320815572-project Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance beb87096-6ce1-4efa-969d-a105784743cb could not be found. Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'beb87096-6ce1-4efa-969d-a105784743cb'} Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb87096-6ce1-4efa-969d-a105784743cb could not be found. Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb87096-6ce1-4efa-969d-a105784743cb could not be found. Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:53:57.017116 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb87096-6ce1-4efa-969d-a105784743cb could not be found. Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:53:57.030320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Returning 404 to user: Instance beb87096-6ce1-4efa-969d-a105784743cb could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:53:57.037508 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42d2f522-0c40-462f-a53a-12fdd94c0d43 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb" status: 404 len: 111 microversion: 2.1 time: 0.130427 Jul 20 10:53:57.040203 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 895/1731] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:56 2022] GET /compute/v2.1/servers/beb87096-6ce1-4efa-969d-a105784743cb => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:53:57.056186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7dec43dc-aab9-4f70-8d45-b89bd1daede1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '.version_select at 0x7f2c3f761040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:57.114477 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7dec43dc-aab9-4f70-8d45-b89bd1daede1 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418046598" status: 202 len: 0 microversion: 2.1 time: 0.069125 Jul 20 10:53:57.115530 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 896/1732] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 10:53:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418046598 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:53:57.151995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:57.172829 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7e548c5-f814-45e3-a3f3-246ef5761f55 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.462732 Jul 20 10:53:57.185392 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 837/1733] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:56 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:57.423298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:57.424305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:57.448417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:57.455195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:57.458118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:57.476916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:57.631654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:57.644177 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6bab77a3-a87a-425f-b0f3-978e87b86a64 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.225680 Jul 20 10:53:57.654635 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 897/1734] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:57 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:57.680905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:57.681674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:57.703870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:57.720417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:57.722894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:57.723970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:57.999379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:58.019589 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4aa9fa62-396b-471a-baee-1bfff58d3e5f tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1271 microversion: 2.1 time: 0.345636 Jul 20 10:53:58.028902 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 838/1735] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:57 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1271 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:58.200632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:58.207384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:58.254567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:58.260600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:58.261890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:58.262663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:58.663803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:58.664490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:58.679464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:58.679919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:58.680706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:58.681149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:58.785386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:58.811362 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-555c607a-f328-49b0-803b-bbc1b27ae84f tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.619518 Jul 20 10:53:58.832302 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 898/1736] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:58 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:59.026965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:59.037427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5572d4e-28a8-4510-a524-0d5476192a0a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.377836 Jul 20 10:53:59.043592 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 839/1737] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:58 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:59.059004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:59.059693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:59.078038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:59.079786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:59.091626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:59.092138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:59.576021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:53:59.588133 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7279e2ce-d3a0-425e-9794-08878b2da473 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1313 microversion: 2.1 time: 0.534498 Jul 20 10:53:59.594898 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 899/1738] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:59 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:53:59.805286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:59.806007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:59.822281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:59.822739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:59.823827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:59.824266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:59.840301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:53:59.841149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:53:59.852618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:59.853074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:59.867431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:53:59.868057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:53:59.917861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:00.096701 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d959231-fe7a-434f-bc2f-a5de82b80ee3 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 204 len: 0 microversion: 2.1 time: 0.294692 Jul 20 10:54:00.097768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 840/1739] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:53:59 2022] DELETE /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:00.116809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:00.117525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:00.139997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:00.140584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:00.141825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:00.142465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:01.073988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:01.083215 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-224d040c-89a9-4923-8d6a-bed90d3bcd42 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.984199 Jul 20 10:54:01.088425 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 841/1740] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:00 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:01.105575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:01.107151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:01.121193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:01.123785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:01.129454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:01.138959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4de5af2-11f1-429b-ad6a-02922ca21eb3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 1.302503 Jul 20 10:54:01.140296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:01.141023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:01.163286 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 900/1741] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:53:59 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:01.187415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:01.188593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:01.225188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:01.237563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:01.238616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:01.239075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:01.555664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:01.629793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:01.768694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:01.794393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:01.809032 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d69a119-19b5-4067-8d4a-fb1610deb08b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1313 microversion: 2.1 time: 0.636993 Jul 20 10:54:01.810120 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 901/1742] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:01 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:01.829383 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01d404cc-db3d-4a1c-a1fd-e222b54f8ded tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1468 microversion: 2.1 time: 0.738596 Jul 20 10:54:01.830673 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 842/1743] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:01 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1468 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:02.119150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:02.124834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:02.165555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:02.166677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:02.199895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:02.200980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:02.202533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:02.209769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:02.210594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:02.211051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:02.231358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:02.232027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:02.456542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:02.602127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:02.663778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-861adee7-4d81-4bb7-91b1-8700b75e3284 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 200 len: 1184 microversion: 2.1 time: 0.559113 Jul 20 10:54:02.680632 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 902/1744] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:02 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 1184 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:02.841737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:02.842879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:02.863375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:02.864010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:02.864993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:02.869140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:02.955589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:02.969157 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e078c1da-b001-446f-be6d-7a71591d809b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.809661 Jul 20 10:54:02.973711 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 843/1745] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:02 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:02.987163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:02.988620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:03.004751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:03.005690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:03.007887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:03.011699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:03.607709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:03.634976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e926e84-ac2c-4ca2-a753-aa8f08f41b88 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 0.797585 Jul 20 10:54:03.637369 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 903/1746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:02 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:03.666431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-72c5ec0e-70e8-43ae-896c-8ec48fbb7ca3 req-0630696c-dd0e-4812-b60a-be3141ce54e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "name": "network-vif-plugged", "status": "completed", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:03.673689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:03.697366 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a7e19ec-a163-4b43-b06b-ec999dc4e824 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1468 microversion: 2.1 time: 0.720130 Jul 20 10:54:03.699387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-72c5ec0e-70e8-43ae-896c-8ec48fbb7ca3 req-0630696c-dd0e-4812-b60a-be3141ce54e7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:03.699644 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 844/1747] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:02 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1468 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:03.702085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-72c5ec0e-70e8-43ae-896c-8ec48fbb7ca3 req-0630696c-dd0e-4812-b60a-be3141ce54e7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:03.711300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:03.717022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: ebf1c0b2-b3ca-452b-bf03-d36f55019d0a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:03.743530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:03.744964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:03.747670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:03.748476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:03.752811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-72c5ec0e-70e8-43ae-896c-8ec48fbb7ca3 req-0630696c-dd0e-4812-b60a-be3141ce54e7 service nova] Creating event network-vif-plugged:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:54:03.777204 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-72c5ec0e-70e8-43ae-896c-8ec48fbb7ca3 req-0630696c-dd0e-4812-b60a-be3141ce54e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133748 Jul 20 10:54:03.785728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 904/1748] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:03.808289 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] HTTP exception thrown: Instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a could not be found. Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Request method failure captured: Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a HTTP/1.1 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190Myvxdc0arewOe1a8fj2freERGmQ12E0Qzz_dLyxFQrNenYR9kR8w_ovszOo9s-L7LZbZ14Ah5fQzTSDIDo_almzxiL8EyMrG8S7-sj6v31zL8pCeL2gcb3GFcJ8dGy9lPvEcXKJV7W8ddzB3A1r9ZthuhusBqkYQ2-4wMr_SFUPU Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_985736ff3ec5477c99f3b0bdf3c9c4bd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-LiveMigrationTest-1677797 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90200241ccaf4904a4b973e0351fdff6 Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a could not be found. Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ebf1c0b2-b3ca-452b-bf03-d36f55019d0a'} Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a could not be found. Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a could not be found. Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:03.826865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a could not be found. Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:03.834879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Returning 404 to user: Instance ebf1c0b2-b3ca-452b-bf03-d36f55019d0a could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:03.837636 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99c65e9b-ee13-4f47-9155-155706b22114 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a" status: 404 len: 111 microversion: 2.1 time: 0.135461 Jul 20 10:54:03.839024 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 845/1749] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:03 2022] GET /compute/v2.1/servers/ebf1c0b2-b3ca-452b-bf03-d36f55019d0a => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:03.993844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:03.994976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:04.036832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.042060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.050826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.057380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.081288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-edf9fbb1-8e43-4916-9700-f97037353b89 req-5f3fb4c7-0b48-4408-8690-f9f424abc3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ac7237-71ff-472f-bc87-9da4f2249221", "name": "network-vif-deleted", "tag": "24e47f7f-6301-495e-893e-49d3d309e0c0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:04.104431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-edf9fbb1-8e43-4916-9700-f97037353b89 req-5f3fb4c7-0b48-4408-8690-f9f424abc3f4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.105045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-edf9fbb1-8e43-4916-9700-f97037353b89 req-5f3fb4c7-0b48-4408-8690-f9f424abc3f4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.150712 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-edf9fbb1-8e43-4916-9700-f97037353b89 req-5f3fb4c7-0b48-4408-8690-f9f424abc3f4 service nova] Creating event network-vif-deleted:24e47f7f-6301-495e-893e-49d3d309e0c0 for instance c5ac7237-71ff-472f-bc87-9da4f2249221 on n-h1-846219-10 Jul 20 10:54:04.185047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-edf9fbb1-8e43-4916-9700-f97037353b89 req-5f3fb4c7-0b48-4408-8690-f9f424abc3f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108982 Jul 20 10:54:04.186317 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 846/1750] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:04.557357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:04.574659 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79965138-ecdd-4294-a6fe-5b959fc81345 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.586711 Jul 20 10:54:04.575435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 905/1751] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:03 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:04.660397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:04.667869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:04.678831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.680857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.681881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.682531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.717680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:04.719958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:04.733287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.733750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.734629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.745986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.780085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:04.808991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:04.810237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:04.810936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lazy-loading 'fault' on Instance uuid c5ac7237-71ff-472f-bc87-9da4f2249221 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:05.013966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:05.038802 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9842b06-7b1c-4b37-b4ab-c5588986aeba tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 200 len: 1302 microversion: 2.1 time: 0.324597 Jul 20 10:54:05.044456 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 906/1752] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:04 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 1302 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:05.315503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:05.330029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23443454-cf5c-4fbf-be13-083c884076c7 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 0.679394 Jul 20 10:54:05.333662 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 847/1753] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:04 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:05.613465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:05.614335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:05.638657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:05.657895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:05.659077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:05.667578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.063002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:06.070065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:06.071199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: c5ac7237-71ff-472f-bc87-9da4f2249221] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:06.074950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1705da1e-d532-473e-8f2e-c3f151f974e5 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1478 microversion: 2.1 time: 0.486210 Jul 20 10:54:06.075909 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 907/1754] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:05 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1478 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:06.091608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.102045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.103563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.105315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.160607 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] HTTP exception thrown: Instance c5ac7237-71ff-472f-bc87-9da4f2249221 could not be found. Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Request method failure captured: Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 HTTP/1.1 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi191JhNxvpvS-L-N5TbSTnJqgkiQTXI0FqUL1cyOD7iBsHFgYOWLtx2VYBePTs53c5AvFKG4qLDAbvjK_3eNN6PkfftZ7nO2iJCBbabCwq89Ak9euXK7dpSKXY-WKLiS6P5drOrYvCqOXsug2IRCDqxrC5Wi_ySHTZ82w8Uo0P3whwn8 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_905746ae8ae74012bd4c19dd4fed75e4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MigrationsAdminTest-320815572 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MigrationsAdminTest-320815572-project Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 14131c23a0e24e56bbf0ea1a167e256c Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MigrationsAdminTest-320815572-project Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c5ac7237-71ff-472f-bc87-9da4f2249221 could not be found. Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c5ac7237-71ff-472f-bc87-9da4f2249221'} Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ac7237-71ff-472f-bc87-9da4f2249221 could not be found. Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ac7237-71ff-472f-bc87-9da4f2249221 could not be found. Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:06.172807 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ac7237-71ff-472f-bc87-9da4f2249221 could not be found. Jul 20 10:54:06.180474 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:06.184729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Returning 404 to user: Instance c5ac7237-71ff-472f-bc87-9da4f2249221 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:06.186444 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb758707-7952-4d8c-ada7-67b416d83871 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221" status: 404 len: 111 microversion: 2.1 time: 0.123338 Jul 20 10:54:06.194024 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 848/1755] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:06 2022] GET /compute/v2.1/servers/c5ac7237-71ff-472f-bc87-9da4f2249221 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:06.201327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:06.202190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:06.217841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.220359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.222717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.223458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.327120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:06.350702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:06.351777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:06.363609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.369817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.375428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.379516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.588528 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7e3349d-b4fb-4cb4-a55c-0682e7ff9b17 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "DELETE /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 204 len: 0 microversion: 2.1 time: 0.391491 Jul 20 10:54:06.595389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 908/1756] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:06 2022] DELETE /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:06.604238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:06.607230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:06.620276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.620747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:06.621561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:06.622130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:07.591201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:07.602550 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-71c56635-17bd-426d-993e-99a4362a6043 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 1.255535 Jul 20 10:54:07.606494 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 849/1757] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:06 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:07.624972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-582456509", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "91e8e2a5-7d79-4c89-b21c-e5ff9469e846"}], "block_device_mapping_v2": [{"uuid": "4acc5f69-0268-4133-9904-ed9fab80266e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:07.803447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] validate_networks() for [('91e8e2a5-7d79-4c89-b21c-e5ff9469e846', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:54:08.770139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14131c23a0e24e56bbf0ea1a167e256c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905746ae8ae74012bd4c19dd4fed75e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:08.788433 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce17c847-3c6c-43cc-9392-207e381a0491 tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 200 len: 1469 microversion: 2.1 time: 2.187991 Jul 20 10:54:08.789123 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 909/1758] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:06 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 1469 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:08.807240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:08.808549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:08.828498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:08.834676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:08.836482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:08.837110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:10.162049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:10.201648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a8d97427-e6b3-49a9-a5fe-a5715bd824d2 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1463 microversion: 2.1 time: 1.411347 Jul 20 10:54:10.202837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 910/1759] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:08 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1463 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:10.211685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7d0b59d2-aa8b-4120-903c-c554f9875f80 req-461af79d-6d33-401b-b5ac-b0f4339f6f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b596cea-3a76-4d68-af1c-28a6d3cb522a", "tag": "c92788d1-9b58-48bd-a526-f8ae3aebef1b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:10.249706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7d0b59d2-aa8b-4120-903c-c554f9875f80 req-461af79d-6d33-401b-b5ac-b0f4339f6f1c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:10.250611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7d0b59d2-aa8b-4120-903c-c554f9875f80 req-461af79d-6d33-401b-b5ac-b0f4339f6f1c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:10.297523 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7d0b59d2-aa8b-4120-903c-c554f9875f80 req-461af79d-6d33-401b-b5ac-b0f4339f6f1c service nova] Creating event network-changed:c92788d1-9b58-48bd-a526-f8ae3aebef1b for instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a on n-h2-846219-10 Jul 20 10:54:10.320756 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7d0b59d2-aa8b-4120-903c-c554f9875f80 req-461af79d-6d33-401b-b5ac-b0f4339f6f1c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109948 Jul 20 10:54:10.324412 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 911/1760] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:10.339399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:10.348859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:10.370355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:10.371611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:10.377899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:10.381973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.325044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:54:12.326422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:54:12.329477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:54:12.330280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:54:12.331020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:54:12.401251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.407128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.415363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.416859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.555596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:54:12.576402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:12.587505 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c784e283-df16-4858-bb10-a0fb4ea35882 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 2.261541 Jul 20 10:54:12.588114 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 912/1761] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:10 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:12.620564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:12.620971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:12.622091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] [instance: 76c246d4-40d9-44e6-ba74-ae2d6391c4c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:12.631474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Getting quotas for user cc3921f3f8264fb2aa9c95b86cf4dd9d and project 8804616b1f144b18a5c5cba5ccfaaa0e. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:54:12.644333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.645980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.648537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.649225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.668597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] HTTP exception thrown: Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 could not be found. Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Request method failure captured: Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 HTTP/1.1 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi191JhNxvpvS-L-N5TbSTnJqgkiQTXI0FqUL1cyOD7iBsHFgYOWLtx2VYBePTs53c5AvFKG4qLDAbvjK_3eNN6PkfftZ7nO2iJCBbabCwq89Ak9euXK7dpSKXY-WKLiS6P5drOrYvCqOXsug2IRCDqxrC5Wi_ySHTZ82w8Uo0P3whwn8 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_905746ae8ae74012bd4c19dd4fed75e4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/905746ae8ae74012bd4c19dd4fed75e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-MigrationsAdminTest-320815572 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 905746ae8ae74012bd4c19dd4fed75e4 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-MigrationsAdminTest-320815572 Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-MigrationsAdminTest-320815572-project Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 14131c23a0e24e56bbf0ea1a167e256c Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-MigrationsAdminTest-320815572-project Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 could not be found. Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '76c246d4-40d9-44e6-ba74-ae2d6391c4c2'} Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 could not be found. Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 could not be found. Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:12.670612 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 could not be found. Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] Returning 404 to user: Instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-749ddd60-f77a-412f-a1f0-c72d18b89c7b tempest-MigrationsAdminTest-320815572 tempest-MigrationsAdminTest-320815572-project] 10.222.0.79 "GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2" status: 404 len: 111 microversion: 2.1 time: 0.076956 Jul 20 10:54:12.675843 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 913/1762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:12 2022] GET /compute/v2.1/servers/76c246d4-40d9-44e6-ba74-ae2d6391c4c2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:12.680342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:12.681861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:12.690872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.691636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.692638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.693238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.798759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:54:12.801018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4acc5f69-0268-4133-9904-ed9fab80266e',volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:54:12.851008 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a5ab084-14d2-4167-bfb9-a0f410c10619 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.175296 Jul 20 10:54:12.852742 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 914/1763] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:54:12 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:54:12.860928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-520793c3-fc5c-430a-95a6-b7e350e241c2 req-6597b00a-84db-4730-81dc-1e8572a3bcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c246d4-40d9-44e6-ba74-ae2d6391c4c2", "name": "network-vif-deleted", "tag": "bd65064d-d349-4797-86ea-06a35e3eb77f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:12.886533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-520793c3-fc5c-430a-95a6-b7e350e241c2 req-6597b00a-84db-4730-81dc-1e8572a3bcd1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.891430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-520793c3-fc5c-430a-95a6-b7e350e241c2 req-6597b00a-84db-4730-81dc-1e8572a3bcd1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.913560 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-520793c3-fc5c-430a-95a6-b7e350e241c2 req-6597b00a-84db-4730-81dc-1e8572a3bcd1 service nova] Creating event network-vif-deleted:bd65064d-d349-4797-86ea-06a35e3eb77f for instance 76c246d4-40d9-44e6-ba74-ae2d6391c4c2 on n-h2-846219-10 Jul 20 10:54:12.930550 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-520793c3-fc5c-430a-95a6-b7e350e241c2 req-6597b00a-84db-4730-81dc-1e8572a3bcd1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076529 Jul 20 10:54:12.931517 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 915/1764] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:12.950774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-be4f75b6-b919-4bd1-bfd7-d7b4cde7bc56 req-f09ef702-4b29-4562-a0a8-7b59aac2b7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b596cea-3a76-4d68-af1c-28a6d3cb522a", "tag": "649adcea-981a-4c2e-9104-395f35c5f0bc"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:12.958385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:12.977296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-be4f75b6-b919-4bd1-bfd7-d7b4cde7bc56 req-f09ef702-4b29-4562-a0a8-7b59aac2b7c0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:12.978285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-be4f75b6-b919-4bd1-bfd7-d7b4cde7bc56 req-f09ef702-4b29-4562-a0a8-7b59aac2b7c0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:12.995510 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-be4f75b6-b919-4bd1-bfd7-d7b4cde7bc56 req-f09ef702-4b29-4562-a0a8-7b59aac2b7c0 service nova] Creating event network-changed:649adcea-981a-4c2e-9104-395f35c5f0bc for instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a on n-h2-846219-10 Jul 20 10:54:13.003076 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-be4f75b6-b919-4bd1-bfd7-d7b4cde7bc56 req-f09ef702-4b29-4562-a0a8-7b59aac2b7c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070130 Jul 20 10:54:13.008283 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 916/1765] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:13.015547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:13.017279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:13.025253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.026235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:13.027307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.028019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:13.097023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c6bc92c4-8fd9-4d45-9f06-0f2baf64ea81 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 5.489375 Jul 20 10:54:13.099496 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 850/1766] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 5492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:54:13.117454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-007171c0-be0d-44da-b1e5-c7b08e8cbb8d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:13.117915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-007171c0-be0d-44da-b1e5-c7b08e8cbb8d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:13.122790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.125648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:13.127009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lazy-loading 'fault' on Instance uuid ac4a4890-3d11-4186-8d89-69ca4c410ed3 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:13.411278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-007171c0-be0d-44da-b1e5-c7b08e8cbb8d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:13.421255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-007171c0-be0d-44da-b1e5-c7b08e8cbb8d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:13.423350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-007171c0-be0d-44da-b1e5-c7b08e8cbb8d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:13.424470 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-007171c0-be0d-44da-b1e5-c7b08e8cbb8d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1103 microversion: 2.25 time: 0.317891 Jul 20 10:54:13.436019 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 851/1767] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:13 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1103 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:54:13.442921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:13.445746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:13.464379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.471511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:13.473484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.474825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:13.558259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:13.642170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:13.864067 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ecd52929-4e10-487a-8f33-0965217b7ccb tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 204 len: 0 microversion: 2.1 time: 0.425738 Jul 20 10:54:13.865088 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 852/1768] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:13 2022] DELETE /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:13.890350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:13.894794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:13.907449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.909115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:13.910535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:13.911381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.282940 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-644a27f3-efda-4e91-a17d-a2071989eeae tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1599 microversion: 2.1 time: 1.272652 Jul 20 10:54:14.299529 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 917/1769] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:13 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1599 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:14.309896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:14.313258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:14.330346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.330897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.331753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.333452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.422531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:14.434249 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81b726a7-c9f0-47c7-8153-74c9ac5d82af tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 0.567813 Jul 20 10:54:14.435732 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 853/1770] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:13 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:14.448009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:14.451100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:14.466974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.467455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.468231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.475119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.645470 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cef395ab-9674-4876-8bfc-781c2e089306 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action" status: 202 len: 0 microversion: 2.1 time: 0.202630 Jul 20 10:54:14.646411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 854/1771] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:54:14 2022] POST /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:54:14.652029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:14.652919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:14.675991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.676438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.677220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.677649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.828766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:14.840744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:14.842208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:14.850369 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44da32c5-331c-4c7e-8936-4944c222da5f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1232 microversion: 2.25 time: 0.202705 Jul 20 10:54:14.851475 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 855/1772] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:14 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1232 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:14.856007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:14.867011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:14.878518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.882286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:14.884617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:14.885412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:15.170686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:15.182113 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6cb83a81-7ece-4ac3-9d48-6730f6bc072a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1667 microversion: 2.1 time: 0.881135 Jul 20 10:54:15.183043 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 918/1773] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:14 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1667 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:15.402187 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f19a542-07e8-41ac-9f47-247ad249db14 tempest-ServersAdminTestJSON-423131804 tempest-ServersAdminTestJSON-423131804-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1616 microversion: 2.1 time: 0.549478 Jul 20 10:54:15.420045 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 856/1774] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:14 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1616 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:15.431291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:15.431902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:15.445171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:15.445624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:15.446435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:15.448458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:15.454966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:15.464408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:15.481601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:15.482333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:15.485957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:15.487052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:15.517545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:15.643251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:15.720613 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-18e6b009-9e4f-4eb8-a100-4e92464250a1 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 204 len: 0 microversion: 2.1 time: 0.292775 Jul 20 10:54:15.724194 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 919/1775] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:15 2022] DELETE /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:15.753910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:15.756024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:15.777526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:15.778151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:15.780154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:15.783439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:16.122308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:16.130350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d98ebeb6-8a7c-497f-8ca5-9901b5319045 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 0.680437 Jul 20 10:54:16.130954 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 857/1776] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:15 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:16.145602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:16.146411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:16.153379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:16.159683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:16.165491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:16.166317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:16.181142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:16.190623 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8f76e589-346a-427d-865d-d2454e8e5747 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1469 microversion: 2.1 time: 0.452940 Jul 20 10:54:16.192299 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 920/1777] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:15 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:16.215384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:16.216058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:16.234127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:16.236696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:16.238956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:16.241795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:16.320999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:16.332242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:16.339351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:16.340917 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-82121ddb-5f10-4451-a08d-e2ecc18f1e4a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1250 microversion: 2.25 time: 0.206027 Jul 20 10:54:16.344361 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 858/1778] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:16 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1250 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:16.543795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:16.552566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05b4df7c-406e-4873-9906-229da6ab8261 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1667 microversion: 2.1 time: 0.355819 Jul 20 10:54:16.556334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 921/1779] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:16 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1667 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:17.148185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:17.149257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:17.169550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:17.170003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:17.177572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:17.180254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:17.210226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:17.211259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:17.233123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:17.233601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:17.234943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:17.250785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:18.479667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:18.485495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:18.504891 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b4923b2-c7e5-4ff9-93af-73b572f53c63 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1469 microversion: 2.1 time: 1.299336 Jul 20 10:54:18.506150 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5a914db5-da66-460c-9d65-2c07e0710ffc tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 1.351683 Jul 20 10:54:18.510006 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 859/1780] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:17 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:18.519526 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 922/1781] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:17 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1469 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:18.539990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:18.546337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:18.550037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:18.551832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:18.573021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:18.574263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:18.574398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:18.574857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:18.575710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:18.577031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:18.579243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:18.587407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:18.634030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:18.634812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:18.635467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lazy-loading 'fault' on Instance uuid f1d6eb03-c865-4b85-94fa-f0071dc885da {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:19.053920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:19.069504 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c15e1906-d735-4032-896e-909ca95cb46e tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 200 len: 1324 microversion: 2.1 time: 0.539456 Jul 20 10:54:19.070155 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 923/1782] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:18 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:19.101258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-16cadeff-8da4-44db-992d-2b0eb97567b4 req-55dcbde8-fcb7-42c4-bfe3-1efe5d963dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d6eb03-c865-4b85-94fa-f0071dc885da", "name": "network-vif-deleted", "tag": "90e0cd43-11b8-4203-b878-387e10a72630"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:19.117833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-16cadeff-8da4-44db-992d-2b0eb97567b4 req-55dcbde8-fcb7-42c4-bfe3-1efe5d963dcd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:19.118838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-16cadeff-8da4-44db-992d-2b0eb97567b4 req-55dcbde8-fcb7-42c4-bfe3-1efe5d963dcd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:19.153650 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-16cadeff-8da4-44db-992d-2b0eb97567b4 req-55dcbde8-fcb7-42c4-bfe3-1efe5d963dcd service nova] Creating event network-vif-deleted:90e0cd43-11b8-4203-b878-387e10a72630 for instance f1d6eb03-c865-4b85-94fa-f0071dc885da on n-h1-846219-10 Jul 20 10:54:19.193024 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-16cadeff-8da4-44db-992d-2b0eb97567b4 req-55dcbde8-fcb7-42c4-bfe3-1efe5d963dcd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106814 Jul 20 10:54:19.193870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 924/1783] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:19.303276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4aab330d-15a6-4765-9a70-31a3e2aee718 req-51187f9e-4e1d-4120-90f4-f811c8efaa9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b596cea-3a76-4d68-af1c-28a6d3cb522a", "name": "network-vif-plugged", "status": "completed", "tag": "649adcea-981a-4c2e-9104-395f35c5f0bc"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:19.334931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4aab330d-15a6-4765-9a70-31a3e2aee718 req-51187f9e-4e1d-4120-90f4-f811c8efaa9e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:19.335424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4aab330d-15a6-4765-9a70-31a3e2aee718 req-51187f9e-4e1d-4120-90f4-f811c8efaa9e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:19.374044 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4aab330d-15a6-4765-9a70-31a3e2aee718 req-51187f9e-4e1d-4120-90f4-f811c8efaa9e service nova] Creating event network-vif-plugged:649adcea-981a-4c2e-9104-395f35c5f0bc for instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a on n-h2-846219-10 Jul 20 10:54:19.392407 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4aab330d-15a6-4765-9a70-31a3e2aee718 req-51187f9e-4e1d-4120-90f4-f811c8efaa9e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097601 Jul 20 10:54:19.396631 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 925/1784] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:54:19.443793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:19.479033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:19.495845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:19.499314 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b340b0d9-ac20-47af-8970-3255ee4431a3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1292 microversion: 2.25 time: 0.976804 Jul 20 10:54:19.501060 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 860/1785] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:18 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1292 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:19.526590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:19.528168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:19.537711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:19.538539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:19.539673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:19.540929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:19.543545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:19.544389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:19.567140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:19.567633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:19.568449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:19.568891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:20.073927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:20.086115 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6200f6d9-940a-4735-8888-415ff406a016 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 200 len: 1427 microversion: 2.1 time: 0.553085 Jul 20 10:54:20.087981 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 861/1786] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:19 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 1427 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:20.103699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:20.121108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: f1d6eb03-c865-4b85-94fa-f0071dc885da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:20.142944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:20.143833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:20.147540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:20.149029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:20.230798 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] HTTP exception thrown: Instance f1d6eb03-c865-4b85-94fa-f0071dc885da could not be found. Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Request method failure captured: Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da HTTP/1.1 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190Myvxdc0arewOe1a8fj2freERGmQ12E0Qzz_dLyxFQrNenYR9kR8w_ovszOo9s-L7LZbZ14Ah5fQzTSDIDo_almzxiL8EyMrG8S7-sj6v31zL8pCeL2gcb3GFcJ8dGy9lPvEcXKJV7W8ddzB3A1r9ZthuhusBqkYQ2-4wMr_SFUPU Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_985736ff3ec5477c99f3b0bdf3c9c4bd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-LiveMigrationTest-1677797 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90200241ccaf4904a4b973e0351fdff6 Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f1d6eb03-c865-4b85-94fa-f0071dc885da could not be found. Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f1d6eb03-c865-4b85-94fa-f0071dc885da'} Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d6eb03-c865-4b85-94fa-f0071dc885da could not be found. Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d6eb03-c865-4b85-94fa-f0071dc885da could not be found. Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:20.232867 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:20.239020 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:20.239020 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:20.239020 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:20.239020 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:20.239020 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d6eb03-c865-4b85-94fa-f0071dc885da could not be found. Jul 20 10:54:20.239020 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:20.244885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Returning 404 to user: Instance f1d6eb03-c865-4b85-94fa-f0071dc885da could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:20.246869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04fe8885-4390-49d4-a9cd-8889e05dd44c tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da" status: 404 len: 111 microversion: 2.1 time: 0.157556 Jul 20 10:54:20.251000 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 862/1787] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:20 2022] GET /compute/v2.1/servers/f1d6eb03-c865-4b85-94fa-f0071dc885da => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:20.268910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-480dec6a-856c-4dcb-8a72-b1385ef5c1a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '.version_select at 0x7f2c3eec7310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:20.306171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-480dec6a-856c-4dcb-8a72-b1385ef5c1a1 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973584643" status: 202 len: 0 microversion: 2.1 time: 0.043117 Jul 20 10:54:20.307486 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 863/1788] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 10:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973584643 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:54:20.519096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:20.519816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:20.538870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:20.543658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:20.548706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:20.549353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:20.563261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:20.572374 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4afe1d29-84d2-465b-93b5-2c4ed997e0b9 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 1.050518 Jul 20 10:54:20.590389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 926/1789] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:19 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:21.104445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:21.105477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: e00cb2df-37c8-49f3-8049-f4ea07bb78f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:21.117385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.120702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.121800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.127022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.136576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:21.159144 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] HTTP exception thrown: Instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 could not be found. Jul 20 10:54:21.159729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Request method failure captured: Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 HTTP/1.1 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi194PEEDFwOc1kD73XORmDPyVVoHOrXSVbkQIEIAycdvpEbCeCZ7_EXqc9OY2jIM2c59Jw7s8sEa8CSUejpv51h1p5TYx0vib_IxX10Xdhw2JKw3Ps-OUlaaqzwGQDobmjtQKo8cibsWKgQJrZx5Gbjd0D0_u-qweU6hkYBl2VfQY-DA Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 6ed41f29a0fe4ebba18c8d24c7f513bf Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ed41f29a0fe4ebba18c8d24c7f513bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 6ed41f29a0fe4ebba18c8d24c7f513bf Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminTestJSON-1570528732-project Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 61aca4c4632f40a0b2eb6425fdcbd55e Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminTestJSON-1570528732-project Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 could not be found. Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'e00cb2df-37c8-49f3-8049-f4ea07bb78f9'} Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 could not be found. Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 could not be found. Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:21.164419 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 could not be found. Jul 20 10:54:21.174210 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:21.174940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:21.174940 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2bae5181-35c1-4044-b428-eb2f8557d98b tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1292 microversion: 2.25 time: 0.659232 Jul 20 10:54:21.176163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Returning 404 to user: Instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:21.178776 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 864/1790] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:20 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1292 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:21.179035 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b237750f-d1ac-4f62-ab9f-d7ce81f29d65 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9" status: 404 len: 111 microversion: 2.1 time: 0.078286 Jul 20 10:54:21.179791 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 927/1791] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:21 2022] GET /compute/v2.1/servers/e00cb2df-37c8-49f3-8049-f4ea07bb78f9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:54:21.206860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:21.207777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:21.231570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.238501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.239653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.240276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.329257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:21.582776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef64f7e2-d47e-40d6-ae9a-198520dc21ca tempest-NetworksTest-1785668601 tempest-NetworksTest-1785668601-project-admin] Calling method '.version_select at 0x7f2c3eeba700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:21.602100 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c322794a-02d1-45bd-b113-0316d13ccd5e tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 204 len: 0 microversion: 2.1 time: 0.414979 Jul 20 10:54:21.603033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 928/1792] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:21 2022] DELETE /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:21.615431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-459426da-9457-4bce-8ac4-0ff7fa259537 req-54d5208f-f199-4564-a941-78bf38e03543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00cb2df-37c8-49f3-8049-f4ea07bb78f9", "name": "network-vif-deleted", "tag": "6b51e28e-124f-4a7f-975b-1e0bdcd85de9"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:21.638571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-459426da-9457-4bce-8ac4-0ff7fa259537 req-54d5208f-f199-4564-a941-78bf38e03543 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.639027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-459426da-9457-4bce-8ac4-0ff7fa259537 req-54d5208f-f199-4564-a941-78bf38e03543 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.686938 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-459426da-9457-4bce-8ac4-0ff7fa259537 req-54d5208f-f199-4564-a941-78bf38e03543 service nova] Creating event network-vif-deleted:6b51e28e-124f-4a7f-975b-1e0bdcd85de9 for instance e00cb2df-37c8-49f3-8049-f4ea07bb78f9 on n-h1-846219-10 Jul 20 10:54:21.713670 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-459426da-9457-4bce-8ac4-0ff7fa259537 req-54d5208f-f199-4564-a941-78bf38e03543 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108607 Jul 20 10:54:21.717972 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 929/1793] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:21.729409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a026527c-564c-4657-8817-1c179fde76da req-8daeb6d0-42be-420a-88de-cd403d3b8d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b596cea-3a76-4d68-af1c-28a6d3cb522a", "name": "network-vif-plugged", "status": "completed", "tag": "c92788d1-9b58-48bd-a526-f8ae3aebef1b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:21.756152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a026527c-564c-4657-8817-1c179fde76da req-8daeb6d0-42be-420a-88de-cd403d3b8d14 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.756604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a026527c-564c-4657-8817-1c179fde76da req-8daeb6d0-42be-420a-88de-cd403d3b8d14 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.794817 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a026527c-564c-4657-8817-1c179fde76da req-8daeb6d0-42be-420a-88de-cd403d3b8d14 service nova] Creating event network-vif-plugged:c92788d1-9b58-48bd-a526-f8ae3aebef1b for instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a on n-h2-846219-10 Jul 20 10:54:21.815418 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a026527c-564c-4657-8817-1c179fde76da req-8daeb6d0-42be-420a-88de-cd403d3b8d14 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095172 Jul 20 10:54:21.819227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 930/1794] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:21.835971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:21.836703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:21.862368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.867894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:21.869710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:21.870600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:22.486805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:23.414959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:23.479124 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef64f7e2-d47e-40d6-ae9a-198520dc21ca tempest-NetworksTest-1785668601 tempest-NetworksTest-1785668601-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 10134 microversion: 2.1 time: 2.299104 Jul 20 10:54:23.482568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:23.486356 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 865/1795] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:54:21 2022] GET /compute/v2.1/os-networks => generated 10134 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:54:23.492281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:23.493170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:23.497566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-be1618e5-f78b-450f-b76f-e311e6c6e801 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1334 microversion: 2.1 time: 1.676315 Jul 20 10:54:23.511433 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 931/1796] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:21 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1334 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:23.522036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:23.528404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:23.528745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:23.531865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:23.534351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:23.536062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:23.543853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:23.544228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:23.548544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:23.571360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:24.650368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:24.658942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2bc0ffde-6c4d-422c-af0c-243657a27b4b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1470 microversion: 2.1 time: 1.170371 Jul 20 10:54:24.662207 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 866/1797] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:23 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1470 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:24.666901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e6d25646-5760-4648-9f87-8cf14c9cac79 tempest-NetworksTest-1785668601 tempest-NetworksTest-1785668601-project-admin] Calling method '.version_select at 0x7f2c3f82b820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:24.903648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:24.923542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:24.934291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:24.944607 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebc1c07a-f7a3-4370-885b-f6796d0e4cc6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1292 microversion: 2.25 time: 1.427863 Jul 20 10:54:24.945398 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 932/1798] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:23 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1292 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:24.964452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-718c4008-89a1-4510-95ae-da8f25724e39 req-fccbabe8-d753-4293-aa69-77232f5d8b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde6bc00-8ace-4d73-bbef-3a7881815a7a", "tag": "7ba34fe2-c8a3-4457-aee8-76e7eb387638"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:24.992439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-718c4008-89a1-4510-95ae-da8f25724e39 req-fccbabe8-d753-4293-aa69-77232f5d8b6a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:24.995262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-718c4008-89a1-4510-95ae-da8f25724e39 req-fccbabe8-d753-4293-aa69-77232f5d8b6a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:25.027426 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-718c4008-89a1-4510-95ae-da8f25724e39 req-fccbabe8-d753-4293-aa69-77232f5d8b6a service nova] Creating event network-changed:7ba34fe2-c8a3-4457-aee8-76e7eb387638 for instance cde6bc00-8ace-4d73-bbef-3a7881815a7a on n-h1-846219-10 Jul 20 10:54:25.072144 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-718c4008-89a1-4510-95ae-da8f25724e39 req-fccbabe8-d753-4293-aa69-77232f5d8b6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107589 Jul 20 10:54:25.075037 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 933/1799] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:25.094199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:25.095350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:25.112376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:25.117948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:25.119316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:25.119982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:25.173577 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e6d25646-5760-4648-9f87-8cf14c9cac79 tempest-NetworksTest-1785668601 tempest-NetworksTest-1785668601-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks/6cf8ba49-b406-4ceb-9f39-7791c406c545" status: 200 len: 652 microversion: 2.1 time: 0.510230 Jul 20 10:54:25.174494 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 867/1800] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 10:54:24 2022] GET /compute/v2.1/os-networks/6cf8ba49-b406-4ceb-9f39-7791c406c545 => generated 652 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:25.182824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:25.183733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:25.217535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:25.218112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:25.223548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:25.225510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:25.229807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:25.480566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1cfbe904-2848-4ef7-83a2-8140a0e8e51a tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 204 len: 0 microversion: 2.1 time: 0.400431 Jul 20 10:54:25.481896 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 934/1801] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:25 2022] DELETE /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:25.488685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d572fd02-2914-45bb-b14c-05dda88662ef tempest-NetworksTest-1785668601 tempest-NetworksTest-1785668601-project-admin] Calling method '.version_select at 0x7f2c3f9e9820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:26.098821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:26.120477 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ae0a085-c80c-4ed0-9664-cf7343808f3b tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1669 microversion: 2.1 time: 0.944576 Jul 20 10:54:26.121003 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 868/1802] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:25 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1669 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:26.144671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:26.148411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:26.162544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.163320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.178378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.179307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.315935 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d572fd02-2914-45bb-b14c-05dda88662ef tempest-NetworksTest-1785668601 tempest-NetworksTest-1785668601-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 10134 microversion: 2.1 time: 0.832087 Jul 20 10:54:26.316536 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 935/1803] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:54:25 2022] GET /compute/v2.1/os-networks => generated 10134 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:54:26.326771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:26.328708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:26.347042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.347825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.348804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.349394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.444423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.446490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.451987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lazy-loading 'fault' on Instance uuid ad902bf1-8b58-4faa-a43e-fcd38fb52208 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:26.766232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:26.799127 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b139bf39-52b5-4cdd-b5a0-5c107505dd6b tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 200 len: 1304 microversion: 2.1 time: 0.466579 Jul 20 10:54:26.802410 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 936/1804] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:26 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 1304 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:26.817759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:26.827504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:26.848431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.849465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.852423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:26.853068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:26.916953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:28.190051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:28.203709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:28.212493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:28.220466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:28.233679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e37e923-3c54-43a8-953a-01f1fceffddc tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1483 microversion: 2.1 time: 2.088589 Jul 20 10:54:28.235336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d4b7397b-3897-4e62-b966-7929d5e58ccc tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1292 microversion: 2.25 time: 1.426466 Jul 20 10:54:28.236100 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 869/1805] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:26 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1483 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:28.240615 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 937/1806] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:26 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1292 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:28.246791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bc5e7fd1-f486-48d0-aad5-7c929224a1cc req-6f6eac0f-c437-4dc0-85e0-e4d583e6ece9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad902bf1-8b58-4faa-a43e-fcd38fb52208", "name": "network-vif-deleted", "tag": "fe5d6cc4-deb4-4e11-b2ba-6e37a2a915c2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:28.261420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:28.262183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:28.300614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bc5e7fd1-f486-48d0-aad5-7c929224a1cc req-6f6eac0f-c437-4dc0-85e0-e4d583e6ece9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.301163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.302015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bc5e7fd1-f486-48d0-aad5-7c929224a1cc req-6f6eac0f-c437-4dc0-85e0-e4d583e6ece9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.304483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.306536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.308745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.340033 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bc5e7fd1-f486-48d0-aad5-7c929224a1cc req-6f6eac0f-c437-4dc0-85e0-e4d583e6ece9 service nova] Creating event network-vif-deleted:fe5d6cc4-deb4-4e11-b2ba-6e37a2a915c2 for instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 on n-h2-846219-10 Jul 20 10:54:28.352763 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bc5e7fd1-f486-48d0-aad5-7c929224a1cc req-6f6eac0f-c437-4dc0-85e0-e4d583e6ece9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109111 Jul 20 10:54:28.354929 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 938/1807] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:28.365751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:28.376777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:28.379486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ad902bf1-8b58-4faa-a43e-fcd38fb52208] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:28.410069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.411307 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-41bedc8e-dd1a-4f8f-a12b-b11a549b2b2e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a/ips" status: 200 len: 179 microversion: 2.1 time: 0.171384 Jul 20 10:54:28.413984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.414693 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 870/1808] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 10:54:28 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a/ips => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:28.419345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.420718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.434664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:28.435735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:28.458821 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] HTTP exception thrown: Instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 could not be found. Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Request method failure captured: Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 HTTP/1.1 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi194PEEDFwOc1kD73XORmDPyVVoHOrXSVbkQIEIAycdvpEbCeCZ7_EXqc9OY2jIM2c59Jw7s8sEa8CSUejpv51h1p5TYx0vib_IxX10Xdhw2JKw3Ps-OUlaaqzwGQDobmjtQKo8cibsWKgQJrZx5Gbjd0D0_u-qweU6hkYBl2VfQY-DA Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 6ed41f29a0fe4ebba18c8d24c7f513bf Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ed41f29a0fe4ebba18c8d24c7f513bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 6ed41f29a0fe4ebba18c8d24c7f513bf Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminTestJSON-1570528732-project Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 61aca4c4632f40a0b2eb6425fdcbd55e Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminTestJSON-1570528732-project Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 could not be found. Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ad902bf1-8b58-4faa-a43e-fcd38fb52208'} Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 could not be found. Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 could not be found. Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:28.461450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 could not be found. Jul 20 10:54:28.466203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:28.466730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.466730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.472628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Returning 404 to user: Instance ad902bf1-8b58-4faa-a43e-fcd38fb52208 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:28.474097 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6f9d206-20ea-4110-8530-9b4fc9aab907 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208" status: 404 len: 111 microversion: 2.1 time: 0.115076 Jul 20 10:54:28.475391 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 939/1809] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:28 2022] GET /compute/v2.1/servers/ad902bf1-8b58-4faa-a43e-fcd38fb52208 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:28.477110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.479814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.483889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:28.485770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:28.494612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.495691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.497217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.498192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.589808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:28.590427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:28.825839 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4d94b90-c111-455d-be91-9fb1a49d11e3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 204 len: 0 microversion: 2.1 time: 0.346346 Jul 20 10:54:28.827204 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 940/1810] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:28 2022] DELETE /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 10:54:28.842463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:28.844345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:28.861276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.862169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.863924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.865063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.895024 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-044f0011-c679-4b33-b6ad-05dc6e61ffe4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 204 len: 0 microversion: 2.1 time: 0.470743 Jul 20 10:54:28.899303 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 871/1811] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:28 2022] DELETE /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:28.905299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:28.911914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:28.919000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.924817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:28.925858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:28.926532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:29.247059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:29.257648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3992b2e-6d4e-4b39-8f95-7275b466c777 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1469 microversion: 2.1 time: 0.425141 Jul 20 10:54:29.261565 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 941/1812] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:28 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:29.273085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:29.276340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:29.296648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:29.297557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:29.298484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:29.301469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:29.522196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:29.550002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:29.572808 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-354cc21d-49a0-4897-8c17-42d5e09540d4 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1675 microversion: 2.1 time: 0.671499 Jul 20 10:54:29.584970 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 872/1813] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:28 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1675 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:29.591941 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c989e1fa-ac03-461a-a5d3-f6b8a85d12e0 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 200 len: 1441 microversion: 2.1 time: 0.328953 Jul 20 10:54:29.592315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:29.593123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:29.600902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:29.601630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:29.602603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:29.603222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:29.606276 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 942/1814] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:29 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 1441 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:29.822551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:29.835546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:29.837179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:29.838562 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c119fea-9d65-4d82-a53b-42880836ae12 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 0.252417 Jul 20 10:54:29.845151 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 873/1815] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:29 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:30.281561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:30.282710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:30.292355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:30.293320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:30.295041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:30.295680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:30.543783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:30.552845 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7cb50be5-c956-4b7e-97f2-e33d981bccf3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1469 microversion: 2.1 time: 0.277898 Jul 20 10:54:30.562838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 874/1816] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:30 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:30.580239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7e6551fb-d18d-4f0c-b373-b66789164e15 req-313473eb-423b-43c9-9226-f6e17167c047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dcb596a-1664-4e9f-9764-e9bc6c5e498c", "name": "network-vif-deleted", "tag": "c88b5b93-2adc-408c-99b6-cd6afae19c12"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:30.614645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7e6551fb-d18d-4f0c-b373-b66789164e15 req-313473eb-423b-43c9-9226-f6e17167c047 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:30.621106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7e6551fb-d18d-4f0c-b373-b66789164e15 req-313473eb-423b-43c9-9226-f6e17167c047 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:30.652274 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7e6551fb-d18d-4f0c-b373-b66789164e15 req-313473eb-423b-43c9-9226-f6e17167c047 service nova] Creating event network-vif-deleted:c88b5b93-2adc-408c-99b6-cd6afae19c12 for instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c on n-h2-846219-10 Jul 20 10:54:30.664623 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7e6551fb-d18d-4f0c-b373-b66789164e15 req-313473eb-423b-43c9-9226-f6e17167c047 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100469 Jul 20 10:54:30.668838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 875/1817] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:30.681913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:30.684408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:30.701610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:30.704874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:30.707344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:30.708756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:30.791727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-188193543", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "c53b2baa-aa27-4c35-9d59-0623df3d680d"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:30.876054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] validate_networks() for [('c53b2baa-aa27-4c35-9d59-0623df3d680d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:54:31.288486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:31.298727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74fb6fb4-28fc-4aca-ae0d-13e261a4121e tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1675 microversion: 2.1 time: 0.628411 Jul 20 10:54:31.299849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 876/1818] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:30 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1675 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:31.316960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:31.318174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 0dcb596a-1664-4e9f-9764-e9bc6c5e498c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:31.326911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:31.328417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:31.329339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:31.329781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:31.352860 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] HTTP exception thrown: Instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c could not be found. Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Request method failure captured: Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c HTTP/1.1 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi190Myvxdc0arewOe1a8fj2freERGmQ12E0Qzz_dLyxFQrNenYR9kR8w_ovszOo9s-L7LZbZ14Ah5fQzTSDIDo_almzxiL8EyMrG8S7-sj6v31zL8pCeL2gcb3GFcJ8dGy9lPvEcXKJV7W8ddzB3A1r9ZthuhusBqkYQ2-4wMr_SFUPU Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_985736ff3ec5477c99f3b0bdf3c9c4bd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-LiveMigrationTest-1677797 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 90200241ccaf4904a4b973e0351fdff6 Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c could not be found. Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '0dcb596a-1664-4e9f-9764-e9bc6c5e498c'} Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c could not be found. Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c could not be found. Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:31.354796 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:31.361442 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:31.361442 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:31.361442 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:31.361442 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:31.361442 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c could not be found. Jul 20 10:54:31.361442 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:31.363420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Returning 404 to user: Instance 0dcb596a-1664-4e9f-9764-e9bc6c5e498c could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:31.364683 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2498288-863b-46f2-8fcb-c973d581bece tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c" status: 404 len: 111 microversion: 2.1 time: 0.053400 Jul 20 10:54:31.366476 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 877/1819] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:31 2022] GET /compute/v2.1/servers/0dcb596a-1664-4e9f-9764-e9bc6c5e498c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:31.373283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:31.374175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:31.381065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:31.381527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:31.382323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:31.382840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:31.772746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:31.781849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:31.790564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:31.792146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21a46741-0b92-4e35-b698-610817c1bb80 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 0.423878 Jul 20 10:54:31.792926 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 878/1820] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:31 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:31.807703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:31.815018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:31.826123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:31.831728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:31.832897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:31.833322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:31.884982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:32.098964 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b7ed1e1-df2f-4dc1-b431-3ceac48419c6 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 204 len: 0 microversion: 2.1 time: 0.304274 Jul 20 10:54:32.099996 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 879/1821] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:31 2022] DELETE /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:32.110698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:32.121787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:32.135726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:32.136344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:32.137472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:32.138041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:32.472789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:54:32.473805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:54:32.475774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:54:32.476367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:54:32.476958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:54:32.497605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:32.499959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:32.503650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:32.504113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:32.549967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Getting quotas for project ee539bf2a8d846bea8c27f20ba8961f4. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:54:32.567123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Getting quotas for user fff674b9617b443299acb89f13e58c97 and project ee539bf2a8d846bea8c27f20ba8961f4. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:54:32.606421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:54:32.610361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:54:32.724000 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-62626ec3-491c-4d37-9062-451609a90b2c tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.486542 Jul 20 10:54:32.728154 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 943/1822] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:54:32.737681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:32.738320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:32.750929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:32.754083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:32.754824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:32.755332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:33.334800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61aca4c4632f40a0b2eb6425fdcbd55e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed41f29a0fe4ebba18c8d24c7f513bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:33.349742 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c9bd8166-650d-453a-82bc-755b8db3e3ba tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 200 len: 1469 microversion: 2.1 time: 1.247902 Jul 20 10:54:33.350332 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 880/1823] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:32 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 1469 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:33.354806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:33.355423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:33.371654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:33.372064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:33.372831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:33.378623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:33.454502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:33.463240 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f6fa876-8f42-451e-bc2a-7fc8f4878605 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1498 microversion: 2.1 time: 0.733889 Jul 20 10:54:33.463877 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 944/1824] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:32 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1498 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:33.684345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:33.693849 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3273ddbc-bc38-404e-8c56-6f55d18a8fe6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1654 microversion: 2.1 time: 0.342419 Jul 20 10:54:33.698149 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 881/1825] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:33 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1654 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:33.717016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:33.721118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:33.742251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:33.742789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:33.743783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:33.744655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:33.867612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-daf6dabe-285e-4642-b3cb-a32cb633a3bf tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Calling method '.version_select at 0x7f2c3f84daf0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:34.002368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:34.018732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:34.030112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-018afb30-defe-4703-ac3b-daefdd704c98 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1219 microversion: 2.1 time: 0.329665 Jul 20 10:54:34.036600 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 882/1826] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:33 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1219 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:34.043366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:34.044337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:34.050345 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-daf6dabe-285e-4642-b3cb-a32cb633a3bf tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 371 microversion: 2.1 time: 0.578791 Jul 20 10:54:34.056426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.057534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.059525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.060227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.061491 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 945/1827] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:54:33 2022] GET /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 371 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:34.073215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-50d51231-3c19-4de8-ac8b-cb7d10561708 req-219594a0-4c4e-4335-a6e4-2bc5c9ec6886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4a4890-3d11-4186-8d89-69ca4c410ed3", "name": "network-vif-deleted", "tag": "6e36c3d1-94d0-4c5e-956f-c0da952e3fd1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:34.097916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-50d51231-3c19-4de8-ac8b-cb7d10561708 req-219594a0-4c4e-4335-a6e4-2bc5c9ec6886 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.098585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-50d51231-3c19-4de8-ac8b-cb7d10561708 req-219594a0-4c4e-4335-a6e4-2bc5c9ec6886 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.125888 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-50d51231-3c19-4de8-ac8b-cb7d10561708 req-219594a0-4c4e-4335-a6e4-2bc5c9ec6886 service nova] Creating event network-vif-deleted:6e36c3d1-94d0-4c5e-956f-c0da952e3fd1 for instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 on n-h1-846219-10 Jul 20 10:54:34.147072 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-50d51231-3c19-4de8-ac8b-cb7d10561708 req-219594a0-4c4e-4335-a6e4-2bc5c9ec6886 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083930 Jul 20 10:54:34.152587 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 946/1828] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:34.169644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ecbb8fdf-748a-4587-8743-69720df4c083 req-5ada884e-80a4-4524-a3d9-93608decab55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b596cea-3a76-4d68-af1c-28a6d3cb522a", "name": "network-vif-deleted", "tag": "649adcea-981a-4c2e-9104-395f35c5f0bc"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:34.245801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ecbb8fdf-748a-4587-8743-69720df4c083 req-5ada884e-80a4-4524-a3d9-93608decab55 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.250424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ecbb8fdf-748a-4587-8743-69720df4c083 req-5ada884e-80a4-4524-a3d9-93608decab55 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.294453 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ecbb8fdf-748a-4587-8743-69720df4c083 req-5ada884e-80a4-4524-a3d9-93608decab55 service nova] Creating event network-vif-deleted:649adcea-981a-4c2e-9104-395f35c5f0bc for instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a on n-h2-846219-10 Jul 20 10:54:34.321128 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ecbb8fdf-748a-4587-8743-69720df4c083 req-5ada884e-80a4-4524-a3d9-93608decab55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164874 Jul 20 10:54:34.322912 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 947/1829] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:34.337980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44c27bdf-9a99-44ea-b530-f5c4420f953e tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f9013a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:34.452953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:34.465276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:34.467365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:34.469204 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d72bdf4-1d49-45da-8ce4-0674f41f5556 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 0.431061 Jul 20 10:54:34.470460 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 883/1830] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:34 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:34.482172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:34.483037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] [instance: ac4a4890-3d11-4186-8d89-69ca4c410ed3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:34.492734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.493475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.495439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.496274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.534772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44c27bdf-9a99-44ea-b530-f5c4420f953e tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.535253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44c27bdf-9a99-44ea-b530-f5c4420f953e tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.538331 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] HTTP exception thrown: Instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 could not be found. Jul 20 10:54:34.539985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44c27bdf-9a99-44ea-b530-f5c4420f953e tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.541560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44c27bdf-9a99-44ea-b530-f5c4420f953e tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Request method failure captured: Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 HTTP/1.1 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi194PEEDFwOc1kD73XORmDPyVVoHOrXSVbkQIEIAycdvpEbCeCZ7_EXqc9OY2jIM2c59Jw7s8sEa8CSUejpv51h1p5TYx0vib_IxX10Xdhw2JKw3Ps-OUlaaqzwGQDobmjtQKo8cibsWKgQJrZx5Gbjd0D0_u-qweU6hkYBl2VfQY-DA Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 6ed41f29a0fe4ebba18c8d24c7f513bf Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6ed41f29a0fe4ebba18c8d24c7f513bf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6ed41f29a0fe4ebba18c8d24c7f513bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 6ed41f29a0fe4ebba18c8d24c7f513bf Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersAdminTestJSON-1570528732 Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersAdminTestJSON-1570528732-project Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 61aca4c4632f40a0b2eb6425fdcbd55e Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersAdminTestJSON-1570528732-project Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 could not be found. Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ac4a4890-3d11-4186-8d89-69ca4c410ed3'} Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 could not be found. Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 could not be found. Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:34.544846 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 could not be found. Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] Returning 404 to user: Instance ac4a4890-3d11-4186-8d89-69ca4c410ed3 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44e8b13f-4323-466b-a166-dc2f59848bd3 tempest-ServersAdminTestJSON-1570528732 tempest-ServersAdminTestJSON-1570528732-project] 10.222.0.79 "GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3" status: 404 len: 111 microversion: 2.1 time: 0.074487 Jul 20 10:54:34.550672 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 884/1831] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:34 2022] GET /compute/v2.1/servers/ac4a4890-3d11-4186-8d89-69ca4c410ed3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:34.562753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:34.568789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:34.589014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.590430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.592391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.592886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.652925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.654380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.655064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lazy-loading 'fault' on Instance uuid 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:34.702178 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44c27bdf-9a99-44ea-b530-f5c4420f953e tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 328 microversion: 2.1 time: 0.376829 Jul 20 10:54:34.704447 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 948/1832] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:34 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 328 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:34.731152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90200241ccaf4904a4b973e0351fdff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '985736ff3ec5477c99f3b0bdf3c9c4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:34.737159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:34.739496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:34.740379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:34.743043 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b5f1011-b00e-4515-862c-9abb2fecaf41 tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 200 len: 1300 microversion: 2.1 time: 0.190845 Jul 20 10:54:34.754612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 885/1833] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:34 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:34.760812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.769184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.770169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.772237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.855399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:34.856354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:34.859674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lazy-loading 'fault' on Instance uuid 8b596cea-3a76-4d68-af1c-28a6d3cb522a {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:34.929851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b622b3ec37f48e49ae295acd6d1c34a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6480dcf785424b827d35f7cbfa6ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:34.943587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-10fc270c-8871-4d1a-a550-653bddd8c825 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 200 len: 1303 microversion: 2.1 time: 0.231247 Jul 20 10:54:34.944136 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 949/1834] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:34 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 1303 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:35.053220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:35.054216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:35.067038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:35.072902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:35.076413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:35.077026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:35.089040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-492641097", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:35.105991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:35.234657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:54:35.369974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:35.381071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7fba51e7-efaa-4cba-a540-454a18ecf6e2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1275 microversion: 2.1 time: 0.332174 Jul 20 10:54:35.384015 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 950/1835] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:35 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1275 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:35.489942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:35.490823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:35.509193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:35.514040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:35.517343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:35.518009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.438361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:36.457694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:36.461974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:36.463430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ab3f41a-e7d6-4273-9e82-18b32b697ba3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 0.979870 Jul 20 10:54:36.464642 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 951/1836] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:35 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:54:36.473625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:36.478652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] [instance: 8ae21dfc-ec5d-483b-81c8-6b3d2a601620] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:36.504432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.505013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.505816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.506355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.554206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:54:36.554791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:54:36.555398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:54:36.555946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:54:36.556486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:54:36.561226 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] HTTP exception thrown: Instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 could not be found. Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Request method failure captured: Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 HTTP/1.1 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi190Myvxdc0arewOe1a8fj2freERGmQ12E0Qzz_dLyxFQrNenYR9kR8w_ovszOo9s-L7LZbZ14Ah5fQzTSDIDo_almzxiL8EyMrG8S7-sj6v31zL8pCeL2gcb3GFcJ8dGy9lPvEcXKJV7W8ddzB3A1r9ZthuhusBqkYQ2-4wMr_SFUPU Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_985736ff3ec5477c99f3b0bdf3c9c4bd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/985736ff3ec5477c99f3b0bdf3c9c4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-LiveMigrationTest-1677797 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 985736ff3ec5477c99f3b0bdf3c9c4bd Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-LiveMigrationTest-1677797 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 90200241ccaf4904a4b973e0351fdff6 Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-LiveMigrationTest-1677797-project Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 could not be found. Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8ae21dfc-ec5d-483b-81c8-6b3d2a601620'} Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 could not be found. Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 could not be found. Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.569560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.575076 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:36.575076 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:36.575076 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:36.575076 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:36.575076 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 could not be found. Jul 20 10:54:36.575076 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.583150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] Returning 404 to user: Instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:36.584491 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3cf66f18-26a5-4cbd-9c23-fa9a9736c2fd tempest-LiveMigrationTest-1677797 tempest-LiveMigrationTest-1677797-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620" status: 404 len: 111 microversion: 2.1 time: 0.118712 Jul 20 10:54:36.585578 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 952/1837] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:36 2022] GET /compute/v2.1/servers/8ae21dfc-ec5d-483b-81c8-6b3d2a601620 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:36.586705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.587309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.588244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.595597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:36.596237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:36.599902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.615566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.617036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.618493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.619444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.678791 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] HTTP exception thrown: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Request method failure captured: Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a HTTP/1.1 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196DYCFMlu1GM5HcIJa1w_4cpSl6a4OatlIgHbv57yl-7IjtD5yzSdfBrnnm-DHhy8Dmk6oZecArQS8MhIkSk8vjMP2WMeSMV5_fP01phf7Rg94R6lVMp3eXVeHS2ryctvLPHmvsCCg4sE6DLDpSFK1SwI68iy8NbNrDdY2amQNtLjk Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f6480dcf785424b827d35f7cbfa6ddf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8b622b3ec37f48e49ae295acd6d1c34a Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8b596cea-3a76-4d68-af1c-28a6d3cb522a'} Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.694837 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:36.701387 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.704851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Returning 404 to user: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:36.709131 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b779c143-430d-480c-b2db-1cf0c8565f44 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 404 len: 111 microversion: 2.1 time: 0.120043 Jul 20 10:54:36.709965 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 953/1838] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:36 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:36.721268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-637b85c4-4725-4e3e-b229-d5e3bd1d82ac req-bee14579-3b38-4787-ac65-c18afc0d1b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae21dfc-ec5d-483b-81c8-6b3d2a601620", "name": "network-vif-deleted", "tag": "06e1be1c-ac80-4793-896d-da3e027de287"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:36.741383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Getting quotas for project 3af4534a503f4c3b98c4d1bf2a1cf97b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:54:36.745235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-637b85c4-4725-4e3e-b229-d5e3bd1d82ac req-bee14579-3b38-4787-ac65-c18afc0d1b83 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.746389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-637b85c4-4725-4e3e-b229-d5e3bd1d82ac req-bee14579-3b38-4787-ac65-c18afc0d1b83 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.754660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Getting quotas for user ac211432f3bc4998a83ca6e708ff8d20 and project 3af4534a503f4c3b98c4d1bf2a1cf97b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:54:36.765805 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-637b85c4-4725-4e3e-b229-d5e3bd1d82ac req-bee14579-3b38-4787-ac65-c18afc0d1b83 service nova] Creating event network-vif-deleted:06e1be1c-ac80-4793-896d-da3e027de287 for instance 8ae21dfc-ec5d-483b-81c8-6b3d2a601620 on n-h2-846219-10 Jul 20 10:54:36.772602 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-637b85c4-4725-4e3e-b229-d5e3bd1d82ac req-bee14579-3b38-4787-ac65-c18afc0d1b83 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061218 Jul 20 10:54:36.773767 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 954/1839] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:36.782139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:36.782977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:36.790162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.790524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.792833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.794319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.831489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.utils [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] cores quota exceeded for 3af4534a503f4c3b98c4d1bf2a1cf97b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125886) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 10:54:36.832491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Request method failure captured: Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 144 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi197n7fHaD9rHzhuLLrprPYFCOrnfH2FyEgLtYpoYBSDviUxbvaTs_PgFwGUVdZB0nZ50yThFaVvJSFq-MNfGiu0LTNr3JAmXNBE5f-QGOhD0R7NsP26XdhA6qtnif7kkVdAf6bDgIQmHjE5vzT0qjSTzjsFMIJVodvmMgztCTDzM1Mc Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3af4534a503f4c3b98c4d1bf2a1cf97b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ac211432f3bc4998a83ca6e708ff8d20 Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-492641097", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-492641097', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452'}}} Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 10:54:36.862930 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:36.868566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:36.872594 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c6379f01-0914-4410-825d-6bb7e2fb5ae4 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.924723 Jul 20 10:54:36.875045 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 886/1840] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:54:34 2022] POST /compute/v2.1/servers => generated 111 bytes in 1928 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:36.902296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5d3a98a9-aa9b-424f-952d-5d01152c02eb req-a79b1d31-0e68-487b-8205-b3e8fee74d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b596cea-3a76-4d68-af1c-28a6d3cb522a", "name": "network-vif-deleted", "tag": "c92788d1-9b58-48bd-a526-f8ae3aebef1b"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:36.923615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5d3a98a9-aa9b-424f-952d-5d01152c02eb req-a79b1d31-0e68-487b-8205-b3e8fee74d99 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:36.924057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5d3a98a9-aa9b-424f-952d-5d01152c02eb req-a79b1d31-0e68-487b-8205-b3e8fee74d99 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:36.966806 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5d3a98a9-aa9b-424f-952d-5d01152c02eb req-a79b1d31-0e68-487b-8205-b3e8fee74d99 service nova] Creating event network-vif-deleted:c92788d1-9b58-48bd-a526-f8ae3aebef1b for instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a on n-h2-846219-10 Jul 20 10:54:36.986497 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5d3a98a9-aa9b-424f-952d-5d01152c02eb req-a79b1d31-0e68-487b-8205-b3e8fee74d99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107569 Jul 20 10:54:36.987478 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 887/1841] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:36.998653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-498f7653-db76-4bb2-881b-f743f2222be5 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3eeee790>, body: {"quota_set": {"cores": 20}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:37.006768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:37.020626 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f44fcddb-1c6f-4fd4-980f-654877543384 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1273 microversion: 2.1 time: 0.244204 Jul 20 10:54:37.022108 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 955/1842] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:36 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:37.407398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-498f7653-db76-4bb2-881b-f743f2222be5 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:37.407856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-498f7653-db76-4bb2-881b-f743f2222be5 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:37.409630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-498f7653-db76-4bb2-881b-f743f2222be5 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:37.410208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-498f7653-db76-4bb2-881b-f743f2222be5 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:37.484610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:37.486420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:37.503965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:37.504939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:37.506177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:37.511343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:37.547828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-498f7653-db76-4bb2-881b-f743f2222be5 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 329 microversion: 2.1 time: 0.558648 Jul 20 10:54:37.550355 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 888/1843] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:36 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 329 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:37.562778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a063118-8b10-46bd-b904-d7861fa293a9 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Calling method '.version_select at 0x7f2c3eec75e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:37.790915 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a063118-8b10-46bd-b904-d7861fa293a9 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 371 microversion: 2.1 time: 0.233831 Jul 20 10:54:37.792147 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 889/1844] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:54:37 2022] GET /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:37.807730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05b94830-cb83-4864-b56f-8fbb5cd7f7e7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3eec7dc0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:37.943837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05b94830-cb83-4864-b56f-8fbb5cd7f7e7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:37.944313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05b94830-cb83-4864-b56f-8fbb5cd7f7e7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:37.945868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05b94830-cb83-4864-b56f-8fbb5cd7f7e7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:37.947216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05b94830-cb83-4864-b56f-8fbb5cd7f7e7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:38.036036 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05b94830-cb83-4864-b56f-8fbb5cd7f7e7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 328 microversion: 2.1 time: 0.235701 Jul 20 10:54:38.042139 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 890/1845] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:37 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:38.053355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ca12a4-5824-428c-b194-a93da434397a"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:38.057674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:38.076120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:38.080347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:38.081356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:38.082356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:38.237135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:38.289717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:38.291305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:38.306749 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a6f92d2-8905-48b1-a974-416abcfa408f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 0.827752 Jul 20 10:54:38.314628 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 956/1846] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:37 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:54:38.372360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:38.373004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:38.408427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:38.417553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:38.419570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:38.422181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:38.709449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-781ec787-d5c0-45bb-bbe4-37350bd78a78 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "POST /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665845 Jul 20 10:54:38.711854 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 891/1847] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 10:54:38 2022] POST /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:38.759470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1900344931", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:38.881389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:54:39.331122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:39.342757 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-371fa04a-479f-4a88-bd0c-2d5568ef50f7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 0.994755 Jul 20 10:54:39.345629 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 957/1848] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:38 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:39.356846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:39.358753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:39.396187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:39.396657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:39.397469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:39.400412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:39.808520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:54:39.808980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:54:39.809743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:54:39.810159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:54:39.810576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:54:39.834966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:39.835454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:39.836366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:39.845266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:39.934726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Getting quotas for project 3af4534a503f4c3b98c4d1bf2a1cf97b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:54:39.951622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Getting quotas for user ac211432f3bc4998a83ca6e708ff8d20 and project 3af4534a503f4c3b98c4d1bf2a1cf97b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:54:39.999372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.utils [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] instances quota exceeded for 3af4534a503f4c3b98c4d1bf2a1cf97b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125886) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 10:54:40.000776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Request method failure captured: Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 145 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi197n7fHaD9rHzhuLLrprPYFCOrnfH2FyEgLtYpoYBSDviUxbvaTs_PgFwGUVdZB0nZ50yThFaVvJSFq-MNfGiu0LTNr3JAmXNBE5f-QGOhD0R7NsP26XdhA6qtnif7kkVdAf6bDgIQmHjE5vzT0qjSTzjsFMIJVodvmMgztCTDzM1Mc Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3af4534a503f4c3b98c4d1bf2a1cf97b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ac211432f3bc4998a83ca6e708ff8d20 Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1900344931", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1900344931', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452'}}} Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 10:54:40.006245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:40.011640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:40.019211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65e7589e-24eb-45f9-b735-98fade151822 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.298769 Jul 20 10:54:40.019211 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 892/1849] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:54:38 2022] POST /compute/v2.1/servers => generated 119 bytes in 1305 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:40.027799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c0969715-bbc5-468b-bb55-1abcb8907b8a tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3ee6b940>, body: {"quota_set": {"instances": 10}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:40.705463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0969715-bbc5-468b-bb55-1abcb8907b8a tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:40.705929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0969715-bbc5-468b-bb55-1abcb8907b8a tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:40.706776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0969715-bbc5-468b-bb55-1abcb8907b8a tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:40.714037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c0969715-bbc5-468b-bb55-1abcb8907b8a tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:40.841651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:40.852405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:40.854085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:40.874920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c0969715-bbc5-468b-bb55-1abcb8907b8a tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 329 microversion: 2.1 time: 0.851460 Jul 20 10:54:40.875831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-173627c0-9c90-4ca1-b0d7-19134ae3f8e1 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 1.527924 Jul 20 10:54:40.883552 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 958/1850] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:39 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:40.886152 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 893/1851] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:40 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 329 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:40.892103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:40.903121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:40.909349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17daa883-0029-4f79-be87-1002453f1045 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Calling method '.version_select at 0x7f2c3ee3e5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:40.945896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:40.948810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:40.950705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:40.951208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:41.052106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:41.481666 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17daa883-0029-4f79-be87-1002453f1045 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 371 microversion: 2.1 time: 0.585070 Jul 20 10:54:41.487284 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 894/1852] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:54:40 2022] GET /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:41.514266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-acfa6dbc-e2ae-435b-b328-35d5643f07c7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3ee6bf70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:41.556208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:41.578713 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b8abc443-3e90-47f1-9bb9-332d3b9c3dbd tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 0.693894 Jul 20 10:54:41.592034 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 959/1853] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:40 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:41.826699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acfa6dbc-e2ae-435b-b328-35d5643f07c7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:41.835044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acfa6dbc-e2ae-435b-b328-35d5643f07c7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:41.839330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acfa6dbc-e2ae-435b-b328-35d5643f07c7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:41.839798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acfa6dbc-e2ae-435b-b328-35d5643f07c7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:42.045053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-561271614", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:42.048869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-acfa6dbc-e2ae-435b-b328-35d5643f07c7 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 325 microversion: 2.1 time: 0.556912 Jul 20 10:54:42.051783 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 895/1854] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:41 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:42.086908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:42.090089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:42.104144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:42.107470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:42.109838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:42.112536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:42.210736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:54:43.521036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:54:43.524028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:54:43.524983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:54:43.525890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:54:43.529814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:54:43.555394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:43.555845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:43.556791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:43.557230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:43.573348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:43.583985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:43.591258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:43.592738 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d685d563-f8bf-41af-b424-5f68f61bde5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 1.539723 Jul 20 10:54:43.604185 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 896/1855] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:42 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:43.611196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-281986b0-b01b-488d-84d4-877cbbc41f91 req-7e3432b9-4fb4-4c6f-b3eb-7202b9712498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde6bc00-8ace-4d73-bbef-3a7881815a7a", "name": "network-vif-plugged", "status": "completed", "tag": "7ba34fe2-c8a3-4457-aee8-76e7eb387638"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:43.614939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Getting quotas for project 240d79e50d2f47bd8818427d9f7945c3. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:54:43.620391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-281986b0-b01b-488d-84d4-877cbbc41f91 req-7e3432b9-4fb4-4c6f-b3eb-7202b9712498 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:43.621600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-281986b0-b01b-488d-84d4-877cbbc41f91 req-7e3432b9-4fb4-4c6f-b3eb-7202b9712498 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:43.621851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Getting quotas for user f97bc970fd68474292d14cb84eb5c4c9 and project 240d79e50d2f47bd8818427d9f7945c3. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:54:43.636104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-281986b0-b01b-488d-84d4-877cbbc41f91 req-7e3432b9-4fb4-4c6f-b3eb-7202b9712498 service nova] Creating event network-vif-plugged:7ba34fe2-c8a3-4457-aee8-76e7eb387638 for instance cde6bc00-8ace-4d73-bbef-3a7881815a7a on n-h1-846219-10 Jul 20 10:54:43.641258 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-281986b0-b01b-488d-84d4-877cbbc41f91 req-7e3432b9-4fb4-4c6f-b3eb-7202b9712498 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Jul 20 10:54:43.641755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:54:43.644953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:54:43.646472 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 897/1856] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:43.652739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-22924439", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:43.661367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:43.707648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1ccea1ed-a087-4c2a-b176-218a9ee7e18e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859536 Jul 20 10:54:43.708989 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 960/1857] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:54:43.714848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:43.716677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:43.741631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:54:43.742370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:43.742898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:43.743785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:43.744473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:44.770177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:44.813137 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e942a238-0a84-47b4-97f0-10462e7aa9c8 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 1.097082 Jul 20 10:54:44.815509 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 961/1858] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:43 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:44.824488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e868694b-26ff-40e8-9a7e-09a7d233d6a5 req-6eb8aa77-839f-4766-a5b5-b0bcfab0c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205806e2-29cc-4dda-bcb8-728cf5b6851e", "tag": "4b6b68c5-0804-4a77-a41d-0fbbcac1f881"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:44.846200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e868694b-26ff-40e8-9a7e-09a7d233d6a5 req-6eb8aa77-839f-4766-a5b5-b0bcfab0c1c6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:44.850196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e868694b-26ff-40e8-9a7e-09a7d233d6a5 req-6eb8aa77-839f-4766-a5b5-b0bcfab0c1c6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:44.860391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:54:44.860986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:54:44.861533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:54:44.863150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:54:44.863768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:54:44.877871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:44.878434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:44.880238 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e868694b-26ff-40e8-9a7e-09a7d233d6a5 req-6eb8aa77-839f-4766-a5b5-b0bcfab0c1c6 service nova] Creating event network-changed:4b6b68c5-0804-4a77-a41d-0fbbcac1f881 for instance 205806e2-29cc-4dda-bcb8-728cf5b6851e on n-h2-846219-10 Jul 20 10:54:44.880524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:44.882363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:44.892131 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e868694b-26ff-40e8-9a7e-09a7d233d6a5 req-6eb8aa77-839f-4766-a5b5-b0bcfab0c1c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075282 Jul 20 10:54:44.892751 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 962/1859] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:44.905989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:44.911476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:44.926834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:44.927266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:44.928262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:44.928873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:44.929940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Getting quotas for project 3af4534a503f4c3b98c4d1bf2a1cf97b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:54:44.944220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Getting quotas for user ac211432f3bc4998a83ca6e708ff8d20 and project 3af4534a503f4c3b98c4d1bf2a1cf97b. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:54:44.959902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] HTTP exception thrown: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:44.964017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.utils [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] ram quota exceeded for 3af4534a503f4c3b98c4d1bf2a1cf97b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125886) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 20 10:54:44.964838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Request method failure captured: Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 143 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi197n7fHaD9rHzhuLLrprPYFCOrnfH2FyEgLtYpoYBSDviUxbvaTs_PgFwGUVdZB0nZ50yThFaVvJSFq-MNfGiu0LTNr3JAmXNBE5f-QGOhD0R7NsP26XdhA6qtnif7kkVdAf6bDgIQmHjE5vzT0qjSTzjsFMIJVodvmMgztCTDzM1Mc Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3af4534a503f4c3b98c4d1bf2a1cf97b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ac211432f3bc4998a83ca6e708ff8d20 Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-22924439", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-22924439', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452'}}} Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 10:54:44.967132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 20 10:54:44.974818 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Request method failure captured: Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a HTTP/1.1 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196DYCFMlu1GM5HcIJa1w_4cpSl6a4OatlIgHbv57yl-7IjtD5yzSdfBrnnm-DHhy8Dmk6oZecArQS8MhIkSk8vjMP2WMeSMV5_fP01phf7Rg94R6lVMp3eXVeHS2ryctvLPHmvsCCg4sE6DLDpSFK1SwI68iy8NbNrDdY2amQNtLjk Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f6480dcf785424b827d35f7cbfa6ddf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8b622b3ec37f48e49ae295acd6d1c34a Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8b596cea-3a76-4d68-af1c-28a6d3cb522a'} Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:44.983571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Returning 404 to user: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d754ed4-e894-42bb-a748-9d8197c155d6 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 404 len: 111 microversion: 2.1 time: 0.069597 Jul 20 10:54:45.000124 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 963/1860] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:44 2022] DELETE /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:45.004402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:45.004402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-836e4073-842c-4145-aa56-70ebf30c4d2d tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.331252 Jul 20 10:54:45.004771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:45.004771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:45.004771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.004771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.004771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.004771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.010267 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 898/1861] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:54:43 2022] POST /compute/v2.1/servers => generated 110 bytes in 1353 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:45.014492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:45.017595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:45.028427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.032769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.033925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.034527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.241630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:45.261031 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7eb635b1-f282-4bfe-b915-1f86305baf4b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1209 microversion: 2.1 time: 0.288544 Jul 20 10:54:45.262206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 964/1862] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:44 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1209 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:45.268647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:45.270009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: 8b596cea-3a76-4d68-af1c-28a6d3cb522a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:45.285091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.286372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.287884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.288796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.299051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:45.311579 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] HTTP exception thrown: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.312275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Request method failure captured: Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a HTTP/1.1 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196DYCFMlu1GM5HcIJa1w_4cpSl6a4OatlIgHbv57yl-7IjtD5yzSdfBrnnm-DHhy8Dmk6oZecArQS8MhIkSk8vjMP2WMeSMV5_fP01phf7Rg94R6lVMp3eXVeHS2ryctvLPHmvsCCg4sE6DLDpSFK1SwI68iy8NbNrDdY2amQNtLjk Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f6480dcf785424b827d35f7cbfa6ddf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8b622b3ec37f48e49ae295acd6d1c34a Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8b596cea-3a76-4d68-af1c-28a6d3cb522a'} Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.313260 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. Jul 20 10:54:45.317799 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.326130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:45.326130 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3503816e-bf14-4944-9584-a5cdf80515fd tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1280 microversion: 2.25 time: 0.306979 Jul 20 10:54:45.330793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Returning 404 to user: Instance 8b596cea-3a76-4d68-af1c-28a6d3cb522a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:45.331378 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 899/1863] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:45 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:45.332281 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab745760-441a-428f-836f-c15c14d07667 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a" status: 404 len: 111 microversion: 2.1 time: 0.068898 Jul 20 10:54:45.333755 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 965/1864] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:45 2022] GET /compute/v2.1/servers/8b596cea-3a76-4d68-af1c-28a6d3cb522a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:45.336826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dafb38a7-d660-4cf0-b7ca-cfd438440ea2 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3ee3ec10>, body: {"quota_set": {"ram": 51200}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:45.343761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:45.349820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:45.363987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.368354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.370880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.372822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.403047 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] HTTP exception thrown: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Request method failure captured: Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 HTTP/1.1 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196DYCFMlu1GM5HcIJa1w_4cpSl6a4OatlIgHbv57yl-7IjtD5yzSdfBrnnm-DHhy8Dmk6oZecArQS8MhIkSk8vjMP2WMeSMV5_fP01phf7Rg94R6lVMp3eXVeHS2ryctvLPHmvsCCg4sE6DLDpSFK1SwI68iy8NbNrDdY2amQNtLjk Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f6480dcf785424b827d35f7cbfa6ddf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8b622b3ec37f48e49ae295acd6d1c34a Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'dd22ae96-f5fd-47f7-b21b-bcb7946f2834'} Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:45.404651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Returning 404 to user: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:45.410249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-926e50ad-893a-4b16-9575-457161f10ea1 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 404 len: 111 microversion: 2.1 time: 0.068555 Jul 20 10:54:45.418697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 966/1865] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:45 2022] DELETE /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:45.434092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:45.434706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] [instance: dd22ae96-f5fd-47f7-b21b-bcb7946f2834] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:45.444715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dafb38a7-d660-4cf0-b7ca-cfd438440ea2 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.444828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dafb38a7-d660-4cf0-b7ca-cfd438440ea2 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.446651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dafb38a7-d660-4cf0-b7ca-cfd438440ea2 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.447106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dafb38a7-d660-4cf0-b7ca-cfd438440ea2 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.466886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.467771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.469396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.470104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.497423 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] HTTP exception thrown: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Request method failure captured: Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 HTTP/1.1 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi196DYCFMlu1GM5HcIJa1w_4cpSl6a4OatlIgHbv57yl-7IjtD5yzSdfBrnnm-DHhy8Dmk6oZecArQS8MhIkSk8vjMP2WMeSMV5_fP01phf7Rg94R6lVMp3eXVeHS2ryctvLPHmvsCCg4sE6DLDpSFK1SwI68iy8NbNrDdY2amQNtLjk Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7f6480dcf785424b827d35f7cbfa6ddf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7f6480dcf785424b827d35f7cbfa6ddf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 7f6480dcf785424b827d35f7cbfa6ddf Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestMultiNic-1542454738 Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8b622b3ec37f48e49ae295acd6d1c34a Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestMultiNic-1542454738-project Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'dd22ae96-f5fd-47f7-b21b-bcb7946f2834'} Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.505927 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] Returning 404 to user: Instance dd22ae96-f5fd-47f7-b21b-bcb7946f2834 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-74d7c41c-5a1b-4bb0-b39a-c6898f592d98 tempest-ServersTestMultiNic-1542454738 tempest-ServersTestMultiNic-1542454738-project] 10.222.0.79 "GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834" status: 404 len: 111 microversion: 2.1 time: 0.077907 Jul 20 10:54:45.510642 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 967/1866] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:45 2022] GET /compute/v2.1/servers/dd22ae96-f5fd-47f7-b21b-bcb7946f2834 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:45.543717 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dafb38a7-d660-4cf0-b7ca-cfd438440ea2 tempest-QuotasAdminNegativeTest-208672545 tempest-QuotasAdminNegativeTest-208672545-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 200 len: 329 microversion: 2.1 time: 0.210690 Jul 20 10:54:45.550885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 900/1867] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:45 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:45.576616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b73bc589-1064-472b-8b53-abe113544c24 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Action: 'update', calling method: .version_select at 0x7f2c3fbe3a60>, body: {"quota_set": {"ram": 0}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:45.579787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b73bc589-1064-472b-8b53-abe113544c24 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ac211432f3bc4998a83ca6e708ff8d20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af4534a503f4c3b98c4d1bf2a1cf97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b73bc589-1064-472b-8b53-abe113544c24 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Request method failure captured: Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b HTTP/1.1 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 25 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi197n7fHaD9rHzhuLLrprPYFCOrnfH2FyEgLtYpoYBSDviUxbvaTs_PgFwGUVdZB0nZ50yThFaVvJSFq-MNfGiu0LTNr3JAmXNBE5f-QGOhD0R7NsP26XdhA6qtnif7kkVdAf6bDgIQmHjE5vzT0qjSTzjsFMIJVodvmMgztCTDzM1Mc Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3af4534a503f4c3b98c4d1bf2a1cf97b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3af4534a503f4c3b98c4d1bf2a1cf97b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 3af4534a503f4c3b98c4d1bf2a1cf97b Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1415973483 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: ac211432f3bc4998a83ca6e708ff8d20 Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-QuotasAdminNegativeTest-1415973483-project Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: {"quota_set": {"ram": 0}} Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3af4534a503f4c3b98c4d1bf2a1cf97b', 'body': {'quota_set': {'ram': 0}}} Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:54:45.590056 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b73bc589-1064-472b-8b53-abe113544c24 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b73bc589-1064-472b-8b53-abe113544c24 tempest-QuotasAdminNegativeTest-1415973483 tempest-QuotasAdminNegativeTest-1415973483-project] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b" status: 403 len: 116 microversion: 2.1 time: 0.032534 Jul 20 10:54:45.597752 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 968/1868] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:54:45 2022] PUT /compute/v2.1/os-quota-sets/3af4534a503f4c3b98c4d1bf2a1cf97b => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:54:45.830703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:45.831434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:45.855536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.856257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:45.860928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:45.865415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:46.284195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:46.285635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:46.302361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:46.304482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:46.305719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:46.306742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:46.590986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:46.618245 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a4279f1-aae4-4e5a-821b-16b1b2e3a4ae tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1273 microversion: 2.1 time: 0.343811 Jul 20 10:54:46.621831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 969/1869] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:46 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:46.637033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:46.638057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:46.647503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:46.648057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:46.648934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:46.649619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:47.034024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:47.041600 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94cca1ca-d5c6-41f1-a6ca-356ca9cce433 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 1.215407 Jul 20 10:54:47.046410 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 901/1870] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:45 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:47.410189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:47.424966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:47.426502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:47.440018 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4788c7dd-2cea-4650-957a-f3c046499919 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1476 microversion: 2.25 time: 0.806892 Jul 20 10:54:47.441149 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 970/1871] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:46 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1476 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:47.457852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:47.458474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:47.474894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:47.475649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:47.476643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:47.477258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:47.641469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:47.642390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:47.653149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:47.655780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:47.659092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:47.659839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:47.896141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:47.920401 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1c91111e-d8df-4b23-8736-e936af95379b tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1271 microversion: 2.1 time: 0.281380 Jul 20 10:54:47.933297 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 971/1872] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:47 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:48.064374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:48.065703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:48.085617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:48.086566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:48.103693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:48.104374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:48.645742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cde6bc00-8ace-4d73-bbef-3a7881815a7a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:48.664182 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b4f6998-ace3-4818-a190-8c5ad82c5a1b tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1970 microversion: 2.25 time: 1.209857 Jul 20 10:54:48.665093 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 902/1873] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:47 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1970 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:48.685869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:48.686783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:48.693497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:48.693942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:48.694896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:48.695384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:48.987364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:48.995609 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90d0a810-ae78-476f-ac6c-e27a1565bfc7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 0.936279 Jul 20 10:54:48.996750 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 972/1874] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:48 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:49.001708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:49.002565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:49.010828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.011720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.013338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.013960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.654042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cde6bc00-8ace-4d73-bbef-3a7881815a7a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:49.689298 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c4697b70-8aba-4eb3-a593-88776dce9f06 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1970 microversion: 2.25 time: 1.010463 Jul 20 10:54:49.691502 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 903/1875] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:48 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1970 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:49.697598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4bfb50ec-f8d7-4e1a-81cb-d69b246b57d6 req-ae86b3a9-962e-4043-a219-cb6b5fcacd0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b1585e-c803-481c-b165-621367e6f92c", "tag": "272e873a-1430-4b58-ac34-551400eb7a94"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:49.716442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4bfb50ec-f8d7-4e1a-81cb-d69b246b57d6 req-ae86b3a9-962e-4043-a219-cb6b5fcacd0a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.717380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4bfb50ec-f8d7-4e1a-81cb-d69b246b57d6 req-ae86b3a9-962e-4043-a219-cb6b5fcacd0a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.741668 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4bfb50ec-f8d7-4e1a-81cb-d69b246b57d6 req-ae86b3a9-962e-4043-a219-cb6b5fcacd0a service nova] Creating event network-changed:272e873a-1430-4b58-ac34-551400eb7a94 for instance 32b1585e-c803-481c-b165-621367e6f92c on n-h2-846219-10 Jul 20 10:54:49.747582 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4bfb50ec-f8d7-4e1a-81cb-d69b246b57d6 req-ae86b3a9-962e-4043-a219-cb6b5fcacd0a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054483 Jul 20 10:54:49.748834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 904/1876] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:49.757667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24dbdb6d-5007-44f5-b71e-7dd714097576 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:49.759619 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:54:49.759619 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 10:54:49.761908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24dbdb6d-5007-44f5-b71e-7dd714097576 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.763010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24dbdb6d-5007-44f5-b71e-7dd714097576 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.763854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24dbdb6d-5007-44f5-b71e-7dd714097576 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.764489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24dbdb6d-5007-44f5-b71e-7dd714097576 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.794027 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-24dbdb6d-5007-44f5-b71e-7dd714097576 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.042852 Jul 20 10:54:49.795346 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 905/1877] 10.222.0.79 () {60 vars in 1216 bytes} [Wed Jul 20 10:54:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:54:49.807683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846219-10", "block_migration": "auto"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:49.809161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:49.818485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.819367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.821638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:49.822091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:49.831097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:49.842069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-441954e1-3974-4b00-b4df-65f8bbe1d7ac tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1313 microversion: 2.1 time: 0.844094 Jul 20 10:54:49.852200 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 973/1878] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:48 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1313 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:49.860660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'flavor' on Instance uuid cde6bc00-8ace-4d73-bbef-3a7881815a7a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:49.875426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Going to try to live migrate instance to n-h2-846219-10 {{(pid=125886) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 10:54:50.014054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:50.015626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:50.025431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:50.028070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:50.028878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:50.033125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:50.517102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:50.538125 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-094850a5-6630-4588-90c0-11dd0c39d967 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 0.528528 Jul 20 10:54:50.539631 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 974/1879] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:50 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:50.547996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1a30bba1-244e-470c-964d-3c1fe95cf041 req-7e11fa0f-46ba-4e4b-9091-0871d0f51a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205806e2-29cc-4dda-bcb8-728cf5b6851e", "name": "network-vif-plugged", "status": "completed", "tag": "4b6b68c5-0804-4a77-a41d-0fbbcac1f881"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:50.567274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1a30bba1-244e-470c-964d-3c1fe95cf041 req-7e11fa0f-46ba-4e4b-9091-0871d0f51a35 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:50.568487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1a30bba1-244e-470c-964d-3c1fe95cf041 req-7e11fa0f-46ba-4e4b-9091-0871d0f51a35 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:50.584838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1a30bba1-244e-470c-964d-3c1fe95cf041 req-7e11fa0f-46ba-4e4b-9091-0871d0f51a35 service nova] Creating event network-vif-plugged:4b6b68c5-0804-4a77-a41d-0fbbcac1f881 for instance 205806e2-29cc-4dda-bcb8-728cf5b6851e on n-h2-846219-10 Jul 20 10:54:50.592195 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1a30bba1-244e-470c-964d-3c1fe95cf041 req-7e11fa0f-46ba-4e4b-9091-0871d0f51a35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050150 Jul 20 10:54:50.599029 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 975/1880] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:50.860905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:50.861722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:50.879294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:50.879846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:50.882740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:50.883744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:51.425644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:51.437137 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a34c0993-a27e-4901-886b-7c415329df18 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1313 microversion: 2.1 time: 0.581635 Jul 20 10:54:51.439300 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 976/1881] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:50 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:51.555818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:51.556457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:51.563763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:51.564275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:51.565318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:51.565765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:51.989704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:52.010918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8549021f-d5e4-49c8-8217-d7201730f813 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1315 microversion: 2.1 time: 0.458791 Jul 20 10:54:52.014618 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 977/1882] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:51 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:52.457226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:52.459447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:52.477398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:52.479521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:52.480868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:52.484575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:52.806579 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66653832-d663-42ac-b9b3-1eaac01718ec tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a/action" status: 202 len: 0 microversion: 2.25 time: 3.001245 Jul 20 10:54:52.807364 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 906/1883] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:54:49 2022] POST /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a/action => generated 0 bytes in 3005 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:52.828384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:52.833508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:52.859706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:52.860638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:52.862046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:52.862722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:52.920136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:52.932960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5309a803-1e74-4eba-94ed-fb84b12f761a tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1313 microversion: 2.1 time: 0.481348 Jul 20 10:54:52.933556 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 978/1884] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:52 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:53.030282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:53.030922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:53.042063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.042514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.043333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.043771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.185068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:53.194122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:53.196515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:53.197930 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4126831a-4e6a-494d-beaa-9ba31840028f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 0.386284 Jul 20 10:54:53.211971 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 907/1885] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:52 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:53.478716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:53.489274 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb21b59b-4a86-4d79-a246-46a09b072cc2 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1504 microversion: 2.1 time: 0.463160 Jul 20 10:54:53.490582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 979/1886] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:53 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:53.507865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:53.511998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:53.533121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.534943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.535997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.541332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.582158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:53.704251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-afcbd85a-bf63-4d84-89e9-57d7c85f33ce tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "DELETE /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.199986 Jul 20 10:54:53.706084 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 908/1887] 10.222.0.79 () {58 vars in 1295 bytes} [Wed Jul 20 10:54:53 2022] DELETE /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e/os-server-password => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:53.718496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:53.718997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:53.721477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:53.722117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=22 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:53.739260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.740299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.741417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.744023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.810261 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da1a2184-600e-4cc7-9b39-583f7c300289 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.097154 Jul 20 10:54:53.811625 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 980/1888] 10.222.0.79 () {58 vars in 1292 bytes} [Wed Jul 20 10:54:53 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e/os-server-password => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:54:53.821464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:53.822062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:53.847997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.848915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.850089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.851124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.888094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:54:53.953572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:53.954027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:53.961378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:53.977663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.978137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:53.982151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:53.982620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:54.070491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62c1bc5a-2700-4d91-887f-494e9bc57db7 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "DELETE /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 204 len: 0 microversion: 2.1 time: 0.252832 Jul 20 10:54:54.079273 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 909/1889] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:54:53 2022] DELETE /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:54:54.088527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:54.089466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:54.108846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:54.109674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:54.110631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:54.111191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:55.107380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:55.114186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:55.126015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-439eb4e7-9e7b-4fbc-862e-f103718c1e15 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1313 microversion: 2.1 time: 1.175164 Jul 20 10:54:55.128129 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 981/1890] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:53 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1313 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:54:55.134599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:55.136371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:55.148109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:55.149246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:55.150529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:55.151493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:55.172175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:55.236219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1b5906fa-1ecb-4b8f-93d5-893fe7ed98cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1510 microversion: 2.1 time: 1.152749 Jul 20 10:54:55.241596 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 910/1891] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:54 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1510 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:55.829039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:55.832415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:55.838050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=62 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:55.861323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:55.862075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:55.863135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:55.863995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:56.013066 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dffafeab-ec89-4e56-9020-89382b301f64 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191775 Jul 20 10:54:56.021107 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 911/1892] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:54:55 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:54:56.053445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:56.056031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:56.079698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:56.083789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:56.085297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:56.092470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:56.125989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:56.147475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:56.149950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:56.151691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0949c9a-1a1a-416f-838b-48c95b4b620a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 1.021982 Jul 20 10:54:56.166269 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 982/1893] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:55 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:56.178941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:56.185248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:56.200467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:56.201228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:56.203227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:56.203961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:56.306551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lazy-loading 'services' on Instance uuid f172f524-ae19-4718-848e-2c6c601750df {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:54:56.466541 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cebadbd2-f426-4498-a114-8ba0f82d0dca tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments/f4ca12a4-5824-428c-b194-a93da434397a" status: 202 len: 0 microversion: 2.1 time: 0.443625 Jul 20 10:54:56.471381 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 912/1894] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 10:54:56 2022] DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments/f4ca12a4-5824-428c-b194-a93da434397a => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:54:56.476979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:56.477685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:56.496789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:56.497241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:56.498036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:56.498479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:57.708163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:57.722091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff674b9617b443299acb89f13e58c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee539bf2a8d846bea8c27f20ba8961f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:57.729880 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-368a0f80-a13d-474d-9d47-4849caac9322 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1313 microversion: 2.1 time: 1.561192 Jul 20 10:54:57.734969 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 983/1895] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:56 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1313 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:57.739021 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c726c5a-4545-44e8-a053-428fa3a3f4cb tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 200 len: 1468 microversion: 2.1 time: 1.266207 Jul 20 10:54:57.739653 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 913/1896] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:56 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 1468 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:54:57.753838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-15fe98b6-5c1b-4d97-971b-9efef3fd5835 req-2eab56e8-ee2a-478f-a31e-b6666e1c8282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205806e2-29cc-4dda-bcb8-728cf5b6851e", "name": "network-vif-deleted", "tag": "4b6b68c5-0804-4a77-a41d-0fbbcac1f881"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:57.768049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:57.770377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:57.793449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:57.800637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:57.803281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-15fe98b6-5c1b-4d97-971b-9efef3fd5835 req-2eab56e8-ee2a-478f-a31e-b6666e1c8282 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:57.804180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-15fe98b6-5c1b-4d97-971b-9efef3fd5835 req-2eab56e8-ee2a-478f-a31e-b6666e1c8282 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:57.806501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:57.808387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:57.820283 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-15fe98b6-5c1b-4d97-971b-9efef3fd5835 req-2eab56e8-ee2a-478f-a31e-b6666e1c8282 service nova] Creating event network-vif-deleted:4b6b68c5-0804-4a77-a41d-0fbbcac1f881 for instance 205806e2-29cc-4dda-bcb8-728cf5b6851e on n-h2-846219-10 Jul 20 10:54:57.829403 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-15fe98b6-5c1b-4d97-971b-9efef3fd5835 req-2eab56e8-ee2a-478f-a31e-b6666e1c8282 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082700 Jul 20 10:54:57.830107 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 984/1897] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:58.362513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3d9b58fa-9623-4380-bd80-8b817bcdba1b req-0faa4b58-a0b6-4993-8e58-1268f0ffa264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1585e-c803-481c-b165-621367e6f92c", "name": "network-vif-plugged", "status": "completed", "tag": "272e873a-1430-4b58-ac34-551400eb7a94"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:54:58.404169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3d9b58fa-9623-4380-bd80-8b817bcdba1b req-0faa4b58-a0b6-4993-8e58-1268f0ffa264 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:58.407587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3d9b58fa-9623-4380-bd80-8b817bcdba1b req-0faa4b58-a0b6-4993-8e58-1268f0ffa264 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:58.452487 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3d9b58fa-9623-4380-bd80-8b817bcdba1b req-0faa4b58-a0b6-4993-8e58-1268f0ffa264 service nova] Creating event network-vif-plugged:272e873a-1430-4b58-ac34-551400eb7a94 for instance 32b1585e-c803-481c-b165-621367e6f92c on n-h2-846219-10 Jul 20 10:54:58.467559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3d9b58fa-9623-4380-bd80-8b817bcdba1b req-0faa4b58-a0b6-4993-8e58-1268f0ffa264 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109034 Jul 20 10:54:58.469436 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 985/1898] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:54:58.751374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:58.753237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:58.766430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:58.773216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:58.777426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:58.778158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:59.771287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=18 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:54:59.780583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:59.832632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:59.846416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:54:59.849311 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b759c372-7bf3-4482-baaf-dc0e92d8bd5e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 2.094163 Jul 20 10:54:59.854501 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 914/1899] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:54:57 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:54:59.870418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:54:59.871199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] [instance: 205806e2-29cc-4dda-bcb8-728cf5b6851e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:54:59.898395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:59.899436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:59.900772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:54:59.907952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:54:59.949365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] HTTP exception thrown: Instance 205806e2-29cc-4dda-bcb8-728cf5b6851e could not be found. Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Request method failure captured: Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e HTTP/1.1 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi197m1_7bdUYA6RcWOl4gFWc5gO1J_g_zvPZBBqolrx9Bkrh5HkCViP8q5D47Dy1IlLGM-JE087Z19auG6FQb0q3NINkdsAWK4iYVIT8pGq9EyayWcBdtwnl0zEU8HP8YQv0dx4yjZ2UuvPi93uUkdLW1xr8yKkXSbTcPR5jyho1HhZY Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ee539bf2a8d846bea8c27f20ba8961f4 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerPasswordTestJSON-71795298 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee539bf2a8d846bea8c27f20ba8961f4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee539bf2a8d846bea8c27f20ba8961f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee539bf2a8d846bea8c27f20ba8961f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee539bf2a8d846bea8c27f20ba8961f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerPasswordTestJSON-71795298 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ee539bf2a8d846bea8c27f20ba8961f4 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerPasswordTestJSON-71795298 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerPasswordTestJSON-71795298-project Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: fff674b9617b443299acb89f13e58c97 Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerPasswordTestJSON-71795298-project Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 205806e2-29cc-4dda-bcb8-728cf5b6851e could not be found. Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '205806e2-29cc-4dda-bcb8-728cf5b6851e'} Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205806e2-29cc-4dda-bcb8-728cf5b6851e could not be found. Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205806e2-29cc-4dda-bcb8-728cf5b6851e could not be found. Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:54:59.969573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205806e2-29cc-4dda-bcb8-728cf5b6851e could not be found. Jul 20 10:54:59.975254 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:54:59.979200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] Returning 404 to user: Instance 205806e2-29cc-4dda-bcb8-728cf5b6851e could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:54:59.979200 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e1e9c3e-d1ef-4d8f-b9ed-661fa7c47ca6 tempest-ServerPasswordTestJSON-71795298 tempest-ServerPasswordTestJSON-71795298-project] 10.222.0.79 "GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e" status: 404 len: 111 microversion: 2.1 time: 0.119972 Jul 20 10:54:59.984472 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 915/1900] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:59 2022] GET /compute/v2.1/servers/205806e2-29cc-4dda-bcb8-728cf5b6851e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:00.118107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:00.133933 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d62150a1-5308-477b-aaeb-67777a8cfacf tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1313 microversion: 2.1 time: 1.387816 Jul 20 10:55:00.136163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 986/1901] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:54:58 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1313 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:00.874690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:00.876141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:00.889736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:00.894998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:00.898567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:00.900197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:01.152629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:01.153292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:01.168555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:01.169477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:01.171679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:01.181735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:01.828620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:01.838026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:01.839611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:01.840806 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e63dbb2e-9ddf-4c0d-aa43-4debea94eacf tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 0.970855 Jul 20 10:55:01.851685 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 916/1902] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:00 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:55:01.910504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:01.933915 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef5a6fb7-1eb3-4c4a-b78a-99097833fc00 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1463 microversion: 2.1 time: 0.785416 Jul 20 10:55:01.948181 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 987/1903] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:01 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1463 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:55:02.463315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c56ebe3-42fe-4faa-9a80-d8ae3e2b6df2 tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Calling method '.version_select at 0x7f2c3eeee0d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:02.534428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c56ebe3-42fe-4faa-9a80-d8ae3e2b6df2 tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.539519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c56ebe3-42fe-4faa-9a80-d8ae3e2b6df2 tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.621576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c56ebe3-42fe-4faa-9a80-d8ae3e2b6df2 tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.627593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c56ebe3-42fe-4faa-9a80-d8ae3e2b6df2 tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.678386 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c56ebe3-42fe-4faa-9a80-d8ae3e2b6df2 tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/240d79e50d2f47bd8818427d9f7945c3?start=2022-07-19T10%3A55%3A01.958604&end=2022-07-21T10%3A55%3A01.958604" status: 200 len: 694 microversion: 2.1 time: 0.709033 Jul 20 10:55:02.679377 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 917/1904] 10.222.0.79 () {58 vars in 1411 bytes} [Wed Jul 20 10:55:01 2022] GET /compute/v2.1/os-simple-tenant-usage/240d79e50d2f47bd8818427d9f7945c3?start=2022-07-19T10%3A55%3A01.958604&end=2022-07-21T10%3A55%3A01.958604 => generated 694 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:02.694568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-76149d0e-27b9-4f38-ada2-bcfe0b2d142e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '.version_select at 0x7f2c3f9f2a60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:02.711009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76149d0e-27b9-4f38-ada2-bcfe0b2d142e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.712057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76149d0e-27b9-4f38-ada2-bcfe0b2d142e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.736926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76149d0e-27b9-4f38-ada2-bcfe0b2d142e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.737705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76149d0e-27b9-4f38-ada2-bcfe0b2d142e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.816227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-76149d0e-27b9-4f38-ada2-bcfe0b2d142e tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/240d79e50d2f47bd8818427d9f7945c3?start=2022-07-19T10%3A55%3A01.958604&end=2022-07-21T10%3A55%3A01.958604" status: 200 len: 694 microversion: 2.1 time: 0.122580 Jul 20 10:55:02.821342 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 988/1905] 10.222.0.79 () {58 vars in 1411 bytes} [Wed Jul 20 10:55:02 2022] GET /compute/v2.1/os-simple-tenant-usage/240d79e50d2f47bd8818427d9f7945c3?start=2022-07-19T10%3A55%3A01.958604&end=2022-07-21T10%3A55%3A01.958604 => generated 694 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:02.838111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f5803e1-9728-4f2b-88c5-2fed49e169ea tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Calling method '.version_select at 0x7f2c3eeee310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:02.852451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f5803e1-9728-4f2b-88c5-2fed49e169ea tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.853164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f5803e1-9728-4f2b-88c5-2fed49e169ea tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.862836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:02.863953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:02.887828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.888713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.894969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.905782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:02.942988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f5803e1-9728-4f2b-88c5-2fed49e169ea tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:02.945396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f5803e1-9728-4f2b-88c5-2fed49e169ea tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:03.208567 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f5803e1-9728-4f2b-88c5-2fed49e169ea tempest-TenantUsagesTestJSON-1300472487 tempest-TenantUsagesTestJSON-1300472487-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T10%3A55%3A01.958604&end=2022-07-21T10%3A55%3A01.958604&detailed=1" status: 200 len: 23176 microversion: 2.1 time: 0.375388 Jul 20 10:55:03.213156 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 918/1906] 10.222.0.79 () {58 vars in 1334 bytes} [Wed Jul 20 10:55:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-19T10%3A55%3A01.958604&end=2022-07-21T10%3A55%3A01.958604&detailed=1 => generated 23176 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:55:03.220360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d7bb4f3-e636-4548-a64e-c3c3cb5ed54a tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Action: 'create', calling method: .version_select at 0x7f2c3ee3e310>, body: {"keypair": {"name": "tempest-keypair-1823760745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRZGZn/o12Katxt1RBZM2547JFtoFjSsSV/AsAMSNCUDXBW2dFRkpcwbDLkijg6y6yXV4EYzkJf/v1EAKEmi1Ifhj7Vbi84VGnqCQBGWdq+m98KQhVP3OY09kwtZcRgpQ=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:03.242011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-9d7bb4f3-e636-4548-a64e-c3c3cb5ed54a tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Getting quotas for project f595bedf58af4d0d9b1866f28148b42b. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:03.258512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-9d7bb4f3-e636-4548-a64e-c3c3cb5ed54a tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Getting quotas for user f8ca8707ab044974b65cd49346ec2618 and project f595bedf58af4d0d9b1866f28148b42b. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:03.305027 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d7bb4f3-e636-4548-a64e-c3c3cb5ed54a tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.090626 Jul 20 10:55:03.316749 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 919/1907] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 10:55:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 10:55:03.328811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:03.329499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:03.347212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:03.347702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:03.348505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:03.348953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:03.410701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:55:03.608724 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7032dd7-fdbb-43af-bcda-42ab2877b8be tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 204 len: 0 microversion: 2.1 time: 0.290092 Jul 20 10:55:03.620292 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 920/1908] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:55:03 2022] DELETE /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:55:03.900389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a29868f-7f06-40df-b5a8-db3d21141e02 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] Action: 'create', calling method: .version_select at 0x7f2c3edce550>, body: {"security_group": {"name": "tempest-securitygroup-1781249223", "description": "tempest-description-1816140017"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:04.148909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:04.163044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:04.173155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:04.175151 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b9113bfe-6713-4ba0-81dd-975159bce698 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 1.316921 Jul 20 10:55:04.175950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 989/1909] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:02 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:55:04.180882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:04.187448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:04.207014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:04.207779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:04.208735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:04.209338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:04.882203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:04.900863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-727289a6-9951-4a6e-9ea4-3b8e64408951 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1469 microversion: 2.1 time: 0.722671 Jul 20 10:55:04.906268 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 990/1910] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:04 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1469 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:05.196083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:05.197573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:05.211922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:05.216793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:05.219993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:05.221791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:05.340711 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a29868f-7f06-40df-b5a8-db3d21141e02 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.718569 Jul 20 10:55:05.341449 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 921/1911] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:55:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:05.432328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2bd4d9be-906e-4507-a811-2903e15584f2 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] Action: 'create', calling method: .version_select at 0x7f2c3ee3edc0>, body: {"security_group": {"name": "tempest-securitygroup-2046696216", "description": "tempest-description-1083654978"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:06.361434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:06.370729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:06.376771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:06.384295 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4b3ac179-6ab1-4d64-98b5-f91cdc71d121 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 1.194390 Jul 20 10:55:06.385390 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 991/1912] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:05 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:06.391918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:06.406847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:06.447469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:06.450543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:06.452570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:06.453388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:06.724343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f97bc970fd68474292d14cb84eb5c4c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '240d79e50d2f47bd8818427d9f7945c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:06.752460 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44a62608-60c4-473e-82a8-a4be6ad1114d tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 200 len: 1427 microversion: 2.1 time: 0.365898 Jul 20 10:55:06.756296 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 992/1913] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:06 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 1427 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:06.802210 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2bd4d9be-906e-4507-a811-2903e15584f2 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.373311 Jul 20 10:55:06.805679 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 922/1914] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:55:05 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:55:06.981612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2ed77a6c-e673-4497-b8e6-952281fbd667 req-0cdf26a3-d88a-4df9-b1a3-bcd629f45c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b1585e-c803-481c-b165-621367e6f92c", "name": "network-vif-deleted", "tag": "272e873a-1430-4b58-ac34-551400eb7a94"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:07.053366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2ed77a6c-e673-4497-b8e6-952281fbd667 req-0cdf26a3-d88a-4df9-b1a3-bcd629f45c8d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:07.057523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2ed77a6c-e673-4497-b8e6-952281fbd667 req-0cdf26a3-d88a-4df9-b1a3-bcd629f45c8d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:07.135294 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2ed77a6c-e673-4497-b8e6-952281fbd667 req-0cdf26a3-d88a-4df9-b1a3-bcd629f45c8d service nova] Creating event network-vif-deleted:272e873a-1430-4b58-ac34-551400eb7a94 for instance 32b1585e-c803-481c-b165-621367e6f92c on n-h2-846219-10 Jul 20 10:55:07.158268 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2ed77a6c-e673-4497-b8e6-952281fbd667 req-0cdf26a3-d88a-4df9-b1a3-bcd629f45c8d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193461 Jul 20 10:55:07.172062 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 923/1915] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:07.407156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:07.408187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:07.409048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-947208bf-e84e-41fd-bb34-ab79729a3ac1 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] Action: 'create', calling method: .version_select at 0x7f2c50d69940>, body: {"security_group": {"name": "tempest-securitygroup-1887618402", "description": "tempest-description-109033493"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:07.427350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:07.428295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:07.429420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:07.433562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:08.554369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:08.605484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:08.609722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:08.613122 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fdca3d6a-fdfb-4f3b-918a-d3d2a2eb3d21 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 1.211159 Jul 20 10:55:08.624470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 924/1916] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:07 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:08.630551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:08.635701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] [instance: 32b1585e-c803-481c-b165-621367e6f92c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:08.657220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:08.661581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:08.662736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:08.664377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:08.671449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:08.704430 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] HTTP exception thrown: Instance 32b1585e-c803-481c-b165-621367e6f92c could not be found. Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Request method failure captured: Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c HTTP/1.1 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi197vJPioMiJw4Isw9U5E92mCbFwLjNbQvo2kSeSy9NT_R9ssA19dNTm6gU7HhJaf2fe_Oc3Ww4oVT1oCSj1jlwEOY8s7nftRKAc3VKGcKOmC0zj2nSuS7TLpKM_DJs_SoUwYDs_z8GsqG_lfRGGb-09RYSbSYgid3tUAYmBEHyi_YOY Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 240d79e50d2f47bd8818427d9f7945c3 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TenantUsagesTestJSON-1530768082 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_240d79e50d2f47bd8818427d9f7945c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/240d79e50d2f47bd8818427d9f7945c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/240d79e50d2f47bd8818427d9f7945c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/240d79e50d2f47bd8818427d9f7945c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TenantUsagesTestJSON-1530768082 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 240d79e50d2f47bd8818427d9f7945c3 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1530768082 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TenantUsagesTestJSON-1530768082-project Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: f97bc970fd68474292d14cb84eb5c4c9 Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TenantUsagesTestJSON-1530768082-project Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 32b1585e-c803-481c-b165-621367e6f92c could not be found. Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '32b1585e-c803-481c-b165-621367e6f92c'} Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b1585e-c803-481c-b165-621367e6f92c could not be found. Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b1585e-c803-481c-b165-621367e6f92c could not be found. Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:08.707211 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b1585e-c803-481c-b165-621367e6f92c could not be found. Jul 20 10:55:08.712571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:08.713876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] Returning 404 to user: Instance 32b1585e-c803-481c-b165-621367e6f92c could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:55:08.714800 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-242d4d6d-3e96-4109-9f28-a93ba060cac6 tempest-TenantUsagesTestJSON-1530768082 tempest-TenantUsagesTestJSON-1530768082-project] 10.222.0.79 "GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c" status: 404 len: 111 microversion: 2.1 time: 0.088651 Jul 20 10:55:08.724081 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 925/1917] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:08 2022] GET /compute/v2.1/servers/32b1585e-c803-481c-b165-621367e6f92c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:09.513791 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-947208bf-e84e-41fd-bb34-ab79729a3ac1 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.701021 Jul 20 10:55:09.516573 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 993/1918] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:55:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:09.529219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e13cc17-e193-4a02-9b5b-e1fcf601561f tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] Action: 'create', calling method: .version_select at 0x7f2c3ee828b0>, body: {"security_group": {"name": "tempest-securitygroup-1130978599", "description": "tempest-description-1736972012"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:09.659221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:09.659221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:09.674156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:09.674909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:09.675947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:09.676394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:10.359485 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e13cc17-e193-4a02-9b5b-e1fcf601561f tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.835636 Jul 20 10:55:10.367348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 926/1919] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:55:09 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:55:10.469148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:10.488164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:10.503513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:10.504736 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad9c0792-a2d7-4868-97b5-eb7fe2931cb5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 0.850599 Jul 20 10:55:10.505214 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 994/1920] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:09 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:55:10.523463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81d65849-19bf-4d13-83dd-2241acd86ed6 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] Calling method '.version_select at 0x7f2c50d69ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:10.849053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1877119379", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "52850ecb-77bc-4f61-b6f0-47ce5e971f9f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:10.968277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] validate_networks() for [('52850ecb-77bc-4f61-b6f0-47ce5e971f9f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:55:12.736185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:12.935828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:13.270607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:13.394051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:13.394564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:13.395122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:13.395628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:13.396115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:13.409699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:13.410910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:13.412117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:13.412785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:13.434394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=7 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:13.452038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Getting quotas for project f5f06f30aefd48fc944292795da922ac. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:13.460038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Getting quotas for user d22e86a63c954ed1ae4bbeae23bf5296 and project f5f06f30aefd48fc944292795da922ac. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:13.477843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:55:13.487450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:55:13.610262 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ecabfcd6-a7e9-42a9-ad3f-3b762ea585e8 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.228023 Jul 20 10:55:13.610262 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 927/1921] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:55:13.620392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:13.624733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:13.644803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:13.646245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:13.648690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:13.649951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:14.200688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:14.236157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:14.242801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:14.250072 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9ae9046b-8946-432a-81ec-e431ad30ef50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 0.649097 Jul 20 10:55:14.253472 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 928/1922] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:13 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:14.270780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:14.272586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:14.299953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:14.302624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:14.308320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:14.309531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:14.418056 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aedfd8b9-89e5-4923-863c-53a3ed8838ba tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.162909 Jul 20 10:55:14.419092 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 929/1923] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:55:14 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:55:14.973933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1890296144", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": "none"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:15.180821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:15.181467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:15.183585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:15.184906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:15.185345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:15.218454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:15.219359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:15.220611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:15.221211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:15.287826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Getting quotas for project 99e51000154b4d5f9f2418d78ca12480. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:15.297383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Getting quotas for user 1d3fa604da274658a7590bad726f217f and project 99e51000154b4d5f9f2418d78ca12480. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:15.327297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:55:15.336938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:55:15.460114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-442aa94a-95f5-42b4-b59b-ff8111f9740d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.039021 Jul 20 10:55:15.494571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 930/1924] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:55:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:55:16.031202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e1f3bfc7-4b64-4472-a73d-9041b89cd2ce tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Action: 'create', calling method: .version_select at 0x7f2c3ee821f0>, body: {"pool": null} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:18.352248 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81d65849-19bf-4d13-83dd-2241acd86ed6 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11614 microversion: 2.1 time: 7.845912 Jul 20 10:55:18.352953 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 995/1925] 10.222.0.79 () {58 vars in 1190 bytes} [Wed Jul 20 10:55:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11614 bytes in 7847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:55:18.366563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1055220277", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6455e120-8cd7-43dd-af87-3a7e97d63668"}, {"port": "43fd4ffa-6bca-4aac-b6cc-fccb361cf680", "tag": "port-1"}, {"port": "49fa9fc9-d879-4192-864a-efb8c87674fb", "tag": "port-2"}, {"uuid": "74af1a8c-230b-4e38-9818-050065a1ff40", "tag": "net-1"}, {"uuid": "74af1a8c-230b-4e38-9818-050065a1ff40"}, {"uuid": "ad074424-745d-4656-b50c-18ae3e66766a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ad074424-745d-4656-b50c-18ae3e66766a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2c38f3c7-e2b8-4a36-8561-872c511f5a17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "32082630-6550-4a8a-a1a3-6f77431e06db", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "00144951-40b7-47db-8d86-ae83f0d5bd8e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--488849789"}], "key_name": "tempest-keypair-1823760745", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:19.029262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] validate_networks() for [('6455e120-8cd7-43dd-af87-3a7e97d63668', None, None, None, None, None), (None, None, '43fd4ffa-6bca-4aac-b6cc-fccb361cf680', None, None, None), (None, None, '49fa9fc9-d879-4192-864a-efb8c87674fb', None, None, None), ('74af1a8c-230b-4e38-9818-050065a1ff40', None, None, None, None, None), ('74af1a8c-230b-4e38-9818-050065a1ff40', None, None, None, None, None), ('ad074424-745d-4656-b50c-18ae3e66766a', '10.2.2.100', None, None, None, None), ('ad074424-745d-4656-b50c-18ae3e66766a', '10.2.2.200', None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:55:20.476623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=60 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:21.054116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e1f3bfc7-4b64-4472-a73d-9041b89cd2ce tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.551903 Jul 20 10:55:21.054737 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 931/1926] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:55:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:21.060852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-921933111", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "52850ecb-77bc-4f61-b6f0-47ce5e971f9f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:21.121168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] validate_networks() for [('52850ecb-77bc-4f61-b6f0-47ce5e971f9f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:55:22.333389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:22.335051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:22.335722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:22.336376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:22.336957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:22.348637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:22.349937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:22.351471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:22.351787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:22.377356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Getting quotas for project f5f06f30aefd48fc944292795da922ac. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:22.384464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Getting quotas for user d22e86a63c954ed1ae4bbeae23bf5296 and project f5f06f30aefd48fc944292795da922ac. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:22.402845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:55:22.407313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:55:22.463815 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85e09f53-333e-4539-80b3-a7a2e3e2050b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407685 Jul 20 10:55:22.464845 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 932/1927] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:55:22.470494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:22.471832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:22.479992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:22.480664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:22.483014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:22.484159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:22.534050 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7bbb93ec-64a3-401c-9298-903913676723 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067915 Jul 20 10:55:22.534865 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 933/1928] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:55:22 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:55:22.557211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:22.557834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:22.574507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:22.574954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:22.575775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:22.576299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:23.270758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:23.298402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:23.310547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:23.313297 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a3f12ee-0015-4d8d-a35a-52edf0ffeb9f tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 0.776867 Jul 20 10:55:23.316664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 934/1929] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:22 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:23.332382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:23.335533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:23.350511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:23.353831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:23.358998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:23.359954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:23.640380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:23.649914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:23.651707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:23.653182 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c81c58f-56c5-4eea-aeca-0fcc43d5dfc6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1357 microversion: 2.57 time: 0.326001 Jul 20 10:55:23.663782 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 935/1930] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:23 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:23.673850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b186409-ebff-477d-abd5-35db7d7c0d30 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] Calling method '.version_select at 0x7f2c3eeea040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:24.206309 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b186409-ebff-477d-abd5-35db7d7c0d30 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.540621 Jul 20 10:55:24.207944 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 936/1931] 10.222.0.79 () {58 vars in 1190 bytes} [Wed Jul 20 10:55:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:24.217489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-04bdde2c-5bae-496b-a10d-7bacdfcf7ef1 req-708513dd-a832-4e09-954a-d24bcb10083a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c561681-3ac8-474b-8b91-e4d18b788ad4", "tag": "a49c07e3-44f1-4c93-a523-3bdc739473a0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:24.236813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-04bdde2c-5bae-496b-a10d-7bacdfcf7ef1 req-708513dd-a832-4e09-954a-d24bcb10083a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:24.238863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-04bdde2c-5bae-496b-a10d-7bacdfcf7ef1 req-708513dd-a832-4e09-954a-d24bcb10083a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:24.266790 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-04bdde2c-5bae-496b-a10d-7bacdfcf7ef1 req-708513dd-a832-4e09-954a-d24bcb10083a service nova] Creating event network-changed:a49c07e3-44f1-4c93-a523-3bdc739473a0 for instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 on n-h2-846219-10 Jul 20 10:55:24.276449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-04bdde2c-5bae-496b-a10d-7bacdfcf7ef1 req-708513dd-a832-4e09-954a-d24bcb10083a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065851 Jul 20 10:55:24.283711 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 937/1932] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:24.293177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-abf9b619-82b7-444e-bbc7-9944cfda2017 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Calling method '.version_select at 0x7f2c3eeea0d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:24.892216 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-abf9b619-82b7-444e-bbc7-9944cfda2017 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/e04d00ee-eac0-4d0f-beb0-ecf9c5e058b9" status: 200 len: 142 microversion: 2.1 time: 0.606293 Jul 20 10:55:24.894883 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 938/1933] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:55:24 2022] GET /compute/v2.1/os-floating-ips/e04d00ee-eac0-4d0f-beb0-ecf9c5e058b9 => generated 142 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:24.913765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:24.914695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:24.937052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:24.938223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:24.939476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:24.940211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:24.983119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:55:25.158468 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f2e0534b-6253-448a-acd8-03c0b9625643 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 204 len: 0 microversion: 2.1 time: 0.256579 Jul 20 10:55:25.160953 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 939/1934] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:55:24 2022] DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:55:25.221567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-954734794", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "451", "networks": [{"uuid": "52850ecb-77bc-4f61-b6f0-47ce5e971f9f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:25.375930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] validate_networks() for [('52850ecb-77bc-4f61-b6f0-47ce5e971f9f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:55:25.628298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:25.629260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:25.629994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:25.630704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:25.631384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:25.634882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=30 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:25.643370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:25.643370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:25.644823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:25.645149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:25.668352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Getting quotas for project f595bedf58af4d0d9b1866f28148b42b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:25.680776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Getting quotas for user f8ca8707ab044974b65cd49346ec2618 and project f595bedf58af4d0d9b1866f28148b42b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:25.990980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:55:25.999952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2c38f3c7-e2b8-4a36-8561-872c511f5a17',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='32082630-6550-4a8a-a1a3-6f77431e06db',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00144951-40b7-47db-8d86-ae83f0d5bd8e',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:55:26.754641 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d30d3e04-1166-49c5-be28-2013f7f13707 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.398223 Jul 20 10:55:26.758176 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 996/1935] 10.222.0.79 () {62 vars in 1188 bytes} [Wed Jul 20 10:55:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 8404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:55:26.775147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:26.782575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:26.809569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:26.810334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:26.813701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:26.814384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:26.970750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:26.971300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:26.971806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:26.973239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:26.973782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:27.022442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:27.023439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:27.024075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:27.024854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:27.025712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:27.051324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:27.052324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:27.053352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:27.054121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:27.082534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:27.090290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:27.090751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:27.091580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:27.093656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:27.098615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Getting quotas for project f5f06f30aefd48fc944292795da922ac. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:27.109609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Getting quotas for user d22e86a63c954ed1ae4bbeae23bf5296 and project f5f06f30aefd48fc944292795da922ac. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:27.133980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:55:27.142124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:55:27.260728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5bd58c63-6379-4356-930e-e219b29f47ed tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "POST /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50/action" status: 202 len: 1138 microversion: 2.57 time: 0.498164 Jul 20 10:55:27.261724 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 997/1936] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Jul 20 10:55:26 2022] POST /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50/action => generated 1138 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 10:55:27.287515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6277415a-f377-4d74-aab1-510f325313e0 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] Calling method '.version_select at 0x7f2c50d849d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:27.322883 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-142e74ba-745d-4eed-a78f-eba2843c6f8d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126984 Jul 20 10:55:27.326380 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 940/1937] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:55:27.342140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:27.343228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:27.372178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:27.372807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:27.383669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:27.385362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:28.433017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:28.456964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:28.461583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:28.464041 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b553d618-3a8e-4fad-8681-293783387c66 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 1.134856 Jul 20 10:55:28.481181 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 941/1938] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:27 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:28.510422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3fbd7f20-f1de-4c96-bc01-13b4dce28864 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Calling method '.version_select at 0x7f2c3ee97670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:29.345545 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3fbd7f20-f1de-4c96-bc01-13b4dce28864 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.861721 Jul 20 10:55:29.346236 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 942/1939] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 10:55:28 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:29.350867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-79273ebe-25dd-43e4-b5a6-90fa46aab47b req-ce79fe0f-c691-448a-b6fe-5b9b151e4aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c561681-3ac8-474b-8b91-e4d18b788ad4", "name": "network-vif-plugged", "status": "completed", "tag": "a49c07e3-44f1-4c93-a523-3bdc739473a0"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:29.400822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-79273ebe-25dd-43e4-b5a6-90fa46aab47b req-ce79fe0f-c691-448a-b6fe-5b9b151e4aff service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.401392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-79273ebe-25dd-43e4-b5a6-90fa46aab47b req-ce79fe0f-c691-448a-b6fe-5b9b151e4aff service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.435094 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-79273ebe-25dd-43e4-b5a6-90fa46aab47b req-ce79fe0f-c691-448a-b6fe-5b9b151e4aff service nova] Creating event network-vif-plugged:a49c07e3-44f1-4c93-a523-3bdc739473a0 for instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 on n-h2-846219-10 Jul 20 10:55:29.447520 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6277415a-f377-4d74-aab1-510f325313e0 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/bcd8af15-ec29-4dd8-a65b-e79f7525d7af" status: 202 len: 0 microversion: 2.1 time: 2.166264 Jul 20 10:55:29.451556 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 998/1940] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:55:27 2022] DELETE /compute/v2.1/os-security-groups/bcd8af15-ec29-4dd8-a65b-e79f7525d7af => generated 0 bytes in 2186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:29.454608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:29.456382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:29.461312 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-79273ebe-25dd-43e4-b5a6-90fa46aab47b req-ce79fe0f-c691-448a-b6fe-5b9b151e4aff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113717 Jul 20 10:55:29.464736 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 943/1941] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:29.472020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1c28c191-3292-4b1f-8393-0ef6836f7544 req-0b335c83-def0-496c-856a-05e0966f0297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde6bc00-8ace-4d73-bbef-3a7881815a7a", "name": "network-vif-unplugged", "status": "completed", "tag": "7ba34fe2-c8a3-4457-aee8-76e7eb387638"}, {"name": "network-changed", "server_uuid": "cde6bc00-8ace-4d73-bbef-3a7881815a7a", "tag": "7ba34fe2-c8a3-4457-aee8-76e7eb387638"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:29.481196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.481839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.483536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.484107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.521715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1c28c191-3292-4b1f-8393-0ef6836f7544 req-0b335c83-def0-496c-856a-05e0966f0297 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.532910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1c28c191-3292-4b1f-8393-0ef6836f7544 req-0b335c83-def0-496c-856a-05e0966f0297 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.587516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1c28c191-3292-4b1f-8393-0ef6836f7544 req-0b335c83-def0-496c-856a-05e0966f0297 service nova] Creating event network-vif-unplugged:7ba34fe2-c8a3-4457-aee8-76e7eb387638 for instance cde6bc00-8ace-4d73-bbef-3a7881815a7a on n-h1-846219-10 Jul 20 10:55:29.590714 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1c28c191-3292-4b1f-8393-0ef6836f7544 req-0b335c83-def0-496c-856a-05e0966f0297 service nova] Creating event network-changed:7ba34fe2-c8a3-4457-aee8-76e7eb387638 for instance cde6bc00-8ace-4d73-bbef-3a7881815a7a on n-h1-846219-10 Jul 20 10:55:29.608387 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1c28c191-3292-4b1f-8393-0ef6836f7544 req-0b335c83-def0-496c-856a-05e0966f0297 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.141324 Jul 20 10:55:29.609179 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 944/1942] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:29.627208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:29.636266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:29.666796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.667637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.668668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.669372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.940341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4031d68fdd34d04885cf9cc999bf4d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30c5b0c0ee4b78afb0206701192a3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:29.965713 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e5fed15-25dc-46dd-bf25-3558bc4f0599 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 200 len: 1324 microversion: 2.1 time: 0.515788 Jul 20 10:55:29.966592 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 999/1943] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:29 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:29.977853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:29.984035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:29.995719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.996490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:29.998252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:29.998932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:30.223036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.242523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.248048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.249364 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d44a7df-351a-419e-b5d8-f5c69f2a0f76 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1576 microversion: 2.42 time: 0.638774 Jul 20 10:55:30.256755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 945/1944] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:29 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1576 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:30.262902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:30.263826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:30.270451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:30.271126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:30.272114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:30.272748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:30.349428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.358918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.383380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.389405 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad1624a9-3c9f-4c74-bca3-8284d2d05a5d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.421008 Jul 20 10:55:30.390326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1000/1945] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:29 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:30.408603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-acab9beb-d572-4d6e-8277-f66f83e04a6a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Calling method '.version_select at 0x7f2c50d695e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:30.723878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:30.741256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c85d605-47c0-4906-96a1-db0058f47c62 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1290 microversion: 2.1 time: 0.481972 Jul 20 10:55:30.741916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 946/1946] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:30 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1290 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:30.756786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92b928cb-51b6-4d8b-8483-2054f2e3d601 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] Calling method '.version_select at 0x7f2c3ee820d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:32.552484 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92b928cb-51b6-4d8b-8483-2054f2e3d601 tempest-SecurityGroupsTestAdminJSON-1626274460 tempest-SecurityGroupsTestAdminJSON-1626274460-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/615eae38-a9cc-4fbf-9317-f85d38458d21" status: 202 len: 0 microversion: 2.1 time: 1.809265 Jul 20 10:55:32.554342 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 947/1947] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:55:30 2022] DELETE /compute/v2.1/os-security-groups/615eae38-a9cc-4fbf-9317-f85d38458d21 => generated 0 bytes in 1811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:32.562103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:32.572893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:32.588015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:32.592383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:32.596419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:32.599315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:33.649302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:33.661000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:33.667405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:33.671161 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72d188f9-1eb8-4792-8f12-95a8f88d3a1c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1486 microversion: 2.25 time: 1.115747 Jul 20 10:55:33.673207 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 948/1948] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:32 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1486 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:33.698060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:33.701918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:33.713937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:33.717352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:33.720801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:33.721467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:33.762156 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] HTTP exception thrown: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Request method failure captured: Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df HTTP/1.1 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi194czVPo1n_pFlflaXy6R1-Vee89XrCjXfuXWN-NeQh7huK9glmdV7oiqUJMugafeOSmQ9bastxXA4wkoTUoAyAXMY_2wD39SLkYkANzzLQyJ7Pyp1bpSCXbF4GyTgkFX8HWpmPC7vby3_FtJzucvM-QlR1B0Skl-QE6NUDu82Vcrz4 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 3c30c5b0c0ee4b78afb0206701192a3b Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c30c5b0c0ee4b78afb0206701192a3b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 3c30c5b0c0ee4b78afb0206701192a3b Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachSCSIVolumeTestJSON-806150202-project Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c4031d68fdd34d04885cf9cc999bf4d1 Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-806150202-project Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f172f524-ae19-4718-848e-2c6c601750df'} Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:33.775266 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:33.778330 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:33.781662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Returning 404 to user: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:55:33.782765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f710b174-63a3-4e91-aab0-f046f6b6ef56 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 404 len: 111 microversion: 2.1 time: 0.094463 Jul 20 10:55:33.784233 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 949/1949] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:33 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:33.793600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:33.794616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:33.798992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:33.819239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:33.824877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:33.827327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:33.834350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:34.780198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:34.798949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:34.823141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:34.826583 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3175cb0d-d7f6-40ad-b95f-201ccb0c4128 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1661 microversion: 2.42 time: 1.040506 Jul 20 10:55:34.828508 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 950/1950] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:33 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1661 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:34.841051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:34.843317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:34.861581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:34.862901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:34.864059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:34.864635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:35.297452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:35.330748 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-acab9beb-d572-4d6e-8277-f66f83e04a6a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/e04d00ee-eac0-4d0f-beb0-ecf9c5e058b9" status: 202 len: 0 microversion: 2.1 time: 4.935779 Jul 20 10:55:35.333865 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1001/1951] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:55:30 2022] DELETE /compute/v2.1/os-floating-ips/e04d00ee-eac0-4d0f-beb0-ecf9c5e058b9 => generated 0 bytes in 4943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:35.341571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:35.344053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:35.345841 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-902b7c64-356e-48cb-80d5-863d19e0d90b tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.515027 Jul 20 10:55:35.346516 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 951/1952] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:34 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:35.359226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-03be5a1d-a8b9-47ea-9456-bd0276b84cea req-749e6d95-b575-402e-b680-a1da6395c0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde6bc00-8ace-4d73-bbef-3a7881815a7a", "name": "network-vif-unplugged", "status": "completed", "tag": "7ba34fe2-c8a3-4457-aee8-76e7eb387638"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:35.384346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0060ad62-55b7-4a4b-9000-482748be6357 req-49b29634-e834-4925-97f5-09a0a180b17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f172f524-ae19-4718-848e-2c6c601750df", "name": "network-vif-deleted", "tag": "8d779160-fbcd-44f4-898a-2ddcbded933d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:35.400081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-03be5a1d-a8b9-47ea-9456-bd0276b84cea req-749e6d95-b575-402e-b680-a1da6395c0d9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:35.401449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-03be5a1d-a8b9-47ea-9456-bd0276b84cea req-749e6d95-b575-402e-b680-a1da6395c0d9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:35.432355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0060ad62-55b7-4a4b-9000-482748be6357 req-49b29634-e834-4925-97f5-09a0a180b17e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:35.432694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0060ad62-55b7-4a4b-9000-482748be6357 req-49b29634-e834-4925-97f5-09a0a180b17e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:35.458316 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0060ad62-55b7-4a4b-9000-482748be6357 req-49b29634-e834-4925-97f5-09a0a180b17e service nova] Creating event network-vif-deleted:8d779160-fbcd-44f4-898a-2ddcbded933d for instance f172f524-ae19-4718-848e-2c6c601750df on n-h1-846219-10 Jul 20 10:55:35.465908 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0060ad62-55b7-4a4b-9000-482748be6357 req-49b29634-e834-4925-97f5-09a0a180b17e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118147 Jul 20 10:55:35.471392 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 952/1953] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:35.484599 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-03be5a1d-a8b9-47ea-9456-bd0276b84cea req-749e6d95-b575-402e-b680-a1da6395c0d9 service nova] Creating event network-vif-unplugged:7ba34fe2-c8a3-4457-aee8-76e7eb387638 for instance cde6bc00-8ace-4d73-bbef-3a7881815a7a on n-h2-846219-10 Jul 20 10:55:35.490734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-03be5a1d-a8b9-47ea-9456-bd0276b84cea req-749e6d95-b575-402e-b680-a1da6395c0d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154445 Jul 20 10:55:35.491620 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1002/1954] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:35.496632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:35.497456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:35.507703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:35.508349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:35.509360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:35.509966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:35.533495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:35.658558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:35.692611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:35.760166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-888991628", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "ba902a31-3b1d-4754-b2cf-d3223978362f"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:35.902605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] validate_networks() for [('ba902a31-3b1d-4754-b2cf-d3223978362f', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:55:36.332763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:36.415007 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be612b0d-ec7f-41fa-9c32-26a670a200f1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1320 microversion: 2.1 time: 0.942193 Jul 20 10:55:36.423462 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 953/1955] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:35 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1320 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:36.437165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ca6379e2-cb07-4fe4-afd1-518ccedead7a tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] Calling method '.version_select at 0x7f2c3f303550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:37.070918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:37.123695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=24 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:37.665107 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ca6379e2-cb07-4fe4-afd1-518ccedead7a tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/8b88e313-d175-416c-a693-6a0631120e76" status: 202 len: 0 microversion: 2.1 time: 1.240012 Jul 20 10:55:37.666005 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 954/1956] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:55:36 2022] DELETE /compute/v2.1/os-security-groups/8b88e313-d175-416c-a693-6a0631120e76 => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:37.674833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3143acc-7130-4aff-98af-da00f18bc8d5 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '.version_select at 0x7f2c3ede1a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:37.724686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3143acc-7130-4aff-98af-da00f18bc8d5 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84482541" status: 202 len: 0 microversion: 2.1 time: 0.054806 Jul 20 10:55:37.726684 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 955/1957] 10.222.0.79 () {58 vars in 1214 bytes} [Wed Jul 20 10:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84482541 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:37.734193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:37.735226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:37.745192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:37.745914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:37.747140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:37.748527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:38.505884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:55:38.507041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:55:38.508356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:55:38.509044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:55:38.511532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:55:38.535017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:38.535909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:38.537128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:38.537897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:38.570650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:55:38.579208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for user 78f1e2aa093b45c2b9063b057251feab and project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:55:38.592062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:38.603696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:38.605839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:55:38.606677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:38.609644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:55:38.611527 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f3d31105-052a-4ff2-a961-8be290c1ac22 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1476 microversion: 2.25 time: 0.882852 Jul 20 10:55:38.616763 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 956/1958] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:37 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1476 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:38.640388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-da25a026-f3ea-4d4f-a036-b6b5f1ef04e5 req-e9153bf0-219d-4574-979b-2993a112f1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635dd2a0-b653-4c43-8602-c3aa1092900e", "tag": "fcd03379-316f-4f51-9233-1fb6290dc9d6"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:38.683596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-da25a026-f3ea-4d4f-a036-b6b5f1ef04e5 req-e9153bf0-219d-4574-979b-2993a112f1e6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:38.689735 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b9e8fb64-185b-455d-95cb-afb59b842a16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.194598 Jul 20 10:55:38.689927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-da25a026-f3ea-4d4f-a036-b6b5f1ef04e5 req-e9153bf0-219d-4574-979b-2993a112f1e6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:38.697036 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1003/1959] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:55:38.703683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-24a8f8f1-ae4a-4842-a1f9-b6c19573bd79 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Action: 'create', calling method: .version_select at 0x7f2c3f76e4c0>, body: {"pool": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:38.755802 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-da25a026-f3ea-4d4f-a036-b6b5f1ef04e5 req-e9153bf0-219d-4574-979b-2993a112f1e6 service nova] Creating event network-changed:fcd03379-316f-4f51-9233-1fb6290dc9d6 for instance 635dd2a0-b653-4c43-8602-c3aa1092900e on n-h1-846219-10 Jul 20 10:55:38.763896 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-da25a026-f3ea-4d4f-a036-b6b5f1ef04e5 req-e9153bf0-219d-4574-979b-2993a112f1e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143086 Jul 20 10:55:38.770875 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 957/1960] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:38.778230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:38.780146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:38.791017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:38.791899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:38.793180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:38.794961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:39.376546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:39.396946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:39.399309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:39.401141 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e8740d09-17c5-4ea3-9da0-bee65f5015b2 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1799 microversion: 2.42 time: 0.628339 Jul 20 10:55:39.413472 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 958/1961] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:38 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1799 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:39.426709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:39.427542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:39.443965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:39.444577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:39.446002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:39.449355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:39.705880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:39.724775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:39.734860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:39.740328 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d750ca3-1db0-45c9-8cd6-6572897a447e tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.322337 Jul 20 10:55:39.744419 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 959/1962] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:39 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:39.761929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:39.762843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:39.788797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:39.789328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:39.790225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:39.791517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:40.375618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:40.394394 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-673f9352-c25f-4364-8f67-9b0fbc0a6fdd tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1320 microversion: 2.1 time: 0.646333 Jul 20 10:55:40.407929 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 960/1963] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:39 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1320 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:40.415953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2aa50389-4652-4aa5-9ce8-8f1ace05e009 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] Calling method '.version_select at 0x7f2c3f73c5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:41.494950 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2aa50389-4652-4aa5-9ce8-8f1ace05e009 tempest-SecurityGroupsTestAdminJSON-293823490 tempest-SecurityGroupsTestAdminJSON-293823490-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ad18c6ef-c0ff-47ef-95e3-1138cd6c0884" status: 202 len: 0 microversion: 2.1 time: 1.085809 Jul 20 10:55:41.496295 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 961/1964] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:55:40 2022] DELETE /compute/v2.1/os-security-groups/ad18c6ef-c0ff-47ef-95e3-1138cd6c0884 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:41.506472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cf83ba68-da3a-4a0c-b078-08d7a260df77 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '.version_select at 0x7f2c3ede14c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:41.517080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf83ba68-da3a-4a0c-b078-08d7a260df77 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:41.519843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf83ba68-da3a-4a0c-b078-08d7a260df77 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:41.550827 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cf83ba68-da3a-4a0c-b078-08d7a260df77 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1713 microversion: 2.25 time: 0.052974 Jul 20 10:55:41.556105 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 962/1965] 10.222.0.79 () {60 vars in 1183 bytes} [Wed Jul 20 10:55:41 2022] GET /compute/v2.1/os-migrations => generated 1713 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:41.572858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:41.573920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:41.597115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:41.600090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:41.601298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:41.603141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:42.190121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:42.225427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c6c2401-f490-4e76-b840-d017f2562007 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1265 microversion: 2.1 time: 0.667647 Jul 20 10:55:42.231544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 963/1966] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:41 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1265 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:42.240074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:42.241747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:42.266415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:42.267474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:42.269002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:42.272226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:43.265586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:43.284558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:43.286191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:43.297550 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f57d2a2-b622-426f-b52c-010ada1e0d58 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1845 microversion: 2.42 time: 1.052999 Jul 20 10:55:43.300532 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 964/1967] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:42 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1845 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:43.316649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:43.318371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:43.333389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:43.337499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:43.340242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:43.342443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:43.569793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:43.584829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:43.589820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:43.594690 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6a38d5d8-e3ba-4401-bb2d-f3c7222ab3be tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.291947 Jul 20 10:55:43.596909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 965/1968] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:43 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:43.618892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e45560c2-bd68-4194-a496-27ca6799841b req-72f92cff-e2a0-43e4-8c09-863a9c15ef8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac793c66-c63a-4616-97b4-9bf0367c9c12", "tag": "aef43059-c894-40e7-8490-4411fe17c8c5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:43.644462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e45560c2-bd68-4194-a496-27ca6799841b req-72f92cff-e2a0-43e4-8c09-863a9c15ef8a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:43.645331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e45560c2-bd68-4194-a496-27ca6799841b req-72f92cff-e2a0-43e4-8c09-863a9c15ef8a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:43.703983 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e45560c2-bd68-4194-a496-27ca6799841b req-72f92cff-e2a0-43e4-8c09-863a9c15ef8a service nova] Creating event network-changed:aef43059-c894-40e7-8490-4411fe17c8c5 for instance ac793c66-c63a-4616-97b4-9bf0367c9c12 on n-h2-846219-10 Jul 20 10:55:43.717511 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e45560c2-bd68-4194-a496-27ca6799841b req-72f92cff-e2a0-43e4-8c09-863a9c15ef8a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118987 Jul 20 10:55:43.718788 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 966/1969] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:43.725436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:43.726931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:43.739022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:43.739900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:43.740983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:43.742230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:44.639395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:44.656135 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c999b8e2-05c9-4449-b6f5-b922a076944a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1320 microversion: 2.1 time: 0.935552 Jul 20 10:55:44.666107 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 967/1970] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:43 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1320 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:44.675619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:44.679600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:44.700191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:44.703873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:44.704863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:44.710060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:45.611405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] Lazy-loading 'services' on Instance uuid cde6bc00-8ace-4d73-bbef-3a7881815a7a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:55:45.648747 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8085f128-3149-4b14-b75d-3ec0c965e8c1 tempest-LiveAutoBlockMigrationV225Test-34151554 tempest-LiveAutoBlockMigrationV225Test-34151554-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1970 microversion: 2.25 time: 0.983672 Jul 20 10:55:45.650676 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 968/1971] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:44 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1970 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:45.658362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:45.659377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:45.668987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:45.670615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:45.681377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:45.682311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:46.472139 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-24a8f8f1-ae4a-4842-a1f9-b6c19573bd79 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.778082 Jul 20 10:55:46.475451 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1004/1972] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:55:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:46.484501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2c14c65a-6858-48fb-8438-5c295513f61a req-3e475f41-ee44-441e-9fcd-a8098eb965a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "d4904062-7549-4970-b00f-51b1691b28cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:46.522921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2c14c65a-6858-48fb-8438-5c295513f61a req-3e475f41-ee44-441e-9fcd-a8098eb965a9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:46.542940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2c14c65a-6858-48fb-8438-5c295513f61a req-3e475f41-ee44-441e-9fcd-a8098eb965a9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:46.566194 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2c14c65a-6858-48fb-8438-5c295513f61a req-3e475f41-ee44-441e-9fcd-a8098eb965a9 service nova] Creating event network-changed:d4904062-7549-4970-b00f-51b1691b28cb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:55:46.579286 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2c14c65a-6858-48fb-8438-5c295513f61a req-3e475f41-ee44-441e-9fcd-a8098eb965a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101009 Jul 20 10:55:46.582668 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1005/1973] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:46.595578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a054185e-d087-44d8-b5a3-9ecf7f9818ad req-6d16430a-8de2-446c-a100-f9c84bfcb874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635dd2a0-b653-4c43-8602-c3aa1092900e", "name": "network-vif-plugged", "status": "completed", "tag": "fcd03379-316f-4f51-9233-1fb6290dc9d6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:46.608692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a054185e-d087-44d8-b5a3-9ecf7f9818ad req-6d16430a-8de2-446c-a100-f9c84bfcb874 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:46.609759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a054185e-d087-44d8-b5a3-9ecf7f9818ad req-6d16430a-8de2-446c-a100-f9c84bfcb874 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:46.642369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a054185e-d087-44d8-b5a3-9ecf7f9818ad req-6d16430a-8de2-446c-a100-f9c84bfcb874 service nova] Creating event network-vif-plugged:fcd03379-316f-4f51-9233-1fb6290dc9d6 for instance 635dd2a0-b653-4c43-8602-c3aa1092900e on n-h1-846219-10 Jul 20 10:55:46.662194 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a054185e-d087-44d8-b5a3-9ecf7f9818ad req-6d16430a-8de2-446c-a100-f9c84bfcb874 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073267 Jul 20 10:55:46.667918 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1006/1974] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:46.696717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:46.699764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:46.733742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:46.734764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:46.738739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:46.741069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:46.806806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:46.819255 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-de203abf-5da0-43ec-b9b6-45a4ad29978e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1307 microversion: 2.1 time: 1.166969 Jul 20 10:55:46.822792 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 969/1975] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:45 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1307 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:46.829979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:46.834821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:46.853008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:46.855708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:46.857776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:46.858566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:47.589460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:47.604756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:47.606374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:47.608360 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c93c1280-ea05-46e0-9c61-8a0e9a0b2276 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.784070 Jul 20 10:55:47.608927 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 970/1976] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:46 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:47.628427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:47.640170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:47.647525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:47.648746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:47.649988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:47.650595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:47.664511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:47.695769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:47.697758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:47.708851 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec4b65c7-12cc-454b-b92a-e7061cc150d4 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.034860 Jul 20 10:55:47.715657 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1007/1977] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:46 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:47.736856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:47.741164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:47.765686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:47.766438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:47.767612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:47.768279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:47.829106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:55:48.085609 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6cdcde1-fcbc-4673-b639-6bd59914844c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 204 len: 0 microversion: 2.25 time: 0.364353 Jul 20 10:55:48.086641 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1008/1978] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:55:47 2022] DELETE /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:55:48.098350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-37b4aeaf-59a1-4547-8e30-342d756af884 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Calling method '.version_select at 0x7f2c3f9530d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:48.555273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:48.567000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:48.592302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:48.595625 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a55417c-cb49-4a18-a63a-293d016acad0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1320 microversion: 2.1 time: 0.969818 Jul 20 10:55:48.597387 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 971/1979] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:47 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1320 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:48.612792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:48.618435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:48.637046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:48.637772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:48.644739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:48.645845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:49.505296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:49.519992 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92ba07fa-3228-4390-82ae-cc868c82a392 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1307 microversion: 2.1 time: 0.919063 Jul 20 10:55:49.520597 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 972/1980] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:48 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1307 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:49.537911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:49.541489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:49.572981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:49.574522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:49.578596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:49.579760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.709953 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-37b4aeaf-59a1-4547-8e30-342d756af884 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217" status: 202 len: 0 microversion: 2.1 time: 2.619780 Jul 20 10:55:50.720696 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1009/1981] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:55:48 2022] DELETE /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217 => generated 0 bytes in 2633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:55:50.731892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:50.732922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:50.755715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.756597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.757739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.758446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.780781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:50.784781 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] HTTP exception thrown: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:50.789439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Request method failure captured: Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df HTTP/1.1 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi194czVPo1n_pFlflaXy6R1-Vee89XrCjXfuXWN-NeQh7huK9glmdV7oiqUJMugafeOSmQ9bastxXA4wkoTUoAyAXMY_2wD39SLkYkANzzLQyJ7Pyp1bpSCXbF4GyTgkFX8HWpmPC7vby3_FtJzucvM-QlR1B0Skl-QE6NUDu82Vcrz4 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 3c30c5b0c0ee4b78afb0206701192a3b Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c30c5b0c0ee4b78afb0206701192a3b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 3c30c5b0c0ee4b78afb0206701192a3b Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachSCSIVolumeTestJSON-806150202-project Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c4031d68fdd34d04885cf9cc999bf4d1 Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-806150202-project Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f172f524-ae19-4718-848e-2c6c601750df'} Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:55:50.825161 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:50.831028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:50.835608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Returning 404 to user: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:55:50.837411 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b14d384c-569d-4689-80e6-01e53ea673c2 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 404 len: 111 microversion: 2.1 time: 0.115155 Jul 20 10:55:50.839894 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1010/1982] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:55:50 2022] DELETE /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:50.844279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:50.846539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:50.852817 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2aa5efa6-3c1c-4225-86b3-c46ab0d6d362 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1482 microversion: 2.25 time: 1.330886 Jul 20 10:55:50.853632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e393644d-8dbd-4812-b3bf-e8b245ecd048 req-65a0f0f6-1024-4b05-a063-468af365cfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "43fd4ffa-6bca-4aac-b6cc-fccb361cf680"}, {"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "49fa9fc9-d879-4192-864a-efb8c87674fb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:50.854837 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 973/1983] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:49 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1482 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:50.867815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:50.869949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:50.882502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e393644d-8dbd-4812-b3bf-e8b245ecd048 req-65a0f0f6-1024-4b05-a063-468af365cfac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.882943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e393644d-8dbd-4812-b3bf-e8b245ecd048 req-65a0f0f6-1024-4b05-a063-468af365cfac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.888996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.889704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.890690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.891310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.921381 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e393644d-8dbd-4812-b3bf-e8b245ecd048 req-65a0f0f6-1024-4b05-a063-468af365cfac service nova] Creating event network-changed:43fd4ffa-6bca-4aac-b6cc-fccb361cf680 for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:55:50.923053 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e393644d-8dbd-4812-b3bf-e8b245ecd048 req-65a0f0f6-1024-4b05-a063-468af365cfac service nova] Creating event network-changed:49fa9fc9-d879-4192-864a-efb8c87674fb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:55:50.930080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:50.935412 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e393644d-8dbd-4812-b3bf-e8b245ecd048 req-65a0f0f6-1024-4b05-a063-468af365cfac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093639 Jul 20 10:55:50.938868 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1011/1984] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:50.945782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:50.947041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:50.957474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.958182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:50.959122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:50.959866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:51.114985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:51.133478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:51.139260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:51.142058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-edb53bcf-3d88-4e04-96f6-ac58d8e7131c tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.285380 Jul 20 10:55:51.144013 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 974/1985] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:50 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:51.151455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8a624bb4-bd4c-437a-83fe-b5b0fc6706de req-9cabd22a-b331-4b54-8a1e-5b282244f83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac793c66-c63a-4616-97b4-9bf0367c9c12", "name": "network-vif-plugged", "status": "completed", "tag": "aef43059-c894-40e7-8490-4411fe17c8c5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:51.164532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8a624bb4-bd4c-437a-83fe-b5b0fc6706de req-9cabd22a-b331-4b54-8a1e-5b282244f83e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:51.166282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8a624bb4-bd4c-437a-83fe-b5b0fc6706de req-9cabd22a-b331-4b54-8a1e-5b282244f83e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:51.184245 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8a624bb4-bd4c-437a-83fe-b5b0fc6706de req-9cabd22a-b331-4b54-8a1e-5b282244f83e service nova] Creating event network-vif-plugged:aef43059-c894-40e7-8490-4411fe17c8c5 for instance ac793c66-c63a-4616-97b4-9bf0367c9c12 on n-h2-846219-10 Jul 20 10:55:51.193109 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8a624bb4-bd4c-437a-83fe-b5b0fc6706de req-9cabd22a-b331-4b54-8a1e-5b282244f83e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046466 Jul 20 10:55:51.200514 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 975/1986] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:51.238543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:51.248982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:51.258510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:51.259616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:51.261264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:51.263726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:51.725220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:51.750296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:51.760522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:51.761839 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-52ed7fd9-1f7a-4a3b-a08a-117fc3526b39 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 0.821145 Jul 20 10:55:51.762519 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1012/1987] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:50 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:51.771835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-586d142c-0892-42df-8c4b-2fd5dbf4a8a0 req-c9de8e99-ca0a-44ea-8ff3-b0f92b6cc913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47561663-9022-4b9f-b8aa-91f078552c26", "tag": "b8d6e196-3d2f-4390-989b-db20ca951932"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:51.788838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-586d142c-0892-42df-8c4b-2fd5dbf4a8a0 req-c9de8e99-ca0a-44ea-8ff3-b0f92b6cc913 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:51.789673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-586d142c-0892-42df-8c4b-2fd5dbf4a8a0 req-c9de8e99-ca0a-44ea-8ff3-b0f92b6cc913 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:51.827632 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-586d142c-0892-42df-8c4b-2fd5dbf4a8a0 req-c9de8e99-ca0a-44ea-8ff3-b0f92b6cc913 service nova] Creating event network-changed:b8d6e196-3d2f-4390-989b-db20ca951932 for instance 47561663-9022-4b9f-b8aa-91f078552c26 on n-h1-846219-10 Jul 20 10:55:51.834162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-586d142c-0892-42df-8c4b-2fd5dbf4a8a0 req-c9de8e99-ca0a-44ea-8ff3-b0f92b6cc913 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066770 Jul 20 10:55:51.835826 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1013/1988] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:51.842370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:51.844402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:51.852859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:51.853824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:51.855057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:51.855881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.041936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:52.093530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-239554a3-c382-430d-a9e2-82d01b743cf0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1320 microversion: 2.1 time: 0.877806 Jul 20 10:55:52.104849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 976/1989] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:51 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1320 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:52.120473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9e7ac90-054e-4c12-9f5c-f62b461c9733 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Calling method '.version_select at 0x7f2c3edce040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:52.212368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-f9e7ac90-054e-4c12-9f5c-f62b461c9733 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2624869d-37fd-4daf-b120-5ee3b8949217 could not be found", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:55:52.213164 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f9e7ac90-054e-4c12-9f5c-f62b461c9733 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] HTTP exception thrown: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9e7ac90-054e-4c12-9f5c-f62b461c9733 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Request method failure captured: Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217 HTTP/1.1 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198Q9tTuMIF61YCvm7-Kh0onQN_vdnUzSl-TxjoUSDU023sbgdRkw0T__kJB3OCcLU73-5rK2D2OeiSzemqE_xGFa48-9rRz6MmsfQCAETDrjeP2pzljAq4rAqxIZNp5WIVxUIU8K7Xq2FbUjrJtLQ_himwRjgrnrQgCr0gc0BgPqWk Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 2376e256b86d416282d2e1b52d40640d Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPsTestJSON-1463688209 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2376e256b86d416282d2e1b52d40640d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2376e256b86d416282d2e1b52d40640d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2376e256b86d416282d2e1b52d40640d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2376e256b86d416282d2e1b52d40640d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPsTestJSON-1463688209 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 2376e256b86d416282d2e1b52d40640d Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1463688209 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPsTestJSON-1463688209-project Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 658592a2c61a4b889390769fb6df1286 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPsTestJSON-1463688209-project Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: exception: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2624869d-37fd-4daf-b120-5ee3b8949217'} Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2624869d-37fd-4daf-b120-5ee3b8949217 could not be found Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c7f5420-ecab-4bfb-91a9-99114c414150'] Jul 20 10:55:52.217358 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217. Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9e7ac90-054e-4c12-9f5c-f62b461c9733 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Returning 404 to user: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:55:52.224400 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9e7ac90-054e-4c12-9f5c-f62b461c9733 tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217" status: 404 len: 111 microversion: 2.1 time: 0.110531 Jul 20 10:55:52.228232 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 977/1990] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:55:52 2022] GET /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:52.238803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:52.242498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] [instance: f172f524-ae19-4718-848e-2c6c601750df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:52.292331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:52.293180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.297045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:52.297827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.340366 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] HTTP exception thrown: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Request method failure captured: Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df HTTP/1.1 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi194czVPo1n_pFlflaXy6R1-Vee89XrCjXfuXWN-NeQh7huK9glmdV7oiqUJMugafeOSmQ9bastxXA4wkoTUoAyAXMY_2wD39SLkYkANzzLQyJ7Pyp1bpSCXbF4GyTgkFX8HWpmPC7vby3_FtJzucvM-QlR1B0Skl-QE6NUDu82Vcrz4 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 3c30c5b0c0ee4b78afb0206701192a3b Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c30c5b0c0ee4b78afb0206701192a3b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c30c5b0c0ee4b78afb0206701192a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 3c30c5b0c0ee4b78afb0206701192a3b Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-806150202 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachSCSIVolumeTestJSON-806150202-project Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c4031d68fdd34d04885cf9cc999bf4d1 Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-806150202-project Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f172f524-ae19-4718-848e-2c6c601750df'} Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:52.343842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. Jul 20 10:55:52.346932 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:55:52.350551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] Returning 404 to user: Instance f172f524-ae19-4718-848e-2c6c601750df could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:55:52.351494 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bd525c23-73ba-4791-a7a8-659d51c58f99 tempest-AttachSCSIVolumeTestJSON-806150202 tempest-AttachSCSIVolumeTestJSON-806150202-project] 10.222.0.79 "GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df" status: 404 len: 111 microversion: 2.1 time: 0.125211 Jul 20 10:55:52.359544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 978/1991] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:52 2022] GET /compute/v2.1/servers/f172f524-ae19-4718-848e-2c6c601750df => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:52.381585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:52.382218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:52.413865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:52.414446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.415362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:52.415807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.656617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:52.674312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:52.676161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:52.676704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:52.684099 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5edf71df-5e05-4a71-9492-30321db636c3 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1265 microversion: 2.25 time: 0.308574 Jul 20 10:55:52.685098 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 979/1992] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:52 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:52.693651 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f024ee99-3b52-4a8f-a880-a1cf8f686242 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1307 microversion: 2.1 time: 0.856075 Jul 20 10:55:52.694332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:52.695867 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1014/1993] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:51 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1307 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:52.703264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:52.711106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:52.713892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.715045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:52.720338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:52.720672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-462d98f8-10cb-402f-b1c0-2831513a4c3a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Calling method '.version_select at 0x7f2c3f1068b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:53.397921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-462d98f8-10cb-402f-b1c0-2831513a4c3a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2624869d-37fd-4daf-b120-5ee3b8949217 could not be found", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:55:53.398624 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-462d98f8-10cb-402f-b1c0-2831513a4c3a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] HTTP exception thrown: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-462d98f8-10cb-402f-b1c0-2831513a4c3a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Request method failure captured: Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217 HTTP/1.1 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198Q9tTuMIF61YCvm7-Kh0onQN_vdnUzSl-TxjoUSDU023sbgdRkw0T__kJB3OCcLU73-5rK2D2OeiSzemqE_xGFa48-9rRz6MmsfQCAETDrjeP2pzljAq4rAqxIZNp5WIVxUIU8K7Xq2FbUjrJtLQ_himwRjgrnrQgCr0gc0BgPqWk Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 2376e256b86d416282d2e1b52d40640d Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsTestJSON-1463688209 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2376e256b86d416282d2e1b52d40640d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2376e256b86d416282d2e1b52d40640d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2376e256b86d416282d2e1b52d40640d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2376e256b86d416282d2e1b52d40640d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsTestJSON-1463688209 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 2376e256b86d416282d2e1b52d40640d Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1463688209 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsTestJSON-1463688209-project Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 658592a2c61a4b889390769fb6df1286 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsTestJSON-1463688209-project Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: exception: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '2624869d-37fd-4daf-b120-5ee3b8949217'} Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2624869d-37fd-4daf-b120-5ee3b8949217 could not be found Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85eb3688-4c56-456f-b66e-6a64c9b2b33d'] Jul 20 10:55:53.401444 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217. Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-462d98f8-10cb-402f-b1c0-2831513a4c3a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] Returning 404 to user: Floating IP not found for ID 2624869d-37fd-4daf-b120-5ee3b8949217 {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-462d98f8-10cb-402f-b1c0-2831513a4c3a tempest-FloatingIPsTestJSON-1463688209 tempest-FloatingIPsTestJSON-1463688209-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217" status: 404 len: 111 microversion: 2.1 time: 0.696225 Jul 20 10:55:53.405345 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1015/1994] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:55:52 2022] DELETE /compute/v2.1/os-floating-ips/2624869d-37fd-4daf-b120-5ee3b8949217 => generated 111 bytes in 708 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:55:53.416364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:53.421112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:53.443500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:53.447575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:53.449994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:53.451077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:53.572736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:53.584969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:53.586985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:53.588474 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c78a800e-43ca-426f-80fe-a5ef1ba0d0b2 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1366 microversion: 2.57 time: 0.901751 Jul 20 10:55:53.604019 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 980/1995] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:52 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1366 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:53.610134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:53.611013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:53.617825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:53.618828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:53.619812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:53.620402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.151570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.175944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.183184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.189317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a37c1fe-29e7-4710-9b61-2ded168976d0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 0.782959 Jul 20 10:55:54.195810 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1016/1996] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:53 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:54.219121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.245263 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8bdb5b8d-87a5-45a4-858e-4e328c2a9bbf tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1320 microversion: 2.1 time: 0.639622 Jul 20 10:55:54.251413 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 981/1997] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:53 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1320 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:54.253004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e86b6f78-15e2-497e-951a-dcf4cb250b95 req-3b6642ea-74e8-4415-a04f-bd8e649d0a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "cb2a6275-25f7-48cc-a346-d8cb908ad01b"}, {"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "06bceed4-358e-4d55-97b4-32bcd00f7e6a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:54.277269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:54.287873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:54.298109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e86b6f78-15e2-497e-951a-dcf4cb250b95 req-3b6642ea-74e8-4415-a04f-bd8e649d0a78 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.301205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e86b6f78-15e2-497e-951a-dcf4cb250b95 req-3b6642ea-74e8-4415-a04f-bd8e649d0a78 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.322257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.328310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.330834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.331314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.343358 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e86b6f78-15e2-497e-951a-dcf4cb250b95 req-3b6642ea-74e8-4415-a04f-bd8e649d0a78 service nova] Creating event network-changed:cb2a6275-25f7-48cc-a346-d8cb908ad01b for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:55:54.345092 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e86b6f78-15e2-497e-951a-dcf4cb250b95 req-3b6642ea-74e8-4415-a04f-bd8e649d0a78 service nova] Creating event network-changed:06bceed4-358e-4d55-97b4-32bcd00f7e6a for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:55:54.359397 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e86b6f78-15e2-497e-951a-dcf4cb250b95 req-3b6642ea-74e8-4415-a04f-bd8e649d0a78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.149517 Jul 20 10:55:54.360298 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1017/1998] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:54.367024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:54.370677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:54.401550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.404888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.408323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.409561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.635482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.648344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.649872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:54.661334 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f036930e-a4c4-43e8-8a39-b7c2a317f596 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1265 microversion: 2.25 time: 0.401172 Jul 20 10:55:54.674271 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 982/1999] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:54 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1265 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:54.686338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d0b13f27-117e-46de-abf0-5b8f9e346afb req-bf084ed1-7ab0-4212-9409-85e8bdae0ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde6bc00-8ace-4d73-bbef-3a7881815a7a", "name": "network-vif-deleted", "tag": "7ba34fe2-c8a3-4457-aee8-76e7eb387638"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:54.713673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d0b13f27-117e-46de-abf0-5b8f9e346afb req-bf084ed1-7ab0-4212-9409-85e8bdae0ab6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.714331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d0b13f27-117e-46de-abf0-5b8f9e346afb req-bf084ed1-7ab0-4212-9409-85e8bdae0ab6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.738408 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d0b13f27-117e-46de-abf0-5b8f9e346afb req-bf084ed1-7ab0-4212-9409-85e8bdae0ab6 service nova] Creating event network-vif-deleted:7ba34fe2-c8a3-4457-aee8-76e7eb387638 for instance cde6bc00-8ace-4d73-bbef-3a7881815a7a on n-h2-846219-10 Jul 20 10:55:54.750138 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d0b13f27-117e-46de-abf0-5b8f9e346afb req-bf084ed1-7ab0-4212-9409-85e8bdae0ab6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074472 Jul 20 10:55:54.753814 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 983/2000] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:54.768277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:54.774278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:54.789337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.790086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:54.792828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:54.795664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:55.439152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:55.452884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:55.456903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:55.461680 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52846f96-2c72-4c48-a5d1-8bf9a5389ae9 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1372 microversion: 2.57 time: 0.704921 Jul 20 10:55:55.464807 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 984/2001] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:54 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1372 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:55.473191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:55.478996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:55.491330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:55.492140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:55.493141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:55.493724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:55.798630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:55.810642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7af359f4-fce0-475f-b92a-031f5497e347 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1307 microversion: 2.1 time: 1.447149 Jul 20 10:55:55.815037 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1018/2002] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:54 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1307 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:55.826621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:55.827652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:55.837755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:55:55.845234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:55.846206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:55.848781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:55.850393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.293861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.323463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.330929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.339904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35ab3254-f405-4a88-8a09-df2da9d6048c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 0.873248 Jul 20 10:55:56.345190 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 985/2003] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:55 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:56.353777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:56.363866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:56.386727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:56.388965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.398327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:56.399474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.572200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.588972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.598175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.601156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.604018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-690b9685-317d-45c4-92f2-f2107a2a0c36 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1265 microversion: 2.25 time: 0.256583 Jul 20 10:55:56.605960 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 986/2004] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:56 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:56.618025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:56.618663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:56.625044 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-91816404-29a5-4f61-86e2-5eb5b3f23379 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1511 microversion: 2.1 time: 0.808309 Jul 20 10:55:56.626194 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1019/2005] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:55 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1511 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:56.637605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:56.638635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.644351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:56.645971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.646846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:56.648302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:56.666348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:56.671939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.675638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:56.679990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:56.974954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:56.996813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:57.002941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:57.007925 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0939715-fba5-407e-9b8f-1c4907fe4c49 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1372 microversion: 2.57 time: 0.397176 Jul 20 10:55:57.024042 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 987/2006] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:56 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1372 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:57.034678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:57.036718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:57.045289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:57.046429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:57.048815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:57.050135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.189320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:58.210671 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-997f0f29-f667-4e45-9fae-350ee97b42cc tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1512 microversion: 2.1 time: 1.570392 Jul 20 10:55:58.233780 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1020/2007] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:56 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1512 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:55:58.277453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:58.283439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:58.312149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.314146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.319007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.319801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.610589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:58.628996 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9be9ad04-d1aa-4015-afc0-ed9c71a9f009 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1307 microversion: 2.1 time: 1.602986 Jul 20 10:55:58.629870 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 988/2008] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:57 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1307 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:58.634897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:58.648356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:58.657528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.671156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.672849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.673410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.822047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:58.836620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:58.840194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:58.842712 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff93886a-66d3-4a90-9bd8-6247520a1e50 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1265 microversion: 2.25 time: 0.211436 Jul 20 10:55:58.843948 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 989/2009] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:58 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:58.849631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1a81e1e4-9611-43da-a9b1-d6f1dd432e30 req-4817b565-6ab3-4078-b842-63ad865037ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "55374b6a-08ec-41f5-a6cc-936f12ac152c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:58.862089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1a81e1e4-9611-43da-a9b1-d6f1dd432e30 req-4817b565-6ab3-4078-b842-63ad865037ee service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.863311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1a81e1e4-9611-43da-a9b1-d6f1dd432e30 req-4817b565-6ab3-4078-b842-63ad865037ee service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.885766 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1a81e1e4-9611-43da-a9b1-d6f1dd432e30 req-4817b565-6ab3-4078-b842-63ad865037ee service nova] Creating event network-changed:55374b6a-08ec-41f5-a6cc-936f12ac152c for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:55:58.895193 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1a81e1e4-9611-43da-a9b1-d6f1dd432e30 req-4817b565-6ab3-4078-b842-63ad865037ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049616 Jul 20 10:55:58.896476 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 990/2010] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:58.906897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:58.909060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:58.933770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.934632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:58.936891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:58.937546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.126536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.144609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.147712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.150393 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3ea5dd0f-8444-4108-9a38-19dd166db23d tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1357 microversion: 2.57 time: 0.252160 Jul 20 10:55:59.152176 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 991/2011] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:58 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:59.161294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:59.162296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:59.177829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.178739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.179623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.180512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.324830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.351907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.354158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.355619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4be4240-81d3-45d7-8ce0-5d558c50782c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.118959 Jul 20 10:55:59.358018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1021/2012] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:55:58 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:55:59.366522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-706bc021-505a-44c2-a039-d15a3e40e42e req-95bc1cf0-1572-42b9-9b53-72939e5e31b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47561663-9022-4b9f-b8aa-91f078552c26", "name": "network-vif-plugged", "status": "completed", "tag": "b8d6e196-3d2f-4390-989b-db20ca951932"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:55:59.379377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-706bc021-505a-44c2-a039-d15a3e40e42e req-95bc1cf0-1572-42b9-9b53-72939e5e31b9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.380365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-706bc021-505a-44c2-a039-d15a3e40e42e req-95bc1cf0-1572-42b9-9b53-72939e5e31b9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.414442 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-706bc021-505a-44c2-a039-d15a3e40e42e req-95bc1cf0-1572-42b9-9b53-72939e5e31b9 service nova] Creating event network-vif-plugged:b8d6e196-3d2f-4390-989b-db20ca951932 for instance 47561663-9022-4b9f-b8aa-91f078552c26 on n-h1-846219-10 Jul 20 10:55:59.425909 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-706bc021-505a-44c2-a039-d15a3e40e42e req-95bc1cf0-1572-42b9-9b53-72939e5e31b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064722 Jul 20 10:55:59.428274 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1022/2013] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:55:59.436845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:59.437736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:59.447263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.448131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.455533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.467588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.542880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:55:59.610810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.623727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-407eec61-9528-4a21-961f-eefc58c33454 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1512 microversion: 2.1 time: 0.470161 Jul 20 10:55:59.643249 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 992/2014] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:59 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:55:59.659477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:59.664475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:55:59.665676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:55:59.696731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.705464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.709399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.710075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.771632 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7dbe0262-4e36-4cc7-a73b-7d34928842e6 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 204 len: 0 microversion: 2.57 time: 0.340072 Jul 20 10:55:59.774955 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1023/2015] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:55:59 2022] DELETE /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:55:59.802222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:55:59.803376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:55:59.815148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.815936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.817502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:55:59.818354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:55:59.952265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:00.162832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:00.171628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:00.173132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:00.829754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:00.843734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4573157-96cb-4be0-a589-935a80a9df2b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1307 microversion: 2.1 time: 1.057700 Jul 20 10:56:00.866709 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1024/2016] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:55:59 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1307 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:00.874118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:00.875331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:00.888981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:00.890263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:00.892038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:00.893343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.297898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.313728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.316953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1d3fa604da274658a7590bad726f217f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e51000154b4d5f9f2418d78ca12480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.322336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5f7b669e-4476-4ff6-83b7-30648ea44a13 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 200 len: 1363 microversion: 2.57 time: 0.452355 Jul 20 10:56:01.325984 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1025/2017] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:00 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 1363 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:01.336949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:01.343477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:01.359033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:01.362618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.363951 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6189883c-faf3-40d1-9d53-dae588b0ea1f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.718899 Jul 20 10:56:01.365298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:01.365860 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 993/2018] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 10:55:59 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:01.368221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.413163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:01.418377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:01.456382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:01.456382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.457160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:01.457610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.463459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:01.602511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.612485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.614163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.645110 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-732c2910-80e5-4bf1-8128-2b4891f72b49 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 200 len: 1265 microversion: 2.25 time: 0.306948 Jul 20 10:56:01.646769 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1026/2019] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:01 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:01.651871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:01.666192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:01.667082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1877119379', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:01.687090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:01.687667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.688473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:01.688904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:01.991460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:02.272610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:02.293519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:02.293990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:02.406533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:02.445383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:02.448328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:02.456719 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3999ba36-22b9-464a-bb14-87076e990cb1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.088739 Jul 20 10:56:02.471893 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 994/2020] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:01 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:02.471893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6a3eb7db-b0cd-4f31-9b66-79f81de65e5a req-8e54949c-fec6-4621-80a8-8aa65622a6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "d8034b29-1e24-41aa-ad30-d4f95643b5dc"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:02.488649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6a3eb7db-b0cd-4f31-9b66-79f81de65e5a req-8e54949c-fec6-4621-80a8-8aa65622a6a4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:02.489207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6a3eb7db-b0cd-4f31-9b66-79f81de65e5a req-8e54949c-fec6-4621-80a8-8aa65622a6a4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:02.538630 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6a3eb7db-b0cd-4f31-9b66-79f81de65e5a req-8e54949c-fec6-4621-80a8-8aa65622a6a4 service nova] Creating event network-changed:d8034b29-1e24-41aa-ad30-d4f95643b5dc for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:02.554643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6a3eb7db-b0cd-4f31-9b66-79f81de65e5a req-8e54949c-fec6-4621-80a8-8aa65622a6a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095048 Jul 20 10:56:02.560260 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 995/2021] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:02.580824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:02.583150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:02.613445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:02.615600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:02.617425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:02.619475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:03.788616 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-76a4ac0a-7e12-4be6-bfd1-2fe9f2a60679 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1877119379" status: 200 len: 1515 microversion: 2.1 time: 2.140330 Jul 20 10:56:03.801777 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1027/2022] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:56:01 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1877119379 => generated 1515 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:03.801777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:03.801777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] [instance: b23237eb-b9c4-4e24-a52b-a4737f5a0f50] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:03.839345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:03.840004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:03.848109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:03.848847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:03.902507 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] HTTP exception thrown: Instance b23237eb-b9c4-4e24-a52b-a4737f5a0f50 could not be found. Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Request method failure captured: Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 HTTP/1.1 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198PjSeZ9ODiZEiFwPw-n2GemZCE3NKpKFnyPWYTyjoG9gwxL6yyS8HaS2bgvLv0fqgE3GOOkSJ0BvOVOkmFAgZ2BF1aIvO6BctQv41y6cz1StHwAOz8rOb8mFbu7IWM1f9YpKvTonle5jOQN4tsBX46ezQ0DfDYgBORmL10nR_RmkM Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.57 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 99e51000154b4d5f9f2418d78ca12480 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerShowV257Test-1957326455 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_99e51000154b4d5f9f2418d78ca12480", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/99e51000154b4d5f9f2418d78ca12480"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/99e51000154b4d5f9f2418d78ca12480"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/99e51000154b4d5f9f2418d78ca12480"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerShowV257Test-1957326455 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 99e51000154b4d5f9f2418d78ca12480 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerShowV257Test-1957326455 Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerShowV257Test-1957326455-project Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 1d3fa604da274658a7590bad726f217f Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerShowV257Test-1957326455-project Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance b23237eb-b9c4-4e24-a52b-a4737f5a0f50 could not be found. Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'b23237eb-b9c4-4e24-a52b-a4737f5a0f50'} Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23237eb-b9c4-4e24-a52b-a4737f5a0f50 could not be found. Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23237eb-b9c4-4e24-a52b-a4737f5a0f50 could not be found. Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:03.905815 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23237eb-b9c4-4e24-a52b-a4737f5a0f50 could not be found. Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] Returning 404 to user: Instance b23237eb-b9c4-4e24-a52b-a4737f5a0f50 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:56:03.911112 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7114671-ea8a-451d-b084-09b8672501a8 tempest-ServerShowV257Test-1957326455 tempest-ServerShowV257Test-1957326455-project] 10.222.0.79 "GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50" status: 404 len: 111 microversion: 2.57 time: 0.116036 Jul 20 10:56:03.912115 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1028/2023] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:03 2022] GET /compute/v2.1/servers/b23237eb-b9c4-4e24-a52b-a4737f5a0f50 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:56:03.934903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:03.935989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cde6bc00-8ace-4d73-bbef-3a7881815a7a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:03.963727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:03.964440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:03.965465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:03.966670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:03.997980 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] HTTP exception thrown: Instance cde6bc00-8ace-4d73-bbef-3a7881815a7a could not be found. Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Request method failure captured: Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a HTTP/1.1 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1908A8meMj2aLh4RBxGI0_lubgbkt-1X1QHcsxBE163TYM3i9fQR5q0DIC6YOI37Nua8611RBiez8-BsYtNibSvjnEytnFgp1r-h0vHk_Yv1kSr3qbDhzqg-90AWm7jCnlYPJFEThaYN3cUsRdM6boB8tF9kRWkIXZ6JNhH3g05KbRE Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8804616b1f144b18a5c5cba5ccfaaa0e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: cc3921f3f8264fb2aa9c95b86cf4dd9d Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance cde6bc00-8ace-4d73-bbef-3a7881815a7a could not be found. Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'cde6bc00-8ace-4d73-bbef-3a7881815a7a'} Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde6bc00-8ace-4d73-bbef-3a7881815a7a could not be found. Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde6bc00-8ace-4d73-bbef-3a7881815a7a could not be found. Jul 20 10:56:04.000060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde6bc00-8ace-4d73-bbef-3a7881815a7a could not be found. Jul 20 10:56:04.004011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:04.024130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Returning 404 to user: Instance cde6bc00-8ace-4d73-bbef-3a7881815a7a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:56:04.025301 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4d74e484-978e-4020-9dd6-a5204b2fc07c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a" status: 404 len: 111 microversion: 2.25 time: 0.111895 Jul 20 10:56:04.032444 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1029/2024] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:03 2022] GET /compute/v2.1/servers/cde6bc00-8ace-4d73-bbef-3a7881815a7a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:56:04.043018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:04.056198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:04.063918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.064520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:04.065473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.066070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:04.080829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:04.317386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:04.356984 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-113172d0-eceb-4b4a-ba5a-61cf40f7ef76 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1488 microversion: 2.1 time: 1.793860 Jul 20 10:56:04.360357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 996/2025] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:02 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1488 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:04.379864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:04.404380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:04.409610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:04.420405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:04.427435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.428178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:04.432031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.433150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:04.656352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:04.869866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:04.883595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:04.884610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.885234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:04.902490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:04.910055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:04.920054 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f103a386-9372-4e67-9b62-07c67eb87b34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 0.878149 Jul 20 10:56:04.920990 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1030/2026] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:04 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:04.940284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:04.941391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:04.964143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.964954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:04.966673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:04.973258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:05.314098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1718b655-3cb4-4135-8874-2a2e52df3bbf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26/action" status: 202 len: 0 microversion: 2.1 time: 0.390242 Jul 20 10:56:05.320642 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1031/2027] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:56:04 2022] POST /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:56:05.332072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:05.337730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:05.367831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:05.368690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:05.374702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:05.375553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:06.188008 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-413e4c04-9b67-4ab3-91b1-40298c9ac030 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 1.825766 Jul 20 10:56:06.190019 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 997/2028] 10.222.0.79 () {58 vars in 1172 bytes} [Wed Jul 20 10:56:04 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:06.196500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:06.203572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:06.225288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:06.225843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:06.226639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:06.227082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:06.452572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:06.469360 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bcf62ab3-8c3f-4b05-b917-ca01325477cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1493 microversion: 2.1 time: 1.142668 Jul 20 10:56:06.497192 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1032/2029] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:05 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1493 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:06.508244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:06.517610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:06.525213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.compute.servers [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Removing options 'limit' from query {{(pid=125885) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 10:56:06.526485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:06.540348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:06.541834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:06.546305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:06.550319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:06.642727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:06.652996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:06.655783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:07.798199 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f843dda2-e931-4795-b135-7335d220eaa2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 1.298598 Jul 20 10:56:07.812090 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1033/2030] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:56:06 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:07.812090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:07.818075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:07.833896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:07.853263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:07.855048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:07.856979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:07.860020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:07.861780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:07.863870 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2ccea42-a42b-449c-9285-dbf1e0de1080 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.671847 Jul 20 10:56:07.865070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:07.867380 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 998/2031] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:06 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:07.887812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:07.907162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:07.911782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:07.929095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:07.929916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:07.932448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:07.933007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.037262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:08.091809 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-def94460-8d8f-41ac-b4a1-f37c38eb70d0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.221291 Jul 20 10:56:08.103490 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 999/2032] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:56:07 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:08.111547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:08.119257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:08.127885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.servers [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Removing options 'limit' from query {{(pid=125886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 10:56:08.129353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:08.142833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:08.143849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.148047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:08.148665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.242871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:08.342636 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-29ab6f1f-fd7c-42f8-8162-f7288a7c6f3d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.237200 Jul 20 10:56:08.355456 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1000/2033] 10.222.0.79 () {58 vars in 1149 bytes} [Wed Jul 20 10:56:08 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:08.365914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:08.380222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:08.382440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:08.403818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:08.405061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.406372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:08.409305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.466814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:08.517827 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92e12f80-dd1e-4457-a750-d7c03232517b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.160823 Jul 20 10:56:08.519296 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1001/2034] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 10:56:08 2022] GET /compute/v2.1/servers => generated 1010 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:08.533341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:08.544700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:08.550137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:08.587647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:08.588094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.593040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:08.593742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:08.837562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:08.963428 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99616d2b-eb6f-480c-90d7-8414de7f7ff1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.434945 Jul 20 10:56:08.971447 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1002/2035] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:56:08 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:56:08.983347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:08.987591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:09.012934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:09.014114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:09.015955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:09.018675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:10.157002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:10.172552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9add0a1-2d1c-4296-be81-8a5ec3967878 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 200 len: 1473 microversion: 2.1 time: 2.371298 Jul 20 10:56:10.187503 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1034/2036] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:07 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 1473 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:10.197483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:10.213836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:10.214320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.compute.servers [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Removing options 'limit' from query {{(pid=125885) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 10:56:10.215061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:10.225923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:10.228801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:10.233971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:10.234621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:10.303126 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed57b259-3a8c-4d8c-858e-c8addb8d65e3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.113917 Jul 20 10:56:10.312407 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1035/2037] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 10:56:10 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:10.317362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-981261571"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:10.318774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:10.329090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:10.329808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:10.331392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:10.332159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:10.844668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:10.865965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:10.877445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:10.879004 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df21a989-e1da-4ee8-95d3-08048cb3aa69 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.909318 Jul 20 10:56:10.880130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1003/2038] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:08 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:10.885388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:10.895960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:10.902489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1877119379', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:10.908705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:10.911916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:10.913087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:10.916429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:11.172951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:11.304141 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-991f9054-74e5-4b25-822b-e253e36d92ff tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26/action" status: 202 len: 0 microversion: 2.1 time: 0.985890 Jul 20 10:56:11.307420 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1036/2039] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:56:10 2022] POST /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26/action => generated 0 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 10:56:11.323002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca955391-1d81-41ee-8d2f-f1bc2a2b833a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f077280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:11.456572 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca955391-1d81-41ee-8d2f-f1bc2a2b833a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.143986 Jul 20 10:56:11.459794 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1037/2040] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:11 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:11.517631 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f608b35-d23b-4c3a-acda-4c0fc781d757 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1877119379" status: 200 len: 346 microversion: 2.1 time: 0.633911 Jul 20 10:56:11.521549 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1004/2041] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 10:56:10 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1877119379 => generated 346 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:11.533458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d036fdae-6bfa-4dff-adb5-1f00a9cc147d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:11.558773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d036fdae-6bfa-4dff-adb5-1f00a9cc147d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:11.559304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d036fdae-6bfa-4dff-adb5-1f00a9cc147d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:11.826391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d036fdae-6bfa-4dff-adb5-1f00a9cc147d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Going to try to stop instance {{(pid=125885) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 10:56:11.906009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:11.907722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:11.935790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:11.937063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:11.941654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:11.942371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:11.977943 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d036fdae-6bfa-4dff-adb5-1f00a9cc147d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "POST /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4/action" status: 202 len: 0 microversion: 2.1 time: 0.449363 Jul 20 10:56:11.981940 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1038/2042] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:56:11 2022] POST /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:56:12.000480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:12.002416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:12.024427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:12.030593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:12.036014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:12.045580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:13.039380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:13.056776 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5d6339dc-499d-4966-bcb0-9b84624b640d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 1.071409 Jul 20 10:56:13.073120 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1039/2043] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:11 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:13.103633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5053331f-1527-4fd7-9681-8f5410716c26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c50d74ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:13.111448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:13.142264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:13.148396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:13.172408 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8ccef6d4-9284-4c09-ad85-eb59d5f0b164 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.252391 Jul 20 10:56:13.174110 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1005/2044] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:11 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:13.232693 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5053331f-1527-4fd7-9681-8f5410716c26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.154538 Jul 20 10:56:13.238001 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1040/2045] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:13 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:14.079832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:14.081185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:14.139445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:14.140154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:14.146305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:14.149713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:14.194158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:14.195284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:14.213069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:14.214061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:14.219401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:14.220200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:14.660562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:14.688759 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5686662-335c-4fd3-baa1-f1a7ceb82e80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 0.617006 Jul 20 10:56:14.692038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1006/2046] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:14 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:56:14.731749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-22d56791-399a-45c4-b3ed-c0e34c2d7de0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fb61430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:14.817154 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-22d56791-399a-45c4-b3ed-c0e34c2d7de0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.120678 Jul 20 10:56:14.819891 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1007/2047] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:14 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:15.064950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:15.094039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:15.099122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:15.103161 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bce46f49-5ee5-4bfb-8220-13fef4f50a46 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 0.913903 Jul 20 10:56:15.119117 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1041/2048] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:14 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:15.713689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:15.714704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:15.747340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:15.753808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:15.754756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:15.756274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:15.756973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:15.832562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ad02218-c1b5-47cf-83cb-3de0cba78d27 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f0775e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:15.906900 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ad02218-c1b5-47cf-83cb-3de0cba78d27 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.078244 Jul 20 10:56:15.916101 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1042/2049] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:15 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:16.126789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:16.127782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:16.151425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:16.152113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:16.153316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:16.154194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:16.245884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:16.256777 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a5041cb-b52f-458b-9e49-c89cf6362c76 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 0.549865 Jul 20 10:56:16.257826 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1008/2050] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:15 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:16.631970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:16.894659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:16.905078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:16.932327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:16.936196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:16.938811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:16.941432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:17.014902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:56:17.053355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:17.210121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:17.219452 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3619c84-f806-484f-b89c-4fff3c8effa5 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 204 len: 0 microversion: 2.25 time: 0.313800 Jul 20 10:56:17.228873 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1009/2051] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:56:16 2022] DELETE /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:56:17.271438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6051fa5-5bfa-4307-9839-8fde5bb983a5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fbc8dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:17.295358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:17.324225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:17.341863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-71da43df-4a78-4e98-a8a5-4b945220fcf0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1887 microversion: 2.42 time: 1.215116 Jul 20 10:56:17.344090 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1043/2052] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:16 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1887 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:17.384367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:17.386929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:17.426283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:17.444886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:17.448850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:17.452548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:17.459747 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c6051fa5-5bfa-4307-9839-8fde5bb983a5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.225745 Jul 20 10:56:17.466756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1010/2053] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:17 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:17.478377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:17.492667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:17.502596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:17.513716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:17.514769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:17.517557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:18.092296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:18.103721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:18.115308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:18.116625 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5bb8f82-ae70-4b47-829c-2c1cd26237e6 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1733 microversion: 2.25 time: 0.764685 Jul 20 10:56:18.123745 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1044/2054] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:17 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1733 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:18.128744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:18.142766 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84cf28fc-2dbd-4c9d-88b8-4c8fb1390880 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 0.673480 Jul 20 10:56:18.145525 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1011/2055] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:17 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:18.379451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:18.380935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:18.388410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:18.389835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:18.394714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:18.396189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:18.473534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c0d39631-18ce-467d-95cb-1e7923a4058b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fb20550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:18.556168 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c0d39631-18ce-467d-95cb-1e7923a4058b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.086536 Jul 20 10:56:18.564588 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1012/2056] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:18 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:56:19.143060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:19.143822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:19.160909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:19.161466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:19.162942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:19.163844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:19.522614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.537937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.542044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.543665 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d1e7ba1-dce2-4d82-95f2-4820acf9c5ff tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.168137 Jul 20 10:56:19.546225 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1045/2057] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:18 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:19.549903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.565555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.567428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.568825 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bdb4b23d-33b3-4456-8539-6587c2536865 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1733 microversion: 2.25 time: 0.431951 Jul 20 10:56:19.572161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:19.583215 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1013/2058] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:19 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1733 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:19.584972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:19.595046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:19.595726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:19.596682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:19.597526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:19.878267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9151aead-b15d-4216-8b55-a59f2c091232 req-18beb81c-4819-4681-9272-2b51f7725ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47561663-9022-4b9f-b8aa-91f078552c26", "name": "network-vif-plugged", "status": "completed", "tag": "b8d6e196-3d2f-4390-989b-db20ca951932"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:19.901907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:19.904137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9151aead-b15d-4216-8b55-a59f2c091232 req-18beb81c-4819-4681-9272-2b51f7725ec1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:19.904771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9151aead-b15d-4216-8b55-a59f2c091232 req-18beb81c-4819-4681-9272-2b51f7725ec1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:19.917532 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-453a982e-6579-48b5-9f09-002ffa71bfe0 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 0.369223 Jul 20 10:56:19.933171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1046/2059] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:19 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:19.935736 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9151aead-b15d-4216-8b55-a59f2c091232 req-18beb81c-4819-4681-9272-2b51f7725ec1 service nova] Creating event network-vif-plugged:b8d6e196-3d2f-4390-989b-db20ca951932 for instance 47561663-9022-4b9f-b8aa-91f078552c26 on n-h1-846219-10 Jul 20 10:56:19.944375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-540d78ad-02e2-4819-988f-cc6684a572f3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f11ce50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:19.948542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9151aead-b15d-4216-8b55-a59f2c091232 req-18beb81c-4819-4681-9272-2b51f7725ec1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374291 Jul 20 10:56:19.951810 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1014/2060] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:20.035255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-540d78ad-02e2-4819-988f-cc6684a572f3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.099281 Jul 20 10:56:20.037088 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1047/2061] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:19 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:20.577241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:20.579308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:20.600831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:20.607789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:20.610950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:20.661471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:20.664612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:20.665395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:20.673103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:20.674689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:20.675372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:20.684650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:20.685663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:20.857731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:21.026971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:21.592476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:21.644453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:21.657996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:21.676255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-baa29f98-f6bf-402e-ab02-4e735ce50363 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 200 len: 1665 microversion: 2.25 time: 1.083587 Jul 20 10:56:21.711828 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1048/2062] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:20 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 1665 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:21.720663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:21.721930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:21.739977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:21.741181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:21.745528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:21.746453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:22.819499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:22.845614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:22.860746 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c4ecb88f-1ac0-4b82-a166-f44eb6c036a2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 1.147427 Jul 20 10:56:22.870132 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1049/2063] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:21 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:22.870132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c67f4809-13de-4a45-8fa9-babba691d622 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f9013a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:22.874740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:22.877917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:22.881809 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-49ffe5ff-b6bc-4644-828d-d6a342d975cd tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 2.316461 Jul 20 10:56:22.903368 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1015/2064] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:20 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:23.022451 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c67f4809-13de-4a45-8fa9-babba691d622 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.159426 Jul 20 10:56:23.025286 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1050/2065] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:22 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:23.040668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:23.043323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cca9a22d-eefc-4a46-8eea-54c393552ac0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:23.063205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.064050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:23.066067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.070080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:23.113106 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] HTTP exception thrown: Instance cca9a22d-eefc-4a46-8eea-54c393552ac0 could not be found. Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Request method failure captured: Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 HTTP/1.1 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1908A8meMj2aLh4RBxGI0_lubgbkt-1X1QHcsxBE163TYM3i9fQR5q0DIC6YOI37Nua8611RBiez8-BsYtNibSvjnEytnFgp1r-h0vHk_Yv1kSr3qbDhzqg-90AWm7jCnlYPJFEThaYN3cUsRdM6boB8tF9kRWkIXZ6JNhH3g05KbRE Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8804616b1f144b18a5c5cba5ccfaaa0e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: cc3921f3f8264fb2aa9c95b86cf4dd9d Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance cca9a22d-eefc-4a46-8eea-54c393552ac0 could not be found. Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'cca9a22d-eefc-4a46-8eea-54c393552ac0'} Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9a22d-eefc-4a46-8eea-54c393552ac0 could not be found. Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9a22d-eefc-4a46-8eea-54c393552ac0 could not be found. Jul 20 10:56:23.118442 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9a22d-eefc-4a46-8eea-54c393552ac0 could not be found. Jul 20 10:56:23.124208 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:56:23.128190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Returning 404 to user: Instance cca9a22d-eefc-4a46-8eea-54c393552ac0 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:56:23.129708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fffdd8d-9a81-40f5-bd24-7b34da5514ce tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0" status: 404 len: 111 microversion: 2.25 time: 0.103047 Jul 20 10:56:23.132496 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1051/2066] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:23 2022] GET /compute/v2.1/servers/cca9a22d-eefc-4a46-8eea-54c393552ac0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:56:23.149317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65ab2216-d0e6-4328-b38e-6b4ecb5f023e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '.version_select at 0x7f2c3f077d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:23.206604 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65ab2216-d0e6-4328-b38e-6b4ecb5f023e tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239166117" status: 204 len: 0 microversion: 2.25 time: 0.065284 Jul 20 10:56:23.210431 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1052/2067] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 10:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1239166117 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 10:56:23.346718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7adffe02-fef3-4586-9488-5558235bdca3 req-a51e48be-35da-4e9f-8432-672e896516ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9a22d-eefc-4a46-8eea-54c393552ac0", "name": "network-vif-deleted", "tag": "cec7d439-0b02-481b-857f-ec1b61e91ca2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:23.392862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7adffe02-fef3-4586-9488-5558235bdca3 req-a51e48be-35da-4e9f-8432-672e896516ec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.394821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7adffe02-fef3-4586-9488-5558235bdca3 req-a51e48be-35da-4e9f-8432-672e896516ec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:23.434541 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7adffe02-fef3-4586-9488-5558235bdca3 req-a51e48be-35da-4e9f-8432-672e896516ec service nova] Creating event network-vif-deleted:cec7d439-0b02-481b-857f-ec1b61e91ca2 for instance cca9a22d-eefc-4a46-8eea-54c393552ac0 on n-h2-846219-10 Jul 20 10:56:23.449032 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7adffe02-fef3-4586-9488-5558235bdca3 req-a51e48be-35da-4e9f-8432-672e896516ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.543518 Jul 20 10:56:23.450786 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1016/2068] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:23.884111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:23.888051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:23.908320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:23.909665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:23.910495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.911450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:23.913030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.913922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:23.932211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.932671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:23.933475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:23.933945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:24.822253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:24.837029 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f074ef35-ade8-4728-8df3-eb5681a3602a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 0.961517 Jul 20 10:56:24.848193 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1053/2069] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:23 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:24.869524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc39bac5-b505-4ec8-8cef-72993788b5c9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f077550>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:24.969500 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc39bac5-b505-4ec8-8cef-72993788b5c9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.119820 Jul 20 10:56:24.970827 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1054/2070] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:24 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:25.210318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:25.307564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:25.331990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:25.366704 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6338b221-c0b0-425b-ada4-6db05a5f63b8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.439873 Jul 20 10:56:25.376506 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1017/2071] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:23 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:25.861558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:25.862474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:25.907796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:25.908322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:25.909360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:25.909809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:25.987871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a81ebf3-87a9-4743-9032-5e9f94bbf3b4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3edc5430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:26.162093 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a81ebf3-87a9-4743-9032-5e9f94bbf3b4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.181807 Jul 20 10:56:26.162692 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1018/2072] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:25 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:56:26.408119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:26.409604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:26.433476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:26.452594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:26.453453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:26.454069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:27.808189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:27.831475 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0ceef937-f13d-442f-892b-19a354bc6cca tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1522 microversion: 2.1 time: 1.977341 Jul 20 10:56:27.833560 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1055/2073] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:25 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1522 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:27.842789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-17c28445-7658-422e-9db1-1af9ad23b545 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3efcdb80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:28.037643 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-17c28445-7658-422e-9db1-1af9ad23b545 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.202473 Jul 20 10:56:28.039141 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1056/2074] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:27 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:28.222733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:28.239237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:28.240791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:28.242002 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d52c6cf8-6183-4e1d-8112-c3abf2fdb91b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.838027 Jul 20 10:56:28.242590 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1019/2075] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:26 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:28.851818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:28.853018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:28.868668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:28.870328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:28.872935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:28.874386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:28.878318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:29.075659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d6bb505-dbb8-4908-9449-eaf7b800e323 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f8773a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:29.197334 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d6bb505-dbb8-4908-9449-eaf7b800e323 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.148013 Jul 20 10:56:29.203474 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1020/2076] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:29 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:29.263960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:29.265762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:29.304132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:29.310202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:29.311084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:29.311561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:29.880673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:29.894911 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-affb858c-db28-425e-9815-c08f903d4cbe tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1499 microversion: 2.1 time: 1.047631 Jul 20 10:56:29.917353 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1057/2077] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:28 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1499 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:29.982906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:30.003675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:30.012820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:30.014421 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cc260e99-7188-4534-91a8-8205b8b9bd23 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 0.755998 Jul 20 10:56:30.015403 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1021/2078] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:29 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:30.032343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:30.036391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:30.037429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:30.059005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.060215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.061554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.062317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.124697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:30.209039 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58f2f8ff-3a2e-48aa-ae3c-2eb128d05ac1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.191887 Jul 20 10:56:30.212081 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1022/2079] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Jul 20 10:56:30 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:30.225866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05639cd1-a714-45f6-bac7-6f375d8776ea tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fed2430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:30.366151 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05639cd1-a714-45f6-bac7-6f375d8776ea tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.152347 Jul 20 10:56:30.373405 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1023/2080] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:30 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:30.384075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7175b824-e940-4aef-924d-ddc2c5d81759 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:30.400012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7175b824-e940-4aef-924d-ddc2c5d81759 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.400829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7175b824-e940-4aef-924d-ddc2c5d81759 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.566970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7175b824-e940-4aef-924d-ddc2c5d81759 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Going to try to start instance {{(pid=125886) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 10:56:30.655666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34724055-23dc-43ed-9e4b-2ac8bd3f9837 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Action: 'create', calling method: .version_select at 0x7f2c50d2bd30>, body: {"keypair": {"name": "tempest-keypair-1679315870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ79wkln3CK+THDr6EaDEBS/D2psS1pSg/dKoyrY155eH8Rw52uIg8TkXV00sac7tQoFM4sSI10vDDOWBfGmJW31yoakzJEW1Ih38ScGq2dcgx6rZdd4XRiEaGci87pWpQ=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:30.657911 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7175b824-e940-4aef-924d-ddc2c5d81759 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "POST /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4/action" status: 202 len: 0 microversion: 2.1 time: 0.281400 Jul 20 10:56:30.679921 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1024/2081] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:56:30 2022] POST /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:56:30.714213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:30.723495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:30.743899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-34724055-23dc-43ed-9e4b-2ac8bd3f9837 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Getting quotas for project 2e7e284f3d1941bfbc0a07318a0df461. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:56:30.753948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.758603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.766960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-34724055-23dc-43ed-9e4b-2ac8bd3f9837 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Getting quotas for user c9b9c7807eb74ecaa2cc6f7669bd09f0 and project 2e7e284f3d1941bfbc0a07318a0df461. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:56:30.768224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.768835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.841959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-34724055-23dc-43ed-9e4b-2ac8bd3f9837 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.908509 Jul 20 10:56:30.852422 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1058/2082] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:56:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:30.870675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:30.875625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:30.912185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.913055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.913897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:30.914339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:30.998674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:56:31.297550 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-62bd67c3-df06-4c9d-8751-2cb2e1ad8292 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 204 len: 0 microversion: 2.25 time: 0.442976 Jul 20 10:56:31.306235 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1059/2083] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:56:30 2022] DELETE /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:56:31.339537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:31.340750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:31.347223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:31.353386 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cdb3e46d-8057-44e3-a304-8d85c85f0dec tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1508 microversion: 2.1 time: 0.669742 Jul 20 10:56:31.353987 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1025/2084] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:30 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1508 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:31.370500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:31.373074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:31.384890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:31.389767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:31.390753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:31.391267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:31.420295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:31.421965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:31.423694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:31.424751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:33.041698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:33.064477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:33.078759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:33.087863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0ff48d5-2538-4ad4-8edd-92f56ecb8509 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.773861 Jul 20 10:56:33.092032 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1060/2085] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:31 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:33.105802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a8bc3f7-222a-4576-b8c7-556e816ddf6c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3efcdb80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:33.228379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:33.254805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:33.259493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:33.262511 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a8bc3f7-222a-4576-b8c7-556e816ddf6c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.168093 Jul 20 10:56:33.266329 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1061/2086] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:33 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:33.270443 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d0cef51-d97d-4902-8a6e-db955469d3d2 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1549 microversion: 2.25 time: 1.906212 Jul 20 10:56:33.274687 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1026/2087] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:31 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1549 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:33.285595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:33.289781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:33.314875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:33.316243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:33.317496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:33.318896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:34.114345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:34.114955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:34.129819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:34.147056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:34.147958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:34.148404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:35.313218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:35.329164 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-231cc805-546a-4674-b5e1-dc7bfcec28bb tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1512 microversion: 2.1 time: 2.053281 Jul 20 10:56:35.329765 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1062/2088] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:33 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1512 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:35.335154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3165f09-3342-4b8f-9346-aa9a8e74fb29 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3efef5e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:35.449015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3165f09-3342-4b8f-9346-aa9a8e74fb29 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.117850 Jul 20 10:56:35.450664 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1063/2089] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:35 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:35.487155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:35.488016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:35.519206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:35.520063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:35.523854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:35.525002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:36.880091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:36.905889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:36.908823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:36.913396 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cebd8916-eb79-408a-95e3-027279bddf3f tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 2.803069 Jul 20 10:56:36.919405 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1027/2090] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:34 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:56:36.931593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:36.937217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:36.942432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.servers [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Removing options 'limit' from query {{(pid=125886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 10:56:36.962750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:36.964868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:36.968607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:36.974114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:36.975748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:36.981955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c4aeb41c-63de-4501-98a4-8aceeaae177d tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.059424 Jul 20 10:56:36.985212 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1028/2091] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 10:56:36 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:56:37.004915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1609950209", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "d551f7eb-1b7b-4d28-b8fb-0384cd940d8a"}], "security_groups": [{"name": "tempest-securitygroup--1569881665"}], "key_name": "tempest-keypair-1679315870", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:37.045360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:37.610879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] validate_networks() for [('d551f7eb-1b7b-4d28-b8fb-0384cd940d8a', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:56:37.643685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:37.654685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:37.666700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:37.668090 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efb56f04-6960-427c-8166-5b57ca040e7d tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 200 len: 1549 microversion: 2.25 time: 2.212981 Jul 20 10:56:37.670246 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1064/2092] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:35 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 1549 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:37.680344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1753444-d25e-4e39-ade8-cda8e46b9f72 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f0771f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:37.790795 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1753444-d25e-4e39-ade8-cda8e46b9f72 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.114861 Jul 20 10:56:37.791432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1065/2093] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:37 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:37.802254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:37.802878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:37.819888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:37.820599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:37.821613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:37.822243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:39.815491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:39.834488 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b199161-87fe-485d-958a-1f46bb0feff2 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1512 microversion: 2.1 time: 2.040633 Jul 20 10:56:39.837036 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1066/2094] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:37 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1512 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:39.864991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:39.872667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:39.906873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:39.913196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:39.915804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:39.917626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.075549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.639764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.653767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Getting quotas for project 2e7e284f3d1941bfbc0a07318a0df461. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:56:40.663546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Getting quotas for user c9b9c7807eb74ecaa2cc6f7669bd09f0 and project 2e7e284f3d1941bfbc0a07318a0df461. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:56:40.677956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:56:40.680902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:56:40.761348 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d98c1b2-7efc-4a9f-af18-9aaedef15b0c tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.773592 Jul 20 10:56:40.767477 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1029/2095] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:56:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 3781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:56:40.790719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:40.791789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: e633ca39-5368-44a8-ae5c-829663eb825c] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:40.798965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:40.811073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:40.839146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:40.844870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:40.847513 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89da5327-b3f0-46d5-a610-16d17d195c06 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.009170 Jul 20 10:56:40.849952 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1067/2096] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:39 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:40.856591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.859692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.860621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.861087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.870806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8689e41-c9da-46ce-a3b4-4f154e43e16f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f077940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:40.884058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] HTTP exception thrown: Instance e633ca39-5368-44a8-ae5c-829663eb825c could not be found. Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Request method failure captured: Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c HTTP/1.1 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1908A8meMj2aLh4RBxGI0_lubgbkt-1X1QHcsxBE163TYM3i9fQR5q0DIC6YOI37Nua8611RBiez8-BsYtNibSvjnEytnFgp1r-h0vHk_Yv1kSr3qbDhzqg-90AWm7jCnlYPJFEThaYN3cUsRdM6boB8tF9kRWkIXZ6JNhH3g05KbRE Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8804616b1f144b18a5c5cba5ccfaaa0e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: cc3921f3f8264fb2aa9c95b86cf4dd9d Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e633ca39-5368-44a8-ae5c-829663eb825c could not be found. Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e633ca39-5368-44a8-ae5c-829663eb825c'} Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e633ca39-5368-44a8-ae5c-829663eb825c could not be found. Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e633ca39-5368-44a8-ae5c-829663eb825c could not be found. Jul 20 10:56:40.886095 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e633ca39-5368-44a8-ae5c-829663eb825c could not be found. Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:40.897203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Returning 404 to user: Instance e633ca39-5368-44a8-ae5c-829663eb825c could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:56:40.908592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23728365-9e9f-477a-9859-690c229b9c6a tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c" status: 404 len: 111 microversion: 2.25 time: 0.129640 Jul 20 10:56:40.908592 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1030/2097] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:40 2022] GET /compute/v2.1/servers/e633ca39-5368-44a8-ae5c-829663eb825c => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:56:40.910412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1ac82cc9-7eea-4405-902a-e468e70c8c44 req-13447390-52dc-4979-9040-71d932c8b304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e633ca39-5368-44a8-ae5c-829663eb825c", "name": "network-vif-deleted", "tag": "fa3c62ec-954a-4138-aa41-81928ecc6a5e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:40.929600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1ac82cc9-7eea-4405-902a-e468e70c8c44 req-13447390-52dc-4979-9040-71d932c8b304 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.929889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1ac82cc9-7eea-4405-902a-e468e70c8c44 req-13447390-52dc-4979-9040-71d932c8b304 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.947096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1ac82cc9-7eea-4405-902a-e468e70c8c44 req-13447390-52dc-4979-9040-71d932c8b304 service nova] Creating event network-vif-deleted:fa3c62ec-954a-4138-aa41-81928ecc6a5e for instance e633ca39-5368-44a8-ae5c-829663eb825c on n-h1-846219-10 Jul 20 10:56:40.954530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1ac82cc9-7eea-4405-902a-e468e70c8c44 req-13447390-52dc-4979-9040-71d932c8b304 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051939 Jul 20 10:56:40.955507 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1031/2098] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:40.962028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:40.963773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:40.973720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.974538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.975588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:40.976290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:40.991454 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8689e41-c9da-46ce-a3b4-4f154e43e16f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.138978 Jul 20 10:56:40.992785 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1068/2099] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:40 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:41.543509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:41.581010 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9586d28e-f85e-457b-bb50-701077bfd20b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1512 microversion: 2.1 time: 0.623262 Jul 20 10:56:41.581705 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1032/2100] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:40 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1512 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:41.603487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25771b82-1fe4-4306-b9bb-2b2955ad9bf2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:41.604124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25771b82-1fe4-4306-b9bb-2b2955ad9bf2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:41.763850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0caaf2b1-2511-4203-93c7-774ba2826c9a tempest-ListImagesTestJSON-1407080427 tempest-ListImagesTestJSON-1407080427-project] Calling method '.version_select at 0x7f2c3f013a60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:41.901052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0caaf2b1-2511-4203-93c7-774ba2826c9a tempest-ListImagesTestJSON-1407080427 tempest-ListImagesTestJSON-1407080427-project] 10.222.0.79 "GET /compute/v2.1/images/478de60b-94fe-4326-bea5-987154e218b6" status: 200 len: 784 microversion: 2.1 time: 0.905859 Jul 20 10:56:41.901510 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1069/2101] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:40 2022] GET /compute/v2.1/images/478de60b-94fe-4326-bea5-987154e218b6 => generated 784 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:41.906151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-25771b82-1fe4-4306-b9bb-2b2955ad9bf2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:41.919715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25771b82-1fe4-4306-b9bb-2b2955ad9bf2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1242 microversion: 2.1 time: 0.327667 Jul 20 10:56:41.929483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:41.933068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:41.934013 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1033/2102] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:41 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1242 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:41.958947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:41.959600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:41.976024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:41.978900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:41.980815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:41.981416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:42.010616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:42.011202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:42.012790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:42.013232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:42.079324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:42.109337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:56:42.370070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38d60e97-2dec-4a64-a412-ac7f9c51df9c tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 204 len: 0 microversion: 2.25 time: 0.458125 Jul 20 10:56:42.371906 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1070/2103] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:56:41 2022] DELETE /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:56:42.387616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:42.390178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:42.408285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:42.408799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:42.409887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:42.410520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:42.686082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:42.700568 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1203c691-2b99-49b7-ac0b-6a2a1d0a68a6 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1511 microversion: 2.1 time: 0.762138 Jul 20 10:56:42.706067 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1034/2104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:41 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1511 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:42.726823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33c2f566-3c13-4756-b3a8-f8e696328d09 tempest-ListImagesTestJSON-1407080427 tempest-ListImagesTestJSON-1407080427-project] Calling method '.version_select at 0x7f2c3f910940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:42.865672 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33c2f566-3c13-4756-b3a8-f8e696328d09 tempest-ListImagesTestJSON-1407080427 tempest-ListImagesTestJSON-1407080427-project] 10.222.0.79 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.154995 Jul 20 10:56:42.877365 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1035/2105] 10.222.0.79 () {58 vars in 1121 bytes} [Wed Jul 20 10:56:42 2022] GET /compute/v2.1/images => generated 445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:42.896721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d619d059-0723-44b8-bbc3-89bc7d5f5e05 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f4d8670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:43.005352 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d619d059-0723-44b8-bbc3-89bc7d5f5e05 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.126226 Jul 20 10:56:43.014781 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1036/2106] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:42 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:43.016222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.032284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.038205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.039719 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-241e36b1-0a24-45ad-b878-0e89425b7338 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 0.664882 Jul 20 10:56:43.044844 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1071/2107] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:42 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:43.047787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:43.050905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:43.055048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:43.064876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.066159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:43.097698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:43.104804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:43.116676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:43.117404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:43.393967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:43.394402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:43.395320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:43.395930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:43.577008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:43.579806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:43.723254 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d12c34d-04b2-44f3-9829-60150efe8415 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 0.676810 Jul 20 10:56:43.725584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1072/2108] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Jul 20 10:56:43 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:43.741105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4300fcd-61e1-494b-abc6-ce572f0147a2 tempest-ListImagesTestJSON-1407080427 tempest-ListImagesTestJSON-1407080427-project] Calling method '.version_select at 0x7f2c3f127670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:43.743239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.765275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.771538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc3921f3f8264fb2aa9c95b86cf4dd9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8804616b1f144b18a5c5cba5ccfaaa0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:43.776416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-27a33bc9-1f4b-4525-ba4d-627266f01b27 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 200 len: 1563 microversion: 2.25 time: 0.757722 Jul 20 10:56:43.780903 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1037/2109] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:43 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 1563 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:43.789947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:43.794390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:43.830702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:43.831474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:43.836372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:43.837038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:43.864388 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4300fcd-61e1-494b-abc6-ce572f0147a2 tempest-ListImagesTestJSON-1407080427 tempest-ListImagesTestJSON-1407080427-project] 10.222.0.79 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.137439 Jul 20 10:56:43.865187 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1073/2110] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 10:56:43 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:44.065910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:44.084393 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1af2cf11-eda9-4031-a6f7-0c3c99c6ddbb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1312 microversion: 2.1 time: 0.301683 Jul 20 10:56:44.085918 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1038/2111] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:43 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:44.101531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:44.104520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:44.119948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:44.120360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:44.122678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:44.125199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:44.807529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:44.826914 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b7ba1830-03ea-4005-8456-3d10ed173a7a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1512 microversion: 2.1 time: 0.732819 Jul 20 10:56:44.827965 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1039/2112] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:44 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1512 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:44.837113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-49f9c277-d0b1-437a-ba36-b5bf56855cd9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f877310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:44.851113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1319937390", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "7190106c-4abd-43a7-91c7-4a44ae33114d"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:45.034838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-49f9c277-d0b1-437a-ba36-b5bf56855cd9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.204132 Jul 20 10:56:45.044185 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1040/2113] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:44 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:45.055822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] validate_networks() for [('7190106c-4abd-43a7-91c7-4a44ae33114d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:56:45.060597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:45.068851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:45.115344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:45.116512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:45.117755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:45.118365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:46.279242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:46.294889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:46.308080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:46.311616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04c125c9-e69e-4d5a-bf3b-5ea833644a0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.261913 Jul 20 10:56:46.312946 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1041/2114] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:45 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:46.322994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:46.324733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] [instance: cb079f77-4d01-445b-85ff-da7793b9aefb] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:46.345442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:46.346144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:46.347203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:46.348156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:46.400705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] HTTP exception thrown: Instance cb079f77-4d01-445b-85ff-da7793b9aefb could not be found. Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Request method failure captured: Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb HTTP/1.1 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1908A8meMj2aLh4RBxGI0_lubgbkt-1X1QHcsxBE163TYM3i9fQR5q0DIC6YOI37Nua8611RBiez8-BsYtNibSvjnEytnFgp1r-h0vHk_Yv1kSr3qbDhzqg-90AWm7jCnlYPJFEThaYN3cUsRdM6boB8tF9kRWkIXZ6JNhH3g05KbRE Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.25 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8804616b1f144b18a5c5cba5ccfaaa0e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8804616b1f144b18a5c5cba5ccfaaa0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8804616b1f144b18a5c5cba5ccfaaa0e Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741 Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: cc3921f3f8264fb2aa9c95b86cf4dd9d Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1028162741-project Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance cb079f77-4d01-445b-85ff-da7793b9aefb could not be found. Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'cb079f77-4d01-445b-85ff-da7793b9aefb'} Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb079f77-4d01-445b-85ff-da7793b9aefb could not be found. Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb079f77-4d01-445b-85ff-da7793b9aefb could not be found. Jul 20 10:56:46.402817 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb079f77-4d01-445b-85ff-da7793b9aefb could not be found. Jul 20 10:56:46.406830 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:46.408339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] Returning 404 to user: Instance cb079f77-4d01-445b-85ff-da7793b9aefb could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:56:46.409362 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0cf8b6e9-81be-4606-9da2-383763262164 tempest-LiveAutoBlockMigrationV225Test-1028162741 tempest-LiveAutoBlockMigrationV225Test-1028162741-project] 10.222.0.79 "GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb" status: 404 len: 111 microversion: 2.25 time: 0.094559 Jul 20 10:56:46.410416 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1042/2115] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:46 2022] GET /compute/v2.1/servers/cb079f77-4d01-445b-85ff-da7793b9aefb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:56:46.416071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:46.416861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:46.436641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:46.437092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:46.438080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:46.438687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:48.193112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:48.200708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:56:48.201228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:56:48.201708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:56:48.202131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:56:48.202553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:56:48.212280 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bcc4f21e-ad4d-4df5-97eb-afc3593403f9 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1512 microversion: 2.1 time: 1.800628 Jul 20 10:56:48.227352 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1043/2116] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:46 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1512 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:48.241784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:48.247506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:48.248884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:48.249164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:48.249954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:48.252240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:48.310111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:48.311586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:48.317520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:48.318279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:48.364335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Getting quotas for project c3fbe1b5416c4494b2b02f8f92d06cdb. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:56:48.387555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Getting quotas for user 3e914003f728485786a2c9daf350c8ed and project c3fbe1b5416c4494b2b02f8f92d06cdb. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:56:48.407522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:56:48.410495 n-d-846219-10 devstack@n-api.service[125885]: WARNING nova.utils [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1319937390 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-131993739 Jul 20 10:56:48.411491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:56:48.551863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3b7605a6-5055-4236-9b89-976501014912 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.674997 Jul 20 10:56:48.556373 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1074/2117] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 4690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:56:48.947144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e649814d-30ff-47c2-9b2f-4de1a7c00454 req-88399a5d-eeef-4cc7-9024-d6af3be916f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb079f77-4d01-445b-85ff-da7793b9aefb", "name": "network-vif-deleted", "tag": "14f4e2fa-0661-43d1-a011-83ca3e6093aa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:48.975414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e649814d-30ff-47c2-9b2f-4de1a7c00454 req-88399a5d-eeef-4cc7-9024-d6af3be916f2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:48.975862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e649814d-30ff-47c2-9b2f-4de1a7c00454 req-88399a5d-eeef-4cc7-9024-d6af3be916f2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:49.022555 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e649814d-30ff-47c2-9b2f-4de1a7c00454 req-88399a5d-eeef-4cc7-9024-d6af3be916f2 service nova] Creating event network-vif-deleted:14f4e2fa-0661-43d1-a011-83ca3e6093aa for instance cb079f77-4d01-445b-85ff-da7793b9aefb on n-h1-846219-10 Jul 20 10:56:49.041441 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e649814d-30ff-47c2-9b2f-4de1a7c00454 req-88399a5d-eeef-4cc7-9024-d6af3be916f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.483042 Jul 20 10:56:49.043432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1075/2118] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:49.052177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36081438-8b2b-4509-938d-5e39e5a60b2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c50d690d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:49.158114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36081438-8b2b-4509-938d-5e39e5a60b2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.113025 Jul 20 10:56:49.158880 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1076/2119] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:49 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:49.173044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:49.173806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:49.191642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:49.196351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:49.197484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:49.197945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:49.240899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:49.259189 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe103133-83a1-4795-b546-cc2b646b61bc tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1368 microversion: 2.1 time: 1.030212 Jul 20 10:56:49.274816 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1044/2120] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:48 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1368 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:49.281077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-42cc8541-a596-42b2-b2ee-2814f1f135b7 req-7f80bfa6-79e1-454f-815d-1f2f5b186820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c30aa1d-4b39-48b1-985a-5dac3991b904", "tag": "c2136b8d-d742-4eb3-a19a-3e1cb30798c2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:49.334835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-42cc8541-a596-42b2-b2ee-2814f1f135b7 req-7f80bfa6-79e1-454f-815d-1f2f5b186820 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:49.344441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-42cc8541-a596-42b2-b2ee-2814f1f135b7 req-7f80bfa6-79e1-454f-815d-1f2f5b186820 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:49.391643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-42cc8541-a596-42b2-b2ee-2814f1f135b7 req-7f80bfa6-79e1-454f-815d-1f2f5b186820 service nova] Creating event network-changed:c2136b8d-d742-4eb3-a19a-3e1cb30798c2 for instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 on n-h2-846219-10 Jul 20 10:56:49.408515 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-42cc8541-a596-42b2-b2ee-2814f1f135b7 req-7f80bfa6-79e1-454f-815d-1f2f5b186820 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130164 Jul 20 10:56:49.410828 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1045/2121] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:49.431151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5e332773-2b2b-4630-86e2-d5a83037dadf req-47c77f28-d7ac-4daa-bdda-8c6c1b015df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "cb2a6275-25f7-48cc-a346-d8cb908ad01b"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:49.507612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e332773-2b2b-4630-86e2-d5a83037dadf req-47c77f28-d7ac-4daa-bdda-8c6c1b015df3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:49.509387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e332773-2b2b-4630-86e2-d5a83037dadf req-47c77f28-d7ac-4daa-bdda-8c6c1b015df3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:49.582191 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5e332773-2b2b-4630-86e2-d5a83037dadf req-47c77f28-d7ac-4daa-bdda-8c6c1b015df3 service nova] Creating event network-vif-plugged:cb2a6275-25f7-48cc-a346-d8cb908ad01b for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:49.607718 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5e332773-2b2b-4630-86e2-d5a83037dadf req-47c77f28-d7ac-4daa-bdda-8c6c1b015df3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193930 Jul 20 10:56:49.613237 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1046/2122] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:49.641052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:49.645257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:49.678528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:49.696280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:49.697526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:49.698129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:50.640559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:50.724401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:50.738904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d1b9bba-a361-4ccb-941e-97b1d53a7457 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1511 microversion: 2.1 time: 1.124308 Jul 20 10:56:50.747953 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1047/2123] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:49 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1511 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:50.771842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:50.776257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:50.781714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:50.819248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:50.820534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:50.824408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:50.826597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:50.827832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:50.830513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:50.840986 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-60d40267-61ae-4f01-a15d-908829e6e180 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 1.678355 Jul 20 10:56:50.849145 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1077/2124] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:49 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:50.873069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-01472cf7-a795-44f8-a8fe-2a68d9069d56 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c50d69ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:50.970544 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-01472cf7-a795-44f8-a8fe-2a68d9069d56 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1413 microversion: 2.1 time: 0.116984 Jul 20 10:56:50.981734 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1078/2125] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:50 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:51.034460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:51.036869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:51.072677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:51.075786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:51.080181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:51.083657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:51.354385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:51.383424 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c45973f-2017-41d5-a84f-c9f7f235e4cb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1284 microversion: 2.1 time: 0.631892 Jul 20 10:56:51.390694 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1048/2126] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:50 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1284 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:51.417340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:51.434260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:51.439820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:51.460678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:51.464907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:51.469319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:51.469959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:51.576211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:51.674111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:51.689806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:51.691934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:51.993226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:52.003903 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b6dc0b0-e687-4e5e-9fb9-0f94dd269af5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1368 microversion: 2.1 time: 1.010258 Jul 20 10:56:52.029024 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1079/2127] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:50 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1368 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:52.268445 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-36fae53d-9b06-4700-83f3-2fda30bafbae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.874264 Jul 20 10:56:52.269084 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1049/2128] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:56:51 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:52.274309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:52.274937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:52.295752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.296666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.297503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.297957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.444063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57a46510-4d3a-4aae-983a-a0babb4a9f84 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Calling method '.version_select at 0x7f2c3efabb80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:52.461667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57a46510-4d3a-4aae-983a-a0babb4a9f84 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.462782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57a46510-4d3a-4aae-983a-a0babb4a9f84 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.464687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57a46510-4d3a-4aae-983a-a0babb4a9f84 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.466402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57a46510-4d3a-4aae-983a-a0babb4a9f84 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.503990 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57a46510-4d3a-4aae-983a-a0babb4a9f84 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.472516 Jul 20 10:56:52.505106 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1080/2129] 10.222.0.79 () {58 vars in 1121 bytes} [Wed Jul 20 10:56:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:52.510622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "06bceed4-358e-4d55-97b4-32bcd00f7e6a"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "49fa9fc9-d879-4192-864a-efb8c87674fb"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "43fd4ffa-6bca-4aac-b6cc-fccb361cf680"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "d4904062-7549-4970-b00f-51b1691b28cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:52.536385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.537036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.560169 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Creating event network-vif-plugged:06bceed4-358e-4d55-97b4-32bcd00f7e6a for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:52.561029 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Creating event network-vif-plugged:49fa9fc9-d879-4192-864a-efb8c87674fb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:52.561738 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Creating event network-vif-plugged:43fd4ffa-6bca-4aac-b6cc-fccb361cf680 for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:52.564477 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] Creating event network-vif-plugged:d4904062-7549-4970-b00f-51b1691b28cb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:52.584630 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d7fbafca-1d98-41b6-81c3-c42d76a736b5 req-f8164862-72aa-41e8-b2d1-5c3f14df411e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.074917 Jul 20 10:56:52.588775 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1081/2130] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:52.611486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ff6517f-6d75-4823-8681-b73716b6a2f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3efcd790>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:52.708582 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ff6517f-6d75-4823-8681-b73716b6a2f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1422 microversion: 2.1 time: 0.115488 Jul 20 10:56:52.709527 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1082/2131] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:52 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:52.729578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:52.739062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:52.741569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:52.926761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.927355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.930154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:52.932051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:52.955160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:52.970812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:52.978748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:52.981681 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e7848141-2171-4bfd-ae01-ee5ae5d38483 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 0.710011 Jul 20 10:56:53.001327 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1050/2132] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:52 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:53.016609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:53.022234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:53.031515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:53.032396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:53.033496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:53.034201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:53.227332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:53.236284 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5517584e-841e-4331-ae79-338989f3a695 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1290 microversion: 2.1 time: 0.233280 Jul 20 10:56:53.240790 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1051/2133] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:53 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1290 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:53.242775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:53.256277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-962621915", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:53.310091 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e5f1c930-05f4-48bd-9ba4-f32625f8b272 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.599406 Jul 20 10:56:53.315707 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1083/2134] 10.222.0.79 () {58 vars in 1149 bytes} [Wed Jul 20 10:56:52 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:53.333902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13746988-b346-4e58-9d32-4b7d8439247f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f139790>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:53.391880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:56:53.405549 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13746988-b346-4e58-9d32-4b7d8439247f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 200 len: 1422 microversion: 2.1 time: 0.083694 Jul 20 10:56:53.413370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1084/2135] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:56:53 2022] GET /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:53.419821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:53.420920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:53.429272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:53.430137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:53.431140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:53.431840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:53.969369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:53.977551 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-17a20dab-29be-45e4-9566-28c4fb286a04 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1368 microversion: 2.1 time: 0.562676 Jul 20 10:56:53.978127 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1085/2136] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:53 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1368 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:53.983398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:53.987508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:53.988228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:54.001324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:54.001972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:54.002923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:54.003837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:54.061599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Getting quotas for project 47571ffdc88b4d969bd37fb6f8035177. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:56:54.070781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Getting quotas for user 3d78080330ac4d359d211f2dca39fd4a and project 47571ffdc88b4d969bd37fb6f8035177. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:56:54.092186 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Request method failure captured: Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 1751 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi199z566mQHlyBz8OJjXxBIWZVKtG6UazOFUb7O_XSWB3v50v37MCoFIlKY_FqtS59P1mNB-iufbA_5gAgx0l4iTEN_sDUO5bCMeSKPoj90OHJ5crkLAEEh4duHbTddD-tAfPuJq-76WTiFUYypNEQL8dv9CVoBviCKLRFUAiA3tIZ58 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 47571ffdc88b4d969bd37fb6f8035177 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2141529338 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_47571ffdc88b4d969bd37fb6f8035177", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47571ffdc88b4d969bd37fb6f8035177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/47571ffdc88b4d969bd37fb6f8035177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/47571ffdc88b4d969bd37fb6f8035177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2141529338 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 47571ffdc88b4d969bd37fb6f8035177 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2141529338 Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3d78080330ac4d359d211f2dca39fd4a Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-962621915", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:56:54.095243 n-d-846219-10 devstack@n-api.service[125886]: exception: Maximum number of metadata items exceeds 128 Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-962621915', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:56:54.097227 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 20 10:56:54.099613 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:56:54.103236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:56:54.104535 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84286a2f-723b-4271-ba8d-00ac22308b14 tempest-AbsoluteLimitsNegativeTestJSON-2141529338 tempest-AbsoluteLimitsNegativeTestJSON-2141529338-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.862779 Jul 20 10:56:54.105898 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1052/2137] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Jul 20 10:56:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 864 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:56:54.112195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b64a1a02-4dff-48d2-9838-1bec176822de tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3edcec10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:54.119107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:54.224625 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-21eb10cb-0ac8-4a1f-82c8-6d785d9c8b66 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.245233 Jul 20 10:56:54.226246 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1086/2138] 10.222.0.79 () {58 vars in 1211 bytes} [Wed Jul 20 10:56:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:54.233482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:54.234472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:54.242661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:54.243432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:54.244920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:54.246954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.067195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:55.084230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:55.088651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:55.094536 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0f456c5-31c7-4537-8c1d-8272a41e4e0b tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 0.865095 Jul 20 10:56:55.096461 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1087/2139] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:54 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:55.107356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:55.119824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:55.121350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:55.129318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.130165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.131495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.132180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.320666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:55.439833 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b64a1a02-4dff-48d2-9838-1bec176822de tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 204 len: 0 microversion: 2.1 time: 1.332242 Jul 20 10:56:55.440487 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1053/2140] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:54 2022] DELETE /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 0 bytes in 1334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:56:55.444892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:55.445502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:55.460219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.464823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.464823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.464823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.510894 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89881fb9-cecc-4f95-93ed-b1bc1f6a740b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.412654 Jul 20 10:56:55.514796 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1088/2141] 10.222.0.79 () {58 vars in 1195 bytes} [Wed Jul 20 10:56:55 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:55.525736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d0d221dc-22cd-4f9a-901b-87202a1ba290 req-4f0d454b-06e2-49b0-95d9-8974566f9ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "55374b6a-08ec-41f5-a6cc-936f12ac152c"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-plugged", "status": "completed", "tag": "d8034b29-1e24-41aa-ad30-d4f95643b5dc"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:55.536120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d0d221dc-22cd-4f9a-901b-87202a1ba290 req-4f0d454b-06e2-49b0-95d9-8974566f9ea3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.536654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d0d221dc-22cd-4f9a-901b-87202a1ba290 req-4f0d454b-06e2-49b0-95d9-8974566f9ea3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.553467 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d0d221dc-22cd-4f9a-901b-87202a1ba290 req-4f0d454b-06e2-49b0-95d9-8974566f9ea3 service nova] Creating event network-vif-plugged:55374b6a-08ec-41f5-a6cc-936f12ac152c for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:55.554192 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d0d221dc-22cd-4f9a-901b-87202a1ba290 req-4f0d454b-06e2-49b0-95d9-8974566f9ea3 service nova] Creating event network-vif-plugged:d8034b29-1e24-41aa-ad30-d4f95643b5dc for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:56:55.561291 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d0d221dc-22cd-4f9a-901b-87202a1ba290 req-4f0d454b-06e2-49b0-95d9-8974566f9ea3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044494 Jul 20 10:56:55.562287 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1089/2142] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:55.570157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:55.570872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:55.593880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.603591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.604705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:55.605697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:55.970371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:55.992688 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c06fe17e-d184-45f6-9c67-73760b40df14 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.551176 Jul 20 10:56:55.995191 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1054/2143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:55 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:56.005889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:56.006406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:56.019610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.020040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.021195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.021821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.116711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:56:56.161247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:56.176827 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-37ed992b-3efa-40ba-9f93-55dc8cafdc13 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1368 microversion: 2.1 time: 0.604556 Jul 20 10:56:56.187770 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1090/2144] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:55 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1368 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:56.197838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:56.225939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:56.226792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': '1877119379', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:56.247017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.248774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.250334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.250463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:56.252738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.360570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a95e2a5-0d8f-4c22-b088-a5f0f588ae61 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 204 len: 0 microversion: 2.1 time: 0.359174 Jul 20 10:56:56.361223 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1055/2145] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:56:55 2022] DELETE /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:56:56.386800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:56.387692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:56.412588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.413541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.416092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.416595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.511932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:56.686392 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3c6cf853-1ad0-49c9-bfbe-2d0fa0488968 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?name=1877119379" status: 200 len: 346 microversion: 2.1 time: 0.497405 Jul 20 10:56:56.687361 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1091/2146] 10.222.0.79 () {58 vars in 1155 bytes} [Wed Jul 20 10:56:56 2022] GET /compute/v2.1/servers?name=1877119379 => generated 346 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:56.692729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8a673ac9-1132-4583-baae-9c9ff3edd2c2 req-127a9610-5d03-4de5-b1c6-9ce1adb5e055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77e5fd3-4dfc-4d75-86b4-1636e6f6f026", "tag": "80b5f929-c755-4f33-8621-16746bd37d6d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:56.707477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8a673ac9-1132-4583-baae-9c9ff3edd2c2 req-127a9610-5d03-4de5-b1c6-9ce1adb5e055 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.708401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8a673ac9-1132-4583-baae-9c9ff3edd2c2 req-127a9610-5d03-4de5-b1c6-9ce1adb5e055 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.740558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8a673ac9-1132-4583-baae-9c9ff3edd2c2 req-127a9610-5d03-4de5-b1c6-9ce1adb5e055 service nova] Creating event network-changed:80b5f929-c755-4f33-8621-16746bd37d6d for instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 on n-h1-846219-10 Jul 20 10:56:56.747741 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8a673ac9-1132-4583-baae-9c9ff3edd2c2 req-127a9610-5d03-4de5-b1c6-9ce1adb5e055 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058464 Jul 20 10:56:56.749136 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1092/2147] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:56.766725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:56.780755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:56.782026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:56.791760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.793278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.794368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:56.795039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:56.876414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:56.892882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:56.899057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:56.901849 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-917df933-049c-4392-8bb0-db6f66a28a7d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1875 microversion: 2.42 time: 0.536304 Jul 20 10:56:56.905666 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1056/2148] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:56 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1875 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:56.918800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1708772017", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "ba902a31-3b1d-4754-b2cf-d3223978362f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:56.997148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:57.009714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] validate_networks() for [('ba902a31-3b1d-4754-b2cf-d3223978362f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:56:57.127722 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f7239e9d-3bd6-4b5a-8c2c-cc3093d89fde tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.376957 Jul 20 10:56:57.128679 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1093/2149] 10.222.0.79 () {58 vars in 1153 bytes} [Wed Jul 20 10:56:56 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:57.141919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:57.142988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:57.150378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.150930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.151865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.152608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.485511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:57.496211 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d3450e88-41f3-4c5d-bdfb-5e95baa4d965 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.359259 Jul 20 10:56:57.505880 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1094/2150] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:57 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:57.537506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:57.547219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:57.553230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-187711937', 'deleted': False, 'project_id': 'f5f06f30aefd48fc944292795da922ac'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 10:56:57.576129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.578958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.584399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.585539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.749768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 10:56:57.754642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:57.842954 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d59cc4d-4e59-45a9-8398-b297479edb55 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-187711937" status: 200 len: 346 microversion: 2.1 time: 0.335159 Jul 20 10:56:57.846162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:56:57.846907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:56:57.847579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:56:57.848133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:56:57.848805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:56:57.851574 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1095/2151] 10.222.0.79 () {58 vars in 1227 bytes} [Wed Jul 20 10:56:57 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-187711937 => generated 346 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:57.857447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:57.858309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:57.865502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.866368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.867375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.867980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.869199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.869658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.870489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:57.870988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:57.910922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:56:57.918635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for user 78f1e2aa093b45c2b9063b057251feab and project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:56:57.940328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:56:57.946559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:56:58.054168 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c056fd89-79ae-4ac5-b18a-8c15f0102ea8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146818 Jul 20 10:56:58.056032 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1057/2152] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:56:58.062295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-817dc828-7683-4791-965e-3de9760e91fc req-f3315bc2-51aa-4011-b7db-fcf327ccfdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c30aa1d-4b39-48b1-985a-5dac3991b904", "name": "network-vif-plugged", "status": "completed", "tag": "c2136b8d-d742-4eb3-a19a-3e1cb30798c2"}, {"server_uuid": "47561663-9022-4b9f-b8aa-91f078552c26", "name": "network-vif-unplugged", "status": "completed", "tag": "b8d6e196-3d2f-4390-989b-db20ca951932"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:58.075561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-817dc828-7683-4791-965e-3de9760e91fc req-f3315bc2-51aa-4011-b7db-fcf327ccfdde service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.076262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-817dc828-7683-4791-965e-3de9760e91fc req-f3315bc2-51aa-4011-b7db-fcf327ccfdde service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:58.095521 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-817dc828-7683-4791-965e-3de9760e91fc req-f3315bc2-51aa-4011-b7db-fcf327ccfdde service nova] Creating event network-vif-plugged:c2136b8d-d742-4eb3-a19a-3e1cb30798c2 for instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 on n-h2-846219-10 Jul 20 10:56:58.096649 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-817dc828-7683-4791-965e-3de9760e91fc req-f3315bc2-51aa-4011-b7db-fcf327ccfdde service nova] Creating event network-vif-unplugged:b8d6e196-3d2f-4390-989b-db20ca951932 for instance 47561663-9022-4b9f-b8aa-91f078552c26 on n-h1-846219-10 Jul 20 10:56:58.109993 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-817dc828-7683-4791-965e-3de9760e91fc req-f3315bc2-51aa-4011-b7db-fcf327ccfdde service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.052510 Jul 20 10:56:58.133130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1058/2153] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:58.143068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:58.144006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:58.154669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:58.157301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.158066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:58.159018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.159715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:58.213018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:56:58.341536 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-824f139b-ede3-49a7-b06d-ec7af628301b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 204 len: 0 microversion: 2.1 time: 0.206293 Jul 20 10:56:58.342496 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1059/2154] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:56:58 2022] DELETE /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:56:58.348905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:58.349725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:58.357301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.358069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:58.358931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.359882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:58.389222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:58.401556 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a047163c-a2a8-47df-8d6f-ac6ee2f208ef tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1368 microversion: 2.1 time: 0.548745 Jul 20 10:56:58.402090 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1096/2155] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:57 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1368 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:58.407072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7cf28e7-615e-43c4-88cd-d47fa5de3d31 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:58.407714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7cf28e7-615e-43c4-88cd-d47fa5de3d31 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:58.622742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7cf28e7-615e-43c4-88cd-d47fa5de3d31 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:58.635803 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7cf28e7-615e-43c4-88cd-d47fa5de3d31 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1208 microversion: 2.1 time: 0.232198 Jul 20 10:56:58.637339 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1097/2156] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:58 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:58.642628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:58.644261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:58.652485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:56:58.654973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.655803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:58.656814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:58.657422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.021092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:59.032141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:59.034287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:59.036678 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-af4f1846-1931-49a8-8167-d6f49bb437ec tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2833 microversion: 2.42 time: 0.692454 Jul 20 10:56:59.037981 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1060/2157] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:56:58 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2833 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:59.047414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:59.048971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:59.057311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.058716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.059856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.060503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.284747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:59.296772 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c296e90-b899-40fa-8d9b-f8b0cb367769 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1517 microversion: 2.1 time: 0.658134 Jul 20 10:56:59.321655 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1098/2158] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:58 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1517 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:59.331891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:59.332628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:59.357619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.364418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.365652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.370077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.688304 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d1f0b89-66b9-4c26-8b46-f3a4883bd0ee tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.365046 Jul 20 10:56:59.689575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1099/2159] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 10:56:59 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472/os-interface => generated 1831 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:56:59.695439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:59.696320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:59.723539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.724007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.724876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.725323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.890194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:56:59.898190 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5de66acb-c755-415b-b1ce-e660e66e1ff4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.858443 Jul 20 10:56:59.905749 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1061/2160] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:59 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:56:59.913102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a33b235c-8e6e-44d3-bf56-bdc7ddc39400 req-8e417fb6-b61c-44b8-82d8-6f2520c908d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47561663-9022-4b9f-b8aa-91f078552c26", "name": "network-vif-deleted", "tag": "b8d6e196-3d2f-4390-989b-db20ca951932"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:56:59.932844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a33b235c-8e6e-44d3-bf56-bdc7ddc39400 req-8e417fb6-b61c-44b8-82d8-6f2520c908d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.933876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a33b235c-8e6e-44d3-bf56-bdc7ddc39400 req-8e417fb6-b61c-44b8-82d8-6f2520c908d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.966971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a33b235c-8e6e-44d3-bf56-bdc7ddc39400 req-8e417fb6-b61c-44b8-82d8-6f2520c908d2 service nova] Creating event network-vif-deleted:b8d6e196-3d2f-4390-989b-db20ca951932 for instance 47561663-9022-4b9f-b8aa-91f078552c26 on n-h1-846219-10 Jul 20 10:56:59.972507 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a33b235c-8e6e-44d3-bf56-bdc7ddc39400 req-8e417fb6-b61c-44b8-82d8-6f2520c908d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064711 Jul 20 10:56:59.973500 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1062/2161] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:56:59.982439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:56:59.983199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:56:59.990419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.990932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:56:59.991731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:56:59.992167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:00.177070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:00.187592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-03b8d76f-87c2-486c-ba5a-fa2da4281358 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1266 microversion: 2.1 time: 0.212649 Jul 20 10:57:00.188270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1063/2162] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:59 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:00.425171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:00.429274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:00.432160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:00.443659 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0131c26b-bf83-4a48-a4a2-9128946ee2cf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1368 microversion: 2.1 time: 0.752752 Jul 20 10:57:00.444458 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1100/2163] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:56:59 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1368 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:00.460132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:00.460723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:00.461637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:00.463993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:00.925324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:00.925947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:00.939648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:00.940638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:00.941897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:00.942578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:01.688744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:01.707788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:01.752803 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f7b1adb-fe54-411b-a27a-ec94b3ae5d23 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 200 len: 1517 microversion: 2.1 time: 1.415741 Jul 20 10:57:01.767023 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bd4765ad-3595-4b49-abcd-faa30575470b tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.832366 Jul 20 10:57:01.768697 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1064/2164] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:00 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 1517 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:01.769206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1101/2165] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:00 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:01.794962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:01.795771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:01.796459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:01.800068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:01.815223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:01.815953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:01.817212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:01.817812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:01.817931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:01.818362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:01.819141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:01.820895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.307255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:02.322234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e6d36e4-3d8b-4b02-9307-4f7ae9d7fcd3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1558 microversion: 2.1 time: 0.537976 Jul 20 10:57:02.328582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1102/2166] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:01 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1558 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:02.332993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:02.334361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-59d50982-3e05-4ef2-96a8-a20fc047ff18 req-f51d41f4-0b06-401b-a9fe-eff44879ec46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac793c66-c63a-4616-97b4-9bf0367c9c12", "name": "network-vif-deleted", "tag": "aef43059-c894-40e7-8490-4411fe17c8c5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:02.347715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cff54cb3-ce89-447a-be47-0190cdeb7b98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 0.566145 Jul 20 10:57:02.349130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1065/2167] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:01 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:02.354229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-59d50982-3e05-4ef2-96a8-a20fc047ff18 req-f51d41f4-0b06-401b-a9fe-eff44879ec46 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.354688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-59d50982-3e05-4ef2-96a8-a20fc047ff18 req-f51d41f4-0b06-401b-a9fe-eff44879ec46 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.366761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:02.368003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:02.376989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.378133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.379294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.380028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.383036 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-59d50982-3e05-4ef2-96a8-a20fc047ff18 req-f51d41f4-0b06-401b-a9fe-eff44879ec46 service nova] Creating event network-vif-deleted:aef43059-c894-40e7-8490-4411fe17c8c5 for instance ac793c66-c63a-4616-97b4-9bf0367c9c12 on n-h2-846219-10 Jul 20 10:57:02.393128 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-59d50982-3e05-4ef2-96a8-a20fc047ff18 req-f51d41f4-0b06-401b-a9fe-eff44879ec46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062219 Jul 20 10:57:02.393791 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1103/2168] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:02.558416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c1070c8-6277-42cd-a54b-14144fbad308 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207819 Jul 20 10:57:02.559039 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1066/2169] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 10:57:02 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:02.773273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:02.773983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: ac793c66-c63a-4616-97b4-9bf0367c9c12] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:02.785982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.786454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.787301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.787743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:02.788200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.788357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:02.801968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.802772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.803628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.804066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.827237 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] HTTP exception thrown: Instance ac793c66-c63a-4616-97b4-9bf0367c9c12 could not be found. Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Request method failure captured: Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 HTTP/1.1 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198NA09nykPCtcHx9BHZBYNyTiEf6dnvjDy-vlhflUn_tuMlZdrTw9GUDrlny_zjhB3N892-gQEBovSmf454KP0TN0BXmjLSqVUSS-7xAk5PMmpfJSsxNUeN1hu_szx9SPI6UZi-5F8BHn2YEkruPd6g9GHekD_dSme6v2cICtn76j0 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f5f06f30aefd48fc944292795da922ac Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5f06f30aefd48fc944292795da922ac", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f5f06f30aefd48fc944292795da922ac Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListServerFiltersTestJSON-1684503392-project Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d22e86a63c954ed1ae4bbeae23bf5296 Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListServerFiltersTestJSON-1684503392-project Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ac793c66-c63a-4616-97b4-9bf0367c9c12 could not be found. Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ac793c66-c63a-4616-97b4-9bf0367c9c12'} Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac793c66-c63a-4616-97b4-9bf0367c9c12 could not be found. Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac793c66-c63a-4616-97b4-9bf0367c9c12 could not be found. Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:02.832002 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac793c66-c63a-4616-97b4-9bf0367c9c12 could not be found. Jul 20 10:57:02.835826 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:02.837301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Returning 404 to user: Instance ac793c66-c63a-4616-97b4-9bf0367c9c12 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:02.839793 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b987c83a-33da-4b44-98fa-090cbe99c5c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12" status: 404 len: 111 microversion: 2.1 time: 0.071251 Jul 20 10:57:02.840401 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1104/2170] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:02 2022] GET /compute/v2.1/servers/ac793c66-c63a-4616-97b4-9bf0367c9c12 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:57:02.852579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:02.853477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:02.869419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.870337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.873885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:02.874618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:02.937234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:57:03.085441 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-07b3eb3c-29f2-44c2-934f-4706614e1b80 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "DELETE /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 204 len: 0 microversion: 2.1 time: 0.239843 Jul 20 10:57:03.086997 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1105/2171] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:57:02 2022] DELETE /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:57:03.096804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:03.104567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:03.140150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:03.140608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:03.142781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:03.144278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:03.909230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:03.921644 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9f71ef1-9f0f-425a-be3f-2e1ff1592516 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 1.139551 Jul 20 10:57:03.922222 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1067/2172] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:02 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:03.927427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:03.928319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:03.935255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:03.937345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:03.938225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:03.939278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:04.634219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:04.642530 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e26784a6-8d9b-4e0c-bed2-8b4555f320ae tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1518 microversion: 2.1 time: 1.549872 Jul 20 10:57:04.647554 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1106/2173] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:03 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1518 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:04.722579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8ba12148-3a78-4412-ac8f-0b662b7eef38 req-7daad413-e188-4ee8-844f-8c3a00a2c1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "tag": "d4904062-7549-4970-b00f-51b1691b28cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:04.753304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8ba12148-3a78-4412-ac8f-0b662b7eef38 req-7daad413-e188-4ee8-844f-8c3a00a2c1a1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:04.753749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8ba12148-3a78-4412-ac8f-0b662b7eef38 req-7daad413-e188-4ee8-844f-8c3a00a2c1a1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:04.775069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8ba12148-3a78-4412-ac8f-0b662b7eef38 req-7daad413-e188-4ee8-844f-8c3a00a2c1a1 service nova] Creating event network-changed:d4904062-7549-4970-b00f-51b1691b28cb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 10:57:04.790211 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8ba12148-3a78-4412-ac8f-0b662b7eef38 req-7daad413-e188-4ee8-844f-8c3a00a2c1a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072451 Jul 20 10:57:04.793189 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1107/2174] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:57:04.857552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:04.874025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ead08bf-2c2d-4e60-86ab-7bbf4b97d9ab tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 0.950299 Jul 20 10:57:04.885279 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1068/2175] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:03 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:04.939639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:04.940577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:04.954826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:04.960019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:04.961327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:04.961976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:05.406665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:05.424787 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67106f8d-1e84-4c37-a444-bea3877c2826 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.490207 Jul 20 10:57:05.431163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1108/2176] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:04 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:05.664488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:05.665727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:05.692555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:05.693385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:05.694386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:05.695027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:05.894122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:05.895420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:05.913808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:05.916051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:05.918438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:05.919707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:07.250832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:07.268434 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f4410ec-6763-4903-98db-2c5f04b5e14b tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1518 microversion: 2.1 time: 1.608457 Jul 20 10:57:07.278624 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1069/2177] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:05 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1518 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:07.283767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c5a78e68-3812-4aa2-8f9c-4feae0b3e2b6 req-786e70a4-4cc8-470b-a89d-2fbee500b4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42d9d15-9585-4fdf-9a76-ebcbe7eba769", "tag": "e4318dc4-aab8-4ad9-9217-fd31b663ae7a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:07.293240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c5a78e68-3812-4aa2-8f9c-4feae0b3e2b6 req-786e70a4-4cc8-470b-a89d-2fbee500b4c9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:07.294141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c5a78e68-3812-4aa2-8f9c-4feae0b3e2b6 req-786e70a4-4cc8-470b-a89d-2fbee500b4c9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:07.308993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:07.312359 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c5a78e68-3812-4aa2-8f9c-4feae0b3e2b6 req-786e70a4-4cc8-470b-a89d-2fbee500b4c9 service nova] Creating event network-changed:e4318dc4-aab8-4ad9-9217-fd31b663ae7a for instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 on n-h1-846219-10 Jul 20 10:57:07.317697 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c5a78e68-3812-4aa2-8f9c-4feae0b3e2b6 req-786e70a4-4cc8-470b-a89d-2fbee500b4c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037388 Jul 20 10:57:07.318834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1070/2178] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:07.327033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:07.328008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:07.331762 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31c56e5e-4cb1-4c4d-b40c-69d862021b52 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 1.442496 Jul 20 10:57:07.333025 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1109/2179] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:05 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:07.336216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:07.336855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:07.337820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:07.339058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:07.887065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:07.906867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:07.920055 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f30bbb52-48cd-424f-9dcf-b757be177e12 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.599337 Jul 20 10:57:07.921131 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1071/2180] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:07 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:08.290610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:08.292865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:08.311859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-581e27bc-e932-443a-9dd3-8ab594dc4378 req-f7714929-9792-47c7-a83f-ef0d3433d79e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c30aa1d-4b39-48b1-985a-5dac3991b904", "tag": "c2136b8d-d742-4eb3-a19a-3e1cb30798c2"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:08.320375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=18 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:08.336628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=20 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:08.342914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:08.346596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:08.352331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:08.353180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:08.353634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-581e27bc-e932-443a-9dd3-8ab594dc4378 req-f7714929-9792-47c7-a83f-ef0d3433d79e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:08.354318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-581e27bc-e932-443a-9dd3-8ab594dc4378 req-f7714929-9792-47c7-a83f-ef0d3433d79e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:08.392340 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-581e27bc-e932-443a-9dd3-8ab594dc4378 req-f7714929-9792-47c7-a83f-ef0d3433d79e service nova] Creating event network-changed:c2136b8d-d742-4eb3-a19a-3e1cb30798c2 for instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 on n-h2-846219-10 Jul 20 10:57:08.401831 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-581e27bc-e932-443a-9dd3-8ab594dc4378 req-f7714929-9792-47c7-a83f-ef0d3433d79e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099701 Jul 20 10:57:08.404750 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1072/2181] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:57:08.431299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:08.435386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:08.457789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:08.458498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:08.459513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:08.460103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:08.629742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:09.020146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:09.033855 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c7e56436-9ee7-4a3e-ad1d-d769817ad39a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1518 microversion: 2.1 time: 0.751560 Jul 20 10:57:09.034463 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1110/2182] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:08 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1518 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:09.049088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:09.049814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:09.060285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:09.060734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:09.062708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:09.067548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:09.382844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:09.398114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07fc1c75-0e30-43bc-8275-1017b62e5f37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 0.983990 Jul 20 10:57:09.399602 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1073/2183] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:08 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:09.415965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-10abddac-46fc-42f9-a2e5-02500f65425a req-d6ebf267-9f4f-4aa1-9154-38eaa8e7137f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77e5fd3-4dfc-4d75-86b4-1636e6f6f026", "name": "network-vif-plugged", "status": "completed", "tag": "80b5f929-c755-4f33-8621-16746bd37d6d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:09.434195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-10abddac-46fc-42f9-a2e5-02500f65425a req-d6ebf267-9f4f-4aa1-9154-38eaa8e7137f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:09.434958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-10abddac-46fc-42f9-a2e5-02500f65425a req-d6ebf267-9f4f-4aa1-9154-38eaa8e7137f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:09.438443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:09.460565 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-10abddac-46fc-42f9-a2e5-02500f65425a req-d6ebf267-9f4f-4aa1-9154-38eaa8e7137f service nova] Creating event network-vif-plugged:80b5f929-c755-4f33-8621-16746bd37d6d for instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 on n-h1-846219-10 Jul 20 10:57:09.466901 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-10abddac-46fc-42f9-a2e5-02500f65425a req-d6ebf267-9f4f-4aa1-9154-38eaa8e7137f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054863 Jul 20 10:57:09.467935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1074/2184] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:09.596931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:09.618889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e5d9b02e-58ea-4631-8c08-6bc918799d6d tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 0.579726 Jul 20 10:57:09.633031 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1111/2185] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:09 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:10.056132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:10.066050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:10.094340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.099564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:10.100964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.102074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:10.203914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.204423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:10.205049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lazy-loading 'fault' on Instance uuid 635dd2a0-b653-4c43-8602-c3aa1092900e {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:57:10.424218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:10.427711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:10.438684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.439507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:10.441123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.442053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:10.822086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:10.835663 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-06bdf846-4e83-4ac1-89bf-72887974b7c3 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 200 len: 1310 microversion: 2.1 time: 0.788489 Jul 20 10:57:10.839755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1075/2186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:10 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 1310 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:10.852594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:10.853612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:10.870286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.871345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:10.872815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:10.873881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:11.697215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:11.707585 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f53d1e3c-c62c-490c-980e-39b35392de00 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 1.292881 Jul 20 10:57:11.711125 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1112/2187] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:10 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:11.725599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-384175c2-bf96-4c61-ae0b-15b3df45add6 req-d2c3b8ee-8c0f-4475-ab0d-b6373b07e9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635dd2a0-b653-4c43-8602-c3aa1092900e", "name": "network-vif-deleted", "tag": "fcd03379-316f-4f51-9233-1fb6290dc9d6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:11.744611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-384175c2-bf96-4c61-ae0b-15b3df45add6 req-d2c3b8ee-8c0f-4475-ab0d-b6373b07e9f6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:11.746025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-384175c2-bf96-4c61-ae0b-15b3df45add6 req-d2c3b8ee-8c0f-4475-ab0d-b6373b07e9f6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:11.771071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-384175c2-bf96-4c61-ae0b-15b3df45add6 req-d2c3b8ee-8c0f-4475-ab0d-b6373b07e9f6 service nova] Creating event network-vif-deleted:fcd03379-316f-4f51-9233-1fb6290dc9d6 for instance 635dd2a0-b653-4c43-8602-c3aa1092900e on n-h1-846219-10 Jul 20 10:57:11.785098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-384175c2-bf96-4c61-ae0b-15b3df45add6 req-d2c3b8ee-8c0f-4475-ab0d-b6373b07e9f6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072370 Jul 20 10:57:11.787508 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1113/2188] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:11.857433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:11.858140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 635dd2a0-b653-4c43-8602-c3aa1092900e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:11.869787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:11.870878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:11.871718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:11.872156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:11.887486 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] HTTP exception thrown: Instance 635dd2a0-b653-4c43-8602-c3aa1092900e could not be found. Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Request method failure captured: Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e HTTP/1.1 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198NA09nykPCtcHx9BHZBYNyTiEf6dnvjDy-vlhflUn_tuMlZdrTw9GUDrlny_zjhB3N892-gQEBovSmf454KP0TN0BXmjLSqVUSS-7xAk5PMmpfJSsxNUeN1hu_szx9SPI6UZi-5F8BHn2YEkruPd6g9GHekD_dSme6v2cICtn76j0 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f5f06f30aefd48fc944292795da922ac Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5f06f30aefd48fc944292795da922ac", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f5f06f30aefd48fc944292795da922ac Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListServerFiltersTestJSON-1684503392-project Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d22e86a63c954ed1ae4bbeae23bf5296 Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListServerFiltersTestJSON-1684503392-project Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 635dd2a0-b653-4c43-8602-c3aa1092900e could not be found. Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '635dd2a0-b653-4c43-8602-c3aa1092900e'} Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635dd2a0-b653-4c43-8602-c3aa1092900e could not be found. Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635dd2a0-b653-4c43-8602-c3aa1092900e could not be found. Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:11.890091 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635dd2a0-b653-4c43-8602-c3aa1092900e could not be found. Jul 20 10:57:11.893771 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:11.896302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Returning 404 to user: Instance 635dd2a0-b653-4c43-8602-c3aa1092900e could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:11.898180 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0485eec2-a1ed-4eff-9290-6b136c72a6c4 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e" status: 404 len: 111 microversion: 2.1 time: 0.046180 Jul 20 10:57:11.899328 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1114/2189] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:11 2022] GET /compute/v2.1/servers/635dd2a0-b653-4c43-8602-c3aa1092900e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 10:57:11.902655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:11.907781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:11.911627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:11.912717 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-90f8320c-e2d7-4390-b817-8d5bf4eb967e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1332 microversion: 2.1 time: 1.071054 Jul 20 10:57:11.913830 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1076/2190] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:10 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1332 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:11.924273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:11.924891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:11.925782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:11.926322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:11.931300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:11.962577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:57:12.078100 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f994d7c3-a4e5-463e-9b72-3d04b0b180a7 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 204 len: 0 microversion: 2.1 time: 0.171298 Jul 20 10:57:12.079639 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1115/2191] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:57:11 2022] DELETE /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 10:57:12.089351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:12.090896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:12.102861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.104100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:12.105671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.106126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:12.320481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:12.330040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e28304ef-f1c3-43cb-a33e-7cda3c87983f tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1518 microversion: 2.1 time: 0.246264 Jul 20 10:57:12.340899 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1077/2192] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:12 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:12.686267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ad56329c-f0cb-4603-85ba-86c189a46a44 req-4cdff1ec-97d9-426a-a4b8-e608f28af1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d9d15-9585-4fdf-9a76-ebcbe7eba769", "name": "network-vif-plugged", "status": "completed", "tag": "e4318dc4-aab8-4ad9-9217-fd31b663ae7a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:12.699740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ad56329c-f0cb-4603-85ba-86c189a46a44 req-4cdff1ec-97d9-426a-a4b8-e608f28af1f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.704147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ad56329c-f0cb-4603-85ba-86c189a46a44 req-4cdff1ec-97d9-426a-a4b8-e608f28af1f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:12.728836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:12.731886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:12.739036 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ad56329c-f0cb-4603-85ba-86c189a46a44 req-4cdff1ec-97d9-426a-a4b8-e608f28af1f1 service nova] Creating event network-vif-plugged:e4318dc4-aab8-4ad9-9217-fd31b663ae7a for instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 on n-h1-846219-10 Jul 20 10:57:12.744199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.747106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:12.748229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.750575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:12.752931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ad56329c-f0cb-4603-85ba-86c189a46a44 req-4cdff1ec-97d9-426a-a4b8-e608f28af1f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071071 Jul 20 10:57:12.759208 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1116/2193] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:12.899956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:12.908178 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a8df8288-2966-4eed-8713-241339ed27f5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 0.183668 Jul 20 10:57:12.918426 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1078/2194] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:12 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:12.934082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:12.934979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:12.950789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.952037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:12.953954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:12.954825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:13.218836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:13.228559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f70c7ba-2178-4fff-a59f-ed75753f8819 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1536 microversion: 2.1 time: 0.301277 Jul 20 10:57:13.242875 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1117/2195] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:12 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1536 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:13.248723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09f6a086-925b-4791-80f1-8588b86219fb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'create', calling method: .version_select at 0x7f2c3fb20b80>, body: {"pool": "6cf8ba49-b406-4ceb-9f39-7791c406c545"} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:13.364731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:13.366186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:13.403609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:13.404509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:13.408489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:13.416343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:13.909619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:13.934200 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05017aca-d05b-46d6-9f95-52eb0f5f17a1 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1518 microversion: 2.1 time: 0.588843 Jul 20 10:57:13.949035 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1118/2196] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:13 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1518 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:13.961782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:13.964511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:13.981401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:13.984195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:13.988685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:13.990546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:14.508831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:14.521907 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61d454ed-c9ba-459a-9e52-9d1eeea0a112 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1308 microversion: 2.1 time: 0.571403 Jul 20 10:57:14.525732 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1119/2197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:13 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:14.952289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:14.952837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:14.966467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:14.966810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:14.970228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:14.970705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:15.193121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd22e86a63c954ed1ae4bbeae23bf5296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f06f30aefd48fc944292795da922ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:15.208156 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2c7520d8-81de-472f-af8c-ad85ef2f1c0a tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 200 len: 1476 microversion: 2.1 time: 0.260196 Jul 20 10:57:15.210970 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1120/2198] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:14 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:15.466969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-aa19b8a3-4624-4d46-aa11-8ae78a48eae0 req-13abd7f7-39db-419d-90d0-40793d4d8415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c561681-3ac8-474b-8b91-e4d18b788ad4", "name": "network-vif-deleted", "tag": "a49c07e3-44f1-4c93-a523-3bdc739473a0"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:15.513209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aa19b8a3-4624-4d46-aa11-8ae78a48eae0 req-13abd7f7-39db-419d-90d0-40793d4d8415 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:15.513668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aa19b8a3-4624-4d46-aa11-8ae78a48eae0 req-13abd7f7-39db-419d-90d0-40793d4d8415 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:15.542486 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-aa19b8a3-4624-4d46-aa11-8ae78a48eae0 req-13abd7f7-39db-419d-90d0-40793d4d8415 service nova] Creating event network-vif-deleted:a49c07e3-44f1-4c93-a523-3bdc739473a0 for instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 on n-h2-846219-10 Jul 20 10:57:15.555376 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-aa19b8a3-4624-4d46-aa11-8ae78a48eae0 req-13abd7f7-39db-419d-90d0-40793d4d8415 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090339 Jul 20 10:57:15.556135 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1121/2199] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:57:15.569793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:15.570449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:15.594778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:15.596209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:15.600110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:15.600850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.159534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:16.186866 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5afeab05-9093-4ffc-b108-42e363a170f4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1488 microversion: 2.1 time: 0.628966 Jul 20 10:57:16.189851 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1122/2200] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:15 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1488 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:16.208503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35d4164d-7d69-41ef-8bb6-61e10dd57f75 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:16.234160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35d4164d-7d69-41ef-8bb6-61e10dd57f75 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.234858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35d4164d-7d69-41ef-8bb6-61e10dd57f75 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.289035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35d4164d-7d69-41ef-8bb6-61e10dd57f75 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Going to try to stop instance {{(pid=125885) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 10:57:16.374156 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35d4164d-7d69-41ef-8bb6-61e10dd57f75 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769/action" status: 202 len: 0 microversion: 2.1 time: 0.170074 Jul 20 10:57:16.376403 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1123/2201] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:16 2022] POST /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:57:16.403636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:16.406773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] [instance: 9c561681-3ac8-474b-8b91-e4d18b788ad4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:16.415271 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09f6a086-925b-4791-80f1-8588b86219fb tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.171060 Jul 20 10:57:16.416649 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1079/2202] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:57:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:16.422699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:16.423691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:16.430489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.433950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.435104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.435822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.446217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.447038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.448191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.449218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.471475 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] HTTP exception thrown: Instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 could not be found. Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Request method failure captured: Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 HTTP/1.1 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198NA09nykPCtcHx9BHZBYNyTiEf6dnvjDy-vlhflUn_tuMlZdrTw9GUDrlny_zjhB3N892-gQEBovSmf454KP0TN0BXmjLSqVUSS-7xAk5PMmpfJSsxNUeN1hu_szx9SPI6UZi-5F8BHn2YEkruPd6g9GHekD_dSme6v2cICtn76j0 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f5f06f30aefd48fc944292795da922ac Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5f06f30aefd48fc944292795da922ac", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5f06f30aefd48fc944292795da922ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f5f06f30aefd48fc944292795da922ac Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1684503392 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListServerFiltersTestJSON-1684503392-project Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d22e86a63c954ed1ae4bbeae23bf5296 Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListServerFiltersTestJSON-1684503392-project Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 could not be found. Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9c561681-3ac8-474b-8b91-e4d18b788ad4'} Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 could not be found. Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 could not be found. Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:16.478774 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 could not be found. Jul 20 10:57:16.483542 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:16.486902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] Returning 404 to user: Instance 9c561681-3ac8-474b-8b91-e4d18b788ad4 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:16.488457 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-45b55b77-3086-4151-a8ce-0e6d39779333 tempest-ListServerFiltersTestJSON-1684503392 tempest-ListServerFiltersTestJSON-1684503392-project] 10.222.0.79 "GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4" status: 404 len: 111 microversion: 2.1 time: 0.110742 Jul 20 10:57:16.491542 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1124/2203] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:16 2022] GET /compute/v2.1/servers/9c561681-3ac8-474b-8b91-e4d18b788ad4 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:57:16.502451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.120"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:16.506782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:16.524382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.527750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.529416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:16.531640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:16.566506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Acquired lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:57:16.777283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:16.799022 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f65b96eb-2ce0-4df4-bf5c-c1abf382feb6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.380044 Jul 20 10:57:16.811638 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1080/2204] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:16 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:17.244208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2128436196", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "8eca6e20-80c8-4d82-8b5f-90492e04a676"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:17.346614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] validate_networks() for [('8eca6e20-80c8-4d82-8b5f-90492e04a676', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:57:18.734186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Building network info cache for instance {{(pid=125885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:57:18.948343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:57:18.951154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:57:18.955387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:57:18.956645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:57:18.957798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:57:18.991864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:18.996655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:19.002359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:19.006621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:19.055028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Getting quotas for project 46f5dd26f7ed47b093c82406bba71003. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:19.071008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Getting quotas for user 6d751bac5ac1467e94f71bdd5f6af4c5 and project 46f5dd26f7ed47b093c82406bba71003. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:19.115592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:57:19.128554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:57:19.291676 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f93eea0f-988b-4c2e-ae4d-4a031cf36601 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.478245 Jul 20 10:57:19.296177 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1081/2205] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:57:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:57:20.221277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e28d617-8983-4d47-a021-3d20e37a247a tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f22f5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:20.428987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Updating instance_info_cache with network_info: [{"id": "80b5f929-c755-4f33-8621-16746bd37d6d", "address": "fa:16:3e:4b:43:a1", "network": {"id": "7190106c-4abd-43a7-91c7-4a44ae33114d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1693847261-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c3fbe1b5416c4494b2b02f8f92d06cdb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap80b5f929-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:57:20.449807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Releasing lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:57:20.452971 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e11d2ffd-49a1-407d-896e-b2bf3ae91e65 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action" status: 202 len: 0 microversion: 2.1 time: 3.959009 Jul 20 10:57:20.476193 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1125/2206] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:16 2022] POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action => generated 0 bytes in 3984 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:57:20.483551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:20.485468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:20.493048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:20.493803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:20.494888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:20.499696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:20.793634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e28d617-8983-4d47-a021-3d20e37a247a tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:20.796275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e28d617-8983-4d47-a021-3d20e37a247a tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:20.797366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e28d617-8983-4d47-a021-3d20e37a247a tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:20.799351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e28d617-8983-4d47-a021-3d20e37a247a tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:20.885243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:20.900505 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5dfa3be5-a58d-4b04-958b-4a6667a6e6cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.422610 Jul 20 10:57:20.903451 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1126/2207] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:20 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:20.910779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-50ff8bfc-648e-425c-929b-92071f4a75cb req-f3cf4588-ff01-40ef-8d3b-ed1e22993425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77e5fd3-4dfc-4d75-86b4-1636e6f6f026", "tag": "80b5f929-c755-4f33-8621-16746bd37d6d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:20.943628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-50ff8bfc-648e-425c-929b-92071f4a75cb req-f3cf4588-ff01-40ef-8d3b-ed1e22993425 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:20.944914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-50ff8bfc-648e-425c-929b-92071f4a75cb req-f3cf4588-ff01-40ef-8d3b-ed1e22993425 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:20.992236 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e28d617-8983-4d47-a021-3d20e37a247a tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad" status: 200 len: 240 microversion: 2.36 time: 1.693299 Jul 20 10:57:20.994462 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-50ff8bfc-648e-425c-929b-92071f4a75cb req-f3cf4588-ff01-40ef-8d3b-ed1e22993425 service nova] Creating event network-changed:80b5f929-c755-4f33-8621-16746bd37d6d for instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 on n-h1-846219-10 Jul 20 10:57:20.997911 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1082/2208] 10.222.0.79 () {62 vars in 1302 bytes} [Wed Jul 20 10:57:19 2022] PUT /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad => generated 240 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:57:21.004317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:21.014406 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-50ff8bfc-648e-425c-929b-92071f4a75cb req-f3cf4588-ff01-40ef-8d3b-ed1e22993425 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109037 Jul 20 10:57:21.016010 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1127/2209] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:21.017598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:21.041339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d39241d8-b178-46df-a157-971bab91f500 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'create', calling method: .version_select at 0x7f2c3fca4820>, body: {"pool": "6cf8ba49-b406-4ceb-9f39-7791c406c545"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:21.047485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:21.056352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:21.067320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:21.068220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:21.569963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:21.599519 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e6cb5d4e-d3dc-42f6-892e-2422cb4825ec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1221 microversion: 2.1 time: 0.599687 Jul 20 10:57:21.607560 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1083/2210] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:20 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1221 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:21.619369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89af7a12-b2bb-4603-8d87-84af1d8c4121 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Calling method '.version_select at 0x7f2c3f22fc10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:22.221235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89af7a12-b2bb-4603-8d87-84af1d8c4121 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:22.227244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89af7a12-b2bb-4603-8d87-84af1d8c4121 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:22.228813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89af7a12-b2bb-4603-8d87-84af1d8c4121 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:22.229695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89af7a12-b2bb-4603-8d87-84af1d8c4121 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:22.293348 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-89af7a12-b2bb-4603-8d87-84af1d8c4121 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad/detail" status: 200 len: 672 microversion: 2.36 time: 0.681984 Jul 20 10:57:22.297247 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1084/2211] 10.222.0.79 () {60 vars in 1303 bytes} [Wed Jul 20 10:57:21 2022] GET /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad/detail => generated 672 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:57:22.310394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:22.311037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:22.328563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:22.332907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:22.334297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:22.335957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:22.797810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:22.843893 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be2c682c-7fa5-4545-8771-74819be48849 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.544727 Jul 20 10:57:22.846753 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1085/2212] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:22 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:22.866940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:22.868945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:22.889476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:22.896050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:22.898304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:22.900557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:23.070174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:23.111710 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee2fd779-b981-470e-bb32-ff8a4594042a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1283 microversion: 2.1 time: 0.262721 Jul 20 10:57:23.112812 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1086/2213] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:22 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:23.132180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f65d1f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:23.252431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:23.253312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:23.254362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:23.255078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:23.293418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:23.306619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:23.307656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:23.309229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:23.309955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:23.407541 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb868d8a-0110-4a03-b6c4-f99393f55a4e tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad?user_id=990988657c6b43c58afba6e881003f44" status: 200 len: 240 microversion: 2.36 time: 0.285349 Jul 20 10:57:23.409559 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1087/2214] 10.222.0.79 () {62 vars in 1383 bytes} [Wed Jul 20 10:57:23 2022] PUT /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad?user_id=990988657c6b43c58afba6e881003f44 => generated 240 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:57:23.418825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60a9545c-0290-4f40-993f-8c795a2520c9 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] Calling method '.version_select at 0x7f2c3f877a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:23.799019 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60a9545c-0290-4f40-993f-8c795a2520c9 tempest-QuotasAdminTestV236-1115876557 tempest-QuotasAdminTestV236-1115876557-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad?user_id=990988657c6b43c58afba6e881003f44" status: 200 len: 282 microversion: 2.36 time: 0.384343 Jul 20 10:57:23.801124 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1088/2215] 10.222.0.79 () {60 vars in 1363 bytes} [Wed Jul 20 10:57:23 2022] GET /compute/v2.1/os-quota-sets/06d44125e2214218b61dedae815639ad?user_id=990988657c6b43c58afba6e881003f44 => generated 282 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:57:23.862085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:23.863356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:23.872875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:23.874852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:23.881585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:23.882524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:24.368999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:24.385263 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33dfc3c6-0852-4a5a-85b8-a83131c5fb83 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.527273 Jul 20 10:57:24.386769 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1089/2216] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:23 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:24.409930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:24.410409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:24.418005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:24.418940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:24.419984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:24.420604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:24.710646 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d39241d8-b178-46df-a157-971bab91f500 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.688068 Jul 20 10:57:24.718157 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1128/2217] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 10:57:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:24.723353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.177"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:24.727895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:24.739410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:24.740037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:24.741071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:24.741674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:24.749379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:24.768831 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4791edb7-7e47-4157-bcfd-6297121c036d tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.367458 Jul 20 10:57:24.769965 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1090/2218] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:24 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:24.776073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Acquired lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:57:25.409947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:25.410713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:25.429938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:25.430747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:25.431696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:25.431980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:25.715641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545.", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:57:25.716547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Releasing lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:57:25.717874 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.717874 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Request method failure captured: Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action HTTP/1.1 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 46 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi199q4GDZEBobbLMDtQICazPZX1piWtGaZc2VlCwhHQfOCSKC9-_fWFcz2SoXv66nf9J-vfT3xD-hGDuKsd_0RpfhApHfIQNq7XxyUaMDmmwtKh3NcqPVYNKZkOvI1w_V2nSTSsZwsBc9ATNlD3-jl18ymLU9qa9GfZwBTOD4AAIBn-s Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c3fbe1b5416c4494b2b02f8f92d06cdb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3e914003f728485786a2c9daf350c8ed Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: {"addFloatingIp": {"address": "172.25.0.177"}} Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a77e5fd3-4dfc-4d75-86b4-1636e6f6f026', 'body': {'addFloatingIp': {'address': '172.25.0.177'}}} Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:57:25.720780 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] Jul 20 10:57:25.724168 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:25.730341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Returning 400 to user: Cannot associate floating IP 172.25.0.177 (d358ffa5-c582-4e41-a0c2-bcfbade4edc4) with port 80b5f929-c755-4f33-8621-16746bd37d6d using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 6cf8ba49-b406-4ceb-9f39-7791c406c545. Jul 20 10:57:25.730341 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-ac718e39-0888-472f-8d3b-d8861549834e'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:25.731712 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b03de08f-6897-474e-a77d-323e522cc216 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action" status: 400 len: 381 microversion: 2.1 time: 1.012494 Jul 20 10:57:25.734299 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1129/2219] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:24 2022] POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action => generated 381 bytes in 1015 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:57:25.742915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d67df997-64d7-4a1b-b64b-bd5adceebf72 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '.version_select at 0x7f2c3fc521f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:25.914631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:25.929831 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9faa413f-77b2-4211-a5eb-5a6a1f952628 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.529599 Jul 20 10:57:25.936042 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1091/2220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:25 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:25.941955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:25.946762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:25.960921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:25.964502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:25.971336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:25.972306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:27.437730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:27.450982 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6cc7812d-c635-4897-b8e2-bcba64fad1c2 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 1.512961 Jul 20 10:57:27.453899 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1092/2221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:25 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:27.467867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0b5a5e0b-5109-4e23-81d8-2e51126b1f3c req-e37f4dd4-4b20-42d3-bedd-af86ce41656a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2110464-2cf1-4489-88a1-8e985254b394", "tag": "e11bde05-7cc1-47b5-88e5-f88fe7d9a772"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:27.496107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0b5a5e0b-5109-4e23-81d8-2e51126b1f3c req-e37f4dd4-4b20-42d3-bedd-af86ce41656a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:27.498539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0b5a5e0b-5109-4e23-81d8-2e51126b1f3c req-e37f4dd4-4b20-42d3-bedd-af86ce41656a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:27.546762 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0b5a5e0b-5109-4e23-81d8-2e51126b1f3c req-e37f4dd4-4b20-42d3-bedd-af86ce41656a service nova] Creating event network-changed:e11bde05-7cc1-47b5-88e5-f88fe7d9a772 for instance b2110464-2cf1-4489-88a1-8e985254b394 on n-h2-846219-10 Jul 20 10:57:27.561169 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0b5a5e0b-5109-4e23-81d8-2e51126b1f3c req-e37f4dd4-4b20-42d3-bedd-af86ce41656a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104496 Jul 20 10:57:27.564322 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1093/2222] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:27.582338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:27.583545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:27.606935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:27.608738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:27.613275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:27.615844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:28.424168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:28.439959 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f438c82c-99d6-485d-b7be-31209c27e31d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.871624 Jul 20 10:57:28.451779 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1094/2223] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:27 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:28.477520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:28.481653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:28.504628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:28.505515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:28.510761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:28.516756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:28.926447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:28.930540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:28.938171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a838bb49-4de1-445b-8999-b1fc57a9efec tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.469125 Jul 20 10:57:28.951815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1095/2224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:28 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:29.379989 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d67df997-64d7-4a1b-b64b-bd5adceebf72 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/d358ffa5-c582-4e41-a0c2-bcfbade4edc4" status: 202 len: 0 microversion: 2.1 time: 3.642092 Jul 20 10:57:29.381347 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1130/2225] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:57:25 2022] DELETE /compute/v2.1/os-floating-ips/d358ffa5-c582-4e41-a0c2-bcfbade4edc4 => generated 0 bytes in 3644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:57:29.392128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.120"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:29.464222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:29.465595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:29.468936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:29.481607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:29.482290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:29.483795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:29.485714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:29.789704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:29.797139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:29.797870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:29.798871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:29.806131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:30.146651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:30.155032 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a35eed3f-c342-4c43-80ec-78606e082ceb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.697724 Jul 20 10:57:30.160823 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1131/2226] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:29 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:30.171585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:30.172544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:30.179812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:30.180732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:30.181791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:30.183195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:30.227208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Acquired lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:57:30.647904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:30.670198 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7b3f1e2d-7ba5-4295-8b62-5c49d1ca1040 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.505312 Jul 20 10:57:30.672175 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1132/2227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:30 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:31.181209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:31.182926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:31.191160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:31.191160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:31.192220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:31.192846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:31.199003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:31.829866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:31.844560 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fa453b52-de7d-4025-9887-fb043506d129 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.669981 Jul 20 10:57:31.845422 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1133/2228] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:31 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:31.853558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:31.855750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:31.864644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:31.865095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:31.865896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:31.866329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.319821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:32.333619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc475f98-763c-4e5a-be31-d29f94a2aca7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.486108 Jul 20 10:57:32.334912 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1134/2229] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:31 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:32.500172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Building network info cache for instance {{(pid=125886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 10:57:32.554800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3fa3aca0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:32.561166 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:32.561166 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:32.563383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.564241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.583263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.587594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.601529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] HTTP exception thrown: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Request method failure captured: Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e HTTP/1.1 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 56 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-cpVpNyytda0RADB2yZqziQziJeQBiuB6xlgq7wni17V__nvnF04QX0uzZbDM0sFsnUVbnWkwgA9BiYt-P_YZ5N0kMf0hLmecWubphn1Q4tPmIl7tuxOFOahj9HI7B339uLXumoQtMpttBTpHAsdEUzkmZRnP5xjgG4g_E8OLu_6I Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 65b6d0fb49bd48899267573d742c94e9 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_65b6d0fb49bd48899267573d742c94e9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 65b6d0fb49bd48899267573d742c94e9 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 422fbd9f9ed44be781f69f14a5f5d355 Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: exception: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:57:32.603806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.609336 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.611939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Returning 404 to user: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:32.613055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1cbf3d26-f220-4f38-8e56-6db4b5ae709c tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e" status: 404 len: 110 microversion: 2.53 time: 0.276613 Jul 20 10:57:32.622044 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1135/2230] 10.222.0.79 () {62 vars in 1308 bytes} [Wed Jul 20 10:57:32 2022] PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e => generated 110 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:57:32.629664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-58fb8b5b-61ad-438d-b0cc-32925c096a5b req-858c087b-be5b-4f33-b20d-b7a6ba3e4340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77e5fd3-4dfc-4d75-86b4-1636e6f6f026", "tag": "80b5f929-c755-4f33-8621-16746bd37d6d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:32.657816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-58fb8b5b-61ad-438d-b0cc-32925c096a5b req-858c087b-be5b-4f33-b20d-b7a6ba3e4340 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.658831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-58fb8b5b-61ad-438d-b0cc-32925c096a5b req-858c087b-be5b-4f33-b20d-b7a6ba3e4340 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.687760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-58fb8b5b-61ad-438d-b0cc-32925c096a5b req-858c087b-be5b-4f33-b20d-b7a6ba3e4340 service nova] Creating event network-changed:80b5f929-c755-4f33-8621-16746bd37d6d for instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 on n-h1-846219-10 Jul 20 10:57:32.701831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-58fb8b5b-61ad-438d-b0cc-32925c096a5b req-858c087b-be5b-4f33-b20d-b7a6ba3e4340 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076913 Jul 20 10:57:32.705714 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1136/2231] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:32.711619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Action: 'update', calling method: .version_select at 0x7f2c3f9c4280>, body: {"status": "disabled"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:32.718313 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:32.718313 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:32.726531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.731974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.741365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.741995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.750778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] HTTP exception thrown: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Request method failure captured: Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e HTTP/1.1 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 22 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-cpVpNyytda0RADB2yZqziQziJeQBiuB6xlgq7wni17V__nvnF04QX0uzZbDM0sFsnUVbnWkwgA9BiYt-P_YZ5N0kMf0hLmecWubphn1Q4tPmIl7tuxOFOahj9HI7B339uLXumoQtMpttBTpHAsdEUzkmZRnP5xjgG4g_E8OLu_6I Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 65b6d0fb49bd48899267573d742c94e9 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_65b6d0fb49bd48899267573d742c94e9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 65b6d0fb49bd48899267573d742c94e9 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 422fbd9f9ed44be781f69f14a5f5d355 Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: {"status": "disabled"} Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: exception: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e', 'body': {'status': 'disabled'}} Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:57:32.753273 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.757296 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.758003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Returning 404 to user: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:32.759013 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5032c60-ad4a-4818-8798-6071c8b655ab tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e" status: 404 len: 110 microversion: 2.53 time: 0.051012 Jul 20 10:57:32.767371 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1137/2232] 10.222.0.79 () {62 vars in 1308 bytes} [Wed Jul 20 10:57:32 2022] PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e => generated 110 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:57:32.774372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Action: 'update', calling method: .version_select at 0x7f2c50d84e50>, body: {"status": "enabled"} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:32.778520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.779451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.788061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.788806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.795754 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] HTTP exception thrown: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Request method failure captured: Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e HTTP/1.1 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 21 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-cpVpNyytda0RADB2yZqziQziJeQBiuB6xlgq7wni17V__nvnF04QX0uzZbDM0sFsnUVbnWkwgA9BiYt-P_YZ5N0kMf0hLmecWubphn1Q4tPmIl7tuxOFOahj9HI7B339uLXumoQtMpttBTpHAsdEUzkmZRnP5xjgG4g_E8OLu_6I Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 65b6d0fb49bd48899267573d742c94e9 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_65b6d0fb49bd48899267573d742c94e9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/65b6d0fb49bd48899267573d742c94e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 65b6d0fb49bd48899267573d742c94e9 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 422fbd9f9ed44be781f69f14a5f5d355 Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: {"status": "enabled"} Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: exception: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e', 'body': {'status': 'enabled'}} Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:57:32.797970 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. Jul 20 10:57:32.802231 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:32.804472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Returning 404 to user: Service ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:32.805533 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5f4fc5d-cd67-486b-90ba-607db84d621b tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e" status: 404 len: 110 microversion: 2.53 time: 0.036026 Jul 20 10:57:32.807446 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1138/2233] 10.222.0.79 () {62 vars in 1308 bytes} [Wed Jul 20 10:57:32 2022] PUT /compute/v2.1/os-services/ddbf47e5-cf76-4c0c-a9eb-28a14c57d67e => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:57:32.827293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-228fbe19-54dd-4ecf-a4bc-487ee3236963 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:32.829346 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:32.829346 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:32.831202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-228fbe19-54dd-4ecf-a4bc-487ee3236963 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.832446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-228fbe19-54dd-4ecf-a4bc-487ee3236963 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.833508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-228fbe19-54dd-4ecf-a4bc-487ee3236963 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.834736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-228fbe19-54dd-4ecf-a4bc-487ee3236963 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.879224 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-228fbe19-54dd-4ecf-a4bc-487ee3236963 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.064770 Jul 20 10:57:32.886581 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1139/2234] 10.222.0.79 () {60 vars in 1177 bytes} [Wed Jul 20 10:57:32 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:57:32.895582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:32.896847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:32.906825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.907706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:32.908776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:32.909435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:33.317395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:33.330859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=11 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:33.347982 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eade926a-2f6a-4b6f-8b13-286933e5b940 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.458310 Jul 20 10:57:33.350103 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1140/2235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:32 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:33.374677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eae24a06-a3e8-4c33-823d-83095dc71de5 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:33.377619 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:33.377619 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:33.379496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eae24a06-a3e8-4c33-823d-83095dc71de5 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:33.380216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eae24a06-a3e8-4c33-823d-83095dc71de5 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:33.382203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eae24a06-a3e8-4c33-823d-83095dc71de5 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:33.383555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eae24a06-a3e8-4c33-823d-83095dc71de5 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:33.433620 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eae24a06-a3e8-4c33-823d-83095dc71de5 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.068620 Jul 20 10:57:33.435008 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1141/2236] 10.222.0.79 () {60 vars in 1210 bytes} [Wed Jul 20 10:57:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:57:33.445491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:33.447713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:33.462606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:33.464289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:33.466502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:33.468982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:33.793202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=32 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:33.937777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:33.947994 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5aea398c-05f0-4635-bf37-4f40cff4f51f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.510890 Jul 20 10:57:33.951197 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1142/2237] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:33 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:33.971350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7230f1f3-5ac1-45e0-b47a-50873e7bfa76 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:33.972710 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:33.972710 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:33.976585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7230f1f3-5ac1-45e0-b47a-50873e7bfa76 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:33.976585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7230f1f3-5ac1-45e0-b47a-50873e7bfa76 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:33.981632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7230f1f3-5ac1-45e0-b47a-50873e7bfa76 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:33.985465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7230f1f3-5ac1-45e0-b47a-50873e7bfa76 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.004154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Updating instance_info_cache with network_info: [{"id": "80b5f929-c755-4f33-8621-16746bd37d6d", "address": "fa:16:3e:4b:43:a1", "network": {"id": "7190106c-4abd-43a7-91c7-4a44ae33114d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1693847261-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c3fbe1b5416c4494b2b02f8f92d06cdb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap80b5f929-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 10:57:34.045702 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7230f1f3-5ac1-45e0-b47a-50873e7bfa76 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.092781 Jul 20 10:57:34.062030 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1143/2238] 10.222.0.79 () {60 vars in 1177 bytes} [Wed Jul 20 10:57:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:57:34.079253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9737ae4e-4d11-4c24-a1ab-2df8a8429d86 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:34.081418 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:34.081418 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:34.086712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9737ae4e-4d11-4c24-a1ab-2df8a8429d86 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.087223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9737ae4e-4d11-4c24-a1ab-2df8a8429d86 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.088235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9737ae4e-4d11-4c24-a1ab-2df8a8429d86 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.091333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9737ae4e-4d11-4c24-a1ab-2df8a8429d86 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.092189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Releasing lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:57:34.095039 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-596087f1-1a4c-431c-ae7f-da3726cdf45e tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action" status: 202 len: 0 microversion: 2.1 time: 4.707359 Jul 20 10:57:34.096515 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1096/2239] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:29 2022] POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action => generated 0 bytes in 4710 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 10:57:34.114205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8263f6b8-e107-44a6-aad6-82ea14c51f63 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '.version_select at 0x7f2c3f2c05e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:34.147118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9737ae4e-4d11-4c24-a1ab-2df8a8429d86 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-846219-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.083216 Jul 20 10:57:34.154012 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1144/2240] 10.222.0.79 () {60 vars in 1236 bytes} [Wed Jul 20 10:57:34 2022] GET /compute/v2.1/os-services?host=n-d-846219-10&binary=xxx => generated 16 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:34.159963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8392778f-d6d3-4556-9492-85bdf4e12771 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:34.168002 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:34.168002 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:34.180843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8392778f-d6d3-4556-9492-85bdf4e12771 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.181700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8392778f-d6d3-4556-9492-85bdf4e12771 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.183115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8392778f-d6d3-4556-9492-85bdf4e12771 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.183785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8392778f-d6d3-4556-9492-85bdf4e12771 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.256070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8392778f-d6d3-4556-9492-85bdf4e12771 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.099613 Jul 20 10:57:34.264644 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1145/2241] 10.222.0.79 () {60 vars in 1177 bytes} [Wed Jul 20 10:57:34 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:57:34.273368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-18af3b03-43eb-4d7b-a646-3948d092f6a4 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:34.274738 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:34.274738 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:34.283964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18af3b03-43eb-4d7b-a646-3948d092f6a4 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.284426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18af3b03-43eb-4d7b-a646-3948d092f6a4 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.285233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18af3b03-43eb-4d7b-a646-3948d092f6a4 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.286336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-18af3b03-43eb-4d7b-a646-3948d092f6a4 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.351754 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-18af3b03-43eb-4d7b-a646-3948d092f6a4 tempest-ServicesAdminNegativeV253TestJSON-1265645457 tempest-ServicesAdminNegativeV253TestJSON-1265645457-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.081928 Jul 20 10:57:34.352389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1146/2242] 10.222.0.79 () {60 vars in 1238 bytes} [Wed Jul 20 10:57:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:34.789010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91680818-883a-4644-856d-f4878b765f32 tempest-ServicesAdminNegativeV253TestJSON-919919567 tempest-ServicesAdminNegativeV253TestJSON-919919567-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:34.790908 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 10:57:34.790908 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 10:57:34.792715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-91680818-883a-4644-856d-f4878b765f32 tempest-ServicesAdminNegativeV253TestJSON-919919567 tempest-ServicesAdminNegativeV253TestJSON-919919567-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '71d78476ad984bf4813f4d5a8ccaeb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e2884784eee4adabd5b7873ab915de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91680818-883a-4644-856d-f4878b765f32 tempest-ServicesAdminNegativeV253TestJSON-919919567 tempest-ServicesAdminNegativeV253TestJSON-919919567-project] Request method failure captured: Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-b8643HKcOxGz4FuKG2JOocmc6u8gi7yNky2upswkGArZexVDEOIQuay-tp6f8lkqHL57moyd51siDy0NKb1VuHK0H6szIL8xU7BfQtTMLDTDKX7fVHxh8Lonimkl6StnZIkUd32LjvR9nEVOl5rtpacxZu11MzO6irZrYW3g6l8g Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.53 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 6e2884784eee4adabd5b7873ab915de5 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-919919567 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6e2884784eee4adabd5b7873ab915de5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e2884784eee4adabd5b7873ab915de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6e2884784eee4adabd5b7873ab915de5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6e2884784eee4adabd5b7873ab915de5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-919919567 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 6e2884784eee4adabd5b7873ab915de5 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-919919567 Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServicesAdminNegativeV253TestJSON-919919567-project Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 71d78476ad984bf4813f4d5a8ccaeb7a Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-919919567-project Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise self.value Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 10:57:34.795146 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91680818-883a-4644-856d-f4878b765f32 tempest-ServicesAdminNegativeV253TestJSON-919919567 tempest-ServicesAdminNegativeV253TestJSON-919919567-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-91680818-883a-4644-856d-f4878b765f32 tempest-ServicesAdminNegativeV253TestJSON-919919567 tempest-ServicesAdminNegativeV253TestJSON-919919567-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.432018 Jul 20 10:57:34.810843 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1147/2243] 10.222.0.79 () {60 vars in 1177 bytes} [Wed Jul 20 10:57:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 433 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:57:34.814243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:34.814604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:34.843080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.843586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:34.844531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:34.844979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:35.237013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:35.252369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-313823b4-cecd-4d32-a359-28078b0b6fd5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.454753 Jul 20 10:57:35.255016 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1148/2244] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:34 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:35.268262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:35.269030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:35.277536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:35.278218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:35.279346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:35.280596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:35.835789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8263f6b8-e107-44a6-aad6-82ea14c51f63 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/5ea1b75e-bdbe-48ef-98ea-2962541ac440" status: 202 len: 0 microversion: 2.1 time: 1.732534 Jul 20 10:57:35.841101 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1097/2245] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:57:34 2022] DELETE /compute/v2.1/os-floating-ips/5ea1b75e-bdbe-48ef-98ea-2962541ac440 => generated 0 bytes in 1741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:57:35.853610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72852535-bc1e-41d4-921a-855242a8cc1a tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72852535-bc1e-41d4-921a-855242a8cc1a tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Request method failure captured: Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action HTTP/1.1 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 34 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi199q4GDZEBobbLMDtQICazPZX1piWtGaZc2VlCwhHQfOCSKC9-_fWFcz2SoXv66nf9J-vfT3xD-hGDuKsd_0RpfhApHfIQNq7XxyUaMDmmwtKh3NcqPVYNKZkOvI1w_V2nSTSsZwsBc9ATNlD3-jl18ymLU9qa9GfZwBTOD4AAIBn-s Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c3fbe1b5416c4494b2b02f8f92d06cdb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3e914003f728485786a2c9daf350c8ed Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: {"addFloatingIp": {"address": ""}} Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a77e5fd3-4dfc-4d75-86b4-1636e6f6f026', 'body': {'addFloatingIp': {'address': ''}}} Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi '' Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:57:35.857374 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72852535-bc1e-41d4-921a-855242a8cc1a tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:35.863295 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72852535-bc1e-41d4-921a-855242a8cc1a tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action" status: 400 len: 142 microversion: 2.1 time: 0.016625 Jul 20 10:57:35.872060 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1098/2246] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:35 2022] POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action => generated 142 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:57:35.876603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:35.882785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:35.883968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:35.895380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:35.896229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:35.897313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:35.898585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:35.903302 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7c1dbf5f-9f25-4b67-9bca-5ea87a77a47b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.646480 Jul 20 10:57:35.914635 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1149/2247] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:35 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:35.962237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Acquired lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 10:57:36.122657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Releasing lock "refresh_cache-a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 10:57:36.123280 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] HTTP exception thrown: floating IP not found Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Request method failure captured: Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action HTTP/1.1 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 41 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi199q4GDZEBobbLMDtQICazPZX1piWtGaZc2VlCwhHQfOCSKC9-_fWFcz2SoXv66nf9J-vfT3xD-hGDuKsd_0RpfhApHfIQNq7XxyUaMDmmwtKh3NcqPVYNKZkOvI1w_V2nSTSsZwsBc9ATNlD3-jl18ymLU9qa9GfZwBTOD4AAIBn-s Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c3fbe1b5416c4494b2b02f8f92d06cdb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3e914003f728485786a2c9daf350c8ed Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: exception: floating IP not found Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a77e5fd3-4dfc-4d75-86b4-1636e6f6f026', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 20 10:57:36.125221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 20 10:57:36.129647 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.137689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Returning 404 to user: floating IP not found {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:36.138595 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-89dcbe19-e2cd-49c0-927b-f489bc45764c tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action" status: 404 len: 67 microversion: 2.1 time: 0.264473 Jul 20 10:57:36.150122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e603c9ea-c15e-4203-8970-6fbd561f4bc4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:36.153465 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1099/2248] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:35 2022] POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action => generated 67 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:57:36.261448 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e603c9ea-c15e-4203-8970-6fbd561f4bc4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e603c9ea-c15e-4203-8970-6fbd561f4bc4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Request method failure captured: Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action HTTP/1.1 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 44 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi199q4GDZEBobbLMDtQICazPZX1piWtGaZc2VlCwhHQfOCSKC9-_fWFcz2SoXv66nf9J-vfT3xD-hGDuKsd_0RpfhApHfIQNq7XxyUaMDmmwtKh3NcqPVYNKZkOvI1w_V2nSTSsZwsBc9ATNlD3-jl18ymLU9qa9GfZwBTOD4AAIBn-s Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c3fbe1b5416c4494b2b02f8f92d06cdb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3e914003f728485786a2c9daf350c8ed Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: exception: Floating IP not found for address 0.0.0.0. Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a77e5fd3-4dfc-4d75-86b4-1636e6f6f026', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 20 10:57:36.263742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 20 10:57:36.268254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:36.270167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e603c9ea-c15e-4203-8970-6fbd561f4bc4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:36.271249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e603c9ea-c15e-4203-8970-6fbd561f4bc4 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action" status: 404 len: 88 microversion: 2.1 time: 0.125969 Jul 20 10:57:36.272052 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1150/2249] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:36 2022] POST /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026/action => generated 88 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:57:36.274894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:36.275611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:36.290708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:36.292426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:36.302760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.303596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.304615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.305537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.328145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.328517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.329310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.329748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.347693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:57:36.491258 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c436a7a-e2a0-4469-9030-55bc8c64a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 204 len: 0 microversion: 2.1 time: 0.212837 Jul 20 10:57:36.491863 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1151/2250] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:57:36 2022] DELETE /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:57:36.505976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:36.506768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:36.533168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.533472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.534260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.534747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.761796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:36.770911 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5cb2acc7-2016-4fe7-a677-5e6cfe128147 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.500440 Jul 20 10:57:36.784831 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1100/2251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:36 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:36.924172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:36.925708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:36.927956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:36.942679 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-345716d0-6afe-4b47-9730-f5704b5723d8 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1542 microversion: 2.1 time: 0.443556 Jul 20 10:57:36.944689 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1152/2252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:36 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1542 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:36.945696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.948371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:36.951004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:36.952892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:37.052581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-813a9d92-4d89-4a5b-bb58-da2812a84ce8 req-21f0525b-4442-4bbe-bbf6-f3e0d421bb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2110464-2cf1-4489-88a1-8e985254b394", "name": "network-vif-plugged", "status": "completed", "tag": "e11bde05-7cc1-47b5-88e5-f88fe7d9a772"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:37.078623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-813a9d92-4d89-4a5b-bb58-da2812a84ce8 req-21f0525b-4442-4bbe-bbf6-f3e0d421bb3e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:37.080493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-813a9d92-4d89-4a5b-bb58-da2812a84ce8 req-21f0525b-4442-4bbe-bbf6-f3e0d421bb3e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:37.116901 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-813a9d92-4d89-4a5b-bb58-da2812a84ce8 req-21f0525b-4442-4bbe-bbf6-f3e0d421bb3e service nova] Creating event network-vif-plugged:e11bde05-7cc1-47b5-88e5-f88fe7d9a772 for instance b2110464-2cf1-4489-88a1-8e985254b394 on n-h2-846219-10 Jul 20 10:57:37.130305 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-813a9d92-4d89-4a5b-bb58-da2812a84ce8 req-21f0525b-4442-4bbe-bbf6-f3e0d421bb3e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082993 Jul 20 10:57:37.132423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1153/2253] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:57:37.369608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:37.379576 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8bcaf46a-1c73-4e79-b3d3-44bc978db815 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1325 microversion: 2.1 time: 0.461221 Jul 20 10:57:37.380756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1101/2254] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:36 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:37.805974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:37.807808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:37.821621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:37.824097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:37.826600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:37.827251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:37.880712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-617880184", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:37.953775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] validate_networks() for [('e9911c98-dd07-4792-8e53-ac1d2884ccc5', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:57:38.683543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:38.700072 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e7f41224-95e7-4455-8ee6-1c7af63329e7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.895360 Jul 20 10:57:38.710087 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1102/2255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:37 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:38.722168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:38.722970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:38.733861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:38.734595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:38.736437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:38.737581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.258760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:39.271620 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d2838c5-3a28-479d-a710-dd2b1e0514c9 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1542 microversion: 2.1 time: 0.560410 Jul 20 10:57:39.288101 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1103/2256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:38 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1542 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:39.294063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:39.294687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:39.319325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:39.326631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.329011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:39.329585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.685850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:57:39.687052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:57:39.688568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:57:39.689867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:57:39.690836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:57:39.741333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:39.747338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:39.749430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.750497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:39.753040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.757703 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50dba1af-2cc9-4ea0-9158-9d0808123234 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1522 microversion: 2.1 time: 0.468375 Jul 20 10:57:39.758651 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1104/2257] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:39 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:39.770380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:39.775147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:39.796698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:39.797409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.800785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:39.802289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:39.820413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Getting quotas for project ee63aa1e5dbd4b85a4fa1d07d1295b97. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:39.841017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Getting quotas for user 888b4307be724144bf40f32c5116a98d and project ee63aa1e5dbd4b85a4fa1d07d1295b97. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:39.876070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:57:39.884630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:57:40.043317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5158b224-752d-4c2a-86f2-912963e56e2d tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.854513 Jul 20 10:57:40.044345 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1154/2258] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:57:40.056949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:40.060990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:40.089061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.092149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.094393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.097289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.206183 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] HTTP exception thrown: Instance is not a member of specified network Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Request method failure captured: Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394/ips/invalid HTTP/1.1 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-Lpub3_OFdTzuNusdvv2eKAES3Hd7L_VhKpcx2Whn8J6-xcKuj7j15RuGyULunlMPPibydRu2Z4V0ivhVf77hJvMpGX_4qE-fMEqOr4c3uACWv4MuyBRwmYMIiHjbh4xdOiifM1hXQJaDf2mKhstj_UbdFf-cFQjhz8c3wid1tQu4 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 46f5dd26f7ed47b093c82406bba71003 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46f5dd26f7ed47b093c82406bba71003", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 46f5dd26f7ed47b093c82406bba71003 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerAddressesNegativeTestJSON-1504235038-project Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 6d751bac5ac1467e94f71bdd5f6af4c5 Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1504235038-project Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance is not a member of specified network Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': 'b2110464-2cf1-4489-88a1-8e985254b394', 'id': 'invalid'} Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 20 10:57:40.216982 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.238727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Returning 404 to user: Instance is not a member of specified network {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:40.240936 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efc98ae4-03d4-472f-af70-5ecab122bc6b tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.195168 Jul 20 10:57:40.251822 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1155/2259] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:57:40 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394/ips/invalid => generated 91 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:57:40.262664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad75c9b6-6965-42e3-8782-9fbb5e6e9b52 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:40.264907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad75c9b6-6965-42e3-8782-9fbb5e6e9b52 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:40.486647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:40.502073 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ac9500c0-987c-47f7-b853-62d45852cd1d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.739477 Jul 20 10:57:40.505189 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1105/2260] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:39 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:40.521809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3517107-abf7-400c-a0f5-268f93b6e088 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:40.522369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3517107-abf7-400c-a0f5-268f93b6e088 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Failed to fetch instance by id 999 {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 10:57:40.523091 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a3517107-abf7-400c-a0f5-268f93b6e088 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] HTTP exception thrown: Instance 999 could not be found. Jul 20 10:57:40.525489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad75c9b6-6965-42e3-8782-9fbb5e6e9b52 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3517107-abf7-400c-a0f5-268f93b6e088 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Request method failure captured: Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19-Lpub3_OFdTzuNusdvv2eKAES3Hd7L_VhKpcx2Whn8J6-xcKuj7j15RuGyULunlMPPibydRu2Z4V0ivhVf77hJvMpGX_4qE-fMEqOr4c3uACWv4MuyBRwmYMIiHjbh4xdOiifM1hXQJaDf2mKhstj_UbdFf-cFQjhz8c3wid1tQu4 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 46f5dd26f7ed47b093c82406bba71003 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46f5dd26f7ed47b093c82406bba71003", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 46f5dd26f7ed47b093c82406bba71003 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerAddressesNegativeTestJSON-1504235038-project Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6d751bac5ac1467e94f71bdd5f6af4c5 Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1504235038-project Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 999 could not be found. Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'server_id': '999'} Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 20 10:57:40.532057 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:40.540017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3517107-abf7-400c-a0f5-268f93b6e088 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Returning 404 to user: Instance 999 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:40.549136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3517107-abf7-400c-a0f5-268f93b6e088 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.041182 Jul 20 10:57:40.550472 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1106/2261] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 10:57:40 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:57:40.559041 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad75c9b6-6965-42e3-8782-9fbb5e6e9b52 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1223 microversion: 2.1 time: 0.303812 Jul 20 10:57:40.573206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1156/2262] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:40 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1223 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:40.573874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:40.575136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:40.583425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:40.609199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.610243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.611410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.612279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.616749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:40.660745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.667009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.675933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.680699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.754490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e914003f728485786a2c9daf350c8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3fbe1b5416c4494b2b02f8f92d06cdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:40.773619 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff2847e3-d155-4418-b14d-f2de02c031b7 tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 200 len: 1317 microversion: 2.1 time: 0.219661 Jul 20 10:57:40.774918 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1107/2263] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:40 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:40.782145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9551cefa-415e-46b1-bf72-8ab4367b3752 req-20fd7fc1-d579-4bf0-b93d-40967055d47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77e5fd3-4dfc-4d75-86b4-1636e6f6f026", "name": "network-vif-deleted", "tag": "80b5f929-c755-4f33-8621-16746bd37d6d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:40.792669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:57:40.812785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9551cefa-415e-46b1-bf72-8ab4367b3752 req-20fd7fc1-d579-4bf0-b93d-40967055d47d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:40.815770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9551cefa-415e-46b1-bf72-8ab4367b3752 req-20fd7fc1-d579-4bf0-b93d-40967055d47d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:40.862666 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9551cefa-415e-46b1-bf72-8ab4367b3752 req-20fd7fc1-d579-4bf0-b93d-40967055d47d service nova] Creating event network-vif-deleted:80b5f929-c755-4f33-8621-16746bd37d6d for instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 on n-h1-846219-10 Jul 20 10:57:40.883364 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9551cefa-415e-46b1-bf72-8ab4367b3752 req-20fd7fc1-d579-4bf0-b93d-40967055d47d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102410 Jul 20 10:57:40.885023 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1108/2264] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:41.001194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:41.078078 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bde4ba6c-76a7-44de-9fd9-35336646cac7 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 204 len: 0 microversion: 2.1 time: 0.511718 Jul 20 10:57:41.078734 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1157/2265] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:57:40 2022] DELETE /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:57:41.094130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:41.095135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:41.109431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.109887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.116862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.117917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.482858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:41.499057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-975b7165-fad3-4ce5-a411-fab8eefb9511 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1528 microversion: 2.1 time: 0.415027 Jul 20 10:57:41.501497 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1109/2266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:41 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1528 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:41.532306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:41.536450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:41.545861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.546392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.547591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.548454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.586608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:41.590212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:41.615279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.621257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.622500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.623366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.794515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:41.827615 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e188d62a-5a85-47f3-95de-9f619b459fa9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1227 microversion: 2.1 time: 0.250018 Jul 20 10:57:41.828851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1110/2267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:41 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1227 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:41.840006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:41.845154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] [instance: a77e5fd3-4dfc-4d75-86b4-1636e6f6f026] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:41.858207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.861475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.863912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:41.864633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:41.910379 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] HTTP exception thrown: Instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 could not be found. Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Request method failure captured: Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 HTTP/1.1 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi199q4GDZEBobbLMDtQICazPZX1piWtGaZc2VlCwhHQfOCSKC9-_fWFcz2SoXv66nf9J-vfT3xD-hGDuKsd_0RpfhApHfIQNq7XxyUaMDmmwtKh3NcqPVYNKZkOvI1w_V2nSTSsZwsBc9ATNlD3-jl18ymLU9qa9GfZwBTOD4AAIBn-s Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c3fbe1b5416c4494b2b02f8f92d06cdb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c3fbe1b5416c4494b2b02f8f92d06cdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c3fbe1b5416c4494b2b02f8f92d06cdb Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758 Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3e914003f728485786a2c9daf350c8ed Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 could not be found. Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a77e5fd3-4dfc-4d75-86b4-1636e6f6f026'} Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 could not be found. Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 could not be found. Jul 20 10:57:41.916500 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 could not be found. Jul 20 10:57:41.922113 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:41.939969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] Returning 404 to user: Instance a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:41.940873 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e733f0db-2236-448f-82af-0071844ab9dd tempest-FloatingIPsAssociationNegativeTestJSON-707151758 tempest-FloatingIPsAssociationNegativeTestJSON-707151758-project] 10.222.0.79 "GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026" status: 404 len: 111 microversion: 2.1 time: 0.110893 Jul 20 10:57:41.949127 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1111/2268] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:41 2022] GET /compute/v2.1/servers/a77e5fd3-4dfc-4d75-86b4-1636e6f6f026 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:57:41.954721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1ceda5de-b4c5-4773-a295-af9c98fdb547 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f48f940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:41.986237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:42.012360 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e98db8dc-c4e3-49c8-b7ac-825c8ee26a6e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1498 microversion: 2.1 time: 0.487280 Jul 20 10:57:42.013627 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1158/2269] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:41 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1498 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:42.044494 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1ceda5de-b4c5-4773-a295-af9c98fdb547 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec" status: 200 len: 637 microversion: 2.1 time: 0.093846 Jul 20 10:57:42.052371 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1112/2270] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:41 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec => generated 637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:42.058165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28d65a4d-120e-4039-adda-a8e08dc9a28f tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3f9f2dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:42.147226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-28d65a4d-120e-4039-adda-a8e08dc9a28f tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:42.223681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-28d65a4d-120e-4039-adda-a8e08dc9a28f tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:42.521481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:42.522130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:42.550004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:42.550458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:42.551271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:42.551711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:43.160974 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28d65a4d-120e-4039-adda-a8e08dc9a28f tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 1.104952 Jul 20 10:57:43.163309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1159/2271] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:42 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:43.172060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:43.183194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:43.183507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:43.197529 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fcb4d5a4-1972-4548-a2f8-61076e3ae86f tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1528 microversion: 2.1 time: 0.679193 Jul 20 10:57:43.213841 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1113/2272] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:42 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1528 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:43.219791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:43.223192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:43.225496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:43.227971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:43.232887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:43.235203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:43.269227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:43.271286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:43.272144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:43.273758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:43.640127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:43.659587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d74aac4-2012-4874-84d4-345b38404ed3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1275 microversion: 2.1 time: 0.491816 Jul 20 10:57:43.669907 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1160/2273] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:43 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1275 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:43.675055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4d835d1-8e66-426e-a388-3d711b83600a tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f797160>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:43.940551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:43.962033 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-10ecbdcb-4a03-4d96-aa2a-b8a2fe96100d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 200 len: 1475 microversion: 2.1 time: 0.744955 Jul 20 10:57:43.968543 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1114/2274] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:43 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 1475 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:43.986252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1381011715"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:43.988364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:43.998529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:43.999272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:44.000369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:44.001289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:44.375211 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4d835d1-8e66-426e-a388-3d711b83600a tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "DELETE /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.713238 Jul 20 10:57:44.379070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1161/2275] 10.222.0.79 () {58 vars in 1295 bytes} [Wed Jul 20 10:57:43 2022] DELETE /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata/os_version => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:57:44.383140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:44.383915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:44.391467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:44.392081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:44.393133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:44.394279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:44.615424 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bddbd529-9519-4cb3-a990-1c9c53acf7d9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769/action" status: 202 len: 0 microversion: 2.1 time: 0.634933 Jul 20 10:57:44.626958 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1115/2276] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:57:43 2022] POST /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 10:57:44.634723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ea308f52-eccb-47fc-ba8a-115c56d25aa5 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f493790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:44.704075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ea308f52-eccb-47fc-ba8a-115c56d25aa5 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074306 Jul 20 10:57:44.704730 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1116/2277] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:57:44 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:44.709578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8185382e-598e-4d09-8684-0c1aab5c94c3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f36e1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:44.780747 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8185382e-598e-4d09-8684-0c1aab5c94c3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.074998 Jul 20 10:57:44.781361 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1117/2278] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:44 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:44.790122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:44.790946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:44.812329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:44.812329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:44.814289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:44.814743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:44.822060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:44.824190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:44.834438 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81cd2a3e-e78b-4017-872c-ea72a8ac095a tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1528 microversion: 2.1 time: 0.456934 Jul 20 10:57:44.848729 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1162/2279] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:44 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1528 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:44.854318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97617f2a-a079-46ac-bd01-6879f068472e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3fee2430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:44.942239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:44.984506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-97617f2a-a079-46ac-bd01-6879f068472e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:44.986715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:44.999314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-97617f2a-a079-46ac-bd01-6879f068472e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:45.005210 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a84975f-02cb-4534-89ec-232b7edbab3e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1281 microversion: 2.1 time: 0.222312 Jul 20 10:57:45.008618 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1118/2280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:44 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:45.030152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b301e11-c2cd-4b49-bf6a-8d2017deef33"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:45.033752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:45.053453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:45.055371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:45.056443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:45.059214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:45.583851 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f4cd221-249c-4b25-abea-2823074bf8da tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "POST /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558161 Jul 20 10:57:45.584936 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1119/2281] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 10:57:45 2022] POST /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:57:45.642035 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97617f2a-a079-46ac-bd01-6879f068472e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 0.791774 Jul 20 10:57:45.644112 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1163/2282] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:44 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:45.655934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a5e9f9d-e0d5-4fbf-8b9b-68a450af0d25 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f4d8940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:45.718444 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3a5e9f9d-e0d5-4fbf-8b9b-68a450af0d25 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.068502 Jul 20 10:57:45.719498 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1120/2283] 10.222.0.79 () {58 vars in 1289 bytes} [Wed Jul 20 10:57:45 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata/os_distro => generated 33 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:45.734295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-054e152c-ad11-452e-8c17-0b4b903f478c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3fee2d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:45.795377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd6c03e0-f3cd-4e3e-800e-e55f4dd41495 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f2e81f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:45.858587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-054e152c-ad11-452e-8c17-0b4b903f478c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:45.880522 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bd6c03e0-f3cd-4e3e-800e-e55f4dd41495 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.090211 Jul 20 10:57:45.887043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-054e152c-ad11-452e-8c17-0b4b903f478c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:45.887699 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1121/2284] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:45 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:45.890672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:45.897033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:45.920174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:45.920554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:45.921356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:45.921797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:46.096835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d751bac5ac1467e94f71bdd5f6af4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5dd26f7ed47b093c82406bba71003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:46.117234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2378b186-35c0-4ea5-bbbd-9a4e74bd5d71 tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 200 len: 1486 microversion: 2.1 time: 0.229496 Jul 20 10:57:46.117881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1122/2285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:45 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 1486 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:46.135456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:46.136399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:46.144216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:46.145307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:46.147224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:46.148230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:46.325358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:46.345549 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6585c5ae-d5bf-497c-a001-33a52702efe1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1281 microversion: 2.1 time: 0.214512 Jul 20 10:57:46.346476 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1123/2286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:46 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:46.362214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7bda20cf-c698-4b12-aa38-0b05713814f7 req-327b1839-650f-4802-87db-acb2661d4347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2110464-2cf1-4489-88a1-8e985254b394", "name": "network-vif-deleted", "tag": "e11bde05-7cc1-47b5-88e5-f88fe7d9a772"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:46.372117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7bda20cf-c698-4b12-aa38-0b05713814f7 req-327b1839-650f-4802-87db-acb2661d4347 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:46.372805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7bda20cf-c698-4b12-aa38-0b05713814f7 req-327b1839-650f-4802-87db-acb2661d4347 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:46.393291 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7bda20cf-c698-4b12-aa38-0b05713814f7 req-327b1839-650f-4802-87db-acb2661d4347 service nova] Creating event network-vif-deleted:e11bde05-7cc1-47b5-88e5-f88fe7d9a772 for instance b2110464-2cf1-4489-88a1-8e985254b394 on n-h2-846219-10 Jul 20 10:57:46.409117 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7bda20cf-c698-4b12-aa38-0b05713814f7 req-327b1839-650f-4802-87db-acb2661d4347 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051466 Jul 20 10:57:46.410297 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1124/2287] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:46.450988 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-054e152c-ad11-452e-8c17-0b4b903f478c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 0.724253 Jul 20 10:57:46.452112 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1164/2288] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:45 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:46.462661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fa308168-1034-4334-a019-b15048d9e52c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3ede1dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:46.520547 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fa308168-1034-4334-a019-b15048d9e52c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 0.061514 Jul 20 10:57:46.522756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1125/2289] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:57:46 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:46.533215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57437eef-adc1-449e-9555-06a9b2467178 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3fabbb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:46.636845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-57437eef-adc1-449e-9555-06a9b2467178 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:46.647491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-57437eef-adc1-449e-9555-06a9b2467178 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:46.895845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96617088-2ff4-416e-a7ef-cb2661698ca7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f6dfee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:47.017302 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96617088-2ff4-416e-a7ef-cb2661698ca7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.126235 Jul 20 10:57:47.029190 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1126/2290] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:46 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:47.149618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:47.151697 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57437eef-adc1-449e-9555-06a9b2467178 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 0.617388 Jul 20 10:57:47.153932 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1165/2291] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:46 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:47.155847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] [instance: b2110464-2cf1-4489-88a1-8e985254b394] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:47.179547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28445e10-c12a-4edf-8508-080178360d4c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3fb5fe50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:47.190634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:47.191757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:47.193121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:47.193786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:47.221475 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] HTTP exception thrown: Instance b2110464-2cf1-4489-88a1-8e985254b394 could not be found. Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Request method failure captured: Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 HTTP/1.1 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19-Lpub3_OFdTzuNusdvv2eKAES3Hd7L_VhKpcx2Whn8J6-xcKuj7j15RuGyULunlMPPibydRu2Z4V0ivhVf77hJvMpGX_4qE-fMEqOr4c3uACWv4MuyBRwmYMIiHjbh4xdOiifM1hXQJaDf2mKhstj_UbdFf-cFQjhz8c3wid1tQu4 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 46f5dd26f7ed47b093c82406bba71003 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46f5dd26f7ed47b093c82406bba71003", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46f5dd26f7ed47b093c82406bba71003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 46f5dd26f7ed47b093c82406bba71003 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1504235038 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerAddressesNegativeTestJSON-1504235038-project Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6d751bac5ac1467e94f71bdd5f6af4c5 Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1504235038-project Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance b2110464-2cf1-4489-88a1-8e985254b394 could not be found. Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'b2110464-2cf1-4489-88a1-8e985254b394'} Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2110464-2cf1-4489-88a1-8e985254b394 could not be found. Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2110464-2cf1-4489-88a1-8e985254b394 could not be found. Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:47.224118 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2110464-2cf1-4489-88a1-8e985254b394 could not be found. Jul 20 10:57:47.227562 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:57:47.229602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] Returning 404 to user: Instance b2110464-2cf1-4489-88a1-8e985254b394 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:47.230832 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-735fc717-c823-46e4-8ab0-00e26a22634e tempest-ServerAddressesNegativeTestJSON-1504235038 tempest-ServerAddressesNegativeTestJSON-1504235038-project] 10.222.0.79 "GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394" status: 404 len: 111 microversion: 2.1 time: 0.100382 Jul 20 10:57:47.231708 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1127/2292] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:47 2022] GET /compute/v2.1/servers/b2110464-2cf1-4489-88a1-8e985254b394 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:57:47.324398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-28445e10-c12a-4edf-8508-080178360d4c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:47.339320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-28445e10-c12a-4edf-8508-080178360d4c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:47.363519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:47.364415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:47.379770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:47.380611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:47.381648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:47.386579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:47.881897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:47.898841 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92f1ef23-e382-47da-814a-f966916ed4ad tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.537510 Jul 20 10:57:47.904042 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1128/2293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:47 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:47.956420 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28445e10-c12a-4edf-8508-080178360d4c tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 64 microversion: 2.1 time: 0.794989 Jul 20 10:57:47.962169 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1166/2294] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:47 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 64 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 10:57:47.969358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1631bea5-4c9f-47fa-9cfd-a5bf68ff093e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f2a6670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:48.047153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5fba5a7-f035-440e-abb9-00dc72d9357b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f964f70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:48.073642 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1631bea5-4c9f-47fa-9cfd-a5bf68ff093e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 64 microversion: 2.1 time: 0.109819 Jul 20 10:57:48.082546 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1129/2295] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:57:47 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 64 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:48.102519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47a48480-f8ee-4f46-b0ff-b84d3dd5bc72 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3f44b430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:48.149688 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5fba5a7-f035-440e-abb9-00dc72d9357b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.107642 Jul 20 10:57:48.159288 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1167/2296] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:48 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:48.296304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-47a48480-f8ee-4f46-b0ff-b84d3dd5bc72 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:48.316426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-47a48480-f8ee-4f46-b0ff-b84d3dd5bc72 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:48.928608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:48.929451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:48.952127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:48.958843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:48.964083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:48.971198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:48.991616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-47a48480-f8ee-4f46-b0ff-b84d3dd5bc72 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 0.906051 Jul 20 10:57:48.999937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1130/2297] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:48 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:49.014535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-06870bf7-da33-49d1-b362-26391a7e21ba req-46440414-9763-4bce-9e83-f1e5654481f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d9d15-9585-4fdf-9a76-ebcbe7eba769", "name": "network-vif-plugged", "status": "completed", "tag": "e4318dc4-aab8-4ad9-9217-fd31b663ae7a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:49.041093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-06870bf7-da33-49d1-b362-26391a7e21ba req-46440414-9763-4bce-9e83-f1e5654481f8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:49.041843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-06870bf7-da33-49d1-b362-26391a7e21ba req-46440414-9763-4bce-9e83-f1e5654481f8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:49.061854 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-06870bf7-da33-49d1-b362-26391a7e21ba req-46440414-9763-4bce-9e83-f1e5654481f8 service nova] Creating event network-vif-plugged:e4318dc4-aab8-4ad9-9217-fd31b663ae7a for instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 on n-h1-846219-10 Jul 20 10:57:49.068719 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-06870bf7-da33-49d1-b362-26391a7e21ba req-46440414-9763-4bce-9e83-f1e5654481f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065125 Jul 20 10:57:49.072932 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1131/2298] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:49.079711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6ce6789-2ad3-479c-b2e2-1435dbf8c8a1 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update', calling method: .version_select at 0x7f2c3f1c4dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:49.202048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d6ce6789-2ad3-479c-b2e2-1435dbf8c8a1 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:49.209932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d6ce6789-2ad3-479c-b2e2-1435dbf8c8a1 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:49.611707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:49.626825 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8b01ca02-eb6f-43e2-bcad-feac74e31e5e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.703118 Jul 20 10:57:49.633127 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1168/2299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:48 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:49.689636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:49.698306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:49.718480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:49.718951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:49.720533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:49.721022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:49.805543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=20 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:49.935726 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6ce6789-2ad3-479c-b2e2-1435dbf8c8a1 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.861337 Jul 20 10:57:49.936664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1132/2300] 10.222.0.79 () {60 vars in 1312 bytes} [Wed Jul 20 10:57:49 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata/os_version => generated 31 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:49.943012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7625fe72-3fbb-4429-9381-2b8e7fb4273a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f354790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:50.079422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7625fe72-3fbb-4429-9381-2b8e7fb4273a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.141058 Jul 20 10:57:50.080818 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1133/2301] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:49 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:50.094391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f1733748-0545-4789-8445-79939f894d49 req-44f574a6-887b-4ee9-a770-f7c1d18ead31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1a00ade-ed85-486f-81c2-4111cbbc7648", "tag": "b629e0e9-62e2-49aa-8eaf-ae12f0485639"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:50.110224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:50.115833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f1733748-0545-4789-8445-79939f894d49 req-44f574a6-887b-4ee9-a770-f7c1d18ead31 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:50.116793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f1733748-0545-4789-8445-79939f894d49 req-44f574a6-887b-4ee9-a770-f7c1d18ead31 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:50.182770 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f1733748-0545-4789-8445-79939f894d49 req-44f574a6-887b-4ee9-a770-f7c1d18ead31 service nova] Creating event network-changed:b629e0e9-62e2-49aa-8eaf-ae12f0485639 for instance d1a00ade-ed85-486f-81c2-4111cbbc7648 on n-h2-846219-10 Jul 20 10:57:50.196577 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f1733748-0545-4789-8445-79939f894d49 req-44f574a6-887b-4ee9-a770-f7c1d18ead31 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113771 Jul 20 10:57:50.197693 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1134/2302] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:50.205524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15cfa68c-b5c4-4cee-b910-8dc8fedd934e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f1c4670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:50.281256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15cfa68c-b5c4-4cee-b910-8dc8fedd934e tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 58 microversion: 2.1 time: 0.082133 Jul 20 10:57:50.282002 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1135/2303] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:57:50 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 58 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:50.292850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb941449-ceee-4173-836b-3f00a1f0ca38 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'update_all', calling method: .version_select at 0x7f2c3f2c0c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:50.381787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-cb941449-ceee-4173-836b-3f00a1f0ca38 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:50.390452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-cb941449-ceee-4173-836b-3f00a1f0ca38 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:50.413645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:50.442609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:50.445774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:50.449852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0d811a2e-6eb2-4a95-9b80-dd7e01c9d850 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2952 microversion: 2.42 time: 0.812706 Jul 20 10:57:50.452565 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1169/2304] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:57:49 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2952 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:57:50.494337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:50.494905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:50.511220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:50.513695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:50.515000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:50.518464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:51.021484 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-26789e37-4b69-4bd2-9e18-2291971ca024 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.531273 Jul 20 10:57:51.022872 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1170/2305] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 10:57:50 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472/os-interface => generated 1831 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 10:57:51.029239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:51.031295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:51.059338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:51.060572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:51.062205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:51.062879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:51.427733 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb941449-ceee-4173-836b-3f00a1f0ca38 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 61 microversion: 2.1 time: 1.136668 Jul 20 10:57:51.429529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1136/2306] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:57:50 2022] PUT /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 61 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 10:57:51.436754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb70ce8f-c77b-490c-93ea-d898c9eadae8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f2e85e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:51.549388 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb70ce8f-c77b-490c-93ea-d898c9eadae8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.118098 Jul 20 10:57:51.560730 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1137/2307] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:51 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:51.585833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95ca6667-934d-4eed-b35e-8c42786ef289 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Action: 'create', calling method: .version_select at 0x7f2c3f1c45e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:51.749736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-95ca6667-934d-4eed-b35e-8c42786ef289 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:57:51.772516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-95ca6667-934d-4eed-b35e-8c42786ef289 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Getting quotas for user a59a577b6f684e2097a14646002cdf68 and project ae87a9ecb3b5499ba672273bdb86e2c8. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:57:51.798134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:51.811004 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-beb8f7d6-a2ef-4a39-a72d-f506db0dd51f tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.786632 Jul 20 10:57:51.812123 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1171/2308] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:51 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:52.282356 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95ca6667-934d-4eed-b35e-8c42786ef289 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "POST /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 85 microversion: 2.1 time: 0.720504 Jul 20 10:57:52.283536 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1138/2309] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Jul 20 10:57:51 2022] POST /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 85 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:52.293857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f17b92f-8d90-485b-8967-eff49c8b0e08 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] Calling method '.version_select at 0x7f2c3f7bc3a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:52.376406 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f17b92f-8d90-485b-8967-eff49c8b0e08 tempest-ImagesMetadataTestJSON-414119789 tempest-ImagesMetadataTestJSON-414119789-project] 10.222.0.79 "GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata" status: 200 len: 85 microversion: 2.1 time: 0.087749 Jul 20 10:57:52.377374 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1172/2310] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:57:52 2022] GET /compute/v2.1/images/927a7d76-b54a-4cb9-a9dc-3a0d256430ec/metadata => generated 85 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:57:52.582016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66b1f063-a9f1-479c-81cc-c295714c862e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f44b430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:52.659419 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66b1f063-a9f1-479c-81cc-c295714c862e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.090292 Jul 20 10:57:52.660015 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1139/2311] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:52 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:52.830860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:52.831750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:52.862195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:52.863038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:52.864776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:52.868335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:53.305070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:53.326912 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e3bcac7a-7d9c-4a35-8601-ebc6346227b1 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.500374 Jul 20 10:57:53.335758 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1173/2312] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:52 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:53.674266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d6e555a-d7ea-401f-be61-66584d5fcdf0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f36e5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:53.782157 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d6e555a-d7ea-401f-be61-66584d5fcdf0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.112247 Jul 20 10:57:53.784593 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1140/2313] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:53 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:54.354396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:54.355303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:54.379900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:54.380224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:54.385527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:54.396180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:54.798631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9163d253-b951-4d9f-82df-8c60b2eb0871 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3ede1040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:54.891234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9163d253-b951-4d9f-82df-8c60b2eb0871 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.097441 Jul 20 10:57:54.891834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1141/2314] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:54 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:57:55.020370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:55.033255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57eb0e3e-4227-4fca-89db-6f9ca65312f3 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.684079 Jul 20 10:57:55.034155 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1174/2315] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:54 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:55.908216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aad37678-0272-4950-ac58-41bd424dc01e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f2be4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:56.045629 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aad37678-0272-4950-ac58-41bd424dc01e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.143350 Jul 20 10:57:56.054682 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1142/2316] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:55 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:56.058150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:56.062337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:56.139275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:56.147155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:56.155564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:56.163044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:56.977976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:56.991484 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f9f5ea3-4aad-4b7d-90a0-0d6c97f2b9ec tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.943633 Jul 20 10:57:57.010452 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1175/2317] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:56 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:57.069486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9894fe91-fcd4-422a-bcb2-7a51194e36ca tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f2e8790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:57.221126 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9894fe91-fcd4-422a-bcb2-7a51194e36ca tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.157323 Jul 20 10:57:57.229279 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1143/2318] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:57 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:57.994760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=28 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:57:58.035122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:58.036222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:57:58.051238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:58.056732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:58.059847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:58.060469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:58.623507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2cbc264b-8a63-4651-a081-c0709367f3e2 tempest-ListImageFiltersNegativeTestJSON-1473770729 tempest-ListImageFiltersNegativeTestJSON-1473770729-project] Calling method '.version_select at 0x7f2c3f85aa60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:58.652183 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2cbc264b-8a63-4651-a081-c0709367f3e2 tempest-ListImageFiltersNegativeTestJSON-1473770729 tempest-ListImageFiltersNegativeTestJSON-1473770729-project] HTTP exception thrown: Image not found. Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2cbc264b-8a63-4651-a081-c0709367f3e2 tempest-ListImageFiltersNegativeTestJSON-1473770729 tempest-ListImageFiltersNegativeTestJSON-1473770729-project] Request method failure captured: Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/images/e11ba6e3-7fc4-45e9-b7a4-8cbade5d2aab HTTP/1.1 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-1pswgDRW5xzocbdlh1wshnC3jerqmrgnHeQX5n764gZ4YttnPsZet7RVLxhmZfH1XUVl6hD62g9yAzjoWJScGh9U49_ku_DWPTUvK6yX3RgXg9QJXCXI_NmEsx0lK1MInUDNYKXcpp5N-lu9ApnSBSS5iE51jBynzgwMRA-OJUZs Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 48983138567b448fab01f0d11b52246f Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1473770729 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_48983138567b448fab01f0d11b52246f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/48983138567b448fab01f0d11b52246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/48983138567b448fab01f0d11b52246f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/48983138567b448fab01f0d11b52246f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1473770729 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 48983138567b448fab01f0d11b52246f Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1473770729 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListImageFiltersNegativeTestJSON-1473770729-project Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 12f6c2e6c0044a978755e89bd5ac7f60 Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1473770729-project Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'e11ba6e3-7fc4-45e9-b7a4-8cbade5d2aab'} Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e11ba6e3-7fc4-45e9-b7a4-8cbade5d2aab Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:57:58.656602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e11ba6e3-7fc4-45e9-b7a4-8cbade5d2aab could not be found. Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:57:58.660525 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:57:58.668202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2cbc264b-8a63-4651-a081-c0709367f3e2 tempest-ListImageFiltersNegativeTestJSON-1473770729 tempest-ListImageFiltersNegativeTestJSON-1473770729-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:57:58.669868 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2cbc264b-8a63-4651-a081-c0709367f3e2 tempest-ListImageFiltersNegativeTestJSON-1473770729 tempest-ListImageFiltersNegativeTestJSON-1473770729-project] 10.222.0.79 "GET /compute/v2.1/images/e11ba6e3-7fc4-45e9-b7a4-8cbade5d2aab" status: 404 len: 62 microversion: 2.1 time: 0.680664 Jul 20 10:57:58.670993 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1176/2319] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:57 2022] GET /compute/v2.1/images/e11ba6e3-7fc4-45e9-b7a4-8cbade5d2aab => generated 62 bytes in 682 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:57:58.783315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-301109545", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:58.949929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:57:59.269938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:57:59.285581 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2df5df8-7fac-4c4c-9f21-2dbf8d0bfda4 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 1.255289 Jul 20 10:57:59.307574 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1144/2320] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:57:58 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:59.324061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-73844490-c8c5-4eec-aea4-94cfa33c8419 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f21a0d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:57:59.628316 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-73844490-c8c5-4eec-aea4-94cfa33c8419 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.319496 Jul 20 10:57:59.629329 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1145/2321] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:57:59 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:57:59.654303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-76f68f31-9a24-4244-a342-830457015fbe req-6e047961-7f0c-4538-8550-f9313c30d486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a00ade-ed85-486f-81c2-4111cbbc7648", "name": "network-vif-plugged", "status": "completed", "tag": "b629e0e9-62e2-49aa-8eaf-ae12f0485639"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:57:59.688050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-76f68f31-9a24-4244-a342-830457015fbe req-6e047961-7f0c-4538-8550-f9313c30d486 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:59.694817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-76f68f31-9a24-4244-a342-830457015fbe req-6e047961-7f0c-4538-8550-f9313c30d486 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:59.729427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-76f68f31-9a24-4244-a342-830457015fbe req-6e047961-7f0c-4538-8550-f9313c30d486 service nova] Creating event network-vif-plugged:b629e0e9-62e2-49aa-8eaf-ae12f0485639 for instance d1a00ade-ed85-486f-81c2-4111cbbc7648 on n-h2-846219-10 Jul 20 10:57:59.742993 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-76f68f31-9a24-4244-a342-830457015fbe req-6e047961-7f0c-4538-8550-f9313c30d486 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112209 Jul 20 10:57:59.754349 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1146/2322] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:57:59.860608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:57:59.861394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:57:59.862508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:57:59.863534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:57:59.864513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:57:59.901821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:59.904620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:59.910333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:57:59.912210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:57:59.989546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Getting quotas for project db383d5e009141f7b1550232e98d795b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:00.026510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Getting quotas for user 947f24c332684626a864bf58222aa8cf and project db383d5e009141f7b1550232e98d795b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:00.083154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:58:00.090887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:58:00.205573 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1502c1ef-311c-4257-a93b-24230124d860 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532227 Jul 20 10:58:00.223965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98fd2329-2e40-4fea-a65e-8b93bf8af417 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:00.224559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-98fd2329-2e40-4fea-a65e-8b93bf8af417 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:00.228148 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1177/2323] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:58:00.310824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:00.311489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:00.327106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:00.334680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:00.335694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:00.354379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:00.397684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-98fd2329-2e40-4fea-a65e-8b93bf8af417 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:00.407545 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98fd2329-2e40-4fea-a65e-8b93bf8af417 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1216 microversion: 2.1 time: 0.188450 Jul 20 10:58:00.430287 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1147/2324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:00 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1216 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:00.646841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-14287af0-750f-47c0-b68f-7c70276a6be3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f36e1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:00.775135 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-14287af0-750f-47c0-b68f-7c70276a6be3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.133826 Jul 20 10:58:00.781768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1148/2325] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:00 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:01.151003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:01.186939 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef2581ae-dffb-42c5-b341-69095ebfd8e7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1323 microversion: 2.1 time: 0.881035 Jul 20 10:58:01.203249 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1178/2326] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:00 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1323 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:01.433898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:01.436652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:01.463377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:01.480481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:01.481750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:01.484165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:01.704428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:01.748635 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c4bb9797-9a17-430b-9ec3-ec344c504f51 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1212 microversion: 2.1 time: 0.320110 Jul 20 10:58:01.752043 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1149/2327] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:01 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1212 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:01.795084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a54f5bf-1970-4339-adb6-ca69107e770d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fee2040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:01.903574 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a54f5bf-1970-4339-adb6-ca69107e770d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.116173 Jul 20 10:58:01.903574 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1179/2328] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:01 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:02.214543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:02.215196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:02.229270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:02.229773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:02.230573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:02.231034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:02.611712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:02.636391 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d3baa8a-5025-48a2-a423-3f6c55b2da88 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1519 microversion: 2.1 time: 0.426574 Jul 20 10:58:02.638279 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1150/2329] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:02 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:02.767562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:02.768116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:02.778986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:02.779480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:02.788127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0544547-e800-4c66-828f-462bf77ce30e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1577496997", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:02.788257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:02.788590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0544547-e800-4c66-828f-462bf77ce30e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 243 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1577496997", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1577496997', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'e9911c98-dd07-4792-8e53-ac1d2884ccc5'}]}}} Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:02.791824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0544547-e800-4c66-828f-462bf77ce30e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b0544547-e800-4c66-828f-462bf77ce30e tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011193 Jul 20 10:58:02.797192 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1151/2330] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:58:02.823514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de0ff0c8-0117-4ac1-8e71-2038bb378a31 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:02.824116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-de0ff0c8-0117-4ac1-8e71-2038bb378a31 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: 42d75bbd-a650-4024-bafc-a29e812a722f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:02.836361 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-de0ff0c8-0117-4ac1-8e71-2038bb378a31 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] HTTP exception thrown: Instance 42d75bbd-a650-4024-bafc-a29e812a722f could not be found. Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de0ff0c8-0117-4ac1-8e71-2038bb378a31 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/42d75bbd-a650-4024-bafc-a29e812a722f/metadata HTTP/1.1 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 42d75bbd-a650-4024-bafc-a29e812a722f could not be found. Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'server_id': '42d75bbd-a650-4024-bafc-a29e812a722f'} Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42d75bbd-a650-4024-bafc-a29e812a722f could not be found. Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42d75bbd-a650-4024-bafc-a29e812a722f could not be found. Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:02.855090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42d75bbd-a650-4024-bafc-a29e812a722f could not be found. Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de0ff0c8-0117-4ac1-8e71-2038bb378a31 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 404 to user: Instance 42d75bbd-a650-4024-bafc-a29e812a722f could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-de0ff0c8-0117-4ac1-8e71-2038bb378a31 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/42d75bbd-a650-4024-bafc-a29e812a722f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.045477 Jul 20 10:58:02.858926 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1152/2331] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:58:02 2022] GET /compute/v2.1/servers/42d75bbd-a650-4024-bafc-a29e812a722f/metadata => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:58:02.918223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21351787-19e1-4f99-b099-e9704334931a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f211b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:02.991537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:03.008941 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fb6bd4f7-0535-4f56-9ad1-03b712a2efee tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1274 microversion: 2.1 time: 0.245897 Jul 20 10:58:03.023964 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1180/2332] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:02 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1274 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:03.031621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21351787-19e1-4f99-b099-e9704334931a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.119074 Jul 20 10:58:03.032395 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1153/2333] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:02 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:03.129046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40312fe9-55ec-4408-a56f-bd1abcab1b27 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2086262655", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40312fe9-55ec-4408-a56f-bd1abcab1b27 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 499 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2086262655", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2086262655', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e9911c98-dd07-4792-8e53-ac1d2884ccc5'}]}}} Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 10:58:03.132440 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40312fe9-55ec-4408-a56f-bd1abcab1b27 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:03.136538 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-40312fe9-55ec-4408-a56f-bd1abcab1b27 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.015656 Jul 20 10:58:03.152435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1181/2334] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:03 2022] POST /compute/v2.1/servers => generated 687 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:58:03.245266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-524e403d-3725-461f-b5d2-1237808d3208 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-730201519", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-524e403d-3725-461f-b5d2-1237808d3208 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 499 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-730201519", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-730201519', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e9911c98-dd07-4792-8e53-ac1d2884ccc5'}]}}} Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 10:58:03.248404 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-524e403d-3725-461f-b5d2-1237808d3208 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:03.251824 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-524e403d-3725-461f-b5d2-1237808d3208 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009974 Jul 20 10:58:03.258173 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1154/2335] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:03 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:58:03.327685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5058c779-16f6-4827-b8b8-2e6f306ddfd7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-444242579", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5058c779-16f6-4827-b8b8-2e6f306ddfd7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 753 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-444242579", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-444242579', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e9911c98-dd07-4792-8e53-ac1d2884ccc5'}]}}} Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:58:03.330614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:58:03.333481 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:58:03.336572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.336572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.336572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5058c779-16f6-4827-b8b8-2e6f306ddfd7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:03.336572 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5058c779-16f6-4827-b8b8-2e6f306ddfd7 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014502 Jul 20 10:58:03.343434 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1182/2336] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:03 2022] POST /compute/v2.1/servers => generated 1197 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 20 10:58:03.460696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fb99723-9a8f-4629-b956-60494c12049b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1479538007", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fb99723-9a8f-4629-b956-60494c12049b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 1266 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1479538007", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e9911c98-dd07-4792-8e53-ac1d2884ccc5"}]}} Jul 20 10:58:03.465365 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1479538007', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e9911c98-dd07-4792-8e53-ac1d2884ccc5'}]}}} Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.467409 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 10:58:03.468686 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 10:58:03.470673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 10:58:03.470673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.470673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fb99723-9a8f-4629-b956-60494c12049b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:03.470673 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6fb99723-9a8f-4629-b956-60494c12049b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010311 Jul 20 10:58:03.484554 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1155/2337] 10.222.0.79 () {60 vars in 1147 bytes} [Wed Jul 20 10:58:03 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 20 10:58:03.495065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a86b80ad-c944-4ed5-804a-3406537cb4f9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:03.495689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a86b80ad-c944-4ed5-804a-3406537cb4f9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: 31e3de94-6abe-44df-aa92-17fc5e4eea1f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:03.508739 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a86b80ad-c944-4ed5-804a-3406537cb4f9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] HTTP exception thrown: Instance 31e3de94-6abe-44df-aa92-17fc5e4eea1f could not be found. Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a86b80ad-c944-4ed5-804a-3406537cb4f9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/31e3de94-6abe-44df-aa92-17fc5e4eea1f/metadata/test2 HTTP/1.1 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 31e3de94-6abe-44df-aa92-17fc5e4eea1f could not be found. Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': '31e3de94-6abe-44df-aa92-17fc5e4eea1f', 'id': 'test2'} Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31e3de94-6abe-44df-aa92-17fc5e4eea1f could not be found. Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31e3de94-6abe-44df-aa92-17fc5e4eea1f could not be found. Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:03.515540 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:03.520919 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:58:03.520919 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:58:03.520919 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31e3de94-6abe-44df-aa92-17fc5e4eea1f could not be found. Jul 20 10:58:03.520919 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:03.520919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a86b80ad-c944-4ed5-804a-3406537cb4f9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 404 to user: Instance 31e3de94-6abe-44df-aa92-17fc5e4eea1f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:03.520919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a86b80ad-c944-4ed5-804a-3406537cb4f9 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/31e3de94-6abe-44df-aa92-17fc5e4eea1f/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.033251 Jul 20 10:58:03.522332 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1183/2338] 10.222.0.79 () {58 vars in 1280 bytes} [Wed Jul 20 10:58:03 2022] GET /compute/v2.1/servers/31e3de94-6abe-44df-aa92-17fc5e4eea1f/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:58:03.544508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:03.545441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:03.558048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:03.559457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:03.560801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:03.561471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:03.616232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:58:03.815434 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-280ffa39-cafe-457a-a01e-1f4cc92633aa tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 204 len: 0 microversion: 2.1 time: 0.275597 Jul 20 10:58:03.816248 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1156/2339] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:58:03 2022] DELETE /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:03.826786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:03.828943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:03.857052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:03.857753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:03.860495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:03.861535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:04.029411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:04.030294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:04.048900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:04.050832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:04.054527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:04.059513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:04.358097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:04.389108 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f94cd399-175f-4567-8b5d-7f8bf935bb47 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1274 microversion: 2.1 time: 0.362701 Jul 20 10:58:04.406663 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1157/2340] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:04 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1274 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:04.418773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:04.427299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d98cf6d-5f63-455e-8909-60448eec4306 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3ede1040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:04.433194 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-331403bc-a62e-46c1-b630-298a1626ad5b tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1525 microversion: 2.1 time: 0.612360 Jul 20 10:58:04.437342 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1184/2341] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:03 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1525 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:04.538391 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d98cf6d-5f63-455e-8909-60448eec4306 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.125561 Jul 20 10:58:04.539671 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1158/2342] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:04 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:05.030264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "487cb6c8-a54c-4d32-a70b-9d321d5b11e2"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:05.031419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:05.047024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:05.047794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:05.049160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:05.049765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:05.413043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:05.414501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:05.428400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:05.432974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:05.435587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:05.436332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:05.529242 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] HTTP exception thrown: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Request method failure captured: Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments/5b301e11-c2cd-4b49-bf6a-8d2017deef33 HTTP/1.1 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 74 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi199dn4p_G5bPksRY4nWO-GWybBSLFwS2gmh0kL-vlrZi4kif4pAgB5JowOoqlAZbQltelB2vRIpv75KTJzx5nZQh2TGYZ70LpMc_osW2IITarIhYvwAwQY7S1maGrDqwm3NbYlhmWAEvaUwQ8mwpxWdxsVpQv4pwJEMCAr29Sm1TiwU Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ff64d9d55fcf479b8a5a5f2f0cf87cbc Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesAdminNegativeTest-1531155989 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff64d9d55fcf479b8a5a5f2f0cf87cbc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff64d9d55fcf479b8a5a5f2f0cf87cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff64d9d55fcf479b8a5a5f2f0cf87cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff64d9d55fcf479b8a5a5f2f0cf87cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesAdminNegativeTest-1531155989 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ff64d9d55fcf479b8a5a5f2f0cf87cbc Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1531155989 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesAdminNegativeTest-1531155989-project-admin Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 662cbc1b885345c7a66db1018dff0c06 Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesAdminNegativeTest-1531155989-project-admin Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: {"volumeAttachment": {"volumeId": "487cb6c8-a54c-4d32-a70b-9d321d5b11e2"}} Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: exception: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': '8c30aa1d-4b39-48b1-985a-5dac3991b904', 'id': '5b301e11-c2cd-4b49-bf6a-8d2017deef33', 'body': {'volumeAttachment': {'volumeId': '487cb6c8-a54c-4d32-a70b-9d321d5b11e2'}}} Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. (HTTP 404) (Request-ID: req-fdbf8d91-d6a4-440f-a055-bea2fad313b5) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 10:58:05.569357 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. Jul 20 10:58:05.576527 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:05.583924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Returning 400 to user: Volume 487cb6c8-a54c-4d32-a70b-9d321d5b11e2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:05.584430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0aa2ac4f-8f98-41cc-a3a2-87453bd82f5a tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments/5b301e11-c2cd-4b49-bf6a-8d2017deef33" status: 400 len: 107 microversion: 2.1 time: 1.071325 Jul 20 10:58:05.585309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1185/2343] 10.222.0.79 () {60 vars in 1432 bytes} [Wed Jul 20 10:58:04 2022] PUT /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments/5b301e11-c2cd-4b49-bf6a-8d2017deef33 => generated 107 bytes in 1074 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:58:05.595990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:05.606693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:05.646248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:05.646956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:05.656314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:05.657124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:05.939246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:05.957432 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-964a340e-d482-47c9-b379-2ccf4b4b5e52 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.539214 Jul 20 10:58:05.958696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1159/2344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:05 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:05.964993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c389bc6-9d64-4dd8-8096-62cf700d31a4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3ede1af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:06.030304 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c389bc6-9d64-4dd8-8096-62cf700d31a4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.070004 Jul 20 10:58:06.031054 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1160/2345] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:05 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:06.036031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:06.048072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:06.068009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:06.068715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:06.069743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:06.070350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:06.241174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lazy-loading 'services' on Instance uuid 8c30aa1d-4b39-48b1-985a-5dac3991b904 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:58:06.275791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:06.439349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:06.459150 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36e18397-ba32-4c43-96f8-6ed289fce523 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1525 microversion: 2.1 time: 0.864218 Jul 20 10:58:06.467597 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1186/2346] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:05 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1525 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:06.469509 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee6a793c-21e8-4c74-9223-1879490a406f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments/5b301e11-c2cd-4b49-bf6a-8d2017deef33" status: 202 len: 0 microversion: 2.1 time: 0.437052 Jul 20 10:58:06.476678 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1161/2347] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 10:58:06 2022] DELETE /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments/5b301e11-c2cd-4b49-bf6a-8d2017deef33 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:58:06.488022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:06.493140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:06.513039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:06.513918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:06.515027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:06.515751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:06.660892 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a09f7896-c12e-497b-8811-4d918f02dd03 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178234 Jul 20 10:58:06.668403 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1187/2348] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:06 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:06.977532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:06.979634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:07.014455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:07.015196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:07.016269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:07.017002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:07.051861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-728556d9-db99-45df-ba19-6f8b24640c59 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fa67af0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:07.143818 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-728556d9-db99-45df-ba19-6f8b24640c59 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.103336 Jul 20 10:58:07.145000 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1188/2349] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:07 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:07.486366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:07.487919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:07.510854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:07.512097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:07.513183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:07.515704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:08.661660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:08.692247 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff37c1f5-65a8-43cb-a8ab-9c7ec24780f9 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 1.717651 Jul 20 10:58:08.703835 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1162/2350] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:06 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:08.719822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:08.722330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:08.739316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:08.740127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:08.740996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:08.741465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:08.794454 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1820a231-78d9-41c4-a8cd-4a72d0ba57a5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089314 Jul 20 10:58:08.795540 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1163/2351] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:08 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:08.814341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56295d18-8193-415b-87ee-6c82ee47042c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f2beaf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:08.833990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:08.848599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:08.857070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-91f981fb-e287-4f8a-ae4c-bae0e5f04383 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1525 microversion: 2.1 time: 1.376045 Jul 20 10:58:08.860361 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1189/2352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:07 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1525 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:08.982941 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56295d18-8193-415b-87ee-6c82ee47042c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.185962 Jul 20 10:58:08.993634 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1164/2353] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:08 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:09.530444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-237c70c1-15e9-4842-8926-a46600ce1716 req-0303303c-e651-41ef-91fa-23464f66800d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1a00ade-ed85-486f-81c2-4111cbbc7648", "name": "network-vif-deleted", "tag": "b629e0e9-62e2-49aa-8eaf-ae12f0485639"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:09.564676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-237c70c1-15e9-4842-8926-a46600ce1716 req-0303303c-e651-41ef-91fa-23464f66800d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:09.567752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-237c70c1-15e9-4842-8926-a46600ce1716 req-0303303c-e651-41ef-91fa-23464f66800d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:09.614703 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-237c70c1-15e9-4842-8926-a46600ce1716 req-0303303c-e651-41ef-91fa-23464f66800d service nova] Creating event network-vif-deleted:b629e0e9-62e2-49aa-8eaf-ae12f0485639 for instance d1a00ade-ed85-486f-81c2-4111cbbc7648 on n-h2-846219-10 Jul 20 10:58:09.623738 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-237c70c1-15e9-4842-8926-a46600ce1716 req-0303303c-e651-41ef-91fa-23464f66800d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096173 Jul 20 10:58:09.625480 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1190/2354] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:09.714161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:09.715786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:09.751268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:09.752355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:09.755723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:09.756362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:09.806741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:09.808535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:09.870126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:09.872076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:09.873098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:09.876389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:09.969536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:10.037626 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dea2e2aa-00ce-4936-a177-fc6cef84f346 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225372 Jul 20 10:58:10.042227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1191/2355] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:09 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:58:10.061379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:10.062226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:10.070763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:10.074239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:10.076490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:10.077544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:10.078162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:10.173545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:10.174272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:10.174982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lazy-loading 'fault' on Instance uuid d1a00ade-ed85-486f-81c2-4111cbbc7648 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:58:10.347799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888b4307be724144bf40f32c5116a98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee63aa1e5dbd4b85a4fa1d07d1295b97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:10.357045 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bb965c3f-1fbe-47b2-84f0-80fe9170b714 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 200 len: 1313 microversion: 2.1 time: 0.313619 Jul 20 10:58:10.359737 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1192/2356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:10 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:10.368501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:10.379121 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9b622d2-8217-4cf0-abdf-311526247b69 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.672124 Jul 20 10:58:10.383889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7792fce3-b10e-42cf-8b3d-ae54ddd81503 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3faa7c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:10.395955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1165/2357] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:09 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:10.460752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7792fce3-b10e-42cf-8b3d-ae54ddd81503 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.100057 Jul 20 10:58:10.464040 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1193/2358] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:10 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:11.050271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:11.051382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:11.053669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=18 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:11.071049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.078817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.080009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.087029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.203698 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec5ca755-affe-402a-a300-63579565952e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157436 Jul 20 10:58:11.211162 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1166/2359] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:11 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:11.375920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:11.377197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] [instance: d1a00ade-ed85-486f-81c2-4111cbbc7648] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:11.386615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.387416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.388818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.389948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.413323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:11.414199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:11.441202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.441669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.442466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.442905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.460527 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] HTTP exception thrown: Instance d1a00ade-ed85-486f-81c2-4111cbbc7648 could not be found. Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Request method failure captured: Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 HTTP/1.1 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-gqh1vdWah_L-m-cGK0sGWRLwR3LE0LKsN3JYNmICa0bA7TcSYzHmI8YOa_Yh34lV2a_Sxi0n3o2wcZwg_Wpsdj_RyVDwQpCtsnuqHMMDhZqBRxk_W78dEiqvJW-myilkZDlwi7DFMkRhzI6YV9Ld6xPr7kv09LTAdKfbD0HfqLIo Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ee63aa1e5dbd4b85a4fa1d07d1295b97", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ee63aa1e5dbd4b85a4fa1d07d1295b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ee63aa1e5dbd4b85a4fa1d07d1295b97 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-396834551 Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 888b4307be724144bf40f32c5116a98d Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-396834551-project Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d1a00ade-ed85-486f-81c2-4111cbbc7648 could not be found. Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd1a00ade-ed85-486f-81c2-4111cbbc7648'} Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1a00ade-ed85-486f-81c2-4111cbbc7648 could not be found. Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1a00ade-ed85-486f-81c2-4111cbbc7648 could not be found. Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:11.462829 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1a00ade-ed85-486f-81c2-4111cbbc7648 could not be found. Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:11.467287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] Returning 404 to user: Instance d1a00ade-ed85-486f-81c2-4111cbbc7648 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:11.479606 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-560f7c05-31d5-4733-b0af-bfc50965fc47 tempest-ServerMetadataNegativeTestJSON-396834551 tempest-ServerMetadataNegativeTestJSON-396834551-project] 10.222.0.79 "GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648" status: 404 len: 111 microversion: 2.1 time: 0.092278 Jul 20 10:58:11.480278 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1194/2360] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:11 2022] GET /compute/v2.1/servers/d1a00ade-ed85-486f-81c2-4111cbbc7648 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:58:11.505680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d255f293-b72b-4eaf-8d75-42c3d5a0ad69 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3faa79d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:11.606425 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d255f293-b72b-4eaf-8d75-42c3d5a0ad69 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.120733 Jul 20 10:58:11.607024 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1195/2361] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:11 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:11.689771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-523079e8-eb51-413d-9d36-420a00831d14 req-14525bf3-4563-4532-9c01-8e6fac6d6c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:11.704478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-523079e8-eb51-413d-9d36-420a00831d14 req-14525bf3-4563-4532-9c01-8e6fac6d6c53 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:11.704935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-523079e8-eb51-413d-9d36-420a00831d14 req-14525bf3-4563-4532-9c01-8e6fac6d6c53 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:11.740990 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-523079e8-eb51-413d-9d36-420a00831d14 req-14525bf3-4563-4532-9c01-8e6fac6d6c53 service nova] Creating event network-changed:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:58:11.751138 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-523079e8-eb51-413d-9d36-420a00831d14 req-14525bf3-4563-4532-9c01-8e6fac6d6c53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066292 Jul 20 10:58:11.760407 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1196/2362] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:11.863239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:11.876661 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5c9ec7b-0c1d-4f59-b56a-4dfa948ae9a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.467893 Jul 20 10:58:11.878260 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1167/2363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:11 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:12.222631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:12.225796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:12.244293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:12.245188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:12.246524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:12.247393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:12.316227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42103fe2-6100-42e3-a4b7-640e37f03791 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097900 Jul 20 10:58:12.317429 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1197/2364] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:12 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:12.620280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-018861d8-909e-4427-aed1-2c6d91efb2c9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f3eeaf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:12.740355 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-018861d8-909e-4427-aed1-2c6d91efb2c9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.124232 Jul 20 10:58:12.741279 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1168/2365] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:12 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:12.896876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:12.899011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:12.925308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:12.932506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:12.933678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:12.944016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:13.329677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:13.330987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:13.352798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:13.356125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:13.357180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:13.362644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:13.463320 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b6135fa-8405-46d7-85c0-c2efb45d7058 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137814 Jul 20 10:58:13.468539 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1169/2366] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:13 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:13.749335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:13.755975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df80f065-211b-4b48-bd85-43dc8786db17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f3eedc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:13.766609 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51018f1e-f6f6-47b9-9fc5-a9f1da46d052 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.875779 Jul 20 10:58:13.776996 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1198/2367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:12 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:13.891904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df80f065-211b-4b48-bd85-43dc8786db17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.139901 Jul 20 10:58:13.893388 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1170/2368] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:13 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:14.475806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:14.478348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:14.512145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:14.521742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:14.524203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:14.528034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:14.607611 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51273d8c-d6df-4661-aaee-14902c71e43b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136849 Jul 20 10:58:14.614086 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1199/2369] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:14 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:14.788840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:14.790999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:14.805787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:14.814051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:14.816041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:14.818361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:14.908513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51428b8d-97f2-41c5-8911-dd2d2c803a67 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fb6f430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:14.990510 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51428b8d-97f2-41c5-8911-dd2d2c803a67 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.085746 Jul 20 10:58:14.991895 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1200/2370] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:14 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:15.504989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:15.517035 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e11a468b-8ff0-4093-a481-b905a94a66d7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.732039 Jul 20 10:58:15.517640 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1171/2371] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:14 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:15.620860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:15.621900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:15.623909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:15.642215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:15.642669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:15.646302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:15.655883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:15.710247 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a3dffa1-923a-41dd-947d-51a488f1c062 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094642 Jul 20 10:58:15.714640 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1201/2372] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:15 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:16.005046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dc1174d0-1d20-4f14-88e0-dd2e0cab21d1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f21a8b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:16.112054 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dc1174d0-1d20-4f14-88e0-dd2e0cab21d1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.110853 Jul 20 10:58:16.115361 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1172/2373] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:15 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:16.537274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:16.538593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:16.553239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:16.555185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:16.558267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:16.562055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:16.722248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:16.723560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:16.758456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:16.760137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:16.761056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:16.765911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:16.893843 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b4751a2f-c90d-4996-bccc-7981301449b8 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175528 Jul 20 10:58:16.900385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1173/2374] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:16 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:58:17.116175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:17.128042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-75d285bc-725f-4f5c-83b3-9ec6be63d0c0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f354af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:17.132119 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f284cdcd-5591-44f8-954c-a29aebec3526 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.600055 Jul 20 10:58:17.161567 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1202/2375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:16 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:17.219143 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-75d285bc-725f-4f5c-83b3-9ec6be63d0c0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.096991 Jul 20 10:58:17.219771 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1174/2376] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:17 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:17.919585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:17.920957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:17.944754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:17.945310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:17.946259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:17.947363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:18.022033 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7873595-8ebe-481d-ab27-9b36e7f7e57f tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118272 Jul 20 10:58:18.028478 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1203/2377] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 10:58:17 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 10:58:18.156269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:18.158589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:18.184204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:18.189773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:18.198122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:18.201480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:18.232863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90488fec-4b55-41c8-8531-daee3819937c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c50d848b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:18.374777 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90488fec-4b55-41c8-8531-daee3819937c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.146018 Jul 20 10:58:18.377105 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1204/2378] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:18 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:18.481661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-631574969", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "d551f7eb-1b7b-4d28-b8fb-0384cd940d8a"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:18.595666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] validate_networks() for [('d551f7eb-1b7b-4d28-b8fb-0384cd940d8a', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:58:19.095968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:19.116936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eb1b05b8-d407-4ebb-8a3c-b6220526c198 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.967373 Jul 20 10:58:19.138270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1175/2379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:18 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:19.390868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-70ee5cbd-7be3-4a50-b135-212a26a361c0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f205160>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:19.505412 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-70ee5cbd-7be3-4a50-b135-212a26a361c0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.119371 Jul 20 10:58:19.506304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1176/2380] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:19 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:20.142074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:20.159286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:20.173642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:20.174125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:20.177729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:20.179499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:20.829675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:20.845817 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0bef4012-747f-4463-a8b5-3ef848b991f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.711210 Jul 20 10:58:20.856324 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1177/2381] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:20 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:20.862331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f29d735-da65-43d8-99cc-20f8f787916d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f65d1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:20.949848 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0f29d735-da65-43d8-99cc-20f8f787916d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.092035 Jul 20 10:58:20.956443 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1178/2382] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:20 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:21.050262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:58:21.051404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:58:21.052118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:58:21.052746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:58:21.053377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:58:21.074094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:21.074998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:21.076361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:21.077035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:21.111888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Getting quotas for project 2e7e284f3d1941bfbc0a07318a0df461. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:21.119641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Getting quotas for user c9b9c7807eb74ecaa2cc6f7669bd09f0 and project 2e7e284f3d1941bfbc0a07318a0df461. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:21.142443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:58:21.145251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:58:21.242668 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2063b353-7aa3-49b3-bc54-7a5ad6877ec5 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.766165 Jul 20 10:58:21.254919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1205/2383] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:58:21.260532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a7ff1e0-7d56-4e59-9801-052488836033 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:21.261440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a7ff1e0-7d56-4e59-9801-052488836033 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:21.269256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:21.404653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1a7ff1e0-7d56-4e59-9801-052488836033 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:21.417901 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a7ff1e0-7d56-4e59-9801-052488836033 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1217 microversion: 2.1 time: 0.158922 Jul 20 10:58:21.422997 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1179/2384] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:21 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:21.878027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:21.878674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:21.927409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:21.939869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:21.952508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:21.965434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d20bb570-f075-4a29-a6d7-98ad99c036cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fd68040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:21.972756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:22.188618 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d20bb570-f075-4a29-a6d7-98ad99c036cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.229536 Jul 20 10:58:22.195221 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1180/2385] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:21 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:22.440524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-40594da6-40d3-456a-8852-010aabaca214 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:22.441279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-40594da6-40d3-456a-8852-010aabaca214 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:22.911706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-40594da6-40d3-456a-8852-010aabaca214 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:22.920616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-40594da6-40d3-456a-8852-010aabaca214 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1217 microversion: 2.1 time: 0.485064 Jul 20 10:58:22.930642 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1181/2386] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:22 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1217 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:23.188051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:23.202403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bed2ee62-9bee-45e1-bf0c-ed1a7b6bdfa6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f21ac10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:23.210114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b2bb966-2044-4b3d-aeb0-85d1a612e92e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 1.337082 Jul 20 10:58:23.225555 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1206/2387] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:21 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:23.351897 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bed2ee62-9bee-45e1-bf0c-ed1a7b6bdfa6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.153590 Jul 20 10:58:23.359767 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1182/2388] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:23 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:23.895576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d5450fe5-568d-49ee-8773-75384c291a9a req-131f2e25-2cbf-480e-9acb-d9cefe8fc64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "name": "network-vif-plugged", "status": "completed", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:23.930296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d5450fe5-568d-49ee-8773-75384c291a9a req-131f2e25-2cbf-480e-9acb-d9cefe8fc64b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:23.931524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d5450fe5-568d-49ee-8773-75384c291a9a req-131f2e25-2cbf-480e-9acb-d9cefe8fc64b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:23.955541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:23.956551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:23.991377 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d5450fe5-568d-49ee-8773-75384c291a9a req-131f2e25-2cbf-480e-9acb-d9cefe8fc64b service nova] Creating event network-vif-plugged:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:58:23.998306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:24.014535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:24.018118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d5450fe5-568d-49ee-8773-75384c291a9a req-131f2e25-2cbf-480e-9acb-d9cefe8fc64b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127531 Jul 20 10:58:24.019432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:24.023047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:24.023269 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1207/2389] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:24.260165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:24.262205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:24.283370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:24.284597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:24.287438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:24.289628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:24.566404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:24.575805 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4aad6b0f-12a2-471d-9a84-def51e2590c0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1269 microversion: 2.1 time: 0.626497 Jul 20 10:58:24.586612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1183/2390] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:23 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1269 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:24.614437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e287ee9-1ce1-4732-b78f-c5a8f6c312de tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f21aca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:24.801117 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e287ee9-1ce1-4732-b78f-c5a8f6c312de tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.209696 Jul 20 10:58:24.801977 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1184/2391] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:24 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:25.132438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:25.148601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8968f012-2d3d-4663-b027-7445e58cc9df tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.894125 Jul 20 10:58:25.149210 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1208/2392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:24 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:25.607412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:25.609244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:25.632624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:25.635032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:25.636174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:25.636846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:25.819880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6bfc9c0c-06be-4d3f-81fa-de0f79683254 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f964d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:25.897486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:25.908325 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-daf8edfe-039a-4f20-82b1-189dff2e90fb tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1275 microversion: 2.1 time: 0.306210 Jul 20 10:58:25.940758 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6bfc9c0c-06be-4d3f-81fa-de0f79683254 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1414 microversion: 2.1 time: 0.125028 Jul 20 10:58:25.944111 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1209/2393] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:25 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:25.947284 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1185/2394] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:25 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:26.171102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:26.174714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:26.187823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:26.192051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:26.193340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:26.194015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:26.633112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:26.650506 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28f4a813-d6a4-4fe0-8944-5f61af759876 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1316 microversion: 2.1 time: 0.483144 Jul 20 10:58:26.651354 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1210/2395] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:26 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:26.917467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5cff72c5-fc5b-45f0-91fc-f6f666544359 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Action: 'create', calling method: .version_select at 0x7f2c3f25a820>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-113888959", "policies": ["affinity"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:26.932465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:26.933078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:26.960313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:26.967932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:26.971885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:26.972674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:27.017561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5cff72c5-fc5b-45f0-91fc-f6f666544359 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:27.047243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5cff72c5-fc5b-45f0-91fc-f6f666544359 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:27.139706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5cff72c5-fc5b-45f0-91fc-f6f666544359 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:27.166686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5cff72c5-fc5b-45f0-91fc-f6f666544359 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:27.184488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:27.192907 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-64d147f5-69f8-43e9-bfed-6331aa9e64e2 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1275 microversion: 2.1 time: 0.264582 Jul 20 10:58:27.207271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1211/2396] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:26 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:27.228208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-84c6e3c6-c002-45ea-a260-025ca400a5ee tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fa968b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:27.234592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5cff72c5-fc5b-45f0-91fc-f6f666544359 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.612085 Jul 20 10:58:27.241470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1186/2397] 10.222.0.79 () {60 vars in 1173 bytes} [Wed Jul 20 10:58:26 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:27.254192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c891caf8-c8b7-4d0d-b2f9-83b6aa8efbe9 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Action: 'create', calling method: .version_select at 0x7f2c3f25a310>, body: {"server_group": {"name": "tempest-server-group-296213843", "policies": ["affinity"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:27.337420 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-84c6e3c6-c002-45ea-a260-025ca400a5ee tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1423 microversion: 2.1 time: 0.125744 Jul 20 10:58:27.343570 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1212/2398] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:27 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:27.345480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c891caf8-c8b7-4d0d-b2f9-83b6aa8efbe9 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:27.357384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-06c825e6-1195-4011-abdb-52ea88be4ba4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fabbe50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:27.370431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c891caf8-c8b7-4d0d-b2f9-83b6aa8efbe9 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:27.468430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-06c825e6-1195-4011-abdb-52ea88be4ba4 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 200 len: 1423 microversion: 2.1 time: 0.113549 Jul 20 10:58:27.468430 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1213/2399] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:27 2022] GET /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:27.486300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7cc71e73-db81-4a26-b9fc-73a75e202b94 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f9644c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:27.489881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c891caf8-c8b7-4d0d-b2f9-83b6aa8efbe9 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:27.499101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c891caf8-c8b7-4d0d-b2f9-83b6aa8efbe9 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:27.516390 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c891caf8-c8b7-4d0d-b2f9-83b6aa8efbe9 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.268533 Jul 20 10:58:27.517700 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1187/2400] 10.222.0.79 () {60 vars in 1172 bytes} [Wed Jul 20 10:58:27 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:27.533629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4e390b8-86e5-4f90-9266-063a8e4895c2 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Action: 'create', calling method: .version_select at 0x7f2c3f211430>, body: {"server_group": {"name": "tempest-server-group-296213843", "policies": ["affinity"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:27.570582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a4e390b8-86e5-4f90-9266-063a8e4895c2 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:27.585150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a4e390b8-86e5-4f90-9266-063a8e4895c2 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:27.684165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a4e390b8-86e5-4f90-9266-063a8e4895c2 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:27.695218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a4e390b8-86e5-4f90-9266-063a8e4895c2 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:27.737662 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4e390b8-86e5-4f90-9266-063a8e4895c2 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.214010 Jul 20 10:58:27.761265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1188/2401] 10.222.0.79 () {60 vars in 1172 bytes} [Wed Jul 20 10:58:27 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:27.770713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:27.771377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:27.793489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:27.794284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:27.798280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:27.798992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:28.184248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:28.204032 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4872df6-461f-44b7-b287-6288196d545f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1466 microversion: 2.1 time: 0.441469 Jul 20 10:58:28.216129 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1189/2402] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:27 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1466 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:28.216129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1cc194d0-ce4a-446c-9ad9-19b7f4f95057 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:28.280243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:28.307089 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1cc194d0-ce4a-446c-9ad9-19b7f4f95057 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/3acb38e8-aa09-49e2-8b2b-1e4b8b455857" status: 204 len: 0 microversion: 2.1 time: 0.100702 Jul 20 10:58:28.313569 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1190/2403] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:58:28 2022] DELETE /compute/v2.1/os-server-groups/3acb38e8-aa09-49e2-8b2b-1e4b8b455857 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:28.318951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1227367389", "metadata": {"image_type": "test"}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:28.320107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:28.333121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:28.335018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:28.339508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:28.341321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:28.443399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Getting quotas for project db383d5e009141f7b1550232e98d795b. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:28.461024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Getting quotas for user 947f24c332684626a864bf58222aa8cf and project db383d5e009141f7b1550232e98d795b. Resources: dict_keys(['metadata_items']) {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:28.718499 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7cc71e73-db81-4a26-b9fc-73a75e202b94 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 204 len: 0 microversion: 2.1 time: 1.237201 Jul 20 10:58:28.719685 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1214/2404] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:27 2022] DELETE /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 0 bytes in 1240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:29.101134 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9ba3ba1c-3059-4840-86ab-0d27970f1fe1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "POST /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5/action" status: 202 len: 0 microversion: 2.1 time: 0.784359 Jul 20 10:58:29.105239 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1191/2405] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:58:28 2022] POST /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 10:58:29.131674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:29.141314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:29.160895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-adc79a31-7bf7-4ab4-9e80-f3e2862a7944 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3f9640d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94725735", "description": "tempest-description-1753701847"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:29.179118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:29.179603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:29.193130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:29.194172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:29.289269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:29.472374 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-adc79a31-7bf7-4ab4-9e80-f3e2862a7944 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.751004 Jul 20 10:58:29.479843 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1215/2406] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:58:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:29.482071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af554fa2-5d73-4041-94b1-667a9199d435 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:29.543118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:29.543976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af554fa2-5d73-4041-94b1-667a9199d435 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.068336 Jul 20 10:58:29.551064 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1216/2407] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:58:29 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:29.557268 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0b34dcd-d682-47f8-a75a-7a439821ab6b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 0.450387 Jul 20 10:58:29.559617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:29.560354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:29.561904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1192/2408] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:29 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:29.568573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:29.569301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:29.570324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:29.570917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:29.573835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2f56bbbb-d867-449f-a961-2e03a3e164b1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f354ca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:29.653750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2f56bbbb-d867-449f-a961-2e03a3e164b1 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.088327 Jul 20 10:58:29.656512 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1193/2409] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:29 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:29.663101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:58:29.672661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98eb4695-f3b4-4c2e-ac14-ab24a316dd64 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3edc0700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-45443021", "description": "tempest-description-1627786257"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:29.873212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:29.952627 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed7a388c-cf46-42cf-a346-398f6e0fac7f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 204 len: 0 microversion: 2.1 time: 0.402825 Jul 20 10:58:29.955341 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1217/2410] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:58:29 2022] DELETE /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:29.971401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-46a79128-7bbe-4bbc-bd65-e1970ccaca51 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:30.030055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-46a79128-7bbe-4bbc-bd65-e1970ccaca51 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/f67441d5-87a3-4695-951e-be4d1977f0a9" status: 204 len: 0 microversion: 2.1 time: 0.070890 Jul 20 10:58:30.034191 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1218/2411] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:58:29 2022] DELETE /compute/v2.1/os-server-groups/f67441d5-87a3-4695-951e-be4d1977f0a9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:30.043740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-04f9c542-3e5a-4bea-b186-70c4f4d05b1e tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:30.070625 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-04f9c542-3e5a-4bea-b186-70c4f4d05b1e tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031621 Jul 20 10:58:30.072474 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1219/2412] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:58:30 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:30.097640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b8d876c9-d2eb-470d-906f-6ebad4eb9719 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Action: 'create', calling method: .version_select at 0x7f2c3fb505e0>, body: {"server_group": {"name": "tempest-server-group-146155397", "policies": ["affinity"]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:30.139340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b8d876c9-d2eb-470d-906f-6ebad4eb9719 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:30.152032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b8d876c9-d2eb-470d-906f-6ebad4eb9719 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:30.224860 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98eb4695-f3b4-4c2e-ac14-ab24a316dd64 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.566985 Jul 20 10:58:30.225844 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1194/2413] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:58:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:30.285335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b8d876c9-d2eb-470d-906f-6ebad4eb9719 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:30.293119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b8d876c9-d2eb-470d-906f-6ebad4eb9719 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:30.322140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1062152735", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "ba902a31-3b1d-4754-b2cf-d3223978362f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:30.331163 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b8d876c9-d2eb-470d-906f-6ebad4eb9719 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.241415 Jul 20 10:58:30.336163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1220/2414] 10.222.0.79 () {60 vars in 1172 bytes} [Wed Jul 20 10:58:30 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:30.348515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4191c9a8-545c-4794-be4c-91bc1a8dcf15 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:30.390162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4191c9a8-545c-4794-be4c-91bc1a8dcf15 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/5ab6706d-efa5-426d-8d45-2fad87ae604b" status: 204 len: 0 microversion: 2.1 time: 0.051298 Jul 20 10:58:30.391228 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1221/2415] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:58:30 2022] DELETE /compute/v2.1/os-server-groups/5ab6706d-efa5-426d-8d45-2fad87ae604b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:30.418107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b72d300d-79e9-4c53-aebc-d000bd7b5f60 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:30.434269 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b72d300d-79e9-4c53-aebc-d000bd7b5f60 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038069 Jul 20 10:58:30.435532 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1222/2416] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:58:30 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:30.449116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fad70cb5-19ce-42a6-950f-3c545f69d3bd tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Action: 'create', calling method: .version_select at 0x7f2c3f909af0>, body: {"server_group": {"name": "tempest-server-group-623680523", "policies": ["anti-affinity"]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:30.460377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] validate_networks() for [('ba902a31-3b1d-4754-b2cf-d3223978362f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:58:30.507731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fad70cb5-19ce-42a6-950f-3c545f69d3bd tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:30.524719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fad70cb5-19ce-42a6-950f-3c545f69d3bd tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:30.576759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:30.674031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fad70cb5-19ce-42a6-950f-3c545f69d3bd tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:30.686880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fad70cb5-19ce-42a6-950f-3c545f69d3bd tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_groups'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:30.719921 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fad70cb5-19ce-42a6-950f-3c545f69d3bd tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.276227 Jul 20 10:58:30.735740 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1223/2417] 10.222.0.79 () {60 vars in 1172 bytes} [Wed Jul 20 10:58:30 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:30.742086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:30.742854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:30.764417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:30.764882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:30.765690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:30.766136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:31.096948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:31.426866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:31.443956 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b4a7ff76-0f5d-46c2-80dd-31f35138bf93 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 0.706525 Jul 20 10:58:31.445007 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1224/2418] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:30 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:31.450624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1375470660", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aba33688-72b8-49d8-9eb6-15b34a514bbc"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:31.545934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] validate_networks() for [('aba33688-72b8-49d8-9eb6-15b34a514bbc', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:58:32.382194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:58:32.383872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:58:32.384626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:58:32.385200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:58:32.385807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:58:32.410134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:32.410588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:32.411433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:32.411854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:32.504351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:32.519189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for user 78f1e2aa093b45c2b9063b057251feab and project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:32.560854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:58:32.567700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:58:32.669376 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-324793ef-13d7-4f82-be88-42ce58647b26 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354504 Jul 20 10:58:32.670451 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1195/2419] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:58:32.683367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24d51a33-feed-4109-a528-78f9526f6114 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f3eed30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:32.769113 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-24d51a33-feed-4109-a528-78f9526f6114 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.097464 Jul 20 10:58:32.769764 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1196/2420] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:32 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:32.779924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2eba10c-ac8f-458d-bf43-8e471c417ee7 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:32.869363 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2eba10c-ac8f-458d-bf43-8e471c417ee7 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/76e2b49b-a94a-486e-baa4-afc46f3e39fa" status: 204 len: 0 microversion: 2.1 time: 0.098524 Jul 20 10:58:32.870246 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1197/2421] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:58:32 2022] DELETE /compute/v2.1/os-server-groups/76e2b49b-a94a-486e-baa4-afc46f3e39fa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:32.875778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fc81b1cf-d52e-4772-bf51-ccd8c04fdd3e req-c4fcee29-7a0c-47d1-bba4-7e117e9ada10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7e791a-5fef-4bd1-95f3-23b42c8bad85", "tag": "bb69da43-6e9b-4bc2-932a-4c3fbc3ee999"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:32.904879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fc81b1cf-d52e-4772-bf51-ccd8c04fdd3e req-c4fcee29-7a0c-47d1-bba4-7e117e9ada10 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:32.910249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fc81b1cf-d52e-4772-bf51-ccd8c04fdd3e req-c4fcee29-7a0c-47d1-bba4-7e117e9ada10 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:32.937313 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fc81b1cf-d52e-4772-bf51-ccd8c04fdd3e req-c4fcee29-7a0c-47d1-bba4-7e117e9ada10 service nova] Creating event network-changed:bb69da43-6e9b-4bc2-932a-4c3fbc3ee999 for instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 on n-h2-846219-10 Jul 20 10:58:32.944457 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fc81b1cf-d52e-4772-bf51-ccd8c04fdd3e req-c4fcee29-7a0c-47d1-bba4-7e117e9ada10 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072768 Jul 20 10:58:32.945346 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1198/2422] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:32.951713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:32.952794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:32.960373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:32.961206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:32.962879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:32.964316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:33.610345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:58:33.612520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:58:33.614593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:58:33.615652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:58:33.617143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:58:33.666115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:33.666865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:33.668139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:33.676423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:33.702724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:33.715348 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a39815ff-d595-4062-9f7d-45dc16dc3ba4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 0.767931 Jul 20 10:58:33.717862 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1199/2423] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:32 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:33.729553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Getting quotas for project 4c0e229c89d74c95bdca8735c4c660c3. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:33.736942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Getting quotas for user 2da03854a50f4c55b53f6aabef37678c and project 4c0e229c89d74c95bdca8735c4c660c3. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:33.745965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:33.749270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:33.756549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:58:33.771349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:58:33.780534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:33.781217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:33.783963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:33.784561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:33.850217 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff1cb341-d21f-433c-b392-c2fe426888d8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.403735 Jul 20 10:58:33.851619 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1225/2424] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:58:33.859278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6e526e1b-13f7-4881-b306-3faa534956d7 req-da0fd886-7d3f-453e-a402-10bff1897f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d9d15-9585-4fdf-9a76-ebcbe7eba769", "name": "network-vif-unplugged", "status": "completed", "tag": "e4318dc4-aab8-4ad9-9217-fd31b663ae7a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:33.882540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6e526e1b-13f7-4881-b306-3faa534956d7 req-da0fd886-7d3f-453e-a402-10bff1897f73 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:33.885270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6e526e1b-13f7-4881-b306-3faa534956d7 req-da0fd886-7d3f-453e-a402-10bff1897f73 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:33.910371 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6e526e1b-13f7-4881-b306-3faa534956d7 req-da0fd886-7d3f-453e-a402-10bff1897f73 service nova] Creating event network-vif-unplugged:e4318dc4-aab8-4ad9-9217-fd31b663ae7a for instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 on n-h1-846219-10 Jul 20 10:58:33.917615 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6e526e1b-13f7-4881-b306-3faa534956d7 req-da0fd886-7d3f-453e-a402-10bff1897f73 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063654 Jul 20 10:58:33.918775 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1226/2425] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:33.924885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e2c0723-17d5-4f4f-b0ce-121045524927 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:33.957768 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e2c0723-17d5-4f4f-b0ce-121045524927 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.037550 Jul 20 10:58:33.966695 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1227/2426] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:58:33 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:33.995545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-653cd390-cb78-4947-a040-c33291f56ce8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3fa96700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:34.040305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:34.050501 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e5615fe-a51d-4098-857b-88657ed8881d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1204 microversion: 2.1 time: 0.329460 Jul 20 10:58:34.051093 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1200/2427] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:33 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1204 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:34.062468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bc07729-b81a-4e91-ab1f-00f9f58c40fb tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:34.063726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6bc07729-b81a-4e91-ab1f-00f9f58c40fb tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:34.092419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-653cd390-cb78-4947-a040-c33291f56ce8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.121233 Jul 20 10:58:34.093344 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1228/2428] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:33 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:34.167449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6bc07729-b81a-4e91-ab1f-00f9f58c40fb tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:34.187619 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6bc07729-b81a-4e91-ab1f-00f9f58c40fb tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1216 microversion: 2.1 time: 0.132220 Jul 20 10:58:34.188570 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1201/2429] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:34 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1216 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:34.213044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1275694379", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "161913a3-b76f-4882-9d4e-fb62bf30b226"}]}, "os:scheduler_hints": {"group": "c7356f98-8317-4f11-aa6b-83e7b85449f9"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:34.306573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] validate_networks() for [('161913a3-b76f-4882-9d4e-fb62bf30b226', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:58:34.734465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:34.735159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:34.774796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:34.778542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:34.780702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:34.781589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:35.432662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:35.444801 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f00704b9-4191-4e0b-b1da-83984c7e7494 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 0.714057 Jul 20 10:58:35.450636 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1202/2430] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:34 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:35.468455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:35.469257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:35.510263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:35.511108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:35.512281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:35.515695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:35.742125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:35.783434 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-154fcbc7-b102-4da1-81be-d2b42c0dce0f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1266 microversion: 2.1 time: 0.322835 Jul 20 10:58:35.786249 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1203/2431] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:35 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:35.792298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e4e7b626-bc24-4e42-b5e3-08bcfb33c8e5 req-f3c76afa-6cdc-4421-bd86-887a9e378d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d9d15-9585-4fdf-9a76-ebcbe7eba769", "name": "network-vif-deleted", "tag": "e4318dc4-aab8-4ad9-9217-fd31b663ae7a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:35.807390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e4e7b626-bc24-4e42-b5e3-08bcfb33c8e5 req-f3c76afa-6cdc-4421-bd86-887a9e378d5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:35.810552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e4e7b626-bc24-4e42-b5e3-08bcfb33c8e5 req-f3c76afa-6cdc-4421-bd86-887a9e378d5b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:35.831212 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e4e7b626-bc24-4e42-b5e3-08bcfb33c8e5 req-f3c76afa-6cdc-4421-bd86-887a9e378d5b service nova] Creating event network-vif-deleted:e4318dc4-aab8-4ad9-9217-fd31b663ae7a for instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 on n-h1-846219-10 Jul 20 10:58:35.847279 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e4e7b626-bc24-4e42-b5e3-08bcfb33c8e5 req-f3c76afa-6cdc-4421-bd86-887a9e378d5b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058856 Jul 20 10:58:35.849350 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1204/2432] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:35.860276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1456c048-95ef-49cd-bff3-d15bd2b546ea tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f3ee430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:35.949529 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1456c048-95ef-49cd-bff3-d15bd2b546ea tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.097344 Jul 20 10:58:35.950138 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1205/2433] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:35 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:35.966947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:35.967834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:35.984703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:35.985165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:35.985978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:35.986416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:36.146935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:36.166064 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-db46668c-7ca1-4ad5-9283-6fe5ed1ea507 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1286 microversion: 2.1 time: 0.214642 Jul 20 10:58:36.167108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1206/2434] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:35 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:36.346866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:58:36.349377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:58:36.350128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:58:36.351932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:58:36.352730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:58:36.395498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:36.396293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:36.397619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:36.400024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:36.428898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:36.440454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:36.466242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:58:36.469227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:58:36.469870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:36.470518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:36.482743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:36.486198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:36.487154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:36.487640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:36.547037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:36.554715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:36.626206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:36.647334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Getting quotas for user d726d1eadae240ff94dd886f5dfc29b0 and project e92fa8b2489541cf949ad0d45ba46425. Resources: {'server_group_members'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:36.708162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e82adfd-5ef5-4a65-a5b0-71bb0c125136 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499732 Jul 20 10:58:36.711295 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1229/2435] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:58:36.730430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49f80480-37d4-41dc-9539-89649310da97 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:36.733473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-49f80480-37d4-41dc-9539-89649310da97 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:36.984888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49f80480-37d4-41dc-9539-89649310da97 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:37.002819 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49f80480-37d4-41dc-9539-89649310da97 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1213 microversion: 2.1 time: 0.283108 Jul 20 10:58:37.004154 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1230/2436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:36 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:37.016710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:37.025866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:37.037657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:37.038201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:37.044460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:37.044924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:37.150481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:37.167772 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1b9c832a-615a-458d-86f9-d948f5a56ab9 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 0.703572 Jul 20 10:58:37.168729 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1207/2437] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:36 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:37.184239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e17db6d4-f582-4a01-8541-3c41866d3042 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f2a6ee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:37.239074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:37.254231 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2192677a-9224-409b-bc46-c2520c7697d8 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1266 microversion: 2.1 time: 0.248752 Jul 20 10:58:37.257770 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1231/2438] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:37 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:37.263425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:37.264384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:37.266410 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e17db6d4-f582-4a01-8541-3c41866d3042 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.096098 Jul 20 10:58:37.267013 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1208/2439] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:37 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:37.279945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:37.280745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:37.281844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:37.282520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:37.409954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:37.426375 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f8e3acc4-9efc-453a-b26c-b39cc56dcf15 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1274 microversion: 2.1 time: 0.166699 Jul 20 10:58:37.427596 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1232/2440] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:37 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:38.022282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:38.023217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:38.035632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:38.038431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:38.044125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:38.044961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:38.185479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:38.186961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:38.199431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:38.200074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:38.203232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:38.204213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:38.210019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:38.226357 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe21369f-6f88-43fd-8a18-76d8b4f146f8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1265 microversion: 2.1 time: 0.206506 Jul 20 10:58:38.228006 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1209/2441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:38 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:38.278887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:38.279674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:38.292374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:38.304000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:38.306373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:38.307473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:38.897177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:38.925740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6932a170-e92f-43be-846b-c2d9814eb96b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.649163 Jul 20 10:58:38.938187 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1210/2442] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:38 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:38.945574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8f911a0-7c1e-466e-9d1c-ef5b97ef9668 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f2a61f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:39.021295 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d8f911a0-7c1e-466e-9d1c-ef5b97ef9668 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.080346 Jul 20 10:58:39.025224 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1211/2443] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:38 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:39.036076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:39.037274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:39.049403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.050127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:39.051093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.052243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:39.188664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:39.192534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:39.204577 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1c9147c-8971-4a19-9be4-771145abbe1b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 1.021238 Jul 20 10:58:39.207220 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1233/2444] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:38 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:39.207701 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ceba49e8-5ab4-4093-8c9e-b5afcdd4687a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1274 microversion: 2.1 time: 0.181085 Jul 20 10:58:39.208281 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1212/2445] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:39 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1274 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:39.246338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:39.246969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:39.258786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.259271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:39.262459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.267634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:39.501291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-52356ff5-bd02-479f-9014-76d03859e2e8 req-333251ea-b26d-429c-91eb-19d2fcef84de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "name": "network-vif-plugged", "status": "completed", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:39.517840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-52356ff5-bd02-479f-9014-76d03859e2e8 req-333251ea-b26d-429c-91eb-19d2fcef84de service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.520799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-52356ff5-bd02-479f-9014-76d03859e2e8 req-333251ea-b26d-429c-91eb-19d2fcef84de service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:39.556798 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-52356ff5-bd02-479f-9014-76d03859e2e8 req-333251ea-b26d-429c-91eb-19d2fcef84de service nova] Creating event network-vif-plugged:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:58:39.577235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:39.590201 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-52356ff5-bd02-479f-9014-76d03859e2e8 req-333251ea-b26d-429c-91eb-19d2fcef84de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092844 Jul 20 10:58:39.590830 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1213/2446] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:39.601910 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-123cf08f-a930-4b88-97bc-2acc309a5d67 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1271 microversion: 2.1 time: 0.361444 Jul 20 10:58:39.603316 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1234/2447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:39 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1271 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:39.954865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:39.955617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:39.971750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.972211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:39.973023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:39.973493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:40.036290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-323b2e94-3e5f-4cbe-a8a6-1ac0d6b5e10d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c50d848b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:40.106079 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-323b2e94-3e5f-4cbe-a8a6-1ac0d6b5e10d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.073565 Jul 20 10:58:40.118917 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1235/2448] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:40 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:40.226739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:40.228172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:40.245692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:40.247639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:40.248509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:40.256389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:40.864530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:40.881578 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c53613f-e571-485d-b667-180716a791cc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.931070 Jul 20 10:58:40.888278 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1214/2449] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:39 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:40.903958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:40.904595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:40.934632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:40.935091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:40.935921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:40.936374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:41.469166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:41.485381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6e9bf83-f2e1-43f5-9500-3e27759ce2a5 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.595704 Jul 20 10:58:41.486020 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1215/2450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:40 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:41.510515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:41.513984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:41.543962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:41.549226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:41.551500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:41.551970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:41.561718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:41.580158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d975c624-ddc7-40fc-a9da-7fd83ab464c3 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 1.356251 Jul 20 10:58:41.581572 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1236/2451] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:40 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:41.594180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-852998e6-afa0-495e-b891-5548ef1bd3ac tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f950430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:41.705138 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-852998e6-afa0-495e-b891-5548ef1bd3ac tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.121308 Jul 20 10:58:41.707528 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1237/2452] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:41 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:41.873073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-5764b267-9674-46c1-8d7a-ea0c675e90fc req-ca497543-eea1-4f3b-a22f-b598fe40539f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7e791a-5fef-4bd1-95f3-23b42c8bad85", "name": "network-vif-plugged", "status": "completed", "tag": "bb69da43-6e9b-4bc2-932a-4c3fbc3ee999"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:41.888459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5764b267-9674-46c1-8d7a-ea0c675e90fc req-ca497543-eea1-4f3b-a22f-b598fe40539f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:41.892214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5764b267-9674-46c1-8d7a-ea0c675e90fc req-ca497543-eea1-4f3b-a22f-b598fe40539f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:41.925071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-5764b267-9674-46c1-8d7a-ea0c675e90fc req-ca497543-eea1-4f3b-a22f-b598fe40539f service nova] Creating event network-vif-plugged:bb69da43-6e9b-4bc2-932a-4c3fbc3ee999 for instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 on n-h2-846219-10 Jul 20 10:58:41.941048 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-5764b267-9674-46c1-8d7a-ea0c675e90fc req-ca497543-eea1-4f3b-a22f-b598fe40539f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072934 Jul 20 10:58:41.958739 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1238/2453] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:41.980072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:41.986297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:42.025425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:42.026268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:42.027477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:42.028073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:42.157576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:42.203888 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f4a6895-e984-4295-83b2-8904cc0e4094 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.700776 Jul 20 10:58:42.204646 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1216/2454] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:41 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:42.280361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-45f1ff3e-5ee6-452b-95b8-c562196c3d42 req-33db6e7a-ad8f-46fd-b153-cb3d67386e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2bd780-295a-4354-aafd-e973390e5dd2", "tag": "ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:42.301594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-45f1ff3e-5ee6-452b-95b8-c562196c3d42 req-33db6e7a-ad8f-46fd-b153-cb3d67386e7e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:42.302204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-45f1ff3e-5ee6-452b-95b8-c562196c3d42 req-33db6e7a-ad8f-46fd-b153-cb3d67386e7e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:42.356130 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-45f1ff3e-5ee6-452b-95b8-c562196c3d42 req-33db6e7a-ad8f-46fd-b153-cb3d67386e7e service nova] Creating event network-changed:ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4 for instance ac2bd780-295a-4354-aafd-e973390e5dd2 on n-h1-846219-10 Jul 20 10:58:42.365487 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-45f1ff3e-5ee6-452b-95b8-c562196c3d42 req-33db6e7a-ad8f-46fd-b153-cb3d67386e7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088914 Jul 20 10:58:42.366419 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1217/2455] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:42.502465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:42.503196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:42.514212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:42.516882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:42.517903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:42.518999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:42.519626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:42.963889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:42.976715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf3a11a0-6051-4930-ae4c-9db5a9bd4f19 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 1.010161 Jul 20 10:58:42.978687 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1239/2456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:41 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:42.997271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:42.997930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:43.010560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:43.010920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:43.018975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:43.019513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:43.200808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:43.218219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7cf42ce-ba7c-41e3-8729-37052592bbad tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.719922 Jul 20 10:58:43.219515 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1218/2457] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:42 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:43.232337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e12d4b99-2970-4474-ab80-cbf7cc268d4b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f43f8b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:43.343562 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e12d4b99-2970-4474-ab80-cbf7cc268d4b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.121630 Jul 20 10:58:43.346742 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1219/2458] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:43 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:43.356397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:43.364880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:43.377266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:43.387990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:43.389224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:43.389802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:43.562203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:43.577061 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28cdd12d-b586-414b-856a-972a3dce6a36 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1317 microversion: 2.1 time: 0.595860 Jul 20 10:58:43.581710 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1240/2459] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:42 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:43.745656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:43.764229 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-30f9bada-2c77-4c44-b8ae-2140792aa9a8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.416259 Jul 20 10:58:43.775548 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1220/2460] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:43 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:43.998138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:43.998873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:44.005194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:44.038333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:44.044404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:44.051393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:44.052386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:44.237066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:44.238517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:44.244749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=36 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:44.262135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:44.262847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:44.263871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:44.264840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:44.272854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:44.442391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:44.451795 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-435dc7a0-24be-4188-b76d-600ba2fde4b6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.459635 Jul 20 10:58:44.481639 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1241/2461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:43 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:44.505042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0e11603-30bf-4b25-a7f8-942d677b6cd3 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3fa67dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:44.605521 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0e11603-30bf-4b25-a7f8-942d677b6cd3 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.122090 Jul 20 10:58:44.606423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1242/2462] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:44 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:44.616145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:44.622785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:44.646163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:44.647734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:44.655719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:44.658504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:45.688903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:45.721827 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6439a4c7-7ae4-4dee-ac7c-4483030a7f1d tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1507 microversion: 2.1 time: 1.106585 Jul 20 10:58:45.738261 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1243/2463] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:44 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1507 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:45.749555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1fa37976-a2b5-41fc-829d-3d16734f6678 req-bddc742e-f10e-43bd-8844-12160269e51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa1e2c8-3a45-4264-a07f-332f65286c48", "tag": "ee7e336d-1377-4cfe-a7b6-77db083f1544"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:45.795981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1fa37976-a2b5-41fc-829d-3d16734f6678 req-bddc742e-f10e-43bd-8844-12160269e51c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:45.796899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1fa37976-a2b5-41fc-829d-3d16734f6678 req-bddc742e-f10e-43bd-8844-12160269e51c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:45.817539 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1fa37976-a2b5-41fc-829d-3d16734f6678 req-bddc742e-f10e-43bd-8844-12160269e51c service nova] Creating event network-changed:ee7e336d-1377-4cfe-a7b6-77db083f1544 for instance bfa1e2c8-3a45-4264-a07f-332f65286c48 on n-h2-846219-10 Jul 20 10:58:45.832221 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1fa37976-a2b5-41fc-829d-3d16734f6678 req-bddc742e-f10e-43bd-8844-12160269e51c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091729 Jul 20 10:58:45.833109 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1244/2464] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:45.843424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:45.846050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:45.846722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:45.857289 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-385ff5aa-9e75-4cd8-8df5-01da13ad0b38 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 1.624596 Jul 20 10:58:45.862473 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1221/2465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:44 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:45.867106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:45.868470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:45.875048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:45.876696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:45.878760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:45.886369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:45.897275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:45.900122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:45.901129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:45.903154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:46.388768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:46.397773 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33011ee9-10e8-4033-8f50-bd69af9a4b16 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.563284 Jul 20 10:58:46.399281 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1245/2466] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:45 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:46.404667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-95e6d41a-ebed-4232-934f-fec66ec50c39 req-a45bf715-f0b0-4ee4-bc27-c978cadd0ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b387629-d603-4b93-b9ba-eb99f897b9f9", "tag": "0763e6c5-46fd-40fe-afe0-9a95acdca23b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:46.417527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:46.421314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-95e6d41a-ebed-4232-934f-fec66ec50c39 req-a45bf715-f0b0-4ee4-bc27-c978cadd0ce4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:46.422005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-95e6d41a-ebed-4232-934f-fec66ec50c39 req-a45bf715-f0b0-4ee4-bc27-c978cadd0ce4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:46.449856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-95e6d41a-ebed-4232-934f-fec66ec50c39 req-a45bf715-f0b0-4ee4-bc27-c978cadd0ce4 service nova] Creating event network-changed:0763e6c5-46fd-40fe-afe0-9a95acdca23b for instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 on n-h1-846219-10 Jul 20 10:58:46.466003 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-95e6d41a-ebed-4232-934f-fec66ec50c39 req-a45bf715-f0b0-4ee4-bc27-c978cadd0ce4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065226 Jul 20 10:58:46.469360 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1246/2467] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:46.486033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0984d7ee-eb55-4446-ae5d-eeca9930b712 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f7045e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:46.608459 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0984d7ee-eb55-4446-ae5d-eeca9930b712 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.137643 Jul 20 10:58:46.610029 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1247/2468] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:46 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:46.698564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:46.722382 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3ee2ac70-5a18-49d7-aa5c-68f6a561950a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.858250 Jul 20 10:58:46.722843 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1222/2469] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:45 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:46.879914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:46.881175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:46.892942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:46.896155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:46.900019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:46.904606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:47.014842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=44 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:47.374710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:47.391019 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c77f9359-693d-40ce-aa16-510ffb3c7492 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.515344 Jul 20 10:58:47.393386 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1248/2470] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:46 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:47.417939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:47.419148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:47.447808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:47.450463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:47.454653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:47.455108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:47.624670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a28c24e3-15eb-4bba-bf94-f9f3ea6e1882 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3fa67a60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:47.705022 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a28c24e3-15eb-4bba-bf94-f9f3ea6e1882 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.078633 Jul 20 10:58:47.707066 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1249/2471] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:47 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:47.740025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:47.741064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:47.780102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:47.782242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:47.784703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:47.785347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:48.756117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:48.766713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:48.802486 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-39abdff7-113d-4a92-9b94-053d6a77cec0 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 1.066406 Jul 20 10:58:48.803025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65d06a5a-de37-471c-a651-942a7bfb930d tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 1.389644 Jul 20 10:58:48.814114 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1223/2472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:47 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:48.815666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:48.822087 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1250/2473] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:47 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:48.822346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:48.835228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:48.839367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:48.840016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ba5e62f3-c1b0-42af-add7-65c8bb48dc53"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:48.842508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:48.844174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:48.847423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:48.860474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:48.860927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:48.863570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:48.871480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:49.007095 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] HTTP exception thrown: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Request method failure captured: Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85/os-volume_attachments/5ddabcf1-64db-4f25-8732-d45da0207ac4 HTTP/1.1 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 74 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi199dn4p_G5bPksRY4nWO-GWybBSLFwS2gmh0kL-vlrZi4kif4pAgB5JowOoqlAZbQltelB2vRIpv75KTJzx5nZQh2TGYZ70LpMc_osW2IITarIhYvwAwQY7S1maGrDqwm3NbYlhmWAEvaUwQ8mwpxWdxsVpQv4pwJEMCAr29Sm1TiwU Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ff64d9d55fcf479b8a5a5f2f0cf87cbc Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesAdminNegativeTest-1531155989 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ff64d9d55fcf479b8a5a5f2f0cf87cbc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff64d9d55fcf479b8a5a5f2f0cf87cbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ff64d9d55fcf479b8a5a5f2f0cf87cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ff64d9d55fcf479b8a5a5f2f0cf87cbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesAdminNegativeTest-1531155989 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ff64d9d55fcf479b8a5a5f2f0cf87cbc Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1531155989 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesAdminNegativeTest-1531155989-project-admin Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 662cbc1b885345c7a66db1018dff0c06 Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesAdminNegativeTest-1531155989-project-admin Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: {"volumeAttachment": {"volumeId": "ba5e62f3-c1b0-42af-add7-65c8bb48dc53"}} Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: exception: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': 'fb7e791a-5fef-4bd1-95f3-23b42c8bad85', 'id': '5ddabcf1-64db-4f25-8732-d45da0207ac4', 'body': {'volumeAttachment': {'volumeId': 'ba5e62f3-c1b0-42af-add7-65c8bb48dc53'}}} Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. (HTTP 404) (Request-ID: req-c9f59ddb-4d74-438c-a160-1ec776cff107) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 10:58:49.010402 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. Jul 20 10:58:49.014279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:58:49.023285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] Returning 404 to user: Volume 5ddabcf1-64db-4f25-8732-d45da0207ac4 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:58:49.024705 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-34461de1-95c5-4763-96fc-af8607198270 tempest-VolumesAdminNegativeTest-1531155989 tempest-VolumesAdminNegativeTest-1531155989-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85/os-volume_attachments/5ddabcf1-64db-4f25-8732-d45da0207ac4" status: 404 len: 109 microversion: 2.1 time: 0.198352 Jul 20 10:58:49.025577 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1251/2474] 10.222.0.79 () {60 vars in 1432 bytes} [Wed Jul 20 10:58:48 2022] PUT /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85/os-volume_attachments/5ddabcf1-64db-4f25-8732-d45da0207ac4 => generated 109 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:58:49.045309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85d24dbf-0550-44e5-bf71-772d2ee9c13c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f85ab80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:49.158807 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-85d24dbf-0550-44e5-bf71-772d2ee9c13c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.131912 Jul 20 10:58:49.161245 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1252/2475] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:49 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:49.498809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:49.509416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-03b5d114-3309-4f03-9069-2d1f568f7715 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.702466 Jul 20 10:58:49.513031 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1224/2476] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:48 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:49.824678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:49.825526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:49.842533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:49.843820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:49.855252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:49.856170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:49.858239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:49.868713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:49.870054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:49.872315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:49.874734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:49.877994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:50.574588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:50.578431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:50.592662 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b0571ac7-3c5f-4d19-9b47-584c9e7d3a32 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.772759 Jul 20 10:58:50.593295 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1253/2477] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:49 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:50.608843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51f3ce6f-481f-48e2-8d07-cf873f635edc tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f7bc3a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:50.610239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:50.619311 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-40e84560-959c-4672-9fc1-a094920d7ebc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.785181 Jul 20 10:58:50.624222 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1225/2478] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:49 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:50.657258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:50.659760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:50.686924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:50.687435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:50.688274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:50.688714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:50.707394 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51f3ce6f-481f-48e2-8d07-cf873f635edc tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.107023 Jul 20 10:58:50.708258 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1254/2479] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:50 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:50.972475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:50.983816 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8ad47090-a982-47f2-89a4-41283c957e91 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.358055 Jul 20 10:58:50.984928 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1226/2480] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:50 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:51.610230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:51.610930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:51.621184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:51.622194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:51.624170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:51.627913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:51.647472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:51.648119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:51.668809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:51.669577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:51.670021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:51.670452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:52.189503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:52.204864 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e5bcbc9-3261-4e8b-82c1-ef4d1ab2cd4c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.561092 Jul 20 10:58:52.207094 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1227/2481] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:51 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:52.282984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:52.294073 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2639e804-cff4-405e-a84f-141eba7ddb7c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.688040 Jul 20 10:58:52.299028 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1255/2482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:51 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:52.304044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9aba18e8-928a-40f8-9a80-1b89a63382a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f9f2dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:52.391559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9aba18e8-928a-40f8-9a80-1b89a63382a0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.091073 Jul 20 10:58:52.392400 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1256/2483] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:52 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:52.410994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:52.416140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:52.429682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:52.430925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:52.434618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:52.435310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:52.481911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-316577735", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:52.634886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:58:53.401807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:53.433893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e3882029-94f8-45df-839e-d5f4251eb0dd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 1.031581 Jul 20 10:58:53.444513 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1257/2484] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:52 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:53.463385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:53.468280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:53.488589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:53.489299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:53.490240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:53.499786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:53.718261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:58:53.718851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:58:53.719272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:58:53.720705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:58:53.721559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:58:53.764194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:53.765941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:53.768787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:53.769441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:53.813011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:58:53.819486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:53.821256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:58:53.841895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:58:53.845075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:58:53.933858 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-59ece67e-b5ce-42bf-945c-784ae08f0aa3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713730 Jul 20 10:58:53.943949 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1228/2485] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:58:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:58:53.970818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:53.973117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:53.991924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:53.994093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:53.995417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:53.996116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.042982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:54.056282 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3aa3564d-f109-4943-bbce-c4866c46c98c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.608252 Jul 20 10:58:54.072409 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1258/2486] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:53 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:54.080184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c83d1d88-6df0-4eb4-96d4-7de75b920b71 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f90d0d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:54.152726 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c83d1d88-6df0-4eb4-96d4-7de75b920b71 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.078943 Jul 20 10:58:54.153496 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1259/2487] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:54 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:54.160034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:54.160778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:54.170131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.170851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.171906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.172547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.215769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:58:54.476429 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2f2dc8b-98c4-4dd5-b7ed-a8f6678dbd09 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 204 len: 0 microversion: 2.1 time: 0.319802 Jul 20 10:58:54.485013 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1260/2488] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:58:54 2022] DELETE /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:58:54.492197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:54.497989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-029f6c7b-f4a2-403e-92ea-62dee1bb8999 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:54.503949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-029f6c7b-f4a2-403e-92ea-62dee1bb8999 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:54.509081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb9bee08-341d-46d3-87e3-6a09c0850d5c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.562274 Jul 20 10:58:54.510424 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1229/2489] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:53 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:54.517534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6508392b-6700-4be5-a0ad-90ba5a736540 req-662507b5-cec2-49a7-9b0d-e62fcb6a3d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2bd780-295a-4354-aafd-e973390e5dd2", "name": "network-vif-plugged", "status": "completed", "tag": "ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:54.532487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6508392b-6700-4be5-a0ad-90ba5a736540 req-662507b5-cec2-49a7-9b0d-e62fcb6a3d39 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.533195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6508392b-6700-4be5-a0ad-90ba5a736540 req-662507b5-cec2-49a7-9b0d-e62fcb6a3d39 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.561405 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6508392b-6700-4be5-a0ad-90ba5a736540 req-662507b5-cec2-49a7-9b0d-e62fcb6a3d39 service nova] Creating event network-vif-plugged:ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4 for instance ac2bd780-295a-4354-aafd-e973390e5dd2 on n-h1-846219-10 Jul 20 10:58:54.576960 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6508392b-6700-4be5-a0ad-90ba5a736540 req-662507b5-cec2-49a7-9b0d-e62fcb6a3d39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064449 Jul 20 10:58:54.579604 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1230/2490] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:54.593901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:54.598783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:54.618187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.626316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.628953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.630470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.725997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-029f6c7b-f4a2-403e-92ea-62dee1bb8999 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:54.740411 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-029f6c7b-f4a2-403e-92ea-62dee1bb8999 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1192 microversion: 2.1 time: 0.253489 Jul 20 10:58:54.744779 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1261/2491] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:54 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1192 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:54.762787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:54.768877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:54.803537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.809570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:54.821083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:54.821722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.133958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:55.162599 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-509213bb-63a5-4caa-9b35-8f09364aee9d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.572126 Jul 20 10:58:55.168277 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1231/2492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:54 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:55.199653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:55.201579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:55.241005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:55.241452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.242761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:55.243211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.603776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:55.616470 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1c78ab7d-8106-4f86-8a35-006847c41bdf tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1513 microversion: 2.1 time: 0.870021 Jul 20 10:58:55.626355 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1262/2493] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:54 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1513 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:55.650113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c965fea0-fea1-42dc-a352-3747df6ab9f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3fb9e5e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:55.751297 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c965fea0-fea1-42dc-a352-3747df6ab9f5 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.123344 Jul 20 10:58:55.752482 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1263/2494] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:55 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:55.776981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:55.784875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:55.785996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:55.790078 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3570c716-6362-4374-a427-fa48c5972d9f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.616707 Jul 20 10:58:55.790893 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1232/2495] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:55 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:55.808441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:55.809342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:55.813469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:55.818039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:55.818800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.819890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:55.821199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.827258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.828640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:55.829393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:55.938609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:55.957654 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8b13dbc9-1436-4d64-bb77-4c5e18080941 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1188 microversion: 2.1 time: 0.147366 Jul 20 10:58:55.969058 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1233/2496] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:55 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1188 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:56.187407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:56.188003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:56.200158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.203240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:56.205347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.206999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:56.267858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:56.276746 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b1286771-d521-4e64-b60b-eeced4491820 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.522765 Jul 20 10:58:56.292360 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1264/2497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:55 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:56.497909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:56.525199 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-22502151-35e9-4c29-b4ec-4e3142e39e09 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.342436 Jul 20 10:58:56.528147 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1234/2498] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:56 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:56.644077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:56.645308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:56.654889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.663400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:56.665118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.669365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:56.696689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e32d9847-f91a-459d-94af-aef92ba0af19 req-4551dbe2-0ae0-4291-947a-59b92e1a2a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa1e2c8-3a45-4264-a07f-332f65286c48", "name": "network-vif-plugged", "status": "completed", "tag": "ee7e336d-1377-4cfe-a7b6-77db083f1544"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:56.718290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e32d9847-f91a-459d-94af-aef92ba0af19 req-4551dbe2-0ae0-4291-947a-59b92e1a2a96 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.718661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e32d9847-f91a-459d-94af-aef92ba0af19 req-4551dbe2-0ae0-4291-947a-59b92e1a2a96 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:56.755243 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e32d9847-f91a-459d-94af-aef92ba0af19 req-4551dbe2-0ae0-4291-947a-59b92e1a2a96 service nova] Creating event network-vif-plugged:ee7e336d-1377-4cfe-a7b6-77db083f1544 for instance bfa1e2c8-3a45-4264-a07f-332f65286c48 on n-h2-846219-10 Jul 20 10:58:56.773015 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e32d9847-f91a-459d-94af-aef92ba0af19 req-4551dbe2-0ae0-4291-947a-59b92e1a2a96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080371 Jul 20 10:58:56.774761 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1235/2499] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:58:56.780292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4456c4b5-cdc8-40e5-a708-7a5aa14c8f64 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f1c4ca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:56.885922 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4456c4b5-cdc8-40e5-a708-7a5aa14c8f64 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.109653 Jul 20 10:58:56.887268 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1236/2500] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:56 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:56.894779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:56.901861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:56.914039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.918371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:56.919476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:56.928434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:57.084868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:57.103826 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b85d2914-b0ae-4bce-ad30-7a93c8298e4b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1513 microversion: 2.1 time: 0.456264 Jul 20 10:58:57.106402 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1265/2501] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:56 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1513 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:57.127873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:57.130734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:57.158063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:57.158821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:57.169398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:57.170056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:57.400008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:57.421863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65989589-a7cc-4b9e-a1c3-0aa995649081 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1244 microversion: 2.1 time: 0.307952 Jul 20 10:58:57.423238 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1266/2502] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:57 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1244 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:57.429511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:57.435453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:57.451203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:57.453540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:57.454563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:57.455868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:57.456684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:57.484608 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3d6db787-969b-445a-93dc-fd5dd3c70563 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1308 microversion: 2.1 time: 0.595994 Jul 20 10:58:57.488005 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1237/2503] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:56 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1308 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:57.565124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:57.565810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:57.577542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:57.578006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:57.578808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:57.579280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.111560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:58.128038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a21615ea-fba9-4fdc-bb2a-25fb3b862ec8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.701056 Jul 20 10:58:58.141435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1267/2504] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:57 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:58.157221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-aabae793-b722-4630-ac96-87208251424f req-93d6a2d0-deaa-48d5-b34e-2d6f7e631c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7e791a-5fef-4bd1-95f3-23b42c8bad85", "name": "network-vif-deleted", "tag": "bb69da43-6e9b-4bc2-932a-4c3fbc3ee999"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:58.177335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aabae793-b722-4630-ac96-87208251424f req-93d6a2d0-deaa-48d5-b34e-2d6f7e631c4f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.178116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aabae793-b722-4630-ac96-87208251424f req-93d6a2d0-deaa-48d5-b34e-2d6f7e631c4f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.206122 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-aabae793-b722-4630-ac96-87208251424f req-93d6a2d0-deaa-48d5-b34e-2d6f7e631c4f service nova] Creating event network-vif-deleted:bb69da43-6e9b-4bc2-932a-4c3fbc3ee999 for instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 on n-h2-846219-10 Jul 20 10:58:58.213994 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-aabae793-b722-4630-ac96-87208251424f req-93d6a2d0-deaa-48d5-b34e-2d6f7e631c4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068466 Jul 20 10:58:58.215279 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1268/2505] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:58:58.221374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ee2696f-43d8-4bf1-9f4a-af4d8ea39aea tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f9d51f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:58.278942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:58.296707 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a033f0e-8ecb-4cee-b19a-6172382d8549 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1316 microversion: 2.1 time: 0.754835 Jul 20 10:58:58.297470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1238/2506] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:57 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:58.321292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:58.330748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:58.375728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ee2696f-43d8-4bf1-9f4a-af4d8ea39aea tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.158859 Jul 20 10:58:58.376602 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1269/2507] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:58 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:58.381311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.382726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.385905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.389434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.439234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:58.440237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:58.458097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.458909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.460717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.461897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.495043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.498377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.499032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lazy-loading 'fault' on Instance uuid fb7e791a-5fef-4bd1-95f3-23b42c8bad85 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:58:58.675999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:58.684076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9107fe2-5dc3-4a81-af26-f3fa62ce1ec7 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 200 len: 1307 microversion: 2.1 time: 0.376556 Jul 20 10:58:58.687566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1239/2508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:58 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:58.692337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:58.692960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:58.707245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:58.719677 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97090411-c5a3-4673-aa86-ec7d1e585f0e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1250 microversion: 2.1 time: 0.284201 Jul 20 10:58:58.721450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.722127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.723079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.723817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.730333 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1270/2509] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:58 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1250 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:58.753785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:58:58.928200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:58.939909 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85760414-7dd8-496b-b3e0-16c73c21935e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1488 microversion: 2.1 time: 0.251187 Jul 20 10:58:58.956360 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1240/2510] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:58 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1488 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:58.962544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:58:58.963100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:58.972179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.972639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:58.973434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:58.973870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.040015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lazy-loading 'flavor' on Instance uuid ac2bd780-295a-4354-aafd-e973390e5dd2 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:58:59.146476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:59.147112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:59.158623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.159084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.159893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.160328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.278633 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-144a841e-97eb-4ba2-b72c-ed3e88a21d47 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.320049 Jul 20 10:58:59.280530 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1271/2511] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:58:58 2022] POST /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:58:59.321302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:59.334821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:59.357711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.364883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.372144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.373060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.474822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:59.488128 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e52e83b6-e44b-4389-b70f-ecda54aeb43f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.345572 Jul 20 10:58:59.490812 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1241/2512] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:59 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:58:59.501105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:59.506026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:59.527846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.528835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.529936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.535274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.838847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:59.850995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9b7d324-be86-4ae1-b1c3-b3f46bff20be tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1496 microversion: 2.1 time: 0.537542 Jul 20 10:58:59.858931 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1272/2513] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:59 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1496 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:59.870208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8fe528c9-302b-4e6d-b9a4-ac1a25ee3741 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3fb50e50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:59.933389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:58:59.942571 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50fc1bd8-efcb-436a-aafd-883fc43fcae2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1503 microversion: 2.1 time: 0.445859 Jul 20 10:58:59.947604 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1242/2514] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:59 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:59.960084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:59.961018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: fb7e791a-5fef-4bd1-95f3-23b42c8bad85] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:59.966729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8fe528c9-302b-4e6d-b9a4-ac1a25ee3741 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.105732 Jul 20 10:58:59.967661 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1273/2515] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:58:59 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:58:59.968682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.969697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.970800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.971816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.980291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:58:59.981289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:58:59.992332 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] HTTP exception thrown: Instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 could not be found. Jul 20 10:58:59.994882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Request method failure captured: Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 HTTP/1.1 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi199BzDNkigTS7AiwwQPxhuHgMBlLy87i4k5PXlW2c99rO9o3QI5FMRk1_iCyOLDaIs3PibI0e6EFxnX93W85YYtExULBLs1nwBvsXVlJcKNNew5zXWcNF5i4RBATBAAOw_ymga1k7nVJOKdBrkxy9rKwprVhrETa6Lnz830D3u1uuJ8 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 2e7e284f3d1941bfbc0a07318a0df461 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesAdminNegativeTest-2066348757 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e7e284f3d1941bfbc0a07318a0df461", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e7e284f3d1941bfbc0a07318a0df461"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e7e284f3d1941bfbc0a07318a0df461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e7e284f3d1941bfbc0a07318a0df461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesAdminNegativeTest-2066348757 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 2e7e284f3d1941bfbc0a07318a0df461 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2066348757 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesAdminNegativeTest-2066348757-project Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c9b9c7807eb74ecaa2cc6f7669bd09f0 Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesAdminNegativeTest-2066348757-project Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 could not be found. Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fb7e791a-5fef-4bd1-95f3-23b42c8bad85'} Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 could not be found. Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 could not be found. Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:58:59.995257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 could not be found. Jul 20 10:58:59.999195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:58:59.999717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:58:59.999717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:58:59.999717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.001975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Returning 404 to user: Instance fb7e791a-5fef-4bd1-95f3-23b42c8bad85 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:00.003049 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb8ea545-48f8-44a5-9c36-09af241d9e37 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85" status: 404 len: 111 microversion: 2.1 time: 0.053288 Jul 20 10:59:00.007056 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1243/2516] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:59 2022] GET /compute/v2.1/servers/fb7e791a-5fef-4bd1-95f3-23b42c8bad85 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:00.015357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fd6690fe-c6c6-4b83-a871-2d3b941bcedb req-b647928f-34ef-438a-b449-b22636267cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b387629-d603-4b93-b9ba-eb99f897b9f9", "name": "network-vif-plugged", "status": "completed", "tag": "0763e6c5-46fd-40fe-afe0-9a95acdca23b"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:00.036174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fd6690fe-c6c6-4b83-a871-2d3b941bcedb req-b647928f-34ef-438a-b449-b22636267cae service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.037384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fd6690fe-c6c6-4b83-a871-2d3b941bcedb req-b647928f-34ef-438a-b449-b22636267cae service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.066949 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fd6690fe-c6c6-4b83-a871-2d3b941bcedb req-b647928f-34ef-438a-b449-b22636267cae service nova] Creating event network-vif-plugged:0763e6c5-46fd-40fe-afe0-9a95acdca23b for instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 on n-h1-846219-10 Jul 20 10:59:00.076143 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fd6690fe-c6c6-4b83-a871-2d3b941bcedb req-b647928f-34ef-438a-b449-b22636267cae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066694 Jul 20 10:59:00.079585 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1244/2517] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:00.093812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-94725735"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:00.095336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:00.105321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.106149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.111661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.115502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.521883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:00.526727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:00.542200 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-20bcfa9f-c8cd-493f-a2b8-92457fcdf85b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.570014 Jul 20 10:59:00.542837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1274/2518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:58:59 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:00.556116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:00.558537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:00.572524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.573446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.574952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.577010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.676690 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.network.security_group_api [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Adding security group 8e276036-3c93-4d3a-b91c-b74677b86b6e to port ee7e336d-1377-4cfe-a7b6-77db083f1544 Jul 20 10:59:00.862358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:00.875560 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f149e4dc-f85e-492c-b864-d41b2f16f56c tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1313 microversion: 2.1 time: 0.331107 Jul 20 10:59:00.876158 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1275/2519] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:00 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:00.891538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:00.892177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:00.924540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.925143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:00.927003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:00.933973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:02.361395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:02.436248 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f6bc09e-3a13-4024-9a3d-2b2a7dbc1475 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 200 len: 1479 microversion: 2.1 time: 1.558783 Jul 20 10:59:02.438775 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1276/2520] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:00 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 1479 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:02.451008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7c5d901-65a3-4b18-9b0d-d427d3d20925 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3efe1040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:02.566866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b0ba793f-7086-498f-af4d-6556639d3fc8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48/action" status: 202 len: 0 microversion: 2.1 time: 2.484703 Jul 20 10:59:02.568356 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1245/2521] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:00 2022] POST /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48/action => generated 0 bytes in 2488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:02.570363 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7c5d901-65a3-4b18-9b0d-d427d3d20925 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.130369 Jul 20 10:59:02.570952 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1277/2522] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:02 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:02.576711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:02.580964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:02.581664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:02.582137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:02.600522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:02.600979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:02.602724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:02.603549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:02.604256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:02.606370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:02.607379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:02.610692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:03.104086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:03.116863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61ec5aff-ddfa-426a-9a3c-0636a4e2ebb8 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1498 microversion: 2.1 time: 0.544453 Jul 20 10:59:03.130427 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1278/2523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:02 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1498 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:03.161935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-76ee37e9-1217-4d78-8b12-25c0c039fccc req-49f3b655-4e98-43d4-8195-9078347afa57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6", "tag": "9b20f129-faf3-47cf-ab0f-a45a462c9ecb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:03.180837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-76ee37e9-1217-4d78-8b12-25c0c039fccc req-49f3b655-4e98-43d4-8195-9078347afa57 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:03.181857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-76ee37e9-1217-4d78-8b12-25c0c039fccc req-49f3b655-4e98-43d4-8195-9078347afa57 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:03.192995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:03.209419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-76ee37e9-1217-4d78-8b12-25c0c039fccc req-49f3b655-4e98-43d4-8195-9078347afa57 service nova] Creating event network-changed:9b20f129-faf3-47cf-ab0f-a45a462c9ecb for instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 on n-h1-846219-10 Jul 20 10:59:03.216431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1393e842-537d-4863-942c-94c1bb3b70fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.646760 Jul 20 10:59:03.224570 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-76ee37e9-1217-4d78-8b12-25c0c039fccc req-49f3b655-4e98-43d4-8195-9078347afa57 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090056 Jul 20 10:59:03.225479 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1279/2524] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:03.232800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1625589504"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:03.234340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:03.241152 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1246/2525] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:02 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:03.246135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:03.248601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:03.252306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:03.253642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-45443021"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:03.254442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:03.254940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:03.265128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:03.265819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:03.267578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:03.268194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:03.600836 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.network.security_group_api [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Adding security group 67859ea8-3646-49e8-83ad-7b5236513355 to port ee7e336d-1377-4cfe-a7b6-77db083f1544 Jul 20 10:59:03.800877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:03.833640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:04.022498 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef3a6354-9258-45cd-863c-3d4d108620f1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.795346 Jul 20 10:59:04.032044 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1280/2526] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:03 2022] POST /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 10:59:04.041385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1eb6c982-2af9-4c29-9ef7-8b85cc506568 req-9b8efb27-d1c4-433a-83f6-145bd82e79c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa1e2c8-3a45-4264-a07f-332f65286c48", "tag": "ee7e336d-1377-4cfe-a7b6-77db083f1544"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:04.060947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1eb6c982-2af9-4c29-9ef7-8b85cc506568 req-9b8efb27-d1c4-433a-83f6-145bd82e79c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.062019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1eb6c982-2af9-4c29-9ef7-8b85cc506568 req-9b8efb27-d1c4-433a-83f6-145bd82e79c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.091560 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1eb6c982-2af9-4c29-9ef7-8b85cc506568 req-9b8efb27-d1c4-433a-83f6-145bd82e79c7 service nova] Creating event network-changed:ee7e336d-1377-4cfe-a7b6-77db083f1544 for instance bfa1e2c8-3a45-4264-a07f-332f65286c48 on n-h2-846219-10 Jul 20 10:59:04.109641 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1eb6c982-2af9-4c29-9ef7-8b85cc506568 req-9b8efb27-d1c4-433a-83f6-145bd82e79c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074696 Jul 20 10:59:04.125056 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1281/2527] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:04.138942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-082075a5-e26c-4779-9fd7-99704afd9710 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:04.199289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.compute.server_groups [None req-082075a5-e26c-4779-9fd7-99704afd9710 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Querying cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) for 1 instances {{(pid=125885) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 10:59:04.200117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-082075a5-e26c-4779-9fd7-99704afd9710 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.206618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-082075a5-e26c-4779-9fd7-99704afd9710 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.240972 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ed07de0f-d9fb-4735-8ae8-416d4127e2a8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48/action" status: 202 len: 0 microversion: 2.1 time: 0.998404 Jul 20 10:59:04.248057 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1247/2528] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:03 2022] POST /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48/action => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:04.256130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-217e69ba-f34c-4124-ad18-0e6ece441776 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3e7a8820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:04.352068 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-082075a5-e26c-4779-9fd7-99704afd9710 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/c7356f98-8317-4f11-aa6b-83e7b85449f9" status: 200 len: 221 microversion: 2.1 time: 0.218288 Jul 20 10:59:04.354776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1282/2529] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:59:04 2022] GET /compute/v2.1/os-server-groups/c7356f98-8317-4f11-aa6b-83e7b85449f9 => generated 221 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:04.360395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-301a111e-7e0d-4970-9b67-910bf7477969 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f9a1ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:04.365358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-217e69ba-f34c-4124-ad18-0e6ece441776 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.115842 Jul 20 10:59:04.365961 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1248/2530] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:04 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:04.388160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:04.389240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:04.399091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.406542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.407471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.407921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.475811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-301a111e-7e0d-4970-9b67-910bf7477969 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.119828 Jul 20 10:59:04.477307 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1283/2531] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:04 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:04.495878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:04.502269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:04.519922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.533118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.537016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.545357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.669513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:04.682058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f4c6516b-0f00-49bc-a13d-63b2bbf14747 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.313072 Jul 20 10:59:04.683203 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1249/2532] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:04 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:04.688011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:04.688729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:04.718681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.720387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.721529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:04.724826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:04.732274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:04.811364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:04.922778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08589605-f4ae-463f-a098-57a44a3d4917 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.443162 Jul 20 10:59:04.923406 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1284/2533] 10.222.0.79 () {58 vars in 1292 bytes} [Wed Jul 20 10:59:04 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48/os-security-groups => generated 1155 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:04.943248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e21657c3-6646-43ce-b995-26ee8e837585 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3f077ee0>, body: {"security_group": {"name": " tempest-securitygroup -1562513654 ", "description": "tempest-description-1223192507"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:05.056357 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-336363e8-a136-4761-a30f-febc6086a598 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 204 len: 0 microversion: 2.1 time: 0.371543 Jul 20 10:59:05.057034 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1250/2534] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:04 2022] DELETE /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:05.068743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:05.069672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:05.084945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:05.085405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:05.086813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:05.090014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:05.428967 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e21657c3-6646-43ce-b995-26ee8e837585 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.491231 Jul 20 10:59:05.435950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1285/2535] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:59:04 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:05.440757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-421007f4-5137-43b8-907f-5b6f0ba9011a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f90de50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:05.530884 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-421007f4-5137-43b8-907f-5b6f0ba9011a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.093718 Jul 20 10:59:05.532102 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1286/2536] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:05 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:05.537301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe1ef09c-ef71-4cd0-b877-c01b86143b29 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3fa67dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:05.650759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:05.662113 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe1ef09c-ef71-4cd0-b877-c01b86143b29 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da" status: 200 len: 224 microversion: 2.1 time: 0.128393 Jul 20 10:59:05.663086 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1287/2537] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:59:05 2022] GET /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da => generated 224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:05.663783 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ab20a42d-2dff-47dc-bea5-d1d8b3c0a6c3 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1504 microversion: 2.1 time: 0.601445 Jul 20 10:59:05.665717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1251/2538] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:05 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:05.668777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-53b8bcb7-afc0-43fc-8bc0-cbb4fa77362d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f964790>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:05.684210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e412ea51-8431-40c4-8d48-ae31aa19c060 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f4d8940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:05.766462 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-53b8bcb7-afc0-43fc-8bc0-cbb4fa77362d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.101780 Jul 20 10:59:05.783703 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1288/2539] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:05 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:05.800270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:05.809812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:05.830868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:05.831372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:05.832248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:05.832687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:06.116085 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e412ea51-8431-40c4-8d48-ae31aa19c060 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da" status: 202 len: 0 microversion: 2.1 time: 0.435283 Jul 20 10:59:06.120449 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1252/2540] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:59:05 2022] DELETE /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:06.139953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f3ee5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:06.238912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:59:06.239560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 3b47fd7f-148b-46c3-bde8-96f58e3186da not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:59:06.240095 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.240095 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da HTTP/1.1 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '3b47fd7f-148b-46c3-bde8-96f58e3186da'} Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:59:06.243245 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-32682aa4-45df-4577-9b2d-4836b7ad54f4'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c38cfbf-e176-482b-b4b3-864e7f33893f tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da" status: 404 len: 194 microversion: 2.1 time: 0.113835 Jul 20 10:59:06.247131 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1253/2541] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:59:06 2022] GET /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:06.259125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1a3417dc-31ab-4538-adb2-6cacd7c34262 req-ef9e0404-86a7-4193-b852-257cde977f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa1e2c8-3a45-4264-a07f-332f65286c48", "tag": "ee7e336d-1377-4cfe-a7b6-77db083f1544"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:06.274486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:06.279831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1a3417dc-31ab-4538-adb2-6cacd7c34262 req-ef9e0404-86a7-4193-b852-257cde977f18 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:06.280287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1a3417dc-31ab-4538-adb2-6cacd7c34262 req-ef9e0404-86a7-4193-b852-257cde977f18 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:06.303007 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4dfaf532-d88f-49d3-92da-a105f536f681 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.517429 Jul 20 10:59:06.303665 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1a3417dc-31ab-4538-adb2-6cacd7c34262 req-ef9e0404-86a7-4193-b852-257cde977f18 service nova] Creating event network-changed:ee7e336d-1377-4cfe-a7b6-77db083f1544 for instance bfa1e2c8-3a45-4264-a07f-332f65286c48 on n-h2-846219-10 Jul 20 10:59:06.304103 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1289/2542] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:05 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:06.314573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1a3417dc-31ab-4538-adb2-6cacd7c34262 req-ef9e0404-86a7-4193-b852-257cde977f18 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067510 Jul 20 10:59:06.315879 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1254/2543] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:06.321481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c8e8fd3-2485-42be-a420-288c01176c35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3f077700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-515753323", "description": "tempest-description-1830033066"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:06.547672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a7b31d4a-08dc-412e-ab34-88ce94ae11a7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3e7a4af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:06.650082 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c8e8fd3-2485-42be-a420-288c01176c35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.342664 Jul 20 10:59:06.650727 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1290/2544] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:59:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:06.672670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df20b5c6-94db-4679-bef8-33af0233d935 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3fa67a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-573303606", "description": "tempest-description-433408170"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:06.680946 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a7b31d4a-08dc-412e-ab34-88ce94ae11a7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1422 microversion: 2.1 time: 0.137284 Jul 20 10:59:06.684890 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1255/2545] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:06 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1422 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:06.712973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:06.713973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:06.733725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:06.744022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:06.745236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:06.745870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:07.246925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:07.271358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a23c7954-3236-4889-a8d5-e77fee2c97b4 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1504 microversion: 2.1 time: 0.583827 Jul 20 10:59:07.285385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1256/2546] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:06 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:07.285385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7a852c5-d5e5-4ebd-9345-67baf58cad4a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e7a44c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:07.379469 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df20b5c6-94db-4679-bef8-33af0233d935 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.720232 Jul 20 10:59:07.381575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1291/2547] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:59:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:07.389746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:07.394550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:07.435309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:07.437665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:07.441639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:07.442102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:07.458055 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7a852c5-d5e5-4ebd-9345-67baf58cad4a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.179501 Jul 20 10:59:07.458657 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1257/2548] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:07 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:07.472607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:07.472794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:07.482201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:07.483044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:07.484068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:07.485290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:07.537736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:07.685891 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d473ff1b-bef4-4406-b208-b8b5d84f85c4 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 204 len: 0 microversion: 2.1 time: 0.301626 Jul 20 10:59:07.688226 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1292/2549] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:07 2022] DELETE /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:07.700269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27abc0b8-073c-4f90-81c8-a051a19b43b8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3efe1ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-972900640", "description": "tempest-description-1932023323"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:07.948099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:07.964713 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c222cb27-345d-42a2-bebe-189bc68cf7a6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.496799 Jul 20 10:59:07.967981 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1258/2550] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:07 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:07.973833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:07.974895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:07.985095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:07.986149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:07.987789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:07.989404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:08.169662 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27abc0b8-073c-4f90-81c8-a051a19b43b8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.475919 Jul 20 10:59:08.170279 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1293/2551] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:59:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:08.174893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8c5d3146-5d8b-4059-9ce3-ae33523be152 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f9d54c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:08.263951 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8c5d3146-5d8b-4059-9ce3-ae33523be152 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1431 microversion: 2.1 time: 0.092619 Jul 20 10:59:08.264783 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1294/2552] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:08 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1431 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:08.269447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81a98724-48dd-430e-bef5-e28daa5b4c0e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3efe1670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:08.354654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:08.362727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6cf3069a-9e0a-469a-b735-f21958c5fe2e tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1682 microversion: 2.1 time: 0.393352 Jul 20 10:59:08.363347 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1259/2553] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:07 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1682 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:08.369462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-285803ba-d0bb-44ee-a90b-c97566dea09a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f368e50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:08.421493 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-285803ba-d0bb-44ee-a90b-c97566dea09a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 200 len: 1431 microversion: 2.1 time: 0.056893 Jul 20 10:59:08.422580 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1260/2554] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:08 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 1431 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:08.427994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:08.428802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:08.436350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:08.437188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:08.439669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:08.440285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:08.798268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd726d1eadae240ff94dd886f5dfc29b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92fa8b2489541cf949ad0d45ba46425', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:08.806958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-833f8e3c-79a4-4a9e-bd00-e43e84acb8bb tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 200 len: 1504 microversion: 2.1 time: 0.382865 Jul 20 10:59:08.807735 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1261/2555] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:08 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:08.813424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:08.814354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:08.822480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:08.823159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:08.823730 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81a98724-48dd-430e-bef5-e28daa5b4c0e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.557716 Jul 20 10:59:08.824876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:08.825747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1295/2556] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:59:08 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:08.827129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:08.831349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f296cac5-d3ce-4aa2-8f8d-dacfd0b2e9c2 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fa968b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:08.892649 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f296cac5-d3ce-4aa2-8f8d-dacfd0b2e9c2 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.065353 Jul 20 10:59:08.893238 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1296/2557] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:08 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:08.897764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce6ed555-7859-4088-ac26-96071ef0952c tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f950280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.240261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:09.251354 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eb07ad44-103d-4b7e-afb3-4700efc44a3d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1466 microversion: 2.1 time: 0.442271 Jul 20 10:59:09.252271 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1262/2558] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:08 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:09.257378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.258965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:09.268723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:09.269370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:09.270248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:09.270680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:09.522610 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce6ed555-7859-4088-ac26-96071ef0952c tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a" status: 202 len: 0 microversion: 2.1 time: 0.628320 Jul 20 10:59:09.528188 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1297/2559] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:59:08 2022] DELETE /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:09.538572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4ca26923-c7ee-4a70-9ffa-55d64c2305da req-b35a2c8d-6bc0-4e41-811b-875f8dacf4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b387629-d603-4b93-b9ba-eb99f897b9f9", "name": "network-vif-deleted", "tag": "0763e6c5-46fd-40fe-afe0-9a95acdca23b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:09.562055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:09.568120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4ca26923-c7ee-4a70-9ffa-55d64c2305da req-b35a2c8d-6bc0-4e41-811b-875f8dacf4df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:09.569056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4ca26923-c7ee-4a70-9ffa-55d64c2305da req-b35a2c8d-6bc0-4e41-811b-875f8dacf4df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:09.575205 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c541201e-24c5-4477-a5df-9ade4a567061 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.321404 Jul 20 10:59:09.576056 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1263/2560] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:09 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:09.581040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-def4055c-5d1d-438b-9013-bc5e746a2a4f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f47f1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.586722 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4ca26923-c7ee-4a70-9ffa-55d64c2305da req-b35a2c8d-6bc0-4e41-811b-875f8dacf4df service nova] Creating event network-vif-deleted:0763e6c5-46fd-40fe-afe0-9a95acdca23b for instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 on n-h1-846219-10 Jul 20 10:59:09.607350 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4ca26923-c7ee-4a70-9ffa-55d64c2305da req-b35a2c8d-6bc0-4e41-811b-875f8dacf4df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077313 Jul 20 10:59:09.608512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1298/2561] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:09.617809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.618748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:09.625880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:09.626719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:09.627791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:09.628395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:09.663704 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-def4055c-5d1d-438b-9013-bc5e746a2a4f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/478de60b-94fe-4326-bea5-987154e218b6" status: 200 len: 784 microversion: 2.1 time: 0.086154 Jul 20 10:59:09.664885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1264/2562] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:09 2022] GET /compute/v2.1/images/478de60b-94fe-4326-bea5-987154e218b6 => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:09.674980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f4d8940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.754404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:59:09.755684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:59:09.756463 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.756463 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a HTTP/1.1 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '983df0e4-6410-4fb0-9ea8-ca6b55d06f2a'} Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:59:09.760884 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] Jul 20 10:59:09.765985 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:09.772099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 10:59:09.772099 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-9b511f4f-4c0e-4966-acc0-7d2847d7e1cb'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:09.774646 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3afa03d-b40f-44bc-bb74-0b65922255cc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a" status: 404 len: 194 microversion: 2.1 time: 0.107743 Jul 20 10:59:09.776236 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1265/2563] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:59:09 2022] GET /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:09.784916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-55840982-8b76-408b-a642-859db69f752c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.802549 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-55840982-8b76-408b-a642-859db69f752c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024238 Jul 20 10:59:09.804017 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1266/2564] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:09.812635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3743acbd-3599-4f5e-b640-78cdef99d937 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f43f8b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:09.946031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9b9c7807eb74ecaa2cc6f7669bd09f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7e284f3d1941bfbc0a07318a0df461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:09.955556 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d25f04ff-e1ae-42af-96d2-3899fd2979b0 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 200 len: 1682 microversion: 2.1 time: 0.345034 Jul 20 10:59:09.956849 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1299/2565] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:09 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 1682 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:09.962522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c6a6b18-e1ab-4881-85a5-1a7ec841e882 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f077c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:10.533929 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3743acbd-3599-4f5e-b640-78cdef99d937 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5" status: 202 len: 0 microversion: 2.1 time: 0.727046 Jul 20 10:59:10.534979 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1267/2566] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:59:09 2022] DELETE /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:10.542522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:10.543270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:10.561166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:10.561621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:10.572282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:10.572877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:10.623725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:10.626951 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 HTTP/1.1 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '6b387629-d603-4b93-b9ba-eb99f897b9f9'} Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:10.633214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.637295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:10.637773 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-796b62db-7d51-4091-82ea-2d624f092cbf tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 404 len: 111 microversion: 2.1 time: 0.101315 Jul 20 10:59:10.651331 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1268/2567] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:10 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:10.659854 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7c6a6b18-e1ab-4881-85a5-1a7ec841e882 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "DELETE /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 204 len: 0 microversion: 2.1 time: 0.701282 Jul 20 10:59:10.660210 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1300/2568] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:09 2022] DELETE /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:10.668337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f761b80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:10.679156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b266fee-a342-4390-8fbd-22f9b1664e16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f211d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:10.754811 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b266fee-a342-4390-8fbd-22f9b1664e16 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.100183 Jul 20 10:59:10.755922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1269/2569] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:10 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:10.761587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:10.762300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:10.769311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:10.769765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:10.770640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:10.771315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:10.870611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:59:10.873230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group f00a5e59-c4db-400d-9038-a962cbb491f5 not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:59:10.874554 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.874554 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5 HTTP/1.1 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f00a5e59-c4db-400d-9038-a962cbb491f5'} Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:59:10.880480 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] Jul 20 10:59:10.886864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:10.894135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 10:59:10.894135 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-f94a1a18-487b-4fcb-9ad0-c3e47d82d9be'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:10.895793 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8f739ea-6e77-4482-9a77-07cf92319851 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5" status: 404 len: 194 microversion: 2.1 time: 0.231252 Jul 20 10:59:10.897097 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1301/2570] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:59:10 2022] GET /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5 => generated 194 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:10.906463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-411cbe77-e708-4f9b-9d44-f3858a37b6cd req-a7eb49af-2960-49db-bcef-a64e3bd26e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c30aa1d-4b39-48b1-985a-5dac3991b904", "name": "network-vif-deleted", "tag": "c2136b8d-d742-4eb3-a19a-3e1cb30798c2"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:10.924283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-411cbe77-e708-4f9b-9d44-f3858a37b6cd req-a7eb49af-2960-49db-bcef-a64e3bd26e6f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:10.925453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-411cbe77-e708-4f9b-9d44-f3858a37b6cd req-a7eb49af-2960-49db-bcef-a64e3bd26e6f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:10.979945 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-411cbe77-e708-4f9b-9d44-f3858a37b6cd req-a7eb49af-2960-49db-bcef-a64e3bd26e6f service nova] Creating event network-vif-deleted:c2136b8d-d742-4eb3-a19a-3e1cb30798c2 for instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 on n-h2-846219-10 Jul 20 10:59:10.990357 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-411cbe77-e708-4f9b-9d44-f3858a37b6cd req-a7eb49af-2960-49db-bcef-a64e3bd26e6f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089342 Jul 20 10:59:10.992199 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1302/2571] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:11.002324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9cc4c4e1-0c1e-4f85-9a8d-751669ffd452 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.034178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.compute.server_groups [None req-9cc4c4e1-0c1e-4f85-9a8d-751669ffd452 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Querying cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) for 1 instances {{(pid=125885) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 10:59:11.035530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9cc4c4e1-0c1e-4f85-9a8d-751669ffd452 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.036218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9cc4c4e1-0c1e-4f85-9a8d-751669ffd452 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.065648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9cc4c4e1-0c1e-4f85-9a8d-751669ffd452 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.070904 Jul 20 10:59:11.066764 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1303/2572] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 10:59:10 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:11.077105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54f248fa-264d-4cb2-b577-34812e1fae21 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f9a1d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.123607 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-54f248fa-264d-4cb2-b577-34812e1fae21 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] HTTP exception thrown: Image not found. Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54f248fa-264d-4cb2-b577-34812e1fae21 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Request method failure captured: Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa HTTP/1.1 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-1zrS0ujZWDVcmh6qS_Ue9VuxigU2htV3ED4zxeMZiNGkscXHEqYI32VQLz-ljiHHmY0t2WaqYmtiNydtcbvOoZ-wUGmGKefn8X_pwzXfAExv1H3QXnLhqPrlXuZ9aZcLU9Md65jx_Zqo78g6i9kg6p-oW5X8XiLFXmnKNjPE4KB8 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: db383d5e009141f7b1550232e98d795b Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerTestJSON-420436444 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db383d5e009141f7b1550232e98d795b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db383d5e009141f7b1550232e98d795b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db383d5e009141f7b1550232e98d795b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db383d5e009141f7b1550232e98d795b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerTestJSON-420436444 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: db383d5e009141f7b1550232e98d795b Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-420436444 Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerTestJSON-420436444-project Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 947f24c332684626a864bf58222aa8cf Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerTestJSON-420436444-project Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '814a9df5-5d76-4499-be3e-1263f5cfd0aa'} Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 814a9df5-5d76-4499-be3e-1263f5cfd0aa Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:11.129384 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 814a9df5-5d76-4499-be3e-1263f5cfd0aa could not be found. Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:11.134312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.140953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54f248fa-264d-4cb2-b577-34812e1fae21 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:11.142555 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-54f248fa-264d-4cb2-b577-34812e1fae21 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 404 len: 62 microversion: 2.1 time: 0.073877 Jul 20 10:59:11.143349 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1304/2573] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:11.175997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b13514ab-91d9-4dc3-b273-64ced4743b4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3efef040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.227979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:11.251432 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4994727-8f3b-4a0f-9469-8694a37e8cb4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.494200 Jul 20 10:59:11.252327 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1270/2574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:10 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:11.257337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.261555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] [instance: 8c30aa1d-4b39-48b1-985a-5dac3991b904] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:11.272061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.274480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.276301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.276978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.303268 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] HTTP exception thrown: Instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 could not be found. Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Request method failure captured: Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 HTTP/1.1 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi199BzDNkigTS7AiwwQPxhuHgMBlLy87i4k5PXlW2c99rO9o3QI5FMRk1_iCyOLDaIs3PibI0e6EFxnX93W85YYtExULBLs1nwBvsXVlJcKNNew5zXWcNF5i4RBATBAAOw_ymga1k7nVJOKdBrkxy9rKwprVhrETa6Lnz830D3u1uuJ8 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 2e7e284f3d1941bfbc0a07318a0df461 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesAdminNegativeTest-2066348757 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2e7e284f3d1941bfbc0a07318a0df461", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e7e284f3d1941bfbc0a07318a0df461"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2e7e284f3d1941bfbc0a07318a0df461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2e7e284f3d1941bfbc0a07318a0df461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesAdminNegativeTest-2066348757 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 2e7e284f3d1941bfbc0a07318a0df461 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2066348757 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesAdminNegativeTest-2066348757-project Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c9b9c7807eb74ecaa2cc6f7669bd09f0 Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesAdminNegativeTest-2066348757-project Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 could not be found. Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '8c30aa1d-4b39-48b1-985a-5dac3991b904'} Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 could not be found. Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 could not be found. Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.307329 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 could not be found. Jul 20 10:59:11.313758 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.315845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Returning 404 to user: Instance 8c30aa1d-4b39-48b1-985a-5dac3991b904 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:11.316993 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9ed54c5-0bfc-4d84-82b6-eee54b91293b tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904" status: 404 len: 111 microversion: 2.1 time: 0.063572 Jul 20 10:59:11.318153 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1271/2575] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/servers/8c30aa1d-4b39-48b1-985a-5dac3991b904 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:11.323891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0affdea4-5d90-41f0-9f3b-8eb46786de6f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.350870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.server_groups [None req-0affdea4-5d90-41f0-9f3b-8eb46786de6f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Querying cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) for 1 instances {{(pid=125886) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 20 10:59:11.355608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0affdea4-5d90-41f0-9f3b-8eb46786de6f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.356570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0affdea4-5d90-41f0-9f3b-8eb46786de6f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.379713 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0affdea4-5d90-41f0-9f3b-8eb46786de6f tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/c7356f98-8317-4f11-aa6b-83e7b85449f9" status: 200 len: 183 microversion: 2.1 time: 0.059854 Jul 20 10:59:11.381098 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1272/2576] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/os-server-groups/c7356f98-8317-4f11-aa6b-83e7b85449f9 => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:11.393000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2023191535"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:11.397222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:11.410423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.411159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.412549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.413584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.568821 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b13514ab-91d9-4dc3-b273-64ced4743b4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a" status: 202 len: 0 microversion: 2.1 time: 0.420894 Jul 20 10:59:11.573345 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1305/2577] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:59:11 2022] DELETE /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:11.577370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a75032ee-689f-4c05-967c-cb34b020a750 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] Calling method '.version_select at 0x7f2c3efef820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.622547 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a75032ee-689f-4c05-967c-cb34b020a750 tempest-VolumesAdminNegativeTest-2066348757 tempest-VolumesAdminNegativeTest-2066348757-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679315870" status: 202 len: 0 microversion: 2.1 time: 0.046902 Jul 20 10:59:11.624036 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1306/2578] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 10:59:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679315870 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:11.645492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.647811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:11.664640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.667005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.669639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.670921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.706036 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 HTTP/1.1 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6b387629-d603-4b93-b9ba-eb99f897b9f9'} Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:59:11.707864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.712327 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.714521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:11.715660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27c75e00-f1f3-49f8-8193-72af0fe0b980 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 404 len: 111 microversion: 2.1 time: 0.090432 Jul 20 10:59:11.716753 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1307/2579] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:11 2022] DELETE /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:11.722115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f7968b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.767889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:59:11.768833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 10:59:11.769529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.769529 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a HTTP/1.1 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a'} Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:59:11.771720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] Jul 20 10:59:11.775328 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.779632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 10:59:11.779632 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-aa396f89-6838-41fe-a9f4-c5869a5b5a18'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:11.780852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e435d82f-10ed-451c-b496-6ab028ccfbbf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a" status: 404 len: 194 microversion: 2.1 time: 0.062879 Jul 20 10:59:11.784813 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1308/2580] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:11.790994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.792055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] [instance: 6b387629-d603-4b93-b9ba-eb99f897b9f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:11.795364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:11.810128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.810952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.814799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:11.815745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:11.839623 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 HTTP/1.1 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6b387629-d603-4b93-b9ba-eb99f897b9f9'} Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.841761 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. Jul 20 10:59:11.845450 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.847434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance 6b387629-d603-4b93-b9ba-eb99f897b9f9 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:11.848591 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5676ed03-190d-4172-8192-3d027a5372ca tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9" status: 404 len: 111 microversion: 2.1 time: 0.062411 Jul 20 10:59:11.849703 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1309/2581] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/servers/6b387629-d603-4b93-b9ba-eb99f897b9f9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:11.856553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4b7fee57-40ca-498d-91bf-82aafebc5ed5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fa968b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.892417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86994667-0434-426d-bd01-cbc9faa37dd2 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "POST /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5/action" status: 202 len: 0 microversion: 2.1 time: 0.509628 Jul 20 10:59:11.893890 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1273/2582] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:11 2022] POST /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 10:59:11.900654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c78a5415-afbc-493c-871a-6b835c348701 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3edc0790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.928678 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4b7fee57-40ca-498d-91bf-82aafebc5ed5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.077388 Jul 20 10:59:11.930160 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1310/2583] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:11.935348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8c4a66e-c874-40ae-aac3-4227db97c181 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:11.942846 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e8c4a66e-c874-40ae-aac3-4227db97c181 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance group 76e2b49b-a94a-486e-baa4-afc46f3e39fa could not be found. Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8c4a66e-c874-40ae-aac3-4227db97c181 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-server-groups/76e2b49b-a94a-486e-baa4-afc46f3e39fa HTTP/1.1 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance group 76e2b49b-a94a-486e-baa4-afc46f3e39fa could not be found. Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '76e2b49b-a94a-486e-baa4-afc46f3e39fa'} Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 76e2b49b-a94a-486e-baa4-afc46f3e39fa could not be found. Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 76e2b49b-a94a-486e-baa4-afc46f3e39fa could not be found. Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.945349 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:11.949753 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:11.949753 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:11.949753 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:11.949753 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:11.949753 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 76e2b49b-a94a-486e-baa4-afc46f3e39fa could not be found. Jul 20 10:59:11.949753 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:11.951780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8c4a66e-c874-40ae-aac3-4227db97c181 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance group 76e2b49b-a94a-486e-baa4-afc46f3e39fa could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:11.952864 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8c4a66e-c874-40ae-aac3-4227db97c181 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/76e2b49b-a94a-486e-baa4-afc46f3e39fa" status: 404 len: 117 microversion: 2.1 time: 0.021293 Jul 20 10:59:11.953955 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1311/2584] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:59:11 2022] DELETE /compute/v2.1/os-server-groups/76e2b49b-a94a-486e-baa4-afc46f3e39fa => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:11.959138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-86a0141c-b0a0-4b42-96a4-df238b6c9410 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3efef9d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:12.063346 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-86a0141c-b0a0-4b42-96a4-df238b6c9410 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.107254 Jul 20 10:59:12.065139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1312/2585] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:12.070809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd2fae66-31dc-41b9-bd3e-0ed8ba9b9c64 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:12.080599 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-cd2fae66-31dc-41b9-bd3e-0ed8ba9b9c64 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance group 5ab6706d-efa5-426d-8d45-2fad87ae604b could not be found. Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd2fae66-31dc-41b9-bd3e-0ed8ba9b9c64 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-server-groups/5ab6706d-efa5-426d-8d45-2fad87ae604b HTTP/1.1 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance group 5ab6706d-efa5-426d-8d45-2fad87ae604b could not be found. Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5ab6706d-efa5-426d-8d45-2fad87ae604b'} Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5ab6706d-efa5-426d-8d45-2fad87ae604b could not be found. Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5ab6706d-efa5-426d-8d45-2fad87ae604b could not be found. Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.082597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.088720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:12.088720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:12.088720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:12.088720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:12.088720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5ab6706d-efa5-426d-8d45-2fad87ae604b could not be found. Jul 20 10:59:12.088720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.090727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd2fae66-31dc-41b9-bd3e-0ed8ba9b9c64 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance group 5ab6706d-efa5-426d-8d45-2fad87ae604b could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:12.091646 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cd2fae66-31dc-41b9-bd3e-0ed8ba9b9c64 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/5ab6706d-efa5-426d-8d45-2fad87ae604b" status: 404 len: 117 microversion: 2.1 time: 0.025224 Jul 20 10:59:12.095276 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1313/2586] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:59:12 2022] DELETE /compute/v2.1/os-server-groups/5ab6706d-efa5-426d-8d45-2fad87ae604b => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:12.102055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f50e3962-8085-4b0a-8506-f1820e60047b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:12.109292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f50e3962-8085-4b0a-8506-f1820e60047b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance group f67441d5-87a3-4695-951e-be4d1977f0a9 could not be found. Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f50e3962-8085-4b0a-8506-f1820e60047b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-server-groups/f67441d5-87a3-4695-951e-be4d1977f0a9 HTTP/1.1 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance group f67441d5-87a3-4695-951e-be4d1977f0a9 could not be found. Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f67441d5-87a3-4695-951e-be4d1977f0a9'} Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f67441d5-87a3-4695-951e-be4d1977f0a9 could not be found. Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f67441d5-87a3-4695-951e-be4d1977f0a9 could not be found. Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.111562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f67441d5-87a3-4695-951e-be4d1977f0a9 could not be found. Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f50e3962-8085-4b0a-8506-f1820e60047b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance group f67441d5-87a3-4695-951e-be4d1977f0a9 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:12.115978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f50e3962-8085-4b0a-8506-f1820e60047b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/f67441d5-87a3-4695-951e-be4d1977f0a9" status: 404 len: 117 microversion: 2.1 time: 0.016511 Jul 20 10:59:12.118925 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1314/2587] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:59:12 2022] DELETE /compute/v2.1/os-server-groups/f67441d5-87a3-4695-951e-be4d1977f0a9 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:12.125415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88bef933-e419-4e51-a3e9-e7cdaf9f2939 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:12.136821 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-88bef933-e419-4e51-a3e9-e7cdaf9f2939 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] HTTP exception thrown: Instance group 3acb38e8-aa09-49e2-8b2b-1e4b8b455857 could not be found. Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88bef933-e419-4e51-a3e9-e7cdaf9f2939 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Request method failure captured: Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-server-groups/3acb38e8-aa09-49e2-8b2b-1e4b8b455857 HTTP/1.1 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_SVBpW5sHeyuF3mteY3WKSRzoLyro-sNGMUijhW85oxK-PuwtMQbW1t10OdcNxNM7YeCdHrn2y3ZRdkm4Ocyh78L2oss0rlzo5nb834Z001-FQq5Pzipt9LTbuHByTNDvVkctJ0Issz9zC_KEPKBXd3hMM1NSp1XOvumgDCrhQzlY Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e92fa8b2489541cf949ad0d45ba46425", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e92fa8b2489541cf949ad0d45ba46425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e92fa8b2489541cf949ad0d45ba46425 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerGroupTestJSON-1756090670 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: d726d1eadae240ff94dd886f5dfc29b0 Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerGroupTestJSON-1756090670-project Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance group 3acb38e8-aa09-49e2-8b2b-1e4b8b455857 could not be found. Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3acb38e8-aa09-49e2-8b2b-1e4b8b455857'} Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3acb38e8-aa09-49e2-8b2b-1e4b8b455857 could not be found. Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3acb38e8-aa09-49e2-8b2b-1e4b8b455857 could not be found. Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.139114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:12.142871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:12.142871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:12.142871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:12.142871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:12.142871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3acb38e8-aa09-49e2-8b2b-1e4b8b455857 could not be found. Jul 20 10:59:12.142871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:12.146333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88bef933-e419-4e51-a3e9-e7cdaf9f2939 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Returning 404 to user: Instance group 3acb38e8-aa09-49e2-8b2b-1e4b8b455857 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:12.147466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-88bef933-e419-4e51-a3e9-e7cdaf9f2939 tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/3acb38e8-aa09-49e2-8b2b-1e4b8b455857" status: 404 len: 117 microversion: 2.1 time: 0.027183 Jul 20 10:59:12.148869 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1315/2588] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:59:12 2022] DELETE /compute/v2.1/os-server-groups/3acb38e8-aa09-49e2-8b2b-1e4b8b455857 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:12.157642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-cd984e06-e90b-4a2d-a20c-d865e4c3187e req-5f41aaeb-1a2a-4b24-8bf8-4754877ab86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6", "name": "network-vif-plugged", "status": "completed", "tag": "9b20f129-faf3-47cf-ab0f-a45a462c9ecb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:12.168972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-cd984e06-e90b-4a2d-a20c-d865e4c3187e req-5f41aaeb-1a2a-4b24-8bf8-4754877ab86e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:12.169629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-cd984e06-e90b-4a2d-a20c-d865e4c3187e req-5f41aaeb-1a2a-4b24-8bf8-4754877ab86e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:12.182926 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-cd984e06-e90b-4a2d-a20c-d865e4c3187e req-5f41aaeb-1a2a-4b24-8bf8-4754877ab86e service nova] Creating event network-vif-plugged:9b20f129-faf3-47cf-ab0f-a45a462c9ecb for instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 on n-h1-846219-10 Jul 20 10:59:12.189349 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-cd984e06-e90b-4a2d-a20c-d865e4c3187e req-5f41aaeb-1a2a-4b24-8bf8-4754877ab86e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 Jul 20 10:59:12.193505 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1316/2589] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:12.203751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a60de7b7-6386-430c-b6e0-f0504738041b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:12.254845 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a60de7b7-6386-430c-b6e0-f0504738041b tempest-ServerGroupTestJSON-1756090670 tempest-ServerGroupTestJSON-1756090670-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/c7356f98-8317-4f11-aa6b-83e7b85449f9" status: 204 len: 0 microversion: 2.1 time: 0.059343 Jul 20 10:59:12.260080 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1317/2590] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 10:59:12 2022] DELETE /compute/v2.1/os-server-groups/c7356f98-8317-4f11-aa6b-83e7b85449f9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:12.271129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:12.273816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:12.296999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:12.298068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:12.300495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:12.302146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:12.652569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:12.663070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94edef9b-b50b-40f9-a4c7-0447ecf969e0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.396756 Jul 20 10:59:12.665575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1318/2591] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:12 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:12.817713 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c78a5415-afbc-493c-871a-6b835c348701 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.922153 Jul 20 10:59:12.818340 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1274/2592] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 10:59:11 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:12.839434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92c882b1-ce5b-4874-b061-23462a5e13d4 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3f9a1ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1192072805", "description": "tempest-description-1791857777"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:12.945809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b877aba-a780-402e-8aa6-822149065271 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e754ca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:13.052817 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b877aba-a780-402e-8aa6-822149065271 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.112345 Jul 20 10:59:13.053726 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1275/2593] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:12 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:13.098667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-415f1f04-019c-4383-8d13-af36331c6792 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f21aaf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:13.204958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-415f1f04-019c-4383-8d13-af36331c6792 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.130356 Jul 20 10:59:13.205799 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1276/2594] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:13 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:13.272547 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92c882b1-ce5b-4874-b061-23462a5e13d4 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.442478 Jul 20 10:59:13.286150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ebbed818-5569-4330-8d3e-57f8a0207033 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3e7a8a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-416190084", "description": "tempest-description-577783129"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:13.287275 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1319/2595] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:59:12 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:13.683270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:13.683943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:13.697995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:13.699063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:13.700094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:13.700741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:13.701365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ebbed818-5569-4330-8d3e-57f8a0207033 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.420475 Jul 20 10:59:13.702240 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1277/2596] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 10:59:13 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:13.923319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1139960698", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aba33688-72b8-49d8-9eb6-15b34a514bbc"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:14.006831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] validate_networks() for [('aba33688-72b8-49d8-9eb6-15b34a514bbc', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:59:14.331437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:14.341293 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba742b77-7597-48ac-bf19-1dfa7004b7a2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1292 microversion: 2.1 time: 0.663143 Jul 20 10:59:14.342137 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1320/2597] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:13 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1292 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:14.347214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90906f62-79dc-4455-9c47-9ea17df31433 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3fa67310>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:14.413141 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90906f62-79dc-4455-9c47-9ea17df31433 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.069437 Jul 20 10:59:14.416037 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1321/2598] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:14 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:14.428100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ed884c31-bbd0-4f7c-89b0-cd29b1523b19 req-151121cf-0cd8-45b0-adb7-b87aa1b80b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2bd780-295a-4354-aafd-e973390e5dd2", "name": "network-vif-plugged", "status": "completed", "tag": "ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4"}, {"server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "name": "network-vif-unplugged", "status": "completed", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:14.453818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ed884c31-bbd0-4f7c-89b0-cd29b1523b19 req-151121cf-0cd8-45b0-adb7-b87aa1b80b21 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:14.456320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ed884c31-bbd0-4f7c-89b0-cd29b1523b19 req-151121cf-0cd8-45b0-adb7-b87aa1b80b21 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:14.476831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ed884c31-bbd0-4f7c-89b0-cd29b1523b19 req-151121cf-0cd8-45b0-adb7-b87aa1b80b21 service nova] Creating event network-vif-plugged:ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4 for instance ac2bd780-295a-4354-aafd-e973390e5dd2 on n-h1-846219-10 Jul 20 10:59:14.477662 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ed884c31-bbd0-4f7c-89b0-cd29b1523b19 req-151121cf-0cd8-45b0-adb7-b87aa1b80b21 service nova] Creating event network-vif-unplugged:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:59:14.486716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ed884c31-bbd0-4f7c-89b0-cd29b1523b19 req-151121cf-0cd8-45b0-adb7-b87aa1b80b21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.068387 Jul 20 10:59:14.488643 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1322/2599] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:14.501086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-855a5163-3892-449d-a745-002b6507ae8e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c50d69ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:14.553024 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-855a5163-3892-449d-a745-002b6507ae8e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.062697 Jul 20 10:59:14.553605 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1323/2600] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:14 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:15.309512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:15.310635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:15.311402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:15.312200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:15.312827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:15.327783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:15.328950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:15.330032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:15.330702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:15.355422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Getting quotas for project 4c0e229c89d74c95bdca8735c4c660c3. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:15.359752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:15.360511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:15.364456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Getting quotas for user 2da03854a50f4c55b53f6aabef37678c and project 4c0e229c89d74c95bdca8735c4c660c3. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:15.372277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:15.372740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:15.377630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:15.383625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:15.386703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:15.388772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:15.390604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:15.428563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:15.452350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf4ed5fe-7781-48a8-936b-578411936f05 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532837 Jul 20 10:59:15.453431 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1278/2601] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 10:59:15.458889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91b19254-35b5-4eb3-b6fb-95d27a9d8c6c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e7a8e50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:15.550086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-91b19254-35b5-4eb3-b6fb-95d27a9d8c6c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.090309 Jul 20 10:59:15.550842 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1279/2602] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:15 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:15.569585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-384348bc-e2aa-49d4-b40f-a30810b89168 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:15.571752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-384348bc-e2aa-49d4-b40f-a30810b89168 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:15.706630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-384348bc-e2aa-49d4-b40f-a30810b89168 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:15.718835 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-384348bc-e2aa-49d4-b40f-a30810b89168 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1216 microversion: 2.1 time: 0.166871 Jul 20 10:59:15.728441 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1280/2603] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:15 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:15.728441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-790a9dc6-1d75-41d9-b833-2e0b21a2cef7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3edc0d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:15.812506 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-790a9dc6-1d75-41d9-b833-2e0b21a2cef7 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.090070 Jul 20 10:59:15.813220 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1281/2604] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:15 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:15.963580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:15.977785 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67095e2e-01e0-455c-ba4b-c643e5fcb2f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1472 microversion: 2.1 time: 0.622772 Jul 20 10:59:15.979090 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1324/2605] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:15 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1472 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:16.134562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1035268807", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:16.209812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:59:16.574057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-211b300c-5ee6-4cf5-9b33-91328570652b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f077af0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:16.652977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-211b300c-5ee6-4cf5-9b33-91328570652b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.092620 Jul 20 10:59:16.660250 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1325/2606] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:16 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:16.736741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:16.737341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:16.750116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:16.750442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:16.751695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:16.752150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:16.958304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:16.972097 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a6f23a0f-48b5-4370-9575-63443d4ffec6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1276 microversion: 2.1 time: 0.239890 Jul 20 10:59:16.973262 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1326/2607] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:16 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:16.987687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ddc0fcb2-25dc-452d-8182-bdb6291da1ea tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f9644c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:17.079448 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ddc0fcb2-25dc-452d-8182-bdb6291da1ea tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.099867 Jul 20 10:59:17.080171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1327/2608] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:16 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:17.666983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4c87da1-7042-4a60-9e89-ab12a0d78715 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3efeff70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:17.729340 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f4c87da1-7042-4a60-9e89-ab12a0d78715 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.067220 Jul 20 10:59:17.729933 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1328/2609] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:17 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:17.990341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:17.991402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:18.021039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:18.027346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:18.029811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:18.030605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:18.510899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:18.514442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:18.522438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:18.523553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:18.524508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:18.643622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:18.644416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:18.657206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:18.666387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:18.766708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:18.784266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:18.818706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:18.822043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:19.036909 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-929c54f5-6190-4e5e-8be3-7a76b2ffdc9c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.908665 Jul 20 10:59:19.038108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1282/2610] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:59:19.055598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77c7a34a-a007-4e7e-bbf6-d753b6ec843e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3e7ba1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:19.203485 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77c7a34a-a007-4e7e-bbf6-d753b6ec843e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.163325 Jul 20 10:59:19.213336 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1283/2611] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:19 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:19.237461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c956e00d-2d58-449a-aae5-83c685ef3cb9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e74b040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:19.376627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c956e00d-2d58-449a-aae5-83c685ef3cb9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.162127 Jul 20 10:59:19.377417 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1284/2612] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:19 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:19.399214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7e4be0a-b5fb-4e17-9bb6-e47d32db5b6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:19.416241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c7e4be0a-b5fb-4e17-9bb6-e47d32db5b6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:19.513501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:19.518175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c7e4be0a-b5fb-4e17-9bb6-e47d32db5b6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:19.527699 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6cfcb9ae-8c0a-4f23-a393-647f47bc3546 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1316 microversion: 2.1 time: 1.538355 Jul 20 10:59:19.528511 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1329/2613] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:17 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1316 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:19.987672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-525293e9-8d57-4e33-a5ec-6b497e5342ad req-eed19324-ef6b-405e-8133-289cc0d9b1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "name": "network-vif-plugged", "status": "completed", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:20.019457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-525293e9-8d57-4e33-a5ec-6b497e5342ad req-eed19324-ef6b-405e-8133-289cc0d9b1d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:20.021946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-525293e9-8d57-4e33-a5ec-6b497e5342ad req-eed19324-ef6b-405e-8133-289cc0d9b1d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:20.058905 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-525293e9-8d57-4e33-a5ec-6b497e5342ad req-eed19324-ef6b-405e-8133-289cc0d9b1d2 service nova] Creating event network-vif-plugged:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:59:20.068188 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-525293e9-8d57-4e33-a5ec-6b497e5342ad req-eed19324-ef6b-405e-8133-289cc0d9b1d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094923 Jul 20 10:59:20.069424 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1330/2614] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:59:20.225113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91e7967a-a523-4122-888f-a06347cb3d0e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3fa968b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:20.389862 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-91e7967a-a523-4122-888f-a06347cb3d0e tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.172551 Jul 20 10:59:20.391642 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1331/2615] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:20 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:20.409909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e31c535-2003-4ba4-9be0-be9e005522e1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f950940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:20.515154 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e31c535-2003-4ba4-9be0-be9e005522e1 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.120691 Jul 20 10:59:20.522277 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1332/2616] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:20 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:20.547533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:20.548292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:20.571576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:20.572602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:20.576986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:20.578051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:20.664010 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.api [None req-c7e4be0a-b5fb-4e17-9bb6-e47d32db5b6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] Instance Mapping does not exist while attempting local delete cleanup. Jul 20 10:59:20.665401 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7e4be0a-b5fb-4e17-9bb6-e47d32db5b6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828" status: 204 len: 0 microversion: 2.1 time: 1.286955 Jul 20 10:59:20.668762 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1285/2617] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:19 2022] DELETE /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 => generated 0 bytes in 1291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:20.679185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1a58e8a-45fd-4c8f-bd7c-24822881c109 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:20.698121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1a58e8a-45fd-4c8f-bd7c-24822881c109 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:20.726880 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-b1a58e8a-45fd-4c8f-bd7c-24822881c109 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1a58e8a-45fd-4c8f-bd7c-24822881c109 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 HTTP/1.1 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '194a3a07-136c-4c88-a902-40ddafedf828'} Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:20.728472 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:20.732978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:20.732978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:20.732978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 10:59:20.732978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:20.732978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1a58e8a-45fd-4c8f-bd7c-24822881c109 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:20.732978 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1a58e8a-45fd-4c8f-bd7c-24822881c109 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828" status: 404 len: 111 microversion: 2.1 time: 0.054959 Jul 20 10:59:20.744887 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1286/2618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:20 2022] GET /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:20.860438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-704520705", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:20.949269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:59:21.607607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:21.628003 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f959735b-50df-4fec-a88a-9a05f0307d42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1316 microversion: 2.1 time: 1.084791 Jul 20 10:59:21.630137 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1333/2619] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:20 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1316 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:21.636816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3995198a-894d-4133-a2b3-43fd1704d9f6 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f9d5f70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:21.692851 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3995198a-894d-4133-a2b3-43fd1704d9f6 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.061079 Jul 20 10:59:21.701435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1334/2620] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:21 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:21.708469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df6cc9ee-03bf-4011-a661-788f84046015 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f950670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:21.808739 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df6cc9ee-03bf-4011-a661-788f84046015 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.105247 Jul 20 10:59:21.810261 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1335/2621] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:21 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:22.056611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:22.057067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:22.057504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:22.058204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:22.059123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:22.078164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:22.079861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:22.082805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:22.083572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:22.162421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:22.176210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:22.203817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:22.206386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:22.380878 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-598060a6-d329-4a34-87ee-5f6304c234ec tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529686 Jul 20 10:59:22.412329 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1287/2622] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:59:22.413805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f5d37693-c685-41a1-8d7c-8143704f554c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:22.419681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f5d37693-c685-41a1-8d7c-8143704f554c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:22.660109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:22.661586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:22.697454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:22.697962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:22.698814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:22.701183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:23.595478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5d37693-c685-41a1-8d7c-8143704f554c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:23.626445 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f5d37693-c685-41a1-8d7c-8143704f554c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1220 microversion: 2.1 time: 1.232327 Jul 20 10:59:23.630975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1336/2623] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:22 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1220 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:23.652721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-254dd1a0-f0a7-4f4f-a3cc-5fbe44400d5c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3faa31f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:23.810706 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-254dd1a0-f0a7-4f4f-a3cc-5fbe44400d5c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.177777 Jul 20 10:59:23.811634 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1337/2624] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:23 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:23.823446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-acca4361-b5fc-4aa7-a7c1-adee26b2e7c3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f84df70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:23.966061 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-acca4361-b5fc-4aa7-a7c1-adee26b2e7c3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.146319 Jul 20 10:59:23.967786 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1338/2625] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:23 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:24.051751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:24.072011 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e85cb58f-eebd-4fd8-9075-5e9c89c689f9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1316 microversion: 2.1 time: 1.424819 Jul 20 10:59:24.082381 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1288/2626] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:22 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1316 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:24.650319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:24.651646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:24.676340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:24.677390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:24.682098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:24.682914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:24.825765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60e51235-2070-4f5c-a983-f1343fd43732 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3e74b3a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:24.950048 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60e51235-2070-4f5c-a983-f1343fd43732 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.118593 Jul 20 10:59:24.951071 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1289/2627] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:24 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:24.983095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fc2ae7d9-b923-4205-9a73-f67388aa8125 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e754a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:25.061129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:25.097499 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8725afe2-1609-4f51-9365-1cec6d54df64 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1290 microversion: 2.1 time: 0.429068 Jul 20 10:59:25.097796 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fc2ae7d9-b923-4205-9a73-f67388aa8125 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1440 microversion: 2.1 time: 0.105314 Jul 20 10:59:25.097796 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1290/2628] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:24 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:25.104276 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1339/2629] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:24 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1290 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:25.138146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:25.139636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:25.153981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:25.159452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:25.160666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:25.165972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:25.254339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ce30ce38-98a3-440a-9678-0fdd5c7668b2 req-928b3bad-8b8d-4f12-b894-2588ae47bb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7020321d-3803-48d0-80f8-43b809906d2a", "tag": "3a93135f-5d18-4226-a747-44a4901e36e5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:25.301449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ce30ce38-98a3-440a-9678-0fdd5c7668b2 req-928b3bad-8b8d-4f12-b894-2588ae47bb39 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:25.301935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ce30ce38-98a3-440a-9678-0fdd5c7668b2 req-928b3bad-8b8d-4f12-b894-2588ae47bb39 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:25.359419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ce30ce38-98a3-440a-9678-0fdd5c7668b2 req-928b3bad-8b8d-4f12-b894-2588ae47bb39 service nova] Creating event network-changed:3a93135f-5d18-4226-a747-44a4901e36e5 for instance 7020321d-3803-48d0-80f8-43b809906d2a on n-h2-846219-10 Jul 20 10:59:25.380992 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ce30ce38-98a3-440a-9678-0fdd5c7668b2 req-928b3bad-8b8d-4f12-b894-2588ae47bb39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134141 Jul 20 10:59:25.386858 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1340/2630] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:25.931974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:25.940965 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bd634498-f1d7-4e9a-96e3-a619e6fa8a18 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1316 microversion: 2.1 time: 0.844863 Jul 20 10:59:25.951521 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1291/2631] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:25 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1316 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:25.981054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89c20c67-8de3-4530-bd23-d6696314338f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f127dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:26.102831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ce86e24-120a-4e96-b27b-e570f893a934 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e754dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:32.120332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:32.197101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=22 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:33.610539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:35.144587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:35.273858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:35.325921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=32 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:35.937451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:39.153297 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89c20c67-8de3-4530-bd23-d6696314338f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 13.176929 Jul 20 10:59:39.160739 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1341/2632] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:25 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 13182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:39.178645 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ce86e24-120a-4e96-b27b-e570f893a934 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1449 microversion: 2.1 time: 13.080613 Jul 20 10:59:39.181626 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1292/2633] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:26 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1449 bytes in 13084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:39.216181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:39.217728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:39.267296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:39.273610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:39.284238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:39.289662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:39.651210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-376675114", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": "none"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:39.745951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:39.782325 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5a26b22e-1632-40ba-a6e0-c6e04dec04fc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1320 microversion: 2.1 time: 0.617916 Jul 20 10:59:39.786071 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1342/2634] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:39 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:39.815096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:39.815867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:39.816491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:39.816997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:39.820091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:39.824926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:39.830901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:39.850082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:39.852703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:39.853716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:39.854276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:39.876416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:39.886015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:39.888990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:39.890310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:39.978954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Getting quotas for project d77017ded15e4f81a415119025e888ce. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:40.002600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Getting quotas for user e537f090671f40d89b45310eb30a11cf and project d77017ded15e4f81a415119025e888ce. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:40.058895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:40.061258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:40.262042 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-39c4ff36-5f30-4e22-8a0d-5e3d179561a6 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.078897 Jul 20 10:59:40.273309 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1293/2635] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:59:40.284831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-99b32bc0-14dc-4269-b4ad-c43135f43238 req-3c339143-aff5-4077-825c-eed94dc00df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66debb22-763c-40cc-9f4a-baaaf24e176a", "tag": "e27a35ac-0767-43b7-bb81-f161cd4389aa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:40.312410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:40.325556 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a79f7c0e-6c19-4ea4-878b-8e0477a8ac42 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1316 microversion: 2.1 time: 0.534644 Jul 20 10:59:40.327755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-99b32bc0-14dc-4269-b4ad-c43135f43238 req-3c339143-aff5-4077-825c-eed94dc00df8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:40.328407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-99b32bc0-14dc-4269-b4ad-c43135f43238 req-3c339143-aff5-4077-825c-eed94dc00df8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:40.339773 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1343/2636] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:39 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:40.349010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c8c06fc8-a866-410c-a961-a35e5b1b0593 req-f8e574be-32e4-4d76-8f13-c781f984cf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7020321d-3803-48d0-80f8-43b809906d2a", "name": "network-vif-plugged", "status": "completed", "tag": "3a93135f-5d18-4226-a747-44a4901e36e5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:40.356737 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-99b32bc0-14dc-4269-b4ad-c43135f43238 req-3c339143-aff5-4077-825c-eed94dc00df8 service nova] Creating event network-changed:e27a35ac-0767-43b7-bb81-f161cd4389aa for instance 66debb22-763c-40cc-9f4a-baaaf24e176a on n-h2-846219-10 Jul 20 10:59:40.364095 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-99b32bc0-14dc-4269-b4ad-c43135f43238 req-3c339143-aff5-4077-825c-eed94dc00df8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084309 Jul 20 10:59:40.370463 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1294/2637] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:40.376862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-808452c6-1673-48b2-85fa-c648fd350db2 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e7ba940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:40.379511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c8c06fc8-a866-410c-a961-a35e5b1b0593 req-f8e574be-32e4-4d76-8f13-c781f984cf2b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:40.380014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c8c06fc8-a866-410c-a961-a35e5b1b0593 req-f8e574be-32e4-4d76-8f13-c781f984cf2b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:40.403646 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c8c06fc8-a866-410c-a961-a35e5b1b0593 req-f8e574be-32e4-4d76-8f13-c781f984cf2b service nova] Creating event network-vif-plugged:3a93135f-5d18-4226-a747-44a4901e36e5 for instance 7020321d-3803-48d0-80f8-43b809906d2a on n-h2-846219-10 Jul 20 10:59:40.409495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c8c06fc8-a866-410c-a961-a35e5b1b0593 req-f8e574be-32e4-4d76-8f13-c781f984cf2b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068280 Jul 20 10:59:40.410154 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1344/2638] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:40.440911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8bbea04c-f3d3-4cb4-8356-e3823ac4520d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3faa39d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:40.442086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-808452c6-1673-48b2-85fa-c648fd350db2 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 200 len: 1449 microversion: 2.1 time: 0.069978 Jul 20 10:59:40.447974 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1295/2639] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:40 2022] GET /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 1449 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:40.478186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-632313e6-3a85-4628-a02e-e35e8aec15a0 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:40.490165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-632313e6-3a85-4628-a02e-e35e8aec15a0 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:40.592784 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8bbea04c-f3d3-4cb4-8356-e3823ac4520d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.169681 Jul 20 10:59:40.599675 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1345/2640] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:40 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:40.605671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90621857-5782-4175-b6c4-9b3cb92d54a6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f11c5e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:40.725469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-632313e6-3a85-4628-a02e-e35e8aec15a0 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:40.741749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-632313e6-3a85-4628-a02e-e35e8aec15a0 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:40.749169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-632313e6-3a85-4628-a02e-e35e8aec15a0 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:40.756185 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-632313e6-3a85-4628-a02e-e35e8aec15a0 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 200 len: 1277 microversion: 2.47 time: 0.302149 Jul 20 10:59:40.759732 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1296/2641] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:40 2022] GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:40.806093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:40.807979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:40.842598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:40.876315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:40.878984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:40.880937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:41.369697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:41.392226 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-782b5b46-c83e-4e0d-ad07-cb5833a47852 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1320 microversion: 2.1 time: 0.590488 Jul 20 10:59:41.393018 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1297/2642] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:40 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1320 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:41.401489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-997703090", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": "none"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:41.803393 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90621857-5782-4175-b6c4-9b3cb92d54a6 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 204 len: 0 microversion: 2.1 time: 1.201385 Jul 20 10:59:41.805082 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1346/2643] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:40 2022] DELETE /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 0 bytes in 1205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:41.825859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:41.829177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:41.878165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:41.878629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:41.888294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:41.888841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:42.018930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:42.019411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:42.019961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:42.020930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:42.021511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:42.047483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:42.048880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:42.050906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:42.055925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:42.111359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Getting quotas for project d77017ded15e4f81a415119025e888ce. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:42.129528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Getting quotas for user e537f090671f40d89b45310eb30a11cf and project d77017ded15e4f81a415119025e888ce. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:42.181045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:42.184029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:42.310525 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-803b1987-f67c-4877-92cd-b10009473df5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.909271 Jul 20 10:59:42.316473 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1298/2644] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 10:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 10:59:42.333697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-284fec93-4b0a-4536-bd55-098606a5d61c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3e7a4b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:42.504930 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-284fec93-4b0a-4536-bd55-098606a5d61c tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.186404 Jul 20 10:59:42.517779 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1299/2645] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:42 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:42.549973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:42.557200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:42.592498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:42.596833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:42.599676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:42.600850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:42.890438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:42.929939 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c09dbad8-ac9d-4f66-9217-7653071760ae tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1316 microversion: 2.1 time: 1.120030 Jul 20 10:59:42.939095 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1347/2646] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:41 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1316 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:42.963154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e233ee71-89da-4b7b-beb6-63e76f605cd9 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:42.964963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e233ee71-89da-4b7b-beb6-63e76f605cd9 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:43.107742 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e233ee71-89da-4b7b-beb6-63e76f605cd9 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "PUT /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 991 microversion: 2.47 time: 0.157815 Jul 20 10:59:43.120113 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1348/2647] 10.222.0.79 () {62 vars in 1296 bytes} [Wed Jul 20 10:59:42 2022] PUT /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 991 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 10:59:43.130813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:43.131958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:43.149348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:43.150303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:43.151443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:43.155103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:43.335732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:43.591609 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-319b345c-7597-4ad0-8a2c-9e8d54cd9c17 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 204 len: 0 microversion: 2.1 time: 1.060373 Jul 20 10:59:43.595415 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1300/2648] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:42 2022] DELETE /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:43.621787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0cbf214b-c5f9-4730-9bcd-b221ded791ec req-858a282e-f8fc-432e-973b-1e5738343d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66debb22-763c-40cc-9f4a-baaaf24e176a", "name": "network-vif-plugged", "status": "completed", "tag": "e27a35ac-0767-43b7-bb81-f161cd4389aa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:43.673822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0cbf214b-c5f9-4730-9bcd-b221ded791ec req-858a282e-f8fc-432e-973b-1e5738343d5c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:43.674320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0cbf214b-c5f9-4730-9bcd-b221ded791ec req-858a282e-f8fc-432e-973b-1e5738343d5c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:43.730670 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0cbf214b-c5f9-4730-9bcd-b221ded791ec req-858a282e-f8fc-432e-973b-1e5738343d5c service nova] Creating event network-vif-plugged:e27a35ac-0767-43b7-bb81-f161cd4389aa for instance 66debb22-763c-40cc-9f4a-baaaf24e176a on n-h2-846219-10 Jul 20 10:59:43.745199 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0cbf214b-c5f9-4730-9bcd-b221ded791ec req-858a282e-f8fc-432e-973b-1e5738343d5c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146040 Jul 20 10:59:43.748027 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1301/2649] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:43.769454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:43.773420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:43.783585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:43.784675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:43.785812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:43.786429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:44.065133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:44.082985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:44.084557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:44.091384 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11adde76-8660-4389-a988-73d906590be2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1273 microversion: 2.47 time: 0.341467 Jul 20 10:59:44.095107 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1302/2650] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:43 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:44.105351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-57b00624-f762-43f2-bed0-38a35f609d9f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f3eedc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:44.200221 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-57b00624-f762-43f2-bed0-38a35f609d9f tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.102491 Jul 20 10:59:44.201665 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1303/2651] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:44 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:44.208801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:44.210798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:44.221766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:44.222523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:44.223547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:44.224138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:44.254594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:44.272109 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ed8e9fa-cbf1-4d28-bab2-4b5270869d72 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1320 microversion: 2.1 time: 1.150056 Jul 20 10:59:44.284929 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1349/2652] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:43 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1320 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:44.291059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2035254484", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "ba902a31-3b1d-4754-b2cf-d3223978362f"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:44.386154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] validate_networks() for [('ba902a31-3b1d-4754-b2cf-d3223978362f', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:59:44.805288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:44.813657 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3858a00-430f-4138-8613-0de6343a6a77 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1503 microversion: 2.1 time: 0.610148 Jul 20 10:59:44.815466 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1304/2653] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:44 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1503 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:44.833081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1192072805"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:44.833983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:44.857287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:44.860274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:44.863502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:44.865720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:45.382885 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.network.security_group_api [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Adding security group 291e7663-cb46-4813-b699-858df8911e35 to port 3a93135f-5d18-4226-a747-44a4901e36e5 Jul 20 10:59:46.046702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:46.047384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:46.048258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:46.051160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:46.052156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:46.091284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:46.094195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:46.095418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:46.096162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:46.137285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:46.146663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Getting quotas for user 78f1e2aa093b45c2b9063b057251feab and project 64590628f1014fd38936c3bfdd9cea02. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:46.207131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:46.210619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:46.321076 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-16a1714c-a9ed-47c4-927a-9e333d276e8f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035052 Jul 20 10:59:46.322291 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1350/2654] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:59:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:59:46.328023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:46.328955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:46.336381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:46.337110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:46.338754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:46.339302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:46.549453 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8221662f-2d4e-4b40-b2e7-27f5b403ecfc tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a/action" status: 202 len: 0 microversion: 2.1 time: 1.721791 Jul 20 10:59:46.550077 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1305/2655] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:44 2022] POST /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a/action => generated 0 bytes in 1724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 10:59:46.557895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c8b15fd-de8b-4794-9959-b0fe303c5bc0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f2be4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:46.572711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:46.590883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:46.604740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:46.606066 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-edac5752-2189-4e43-8b12-09f9f1e7a814 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1335 microversion: 2.47 time: 0.282528 Jul 20 10:59:46.606675 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1351/2656] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:46 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1335 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:46.636419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:46.637038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:46.658305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:46.658710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:46.668350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:46.668716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:46.671597 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c8b15fd-de8b-4794-9959-b0fe303c5bc0 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.120429 Jul 20 10:59:46.677710 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1306/2657] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:46 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:47.014276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47a627b7-bcad-4201-b7ee-4d779be83d40 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.029332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:47.041970 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-21b22009-9a75-49fc-9bb3-b68284f02cd5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1501 microversion: 2.1 time: 0.415137 Jul 20 10:59:47.043205 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1352/2658] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:46 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1501 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:47.048769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6dadbc14-60d3-4acd-8978-0352b02cb106 req-cee81f42-1739-4f6e-a712-cc37712999e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2bd780-295a-4354-aafd-e973390e5dd2", "name": "network-vif-unplugged", "status": "completed", "tag": "ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:47.059216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6dadbc14-60d3-4acd-8978-0352b02cb106 req-cee81f42-1739-4f6e-a712-cc37712999e7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.059908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6dadbc14-60d3-4acd-8978-0352b02cb106 req-cee81f42-1739-4f6e-a712-cc37712999e7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.061768 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-47a627b7-bcad-4201-b7ee-4d779be83d40 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.376990 Jul 20 10:59:47.062426 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1307/2659] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:47.070656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7dd08a7c-d015-4b18-aac9-98fb088b2bac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.085914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7dd08a7c-d015-4b18-aac9-98fb088b2bac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:47.094298 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6dadbc14-60d3-4acd-8978-0352b02cb106 req-cee81f42-1739-4f6e-a712-cc37712999e7 service nova] Creating event network-vif-unplugged:ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4 for instance ac2bd780-295a-4354-aafd-e973390e5dd2 on n-h1-846219-10 Jul 20 10:59:47.102364 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6dadbc14-60d3-4acd-8978-0352b02cb106 req-cee81f42-1739-4f6e-a712-cc37712999e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057351 Jul 20 10:59:47.103801 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1353/2660] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:47.110127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85226f62-d578-4dfc-9304-bd9ba6d09fcd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f9a1550>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.255675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7dd08a7c-d015-4b18-aac9-98fb088b2bac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:47.261632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-85226f62-d578-4dfc-9304-bd9ba6d09fcd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 291e7663-cb46-4813-b699-858df8911e35 in use.", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:59:47.262667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-85226f62-d578-4dfc-9304-bd9ba6d09fcd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.262667 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85226f62-d578-4dfc-9304-bd9ba6d09fcd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35 HTTP/1.1 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: exception: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '291e7663-cb46-4813-b699-858df8911e35'} Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:59:47.264994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] Jul 20 10:59:47.270036 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:47.278360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85226f62-d578-4dfc-9304-bd9ba6d09fcd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 400 to user: Security Group 291e7663-cb46-4813-b699-858df8911e35 in use. Jul 20 10:59:47.278360 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-788d42f6-9081-4c37-9f03-40fe26350b2d'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:47.278928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7dd08a7c-d015-4b18-aac9-98fb088b2bac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1208 microversion: 2.1 time: 0.212556 Jul 20 10:59:47.279235 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-85226f62-d578-4dfc-9304-bd9ba6d09fcd tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35" status: 400 len: 185 microversion: 2.1 time: 0.172975 Jul 20 10:59:47.280431 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1354/2661] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:59:47 2022] DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35 => generated 185 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:59:47.287407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e155fe7c-b7cb-4d23-96d1-461a209c6831 req-59da4e6d-83e5-4927-ac3a-d5aa98684296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7020321d-3803-48d0-80f8-43b809906d2a", "tag": "3a93135f-5d18-4226-a747-44a4901e36e5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:47.293706 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1308/2662] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1208 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:47.299768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e155fe7c-b7cb-4d23-96d1-461a209c6831 req-59da4e6d-83e5-4927-ac3a-d5aa98684296 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.300538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e155fe7c-b7cb-4d23-96d1-461a209c6831 req-59da4e6d-83e5-4927-ac3a-d5aa98684296 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.310322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.311304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:47.314280 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e155fe7c-b7cb-4d23-96d1-461a209c6831 req-59da4e6d-83e5-4927-ac3a-d5aa98684296 service nova] Creating event network-changed:3a93135f-5d18-4226-a747-44a4901e36e5 for instance 7020321d-3803-48d0-80f8-43b809906d2a on n-h2-846219-10 Jul 20 10:59:47.323350 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e155fe7c-b7cb-4d23-96d1-461a209c6831 req-59da4e6d-83e5-4927-ac3a-d5aa98684296 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040608 Jul 20 10:59:47.327626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.328766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.329007 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1355/2663] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:47.332256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.332887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.336778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-faa93c87-78d0-48e1-87d2-9461ae48cea9 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.357098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-faa93c87-78d0-48e1-87d2-9461ae48cea9 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.026426 Jul 20 10:59:47.368535 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1356/2664] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:47.374041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:47.375134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:47.395710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.396201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.396984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.398336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.519550 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a9972387-96de-41dd-a395-3e8d6d6a9d58 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a/action" status: 202 len: 0 microversion: 2.1 time: 0.149455 Jul 20 10:59:47.520223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1357/2665] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:47 2022] POST /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:47.529581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef52b6fd-6ccc-4b61-a654-70c49f6e870a tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.554560 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef52b6fd-6ccc-4b61-a654-70c49f6e870a tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028250 Jul 20 10:59:47.555484 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1358/2666] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:47.572333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.573102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:47.593334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.593805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.594610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:47.595055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:47.925400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:47.933543 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe8e957a-8525-44d8-b3f0-d6cf56a64329 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1574 microversion: 2.1 time: 0.376967 Jul 20 10:59:47.937456 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1359/2667] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1574 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:47.942307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b8dda2e-a027-4c7c-8565-7529c9dbbe8a tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.966485 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b8dda2e-a027-4c7c-8565-7529c9dbbe8a tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026729 Jul 20 10:59:47.967413 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1360/2668] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:47.972782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:47.986052 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1cad57b-f3e1-43b0-9b77-6fec3c606d41 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1501 microversion: 2.1 time: 0.690678 Jul 20 10:59:47.989304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:47.990009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:47.990729 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1309/2669] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1501 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.001266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.003713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9e7e48c-aa44-457f-b00a-fff6c11cc643 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f3ee670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.003908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.004729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.005179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.080322 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c9e7e48c-aa44-457f-b00a-fff6c11cc643 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1427 microversion: 2.1 time: 0.088052 Jul 20 10:59:48.081073 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1310/2670] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.086338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19f0a18a-be3e-4332-8780-a3932bb059bd tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.129008 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19f0a18a-be3e-4332-8780-a3932bb059bd tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.045816 Jul 20 10:59:48.130919 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1311/2671] 10.222.0.79 () {58 vars in 1164 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.138790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.140182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.147690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.148594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.149649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.150323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.204730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:48.216750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.228114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.231001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.239214 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d98e377d-6c3b-4e62-8f59-e0d516c5c864 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1356 microversion: 2.47 time: 0.262621 Jul 20 10:59:48.239922 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1361/2672] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:47 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1356 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:48.249457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-375c6f39-7c7b-4560-af30-272dc4df78f8 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.269783 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-375c6f39-7c7b-4560-af30-272dc4df78f8 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028060 Jul 20 10:59:48.270762 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1362/2673] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:48.283135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:48.288930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.303288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.305990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.307650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.309244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.408388 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ce15bd51-f13a-48c9-bc30-5b81599b4edb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 204 len: 0 microversion: 2.1 time: 0.274849 Jul 20 10:59:48.410033 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1312/2674] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:48 2022] DELETE /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:48.422709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9410369f-34f7-4ab7-b98a-35e436f83d9d tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.450839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9410369f-34f7-4ab7-b98a-35e436f83d9d tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.034965 Jul 20 10:59:48.456083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:48.456632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:48.457222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:48.458377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:48.460752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:48.461977 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1313/2675] 10.222.0.79 () {58 vars in 1168 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.467073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.467835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.474502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.474950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.476468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.477071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.532310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.540097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.540536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.541319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.541755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.551978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.563689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5cc81728-e96b-4f38-bf8a-f214deec518d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1260 microversion: 2.1 time: 0.100319 Jul 20 10:59:48.564866 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1314/2676] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1260 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.574054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.575678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.583985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.585263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.586500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.587045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.588991 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2f4e782-94e5-4cf7-87d3-cbd95b005460 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "POST /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65/action" status: 202 len: 1078 microversion: 2.47 time: 0.314093 Jul 20 10:59:48.589621 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1363/2677] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 10:59:48 2022] POST /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65/action => generated 1078 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 10:59:48.601971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af57ca66-025c-4f2a-b015-986f1ecfc933 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.617578 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af57ca66-025c-4f2a-b015-986f1ecfc933 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.021299 Jul 20 10:59:48.618745 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1364/2678] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:48.623952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.624800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.632869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.633631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.634606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.635255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.730555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.739877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.741997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.751021 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0ae5015b-5bc5-4660-b0cb-c070446b94ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.123267 Jul 20 10:59:48.762801 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1365/2679] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:48.762801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fd077f51-ff25-48ca-974c-24f32483aab7 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.767242 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fd077f51-ff25-48ca-974c-24f32483aab7 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013932 Jul 20 10:59:48.768251 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1366/2680] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:48.781052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4a311e2-4985-4ec6-bca5-67c16100b06a tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.831061 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4a311e2-4985-4ec6-bca5-67c16100b06a tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.055423 Jul 20 10:59:48.840988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1367/2681] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:48.845984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c047e70c-e15a-4d48-8852-f5190ede6f91 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.855738 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c047e70c-e15a-4d48-8852-f5190ede6f91 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013513 Jul 20 10:59:48.856432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1368/2682] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:48.868240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43801d52-bea7-4e61-a079-929a172fc710 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.872489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:48.886836 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6937d360-af75-4a24-bc5c-15a6875db588 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1507 microversion: 2.1 time: 0.320476 Jul 20 10:59:48.895612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1315/2683] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.907095 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43801d52-bea7-4e61-a079-929a172fc710 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043632 Jul 20 10:59:48.907805 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1369/2684] 10.222.0.79 () {58 vars in 1143 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:48.924006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d77395a6-e622-49ed-98cd-a931bcf8a751 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.934789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d77395a6-e622-49ed-98cd-a931bcf8a751 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018009 Jul 20 10:59:48.935931 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1316/2685] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:48.947313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81e23a19-746f-457d-ab0a-6f63a76f39c0 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.955577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.957052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:48.964914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.966442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.967770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:48.968380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:48.972760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81e23a19-746f-457d-ab0a-6f63a76f39c0 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029937 Jul 20 10:59:48.973358 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1370/2686] 10.222.0.79 () {58 vars in 1147 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:48.986242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f072d489-c2bd-4a5d-a68c-52380ed0d829 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:48.998358 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f072d489-c2bd-4a5d-a68c-52380ed0d829 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016046 Jul 20 10:59:48.999732 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1371/2687] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:49.011934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cbd6f88f-ed66-4a60-976c-4490e918d588 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.020574 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cbd6f88f-ed66-4a60-976c-4490e918d588 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012999 Jul 20 10:59:49.021392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1372/2688] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 10:59:49.032078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38e80fb9-6daf-4895-99b7-fae1db35529c tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.053158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38e80fb9-6daf-4895-99b7-fae1db35529c tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.024711 Jul 20 10:59:49.061969 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1373/2689] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:49.067154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f980c144-a412-4161-9320-2e4447d55fd4 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.099411 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f980c144-a412-4161-9320-2e4447d55fd4 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036157 Jul 20 10:59:49.101343 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1374/2690] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:49.107451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a17f733-35ed-4413-bb48-c4ef335b1d48 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f077670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.180234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3a17f733-35ed-4413-bb48-c4ef335b1d48 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1436 microversion: 2.1 time: 0.077349 Jul 20 10:59:49.183359 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1375/2691] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1436 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:49.190285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ca59446-ab24-41a3-b1ce-3bfbf75ff025 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.204218 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ca59446-ab24-41a3-b1ce-3bfbf75ff025 tempest-FlavorsV2TestJSON-1840651691 tempest-FlavorsV2TestJSON-1840651691-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021492 Jul 20 10:59:49.206128 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1376/2692] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:49.214983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b27482ea-1af4-4115-9c51-dc6a320c53da tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c4c3c7ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.259288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:49.272068 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ae3a302-69ba-43fe-9a46-0d9694e7558b tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1574 microversion: 2.1 time: 0.321294 Jul 20 10:59:49.276437 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1317/2693] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:48 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1574 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:49.282452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b27482ea-1af4-4115-9c51-dc6a320c53da tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 200 len: 1436 microversion: 2.1 time: 0.075035 Jul 20 10:59:49.283441 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1377/2694] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 1436 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:49.297073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.298220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:49.306905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.307745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.308762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.311049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.370014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d69dad66-8b6b-4286-ad6d-edc081856c49 req-439460c8-9c7c-4793-801c-93f6e04283f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2bd780-295a-4354-aafd-e973390e5dd2", "name": "network-vif-deleted", "tag": "ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:49.384030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d69dad66-8b6b-4286-ad6d-edc081856c49 req-439460c8-9c7c-4793-801c-93f6e04283f5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.384440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d69dad66-8b6b-4286-ad6d-edc081856c49 req-439460c8-9c7c-4793-801c-93f6e04283f5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.402785 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d69dad66-8b6b-4286-ad6d-edc081856c49 req-439460c8-9c7c-4793-801c-93f6e04283f5 service nova] Creating event network-vif-deleted:ebe96cfe-efdb-4ba0-9a7d-d4145c0e75b4 for instance ac2bd780-295a-4354-aafd-e973390e5dd2 on n-h1-846219-10 Jul 20 10:59:49.408904 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d69dad66-8b6b-4286-ad6d-edc081856c49 req-439460c8-9c7c-4793-801c-93f6e04283f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047011 Jul 20 10:59:49.409840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1378/2695] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:49.583629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.584542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:49.593520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.595018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.595757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.596240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.718376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:49.723051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:49.728894 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b336247-080d-4421-9a45-28eadc11c386 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1260 microversion: 2.1 time: 0.150477 Jul 20 10:59:49.732811 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1379/2696] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:49.772460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:49.781472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.782240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:49.783785 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-935fe3e7-d74a-4ac0-91da-7f2edd23d9f4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1479 microversion: 2.1 time: 0.491448 Jul 20 10:59:49.784696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1318/2697] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1479 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:49.794775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.794775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.795302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.796039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.904093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:49.909841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:49.910813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:49.922596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.923694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:49.924547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.926004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:49.926674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:49.947039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:49.952749 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-04e4097e-e63c-4c41-b8e1-13e271fae7eb tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.172091 Jul 20 10:59:49.964658 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1380/2698] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:50.254062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:50.269271 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dca41095-5b24-45e8-8f50-2b95f05f4621 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1507 microversion: 2.1 time: 0.366261 Jul 20 10:59:50.270343 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1319/2699] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:49 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:50.298926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:50.300247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:50.309802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:50.310534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:50.311391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:50.312047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:50.628492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:50.638058 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42600e69-a054-4048-ba18-a568ec4c3241 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1574 microversion: 2.1 time: 0.343999 Jul 20 10:59:50.638854 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1381/2700] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:50 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1574 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:50.752156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:50.753167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:50.769014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:50.770216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:50.773047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:50.774413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:50.785158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:50.805120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:50.805909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:50.843607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:50.849185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:50.851198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:50.851660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.046242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:51.060936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a38b8c6d-d1e5-41eb-b3bf-ccfcc1ea3214 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1268 microversion: 2.1 time: 0.313027 Jul 20 10:59:51.062561 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1320/2701] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:50 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1268 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:51.076290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:51.077715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:51.103836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.108161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.109799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.110255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.234787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:51.245040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af470da6-de8f-41fc-ad5b-ebf98306a0cd tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1466 microversion: 2.1 time: 0.446653 Jul 20 10:59:51.246693 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1382/2702] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:50 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1466 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:51.251294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7d1a6033-800e-474a-93dc-eaeaf69f1f60 req-f2678165-7494-471a-a795-54cecb5d2224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66debb22-763c-40cc-9f4a-baaaf24e176a", "name": "network-vif-deleted", "tag": "e27a35ac-0767-43b7-bb81-f161cd4389aa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:51.269027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:51.293972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:51.296477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7d1a6033-800e-474a-93dc-eaeaf69f1f60 req-f2678165-7494-471a-a795-54cecb5d2224 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.297034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7d1a6033-800e-474a-93dc-eaeaf69f1f60 req-f2678165-7494-471a-a795-54cecb5d2224 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.305030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:51.309601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7d1a6033-800e-474a-93dc-eaeaf69f1f60 req-f2678165-7494-471a-a795-54cecb5d2224 service nova] Creating event network-vif-deleted:e27a35ac-0767-43b7-bb81-f161cd4389aa for instance 66debb22-763c-40cc-9f4a-baaaf24e176a on n-h2-846219-10 Jul 20 10:59:51.311644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:51.312875 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77398ef1-ccb5-4957-8562-12abb56ba8d5 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.249104 Jul 20 10:59:51.314584 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7d1a6033-800e-474a-93dc-eaeaf69f1f60 req-f2678165-7494-471a-a795-54cecb5d2224 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066722 Jul 20 10:59:51.315319 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1383/2703] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:51.322265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5ad5b687-0021-423d-b21a-0f238309265d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3eb31f70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:51.328594 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1321/2704] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:51 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:51.341624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:51.342334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:51.351258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.351722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.352518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.352962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.504962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:51.526481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1fd32e1d-13b4-46df-87f1-0870440d6b68 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 200 len: 1305 microversion: 2.1 time: 0.185556 Jul 20 10:59:51.527675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1322/2705] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:51 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:51.661272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:51.662503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:51.680084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.680730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:51.682340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:51.682799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:52.019543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:52.036020 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0f93cdf4-1dc9-4338-8d2f-8801239067ec tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1572 microversion: 2.1 time: 0.378212 Jul 20 10:59:52.036687 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1323/2706] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:51 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1572 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:52.073499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-416190084"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:52.090194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:52.099728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:52.121698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:52.122278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:52.123078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:52.123615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:52.281714 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5ad5b687-0021-423d-b21a-0f238309265d tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "DELETE /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac" status: 204 len: 0 microversion: 2.1 time: 0.964978 Jul 20 10:59:52.282843 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1384/2707] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:51 2022] DELETE /compute/v2.1/images/a9cf17d7-699b-4dbc-a352-fe0e8b75ffac => generated 0 bytes in 967 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:52.290300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:52.291361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:52.298401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:52.298940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:52.299845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:52.300351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:52.660763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:52.669963 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65261441-8228-42a9-8d74-1ef7f9207baf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1266 microversion: 2.1 time: 0.384524 Jul 20 10:59:52.672249 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1385/2708] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:52 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:52.817910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5dd81196-6d9a-4136-9a8d-96570353ebbd tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Calling method '.version_select at 0x7f2c3eb1bee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:52.840703 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5dd81196-6d9a-4136-9a8d-96570353ebbd tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] HTTP exception thrown: Image not found. Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5dd81196-6d9a-4136-9a8d-96570353ebbd tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Request method failure captured: Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/ca2a6578-9333-4816-99da-a292118e573a/metadata/os_distro HTTP/1.1 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-AnCv20KviMcIqEwM2XCOBBRSitMuD3a3Lg291kxY5VPgNB1yjC824c-fVudj8lGLHD3rxhGrz2m9dC-6-pBJS1--G-Ry-l8ERo3x-KP95EwAn0eXAqoWrF_K-JF4q5qbfCbIQ-rCBys-OvB0aPX6x0Z16S4itc2PN9hSBirBxfuBE Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6b4f4b415454a9581c9b85417a73d5f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 08a6f4b7768149c79f2c62979ced4721 Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'image_id': 'ca2a6578-9333-4816-99da-a292118e573a', 'id': 'os_distro'} Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ca2a6578-9333-4816-99da-a292118e573a Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:52.848120 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca2a6578-9333-4816-99da-a292118e573a could not be found. Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:52.853366 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.857259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5dd81196-6d9a-4136-9a8d-96570353ebbd tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:52.858144 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5dd81196-6d9a-4136-9a8d-96570353ebbd tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] 10.222.0.79 "DELETE /compute/v2.1/images/ca2a6578-9333-4816-99da-a292118e573a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.184704 Jul 20 10:59:52.858729 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1386/2709] 10.222.0.79 () {58 vars in 1292 bytes} [Wed Jul 20 10:59:52 2022] DELETE /compute/v2.1/images/ca2a6578-9333-4816-99da-a292118e573a/metadata/os_distro => generated 62 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:52.863910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6b08391-0003-4f3e-9e8a-21c757f24f37 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '.version_select at 0x7f2c3f796820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:52.883694 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.network.security_group_api [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Adding security group f7fc2620-5666-4970-8d3d-326b258234eb to port 3a93135f-5d18-4226-a747-44a4901e36e5 Jul 20 10:59:52.890941 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c6b08391-0003-4f3e-9e8a-21c757f24f37 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] HTTP exception thrown: Image not found. Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6b08391-0003-4f3e-9e8a-21c757f24f37 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Request method failure captured: Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa HTTP/1.1 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-1zrS0ujZWDVcmh6qS_Ue9VuxigU2htV3ED4zxeMZiNGkscXHEqYI32VQLz-ljiHHmY0t2WaqYmtiNydtcbvOoZ-wUGmGKefn8X_pwzXfAExv1H3QXnLhqPrlXuZ9aZcLU9Md65jx_Zqo78g6i9kg6p-oW5X8XiLFXmnKNjPE4KB8 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: db383d5e009141f7b1550232e98d795b Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerTestJSON-420436444 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db383d5e009141f7b1550232e98d795b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db383d5e009141f7b1550232e98d795b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db383d5e009141f7b1550232e98d795b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db383d5e009141f7b1550232e98d795b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerTestJSON-420436444 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: db383d5e009141f7b1550232e98d795b Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-420436444 Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerTestJSON-420436444-project Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 947f24c332684626a864bf58222aa8cf Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerTestJSON-420436444-project Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '814a9df5-5d76-4499-be3e-1263f5cfd0aa'} Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 814a9df5-5d76-4499-be3e-1263f5cfd0aa to delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 814a9df5-5d76-4499-be3e-1263f5cfd0aa could not be found. Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.892791 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6b08391-0003-4f3e-9e8a-21c757f24f37 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:52.898689 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6b08391-0003-4f3e-9e8a-21c757f24f37 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "DELETE /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa" status: 404 len: 62 microversion: 2.1 time: 0.034377 Jul 20 10:59:52.901990 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1387/2710] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:52 2022] DELETE /compute/v2.1/images/814a9df5-5d76-4499-be3e-1263f5cfd0aa => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:52.904970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:52.905765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:52.916416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:52.916924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:52.918298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:52.918759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.073727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:53.087582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:53.089276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:53.090529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-298211b3-7cad-4702-8a29-c10e16402f2d tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.190098 Jul 20 10:59:53.091097 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1388/2711] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:52 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:53.098787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.099700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:53.106878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.107888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.108612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.108931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.125744 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a HTTP/1.1 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '66debb22-763c-40cc-9f4a-baaaf24e176a'} Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.128134 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.134307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.134307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.134307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:53.134307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:53.134307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 10:59:53.134307 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.136418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:53.137519 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ca375cb-f4c2-4b8c-824b-4137ca19e470 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 404 len: 111 microversion: 2.1 time: 0.045464 Jul 20 10:59:53.139036 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1389/2712] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:53 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 10:59:53.151334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-550fcf5c-b435-4c07-97a9-2b76894a6f43 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Calling method '.version_select at 0x7f2c3f704e50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.184237 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-550fcf5c-b435-4c07-97a9-2b76894a6f43 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] HTTP exception thrown: Image not found. Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-550fcf5c-b435-4c07-97a9-2b76894a6f43 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Request method failure captured: Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/images/6aaa5136-7b4c-4179-b8d6-7cf24041ce4f/metadata/os_version HTTP/1.1 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-AnCv20KviMcIqEwM2XCOBBRSitMuD3a3Lg291kxY5VPgNB1yjC824c-fVudj8lGLHD3rxhGrz2m9dC-6-pBJS1--G-Ry-l8ERo3x-KP95EwAn0eXAqoWrF_K-JF4q5qbfCbIQ-rCBys-OvB0aPX6x0Z16S4itc2PN9hSBirBxfuBE Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6b4f4b415454a9581c9b85417a73d5f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 08a6f4b7768149c79f2c62979ced4721 Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'image_id': '6aaa5136-7b4c-4179-b8d6-7cf24041ce4f', 'id': 'os_version'} Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6aaa5136-7b4c-4179-b8d6-7cf24041ce4f Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:53.187043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6aaa5136-7b4c-4179-b8d6-7cf24041ce4f could not be found. Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:53.191744 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.199359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-550fcf5c-b435-4c07-97a9-2b76894a6f43 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:53.200376 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-550fcf5c-b435-4c07-97a9-2b76894a6f43 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] 10.222.0.79 "GET /compute/v2.1/images/6aaa5136-7b4c-4179-b8d6-7cf24041ce4f/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.058233 Jul 20 10:59:53.200736 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1390/2713] 10.222.0.79 () {58 vars in 1292 bytes} [Wed Jul 20 10:59:53 2022] GET /compute/v2.1/images/6aaa5136-7b4c-4179-b8d6-7cf24041ce4f/metadata/os_version => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:53.207224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.207892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:53.219471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.219888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.220790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.221337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.251116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:53.352343 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5eaeaa0e-d99c-4d9d-9d8f-94356aae6714 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 204 len: 0 microversion: 2.1 time: 0.150010 Jul 20 10:59:53.355535 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1391/2714] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:53 2022] DELETE /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:53.369416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-023c304e-80e3-458d-b08d-ba857b718faf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: .version_select at 0x7f2c4c3eb9d0>, body: {"keypair": {"name": "tempest-key-783463060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsnXLwIdL2U1lNrj5EfEmmA5gckD8MBlWTdb4DwK3Cnu15iohDmG82We13SWRCmQ6LKuYe5DclWp9hzQKHDLawnK0+xq4OhR9xeeCRxQWi/KlxQD9HDUkVILvsXHECWkw=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:53.388387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-023c304e-80e3-458d-b08d-ba857b718faf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:53.399132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-023c304e-80e3-458d-b08d-ba857b718faf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:53.429234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-023c304e-80e3-458d-b08d-ba857b718faf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.070382 Jul 20 10:59:53.429855 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1392/2715] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 10:59:53 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:53.438689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1633ab88-aaae-4e2a-a3d1-9b88a78c1b27 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Calling method '.version_select at 0x7f2c3f9d5b80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.464946 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1633ab88-aaae-4e2a-a3d1-9b88a78c1b27 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] HTTP exception thrown: Image not found. Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1633ab88-aaae-4e2a-a3d1-9b88a78c1b27 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Request method failure captured: Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/images/e52afe99-1a12-4a55-b0d1-0487b95c7d78/metadata HTTP/1.1 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-AnCv20KviMcIqEwM2XCOBBRSitMuD3a3Lg291kxY5VPgNB1yjC824c-fVudj8lGLHD3rxhGrz2m9dC-6-pBJS1--G-Ry-l8ERo3x-KP95EwAn0eXAqoWrF_K-JF4q5qbfCbIQ-rCBys-OvB0aPX6x0Z16S4itc2PN9hSBirBxfuBE Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6b4f4b415454a9581c9b85417a73d5f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 08a6f4b7768149c79f2c62979ced4721 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'image_id': 'e52afe99-1a12-4a55-b0d1-0487b95c7d78'} Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e52afe99-1a12-4a55-b0d1-0487b95c7d78 Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:53.467495 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e52afe99-1a12-4a55-b0d1-0487b95c7d78 could not be found. Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:53.471646 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.477490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1633ab88-aaae-4e2a-a3d1-9b88a78c1b27 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:53.478602 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1633ab88-aaae-4e2a-a3d1-9b88a78c1b27 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] 10.222.0.79 "GET /compute/v2.1/images/e52afe99-1a12-4a55-b0d1-0487b95c7d78/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047611 Jul 20 10:59:53.480515 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1393/2716] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 10:59:53 2022] GET /compute/v2.1/images/e52afe99-1a12-4a55-b0d1-0487b95c7d78/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:53.488307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.489525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:53.498700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.499712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.500787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.501495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.639059 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f74da3d8-2719-40b0-b1e3-bf92a0b62342 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a/action" status: 202 len: 0 microversion: 2.1 time: 1.586977 Jul 20 10:59:53.640670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1324/2717] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 10:59:52 2022] POST /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a/action => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 10:59:53.660753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7cfc1d7-a584-4023-9e33-02b4d784ad89 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '.version_select at 0x7f2c3f329ca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.674214 n-d-846219-10 devstack@n-api.service[125886]: WARNING oslo_db.sqlalchemy.utils [None req-c7cfc1d7-a584-4023-9e33-02b4d784ad89 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 10:59:53.680976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:53.710005 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7cfc1d7-a584-4023-9e33-02b4d784ad89 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.066096 Jul 20 10:59:53.720610 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1325/2718] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 10:59:53 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:53.730177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-298aaf21-b887-4cfc-8d10-11fed6dc239f tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Action: 'update_all', calling method: .version_select at 0x7f2c3f2c0ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:53.791680 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-298aaf21-b887-4cfc-8d10-11fed6dc239f tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] HTTP exception thrown: Image not found. Jul 20 10:59:53.799120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-298aaf21-b887-4cfc-8d10-11fed6dc239f tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Request method failure captured: Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/images/9e15b957-aba7-4815-967d-9e405312315c/metadata HTTP/1.1 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 57 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-AnCv20KviMcIqEwM2XCOBBRSitMuD3a3Lg291kxY5VPgNB1yjC824c-fVudj8lGLHD3rxhGrz2m9dC-6-pBJS1--G-Ry-l8ERo3x-KP95EwAn0eXAqoWrF_K-JF4q5qbfCbIQ-rCBys-OvB0aPX6x0Z16S4itc2PN9hSBirBxfuBE Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6b4f4b415454a9581c9b85417a73d5f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 08a6f4b7768149c79f2c62979ced4721 Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'image_id': '9e15b957-aba7-4815-967d-9e405312315c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9e15b957-aba7-4815-967d-9e405312315c Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:53.812691 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9e15b957-aba7-4815-967d-9e405312315c could not be found. Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:53.817873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-298aaf21-b887-4cfc-8d10-11fed6dc239f tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:53.824365 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f4380dc-ea8c-4813-b927-d01b3f4f5068 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1472 microversion: 2.1 time: 0.335062 Jul 20 10:59:53.824461 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-298aaf21-b887-4cfc-8d10-11fed6dc239f tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] 10.222.0.79 "PUT /compute/v2.1/images/9e15b957-aba7-4815-967d-9e405312315c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.095391 Jul 20 10:59:53.824540 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1394/2719] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:53 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:53.824614 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1326/2720] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:59:53 2022] PUT /compute/v2.1/images/9e15b957-aba7-4815-967d-9e405312315c/metadata => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:53.835952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b02ee8c-c16f-462b-8f2b-9f29df86da35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f2c04c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.839865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1188d7a9-2c44-48ab-8494-6ccd4f48a139 req-592d2299-95ba-45ef-b255-74577807edf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7020321d-3803-48d0-80f8-43b809906d2a", "tag": "3a93135f-5d18-4226-a747-44a4901e36e5"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:53.853290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1188d7a9-2c44-48ab-8494-6ccd4f48a139 req-592d2299-95ba-45ef-b255-74577807edf4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.854281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1188d7a9-2c44-48ab-8494-6ccd4f48a139 req-592d2299-95ba-45ef-b255-74577807edf4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.878065 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1188d7a9-2c44-48ab-8494-6ccd4f48a139 req-592d2299-95ba-45ef-b255-74577807edf4 service nova] Creating event network-changed:3a93135f-5d18-4226-a747-44a4901e36e5 for instance 7020321d-3803-48d0-80f8-43b809906d2a on n-h2-846219-10 Jul 20 10:59:53.891902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1188d7a9-2c44-48ab-8494-6ccd4f48a139 req-592d2299-95ba-45ef-b255-74577807edf4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068718 Jul 20 10:59:53.896238 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1395/2721] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:53.904160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:53.904874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:53.932563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.933013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:53.933906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:53.934344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.253114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-1b02ee8c-c16f-462b-8f2b-9f29df86da35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use.", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 10:59:54.261517 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1b02ee8c-c16f-462b-8f2b-9f29df86da35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.261517 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b02ee8c-c16f-462b-8f2b-9f29df86da35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb HTTP/1.1 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: exception: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f7fc2620-5666-4970-8d3d-326b258234eb'} Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 10:59:54.263879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b02ee8c-c16f-462b-8f2b-9f29df86da35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 400 to user: Security Group f7fc2620-5666-4970-8d3d-326b258234eb in use. Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-24aca0aa-b06d-4984-a043-20543e810adb'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1b02ee8c-c16f-462b-8f2b-9f29df86da35 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb" status: 400 len: 185 microversion: 2.1 time: 0.439595 Jul 20 10:59:54.269125 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1327/2722] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 10:59:53 2022] DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb => generated 185 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 10:59:54.274193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-57b0a51b-8e96-4b0d-881c-5dd635dcca29 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Action: 'update', calling method: .version_select at 0x7f2c3f4620d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:54.319393 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-57b0a51b-8e96-4b0d-881c-5dd635dcca29 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] HTTP exception thrown: Image not found. Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-57b0a51b-8e96-4b0d-881c-5dd635dcca29 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Request method failure captured: Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/images/b98658cd-280e-4030-a68a-04efd6d22ae7/metadata/os_distro HTTP/1.1 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 30 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-AnCv20KviMcIqEwM2XCOBBRSitMuD3a3Lg291kxY5VPgNB1yjC824c-fVudj8lGLHD3rxhGrz2m9dC-6-pBJS1--G-Ry-l8ERo3x-KP95EwAn0eXAqoWrF_K-JF4q5qbfCbIQ-rCBys-OvB0aPX6x0Z16S4itc2PN9hSBirBxfuBE Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6b4f4b415454a9581c9b85417a73d5f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 08a6f4b7768149c79f2c62979ced4721 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: {"meta": {"os_distro": "alt"}} Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'image_id': 'b98658cd-280e-4030-a68a-04efd6d22ae7', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b98658cd-280e-4030-a68a-04efd6d22ae7 Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:54.321926 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b98658cd-280e-4030-a68a-04efd6d22ae7 could not be found. Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-57b0a51b-8e96-4b0d-881c-5dd635dcca29 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-57b0a51b-8e96-4b0d-881c-5dd635dcca29 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] 10.222.0.79 "PUT /compute/v2.1/images/b98658cd-280e-4030-a68a-04efd6d22ae7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.056167 Jul 20 10:59:54.328224 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1328/2723] 10.222.0.79 () {60 vars in 1309 bytes} [Wed Jul 20 10:59:54 2022] PUT /compute/v2.1/images/b98658cd-280e-4030-a68a-04efd6d22ae7/metadata/os_distro => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:54.332689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:54.336911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-711499407", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "key_name": "tempest-key-783463060", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:54.343558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f900ab52-3b92-48f3-8d25-1c598f095a25 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.445321 Jul 20 10:59:54.354043 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1396/2724] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:53 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:54.364682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:54.365565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:54.382341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.382959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.383976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.384474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.469782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 10:59:54.513409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:54.540021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:54.543915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:54.547013 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-173d75ff-eae1-4c23-97e9-07aed00b732b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.185574 Jul 20 10:59:54.559211 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1397/2725] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:54 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:54.560938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:54.563855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:54.573762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.575935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.579190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.581178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.640965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:54.799161 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-54b5bd97-dfea-470a-9ecc-4a90ce2667c8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 204 len: 0 microversion: 2.1 time: 0.247899 Jul 20 10:59:54.800919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1398/2726] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 10:59:54 2022] DELETE /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 10:59:54.808814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d513554e-6d4b-472f-8eea-2d1479a3bdf0 req-b2c6f2be-fccd-456a-999f-786d37fe10dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "name": "network-vif-unplugged", "status": "completed", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:54.820181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d513554e-6d4b-472f-8eea-2d1479a3bdf0 req-b2c6f2be-fccd-456a-999f-786d37fe10dd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.820869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d513554e-6d4b-472f-8eea-2d1479a3bdf0 req-b2c6f2be-fccd-456a-999f-786d37fe10dd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.838502 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d513554e-6d4b-472f-8eea-2d1479a3bdf0 req-b2c6f2be-fccd-456a-999f-786d37fe10dd service nova] Creating event network-vif-unplugged:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:59:54.844774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d513554e-6d4b-472f-8eea-2d1479a3bdf0 req-b2c6f2be-fccd-456a-999f-786d37fe10dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041376 Jul 20 10:59:54.845930 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1399/2727] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:54.853748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92ab6f9b-94ea-4ab6-850f-a801dc30c8d8 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Action: 'create', calling method: .version_select at 0x7f2c3eb314c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:54.883694 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-92ab6f9b-94ea-4ab6-850f-a801dc30c8d8 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] HTTP exception thrown: Image not found. Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92ab6f9b-94ea-4ab6-850f-a801dc30c8d8 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Request method failure captured: Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/images/fdf28aaf-b1e7-4a5c-99c1-24a25fd449f7/metadata HTTP/1.1 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 57 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-AnCv20KviMcIqEwM2XCOBBRSitMuD3a3Lg291kxY5VPgNB1yjC824c-fVudj8lGLHD3rxhGrz2m9dC-6-pBJS1--G-Ry-l8ERo3x-KP95EwAn0eXAqoWrF_K-JF4q5qbfCbIQ-rCBys-OvB0aPX6x0Z16S4itc2PN9hSBirBxfuBE Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6b4f4b415454a9581c9b85417a73d5f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6b4f4b415454a9581c9b85417a73d5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: a6b4f4b415454a9581c9b85417a73d5f Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-701535771 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 08a6f4b7768149c79f2c62979ced4721 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-701535771-project Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'image_id': 'fdf28aaf-b1e7-4a5c-99c1-24a25fd449f7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fdf28aaf-b1e7-4a5c-99c1-24a25fd449f7 Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 10:59:54.886640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fdf28aaf-b1e7-4a5c-99c1-24a25fd449f7 could not be found. Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 10:59:54.891385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92ab6f9b-94ea-4ab6-850f-a801dc30c8d8 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 10:59:54.894701 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92ab6f9b-94ea-4ab6-850f-a801dc30c8d8 tempest-ImagesMetadataNegativeTestJSON-701535771 tempest-ImagesMetadataNegativeTestJSON-701535771-project] 10.222.0.79 "POST /compute/v2.1/images/fdf28aaf-b1e7-4a5c-99c1-24a25fd449f7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043929 Jul 20 10:59:54.902616 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1400/2728] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Jul 20 10:59:54 2022] POST /compute/v2.1/images/fdf28aaf-b1e7-4a5c-99c1-24a25fd449f7/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 10:59:54.907597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b98ddeed-3c61-4ae3-b2e9-fa0f3201a287 req-30b9e937-728a-499a-b2ab-d5f882652061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f5d25c-6e9e-4cb7-947b-7369ca519e7d", "tag": "852b9cb3-62a1-4a8a-b9fb-0f995c495622"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:54.917989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b98ddeed-3c61-4ae3-b2e9-fa0f3201a287 req-30b9e937-728a-499a-b2ab-d5f882652061 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.918782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b98ddeed-3c61-4ae3-b2e9-fa0f3201a287 req-30b9e937-728a-499a-b2ab-d5f882652061 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.938495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b98ddeed-3c61-4ae3-b2e9-fa0f3201a287 req-30b9e937-728a-499a-b2ab-d5f882652061 service nova] Creating event network-changed:852b9cb3-62a1-4a8a-b9fb-0f995c495622 for instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d on n-h1-846219-10 Jul 20 10:59:54.955386 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b98ddeed-3c61-4ae3-b2e9-fa0f3201a287 req-30b9e937-728a-499a-b2ab-d5f882652061 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049653 Jul 20 10:59:54.958833 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1401/2729] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:54.972699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:54.973857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:54.985552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.986079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:54.989106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:54.993298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:55.284596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 10:59:55.285836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 10:59:55.286329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 10:59:55.286749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 10:59:55.287182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 10:59:55.304310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:55.306294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:55.307900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:55.310845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:55.350491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 10:59:55.359739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 10:59:55.385563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 10:59:55.386363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:55.389929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 10:59:55.396676 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3fec27ba-b6e2-4425-ba5a-b0309b6d83b2 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1646 microversion: 2.1 time: 0.435483 Jul 20 10:59:55.398132 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1402/2730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:54 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1646 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:55.409903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:55.413775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:55.429812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:55.430271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:55.431069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:55.431549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:55.465151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:55.489799 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a2118c7-9c4c-4b71-b9bf-4720b82b3b50 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163903 Jul 20 10:59:55.493471 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1329/2731] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 10:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 10:59:55.505945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:55.508464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:55.534506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:55.535018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:55.536515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:55.536970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.114554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 10:59:56.217853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:56.236989 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-32620e8b-3922-4667-80a3-6fa40729bf6a tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1472 microversion: 2.1 time: 0.826198 Jul 20 10:59:56.238387 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1403/2732] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:55 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1472 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:56.283397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:56.284029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:56.293332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:56.293783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.294750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:56.295607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.648829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:56.660689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-231e38b5-3cf1-4b2d-a937-a4b531ee4607 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 1.162987 Jul 20 10:59:56.665947 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1330/2733] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:55 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:56.672927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:56.673982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:56.694487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:56.697321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.701317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:56.703513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.713968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:56.726587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5231fc7f-32bd-4c23-aea6-e929721e3c7d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1231 microversion: 2.1 time: 0.461114 Jul 20 10:59:56.727426 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1404/2734] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:56 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1231 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:56.743318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:56.746234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:56.760781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:56.763315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.764974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:56.766676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:56.922585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:56.933773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:56.936179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:56.938483 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d09f13d-2e4f-4f81-9dfd-fb434009be26 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.270420 Jul 20 10:59:56.952231 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1331/2735] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:56 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:57.530833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:57.535820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:57.551083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.554236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:57.556924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.558382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:57.630383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 10:59:57.736521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:57.748794 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4affa678-a407-4a22-90de-c8f5b9092a4d tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1646 microversion: 2.1 time: 1.019864 Jul 20 10:59:57.753792 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1405/2736] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:56 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1646 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:57.766411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:57.789041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:57.831238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.838650 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8dc4a8a5-c044-41ff-9f64-33ea475d0d85 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 204 len: 0 microversion: 2.42 time: 0.884696 Jul 20 10:59:57.839985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:57.840456 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1332/2737] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 10:59:56 2022] DELETE /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 10:59:57.841781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.846376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:57.849042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fc9956e5-b110-4809-87ce-478949f9405b req-9b1601e1-bc0e-4413-a923-77fdaec23432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7020321d-3803-48d0-80f8-43b809906d2a", "name": "network-vif-deleted", "tag": "3a93135f-5d18-4226-a747-44a4901e36e5"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:57.866984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fc9956e5-b110-4809-87ce-478949f9405b req-9b1601e1-bc0e-4413-a923-77fdaec23432 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.867889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fc9956e5-b110-4809-87ce-478949f9405b req-9b1601e1-bc0e-4413-a923-77fdaec23432 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:57.887000 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fc9956e5-b110-4809-87ce-478949f9405b req-9b1601e1-bc0e-4413-a923-77fdaec23432 service nova] Creating event network-vif-deleted:3a93135f-5d18-4226-a747-44a4901e36e5 for instance 7020321d-3803-48d0-80f8-43b809906d2a on n-h2-846219-10 Jul 20 10:59:57.894932 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fc9956e5-b110-4809-87ce-478949f9405b req-9b1601e1-bc0e-4413-a923-77fdaec23432 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052494 Jul 20 10:59:57.895788 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1333/2738] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:57.906398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:57.907019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:57.917636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.918312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:57.919111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:57.919578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.071920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.084344 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bb4758c4-f8db-4ea0-b621-2b0f3fd99027 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1430 microversion: 2.1 time: 0.326313 Jul 20 10:59:58.086864 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1406/2739] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:57 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1430 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:58.096204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:58.097415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:58.121631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.123444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.124571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.125216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.317864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.339457 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ccc025ac-46ff-4d85-b6be-cb2f8c93851f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1287 microversion: 2.1 time: 0.250441 Jul 20 10:59:58.340433 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1407/2740] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:58 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1287 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:58.345486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:58.345811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.346360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:58.355264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.355875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.356777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.357331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.386047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3312874a-9624-4259-98ac-ab842ab0e9bf tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.484975 Jul 20 10:59:58.395305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1334/2741] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:57 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:58.413578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:58.414589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:58.432239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.433669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.435514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.436642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.638668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.651632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.656260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.659475 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-304ecbb9-a837-4ea4-8631-bc72650d8904 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.271317 Jul 20 10:59:58.661310 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1335/2742] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:58 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:58.680220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-10ec4cd3-cbe5-4811-92ba-86b189ee5adc req-7e5aeccd-b40c-49c9-99be-8b53d5b92867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7891-f40d-4e3d-a514-8eaf3c42a6d5", "name": "network-vif-deleted", "tag": "e3360773-1ce7-4596-85f3-c548481f8118"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 10:59:58.704669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-10ec4cd3-cbe5-4811-92ba-86b189ee5adc req-7e5aeccd-b40c-49c9-99be-8b53d5b92867 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.705269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-10ec4cd3-cbe5-4811-92ba-86b189ee5adc req-7e5aeccd-b40c-49c9-99be-8b53d5b92867 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.765999 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-10ec4cd3-cbe5-4811-92ba-86b189ee5adc req-7e5aeccd-b40c-49c9-99be-8b53d5b92867 service nova] Creating event network-vif-deleted:e3360773-1ce7-4596-85f3-c548481f8118 for instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 on n-h1-846219-10 Jul 20 10:59:58.776518 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-10ec4cd3-cbe5-4811-92ba-86b189ee5adc req-7e5aeccd-b40c-49c9-99be-8b53d5b92867 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112983 Jul 20 10:59:58.777695 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1336/2743] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 10:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 10:59:58.790490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:58.791743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:58.806311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.806954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.807871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.808409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.881326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:58.882708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:58.884006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lazy-loading 'fault' on Instance uuid 7020321d-3803-48d0-80f8-43b809906d2a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 10:59:58.978825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:58.999839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-824d137a-c706-48cc-9dc9-fecb9b6a4125 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1472 microversion: 2.1 time: 0.220752 Jul 20 10:59:59.001038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1337/2744] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:58 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:59.018650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.034640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.037019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.039027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd21cd18-ac18-4049-8dc3-6b8582473e8c tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2958 microversion: 2.42 time: 0.697418 Jul 20 10:59:59.040250 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1408/2745] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:58 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2958 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 10:59:59.107016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:59.107954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:59.123565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.125185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.140976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.141574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.265678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.279141 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97946422-5580-4443-b4df-04864b48a8a4 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1430 microversion: 2.1 time: 0.179346 Jul 20 10:59:59.281137 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1338/2746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:59 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1430 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:59.358083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:59.359021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:59.369174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.371456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.372305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.373038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.408816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:59.410469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:59.421158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.421621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.422507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.423694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.457431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.467487 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dfdab48a-e09a-43e9-8628-fa9f7e56da1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1287 microversion: 2.1 time: 0.113866 Jul 20 10:59:59.478010 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1409/2747] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:59 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 10:59:59.681962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 10:59:59.682977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 10:59:59.690702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.691155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.691978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 10:59:59.692549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 10:59:59.792358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.800176 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5cac740e-3f81-4e3b-9484-8f8863a1efce tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.400149 Jul 20 10:59:59.805951 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1339/2748] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 10:59:59 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 10:59:59.822488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.831485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.833574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 10:59:59.835879 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1864d575-c232-4c4d-9300-bbc191468352 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.159396 Jul 20 10:59:59.837130 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1410/2749] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 10:59:59 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:00:00.018126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:00.018784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:00.032622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.033129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.034086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.034931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.059685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:00.061202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:00.069955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.070778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.071829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.072526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.116564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.117429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.118119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lazy-loading 'fault' on Instance uuid 7020321d-3803-48d0-80f8-43b809906d2a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:00.237603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:00.246641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:00.256798 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1272fda5-0e7a-4510-8333-059b4bc0c85e tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 200 len: 1472 microversion: 2.1 time: 0.241862 Jul 20 11:00:00.259377 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1340/2750] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:00 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:00.299212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:00.302335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:00.310235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.310691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.311963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.312455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.349549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.350341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.351095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lazy-loading 'fault' on Instance uuid aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:00.886815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '947f24c332684626a864bf58222aa8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db383d5e009141f7b1550232e98d795b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:00.898642 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d1d65d4-6537-41f4-8af4-64d13ba5e1a8 tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 200 len: 1306 microversion: 2.1 time: 0.604384 Jul 20 11:00:00.910384 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1341/2751] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:00 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 1306 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:00:00.914908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:00.915570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:00.927293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.928577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:00.930303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:00.932286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.005511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.017170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.018874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.021184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30dd7f54-c773-443b-87b2-471149ebaf96 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2958 microversion: 2.42 time: 0.965534 Jul 20 11:00:01.022592 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1411/2752] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:00 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2958 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:00:01.027895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:01.028718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:01.038767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.039331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.040989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.041451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.102424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.116245 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ff00af4-6f9a-4a59-9f38-b503c24feb8f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1285 microversion: 2.1 time: 0.215493 Jul 20 11:00:01.130534 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1342/2753] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:00 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:01.136366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:01.137309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:01.144777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.145560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.146567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.147323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.400055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.417500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.421051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.431458 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11df6cf6-0899-4458-8de4-ffa8bfb0b69b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.299015 Jul 20 11:00:01.432741 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1343/2754] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:01 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:01.439033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:01.439998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:01.450798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.451442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.452745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.453557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.488465 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a HTTP/1.1 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '7020321d-3803-48d0-80f8-43b809906d2a'} Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:01.490978 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-46c22d6a-f324-4ef4-9c43-92caa878e623 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 404 len: 111 microversion: 2.1 time: 0.058687 Jul 20 11:00:01.500132 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1344/2755] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:01 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:01.503641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77ff12b9-49a6-41c2-8436-928555406bc6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f3ee5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:01.826744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:01.839635 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-22626bdc-2d0a-4196-8449-6186d0e75c2a tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.815593 Jul 20 11:00:01.841922 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1412/2756] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:01 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:01.920225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:01.922809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] [instance: aaac7891-f40d-4e3d-a514-8eaf3c42a6d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:01.946736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.947669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.948721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:01.949573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:01.985000 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] HTTP exception thrown: Instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 could not be found. Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Request method failure captured: Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 HTTP/1.1 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19-1zrS0ujZWDVcmh6qS_Ue9VuxigU2htV3ED4zxeMZiNGkscXHEqYI32VQLz-ljiHHmY0t2WaqYmtiNydtcbvOoZ-wUGmGKefn8X_pwzXfAExv1H3QXnLhqPrlXuZ9aZcLU9Md65jx_Zqo78g6i9kg6p-oW5X8XiLFXmnKNjPE4KB8 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: db383d5e009141f7b1550232e98d795b Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerTestJSON-420436444 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_db383d5e009141f7b1550232e98d795b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db383d5e009141f7b1550232e98d795b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/db383d5e009141f7b1550232e98d795b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/db383d5e009141f7b1550232e98d795b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerTestJSON-420436444 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: db383d5e009141f7b1550232e98d795b Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-420436444 Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerTestJSON-420436444-project Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 947f24c332684626a864bf58222aa8cf Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerTestJSON-420436444-project Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 could not be found. Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'aaac7891-f40d-4e3d-a514-8eaf3c42a6d5'} Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 could not be found. Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 could not be found. Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:01.988360 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 could not be found. Jul 20 11:00:01.993149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:01.996047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] Returning 404 to user: Instance aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:01.997463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e0616e1-2f71-43f2-a845-a8be0bd8798b tempest-ImagesOneServerTestJSON-420436444 tempest-ImagesOneServerTestJSON-420436444-project] 10.222.0.79 "GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5" status: 404 len: 111 microversion: 2.1 time: 0.083604 Jul 20 11:00:01.999952 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1413/2757] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:01 2022] GET /compute/v2.1/servers/aaac7891-f40d-4e3d-a514-8eaf3c42a6d5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:02.051130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:02.057039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:02.076309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:02.077389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:02.080286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:02.082220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:02.890082 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77ff12b9-49a6-41c2-8436-928555406bc6 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35" status: 202 len: 0 microversion: 2.1 time: 1.392232 Jul 20 11:00:02.892066 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1345/2758] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:01 2022] DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35 => generated 0 bytes in 1395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:00:02.899688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:02.900876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:02.917579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:02.918925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:02.920032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:02.920753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:02.926307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:02.948599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:02.950152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:02.951566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8961b3f-a239-41d5-9e6f-f9b86821bdf8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2958 microversion: 2.42 time: 0.913508 Jul 20 11:00:02.952412 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1414/2759] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:02 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2958 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:02.960359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:02.961255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:02.982745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:02.983636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:02.984648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:02.985307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:03.117303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:03.131950 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-efc18e8d-0c3f-4432-8ac5-fa1601bc9eb3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1285 microversion: 2.1 time: 0.237321 Jul 20 11:00:03.133000 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1346/2760] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:02 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:03.149599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:03.150200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:03.150875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:03.158354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:03.160004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:03.161042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:03.162278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:03.166386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:03.174077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:03.175417 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-edbc893e-4b4f-4757-bffb-a9eb88e8f3d2 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.221853 Jul 20 11:00:03.177492 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1415/2761] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:02 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:03.198828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8977bf2c-a716-4683-81d8-bf1838281456 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3ea84280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:03.407212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:04.314099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:04.331854 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cea53429-265a-4776-92c3-580da758aded tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 1.187012 Jul 20 11:00:04.341755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1347/2762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:03 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:04.341755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:04.341755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:04.355867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:04.356329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:04.357325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:04.358136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:05.113762 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8977bf2c-a716-4683-81d8-bf1838281456 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb" status: 202 len: 0 microversion: 2.1 time: 1.925285 Jul 20 11:00:05.119885 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1416/2763] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:03 2022] DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb => generated 0 bytes in 1941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:00:05.133538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:05.135491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:05.154411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:05.154870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:05.156356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:05.156819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:05.330870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:05.377585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=22 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:05.389874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:05.402554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:05.404944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:05.406530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d987c32-1ea3-43a4-b895-2514f3863ae7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2937 microversion: 2.42 time: 1.073119 Jul 20 11:00:05.407862 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1348/2764] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:04 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2937 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:05.414305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:05.415727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:05.423450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:05.424159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:05.425625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:05.426328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:05.786794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:05.806727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:05.813768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:05.816689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80721e24-4284-41ab-96a1-3e18f535e40f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.406735 Jul 20 11:00:05.820890 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1349/2765] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:05 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:05.831582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-458986b7-511f-42b7-95fe-abb3b96c41ed req-3ca5fd9f-ebd2-4ba5-95f9-50ab4e7cd905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-unplugged", "status": "completed", "tag": "cb2a6275-25f7-48cc-a346-d8cb908ad01b"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:05.852812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-458986b7-511f-42b7-95fe-abb3b96c41ed req-3ca5fd9f-ebd2-4ba5-95f9-50ab4e7cd905 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:05.854794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-458986b7-511f-42b7-95fe-abb3b96c41ed req-3ca5fd9f-ebd2-4ba5-95f9-50ab4e7cd905 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:05.890604 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-458986b7-511f-42b7-95fe-abb3b96c41ed req-3ca5fd9f-ebd2-4ba5-95f9-50ab4e7cd905 service nova] Creating event network-vif-unplugged:cb2a6275-25f7-48cc-a346-d8cb908ad01b for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:05.898790 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-458986b7-511f-42b7-95fe-abb3b96c41ed req-3ca5fd9f-ebd2-4ba5-95f9-50ab4e7cd905 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076504 Jul 20 11:00:05.900564 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1350/2766] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:05.909470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0318f425-5a89-4672-a08e-088340884a28 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'create', calling method: .version_select at 0x7f2c3f3545e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2123006850", "description": "tempest-description-56844884"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:06.690824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:06.708276 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89adb438-82b9-4627-8fb9-332957d5cf1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 1.586377 Jul 20 11:00:06.709647 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1417/2767] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:05 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:06.732267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:06.733088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:06.740006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:06.741483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:06.742292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:06.742735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:07.157321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:07.175557 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c2c09178-748d-4cfd-b774-0de1fbd3fd12 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.452881 Jul 20 11:00:07.176551 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1418/2768] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:06 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:07.189607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:07.191739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:07.208285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:07.211964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:07.213342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:07.214240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:07.716311 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0318f425-5a89-4672-a08e-088340884a28 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.813237 Jul 20 11:00:07.717989 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1351/2769] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:00:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:07.728519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19ee8b74-687f-43e2-930b-862325a67616 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f41e820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:07.797092 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19ee8b74-687f-43e2-930b-862325a67616 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/be15003d-0485-4cfe-a367-cf8642343005" status: 200 len: 662 microversion: 2.1 time: 0.077117 Jul 20 11:00:07.798203 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1352/2770] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:07 2022] GET /compute/v2.1/images/be15003d-0485-4cfe-a367-cf8642343005 => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:07.806838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:07.807828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:07.816314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:07.816903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:07.820389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:07.820943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:08.003012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:08.042875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:08.046943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:08.057167 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-307b6aad-09b5-417e-98ac-2c6cf79e4532 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.255948 Jul 20 11:00:08.061832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1353/2771] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:07 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:08.076882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25505fdc-efea-4170-b16d-de92e7b0a3ed tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Action: 'update', calling method: .version_select at 0x7f2c3f36e820>, body: {"security_group": {"name": "tempest-sg-hth-1344547507", "description": "tempest-description-hth-702185082"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:08.096359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:08.114786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:08.119339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:08.120863 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-82cc7ba0-40bf-410a-9da2-62f34d578260 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2916 microversion: 2.42 time: 0.943045 Jul 20 11:00:08.121543 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1419/2772] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:07 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2916 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:08.129046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:08.130360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:08.160679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:08.163601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:08.165287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:08.170461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.017128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:09.038109 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-485a6a55-03bd-42e8-a0b3-31a0e17a02bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.914200 Jul 20 11:00:09.039346 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1420/2773] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:08 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:09.045378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-14d53203-6bf3-4163-9b3c-80c4cdd4c1b2 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea8d700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:09.125190 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-14d53203-6bf3-4163-9b3c-80c4cdd4c1b2 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/be15003d-0485-4cfe-a367-cf8642343005" status: 200 len: 662 microversion: 2.1 time: 0.084219 Jul 20 11:00:09.126128 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1421/2774] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:09 2022] GET /compute/v2.1/images/be15003d-0485-4cfe-a367-cf8642343005 => generated 662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:09.137548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-unplugged", "status": "completed", "tag": "06bceed4-358e-4d55-97b4-32bcd00f7e6a"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-unplugged", "status": "completed", "tag": "49fa9fc9-d879-4192-864a-efb8c87674fb"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-unplugged", "status": "completed", "tag": "d4904062-7549-4970-b00f-51b1691b28cb"}, {"server_uuid": "88f5d25c-6e9e-4cb7-947b-7369ca519e7d", "name": "network-vif-plugged", "status": "completed", "tag": "852b9cb3-62a1-4a8a-b9fb-0f995c495622"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-unplugged", "status": "completed", "tag": "55374b6a-08ec-41f5-a6cc-936f12ac152c"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-unplugged", "status": "completed", "tag": "d8034b29-1e24-41aa-ad30-d4f95643b5dc"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:09.173445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.183937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.208207 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Creating event network-vif-unplugged:06bceed4-358e-4d55-97b4-32bcd00f7e6a for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:09.209975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Creating event network-vif-unplugged:49fa9fc9-d879-4192-864a-efb8c87674fb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:09.210817 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Creating event network-vif-unplugged:d4904062-7549-4970-b00f-51b1691b28cb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:09.211566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Creating event network-vif-plugged:852b9cb3-62a1-4a8a-b9fb-0f995c495622 for instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d on n-h1-846219-10 Jul 20 11:00:09.212292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Creating event network-vif-unplugged:55374b6a-08ec-41f5-a6cc-936f12ac152c for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:09.213315 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] Creating event network-vif-unplugged:d8034b29-1e24-41aa-ad30-d4f95643b5dc for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:09.256708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f04b5c10-7519-4c71-9825-864171ebac6a req-7b76af30-6db0-4bb7-9833-c139fad7eb90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1048 microversion: 2.1 time: 0.128686 Jul 20 11:00:09.268210 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1422/2775] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 1048 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:09.291494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9532c3c3-13bb-4a8e-b20b-d63d6cfe727c req-74990ae6-31dc-4195-a631-eb676730b880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db57f917-76fe-4603-91c4-a23c061421df", "tag": "7effb974-44e8-4758-be70-43c689f6f6b8"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:09.330381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9532c3c3-13bb-4a8e-b20b-d63d6cfe727c req-74990ae6-31dc-4195-a631-eb676730b880 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.331045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9532c3c3-13bb-4a8e-b20b-d63d6cfe727c req-74990ae6-31dc-4195-a631-eb676730b880 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.358811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9532c3c3-13bb-4a8e-b20b-d63d6cfe727c req-74990ae6-31dc-4195-a631-eb676730b880 service nova] Creating event network-changed:7effb974-44e8-4758-be70-43c689f6f6b8 for instance db57f917-76fe-4603-91c4-a23c061421df on n-h1-846219-10 Jul 20 11:00:09.376754 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9532c3c3-13bb-4a8e-b20b-d63d6cfe727c req-74990ae6-31dc-4195-a631-eb676730b880 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106671 Jul 20 11:00:09.379427 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1423/2776] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:09.385322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:09.386026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:09.401963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.402420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.403263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.403704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.408619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:09.503634 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25505fdc-efea-4170-b16d-de92e7b0a3ed tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/d4313615-46b1-4a72-9191-8d7cd631234f" status: 200 len: 217 microversion: 2.1 time: 1.440526 Jul 20 11:00:09.504676 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1354/2777] 10.222.0.79 () {60 vars in 1289 bytes} [Wed Jul 20 11:00:08 2022] PUT /compute/v2.1/os-security-groups/d4313615-46b1-4a72-9191-8d7cd631234f => generated 217 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:09.511053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:09.512075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:09.525555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.529907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.532520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.534592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.783912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:09.809986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:09.813321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:09.815644 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76a245f1-071f-4a67-b549-ec09dd629dfa tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.309625 Jul 20 11:00:09.829893 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1355/2778] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:09 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:09.839434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:09.840389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:09.853645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.854384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.855514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:09.856121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:09.963095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:09.972386 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c7df5c1-d089-4499-83e8-88631597bb78 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.591472 Jul 20 11:00:09.974065 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1424/2779] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:09 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:09.981789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c02d0710-aa14-4574-b551-6c0aa92237d1 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3eb31040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:10.317801 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c02d0710-aa14-4574-b551-6c0aa92237d1 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/d4313615-46b1-4a72-9191-8d7cd631234f" status: 200 len: 217 microversion: 2.1 time: 0.341477 Jul 20 11:00:10.319828 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1425/2780] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 11:00:09 2022] GET /compute/v2.1/os-security-groups/d4313615-46b1-4a72-9191-8d7cd631234f => generated 217 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:10.324713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:10.325321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:10.345318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:10.346301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:10.347088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:10.347663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:10.391496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:10.408294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:10.417077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:10.433779 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e4c5de77-5b20-4195-99fd-2e3a7239c688 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2870 microversion: 2.42 time: 0.597844 Jul 20 11:00:10.442533 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1356/2781] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:09 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2870 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:10.464633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-705b43bf-9403-4d42-8b9a-ede993bfe615 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f44dee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:10.937492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:10.951483 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-17135e12-e7f8-498c-b31a-a4473fc9a12e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.629807 Jul 20 11:00:10.952939 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1426/2782] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:10 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:10.959695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-72cd39c2-5d37-407b-8b43-dd8c084cd6cb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea8dca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.042692 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-72cd39c2-5d37-407b-8b43-dd8c084cd6cb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/b10aa3e3-23f4-430c-87d9-39952d3ebba3" status: 200 len: 660 microversion: 2.1 time: 0.084315 Jul 20 11:00:11.043788 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1427/2783] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:10 2022] GET /compute/v2.1/images/b10aa3e3-23f4-430c-87d9-39952d3ebba3 => generated 660 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:11.048641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.049269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:11.058618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.059078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.060739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.061362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.311908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:11.329965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:11.337422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:11.341233 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c14ff733-3534-464a-a55d-fc52a63a4b7f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.294156 Jul 20 11:00:11.351726 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1428/2784] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:11 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:11.373585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.374222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:11.384854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.390848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.392014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.394567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.414925 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-705b43bf-9403-4d42-8b9a-ede993bfe615 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d4313615-46b1-4a72-9191-8d7cd631234f" status: 202 len: 0 microversion: 2.1 time: 0.970025 Jul 20 11:00:11.416432 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1357/2785] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:10 2022] DELETE /compute/v2.1/os-security-groups/d4313615-46b1-4a72-9191-8d7cd631234f => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:00:11.425970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b260d7dc-43a2-4db4-9f5e-f7e8e6cb8dfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f3ee430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.548008 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b260d7dc-43a2-4db4-9f5e-f7e8e6cb8dfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/b10aa3e3-23f4-430c-87d9-39952d3ebba3" status: 200 len: 660 microversion: 2.1 time: 0.130315 Jul 20 11:00:11.553497 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1358/2786] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:11 2022] GET /compute/v2.1/images/b10aa3e3-23f4-430c-87d9-39952d3ebba3 => generated 660 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:11.574143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.581903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:11.599387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.600520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.601826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.602706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.652759 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a HTTP/1.1 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '7020321d-3803-48d0-80f8-43b809906d2a'} Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:11.654578 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9ea22675-169e-4cc2-8071-3ec1494a6723 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 404 len: 111 microversion: 2.1 time: 0.101554 Jul 20 11:00:11.659258 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1359/2787] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:11 2022] DELETE /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:11.662920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.664154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:11.671511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.671976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.680819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.681429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.831767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:11.843268 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-60d6b8bf-69e3-4322-b120-51860707bd98 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.487045 Jul 20 11:00:11.844272 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1429/2788] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:11 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:11.853284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e4942558-de75-4d43-ad85-e606f7776d33 req-daa89b9b-cc0c-47bd-abec-99dd692a641b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-deleted", "tag": "d8034b29-1e24-41aa-ad30-d4f95643b5dc"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:11.883573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e4942558-de75-4d43-ad85-e606f7776d33 req-daa89b9b-cc0c-47bd-abec-99dd692a641b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:11.884031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e4942558-de75-4d43-ad85-e606f7776d33 req-daa89b9b-cc0c-47bd-abec-99dd692a641b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:11.936972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e4942558-de75-4d43-ad85-e606f7776d33 req-daa89b9b-cc0c-47bd-abec-99dd692a641b service nova] Creating event network-vif-deleted:d8034b29-1e24-41aa-ad30-d4f95643b5dc for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:11.956167 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e4942558-de75-4d43-ad85-e606f7776d33 req-daa89b9b-cc0c-47bd-abec-99dd692a641b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109765 Jul 20 11:00:11.961220 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1430/2789] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:11.996482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:11.997212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: 7020321d-3803-48d0-80f8-43b809906d2a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:12.018937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.019420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.020207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.020647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.072621 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a HTTP/1.1 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '7020321d-3803-48d0-80f8-43b809906d2a'} Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.074321 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. Jul 20 11:00:12.078884 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.080378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Instance 7020321d-3803-48d0-80f8-43b809906d2a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:12.081252 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4070614a-06d9-4704-83da-3b747f4ebfb8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a" status: 404 len: 111 microversion: 2.1 time: 0.102297 Jul 20 11:00:12.084867 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1431/2790] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:11 2022] GET /compute/v2.1/servers/7020321d-3803-48d0-80f8-43b809906d2a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:12.087512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.088135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:12.097475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:12.098905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.111844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.112704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.113699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.114316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.118973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.122286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.128717 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8309a41-970c-4285-9c5d-340bb06f1d63 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2824 microversion: 2.42 time: 0.469923 Jul 20 11:00:12.145352 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1360/2791] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:11 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2824 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:12.152419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3e7b6040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.203197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:00:12.204211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group f7fc2620-5666-4970-8d3d-326b258234eb not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:00:12.204996 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.204996 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb HTTP/1.1 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f7fc2620-5666-4970-8d3d-326b258234eb'} Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:00:12.207764 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] Jul 20 11:00:12.212499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.221880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group f7fc2620-5666-4970-8d3d-326b258234eb does not exist Jul 20 11:00:12.221880 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-ed3249a4-f386-41df-bc1c-7bca8356e8d2'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:12.223308 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-681fe149-0284-495e-90f9-2e6ca7e1c961 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb" status: 404 len: 194 microversion: 2.1 time: 0.076519 Jul 20 11:00:12.224453 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1361/2792] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:12 2022] DELETE /compute/v2.1/os-security-groups/f7fc2620-5666-4970-8d3d-326b258234eb => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:12.233250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f2d0d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.353671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:00:12.354280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 291e7663-cb46-4813-b699-858df8911e35 not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:00:12.354818 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.354818 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35 HTTP/1.1 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '291e7663-cb46-4813-b699-858df8911e35'} Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:00:12.361832 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 291e7663-cb46-4813-b699-858df8911e35 does not exist Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-2639aafa-fba3-4e52-bc99-79ed57530249'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:12.366839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-baf9b8ba-2249-4672-ba53-db773a8fe0e3 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35" status: 404 len: 194 microversion: 2.1 time: 0.134012 Jul 20 11:00:12.369929 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1362/2793] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:12 2022] DELETE /compute/v2.1/os-security-groups/291e7663-cb46-4813-b699-858df8911e35 => generated 194 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:12.382682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.383220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:12.404283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.404695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.405504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.405951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.512722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.521177 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db12cfc8-2385-44db-a8e0-8c75d3aaccb6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.437955 Jul 20 11:00:12.539564 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1432/2794] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:12 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:12.547770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f11c8b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.572243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.583678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.588314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:12.592588 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9f935a8-e628-4b15-a0d9-85ab71b37491 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.223425 Jul 20 11:00:12.594207 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1363/2795] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:12 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:12.643494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:00:12.644216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:00:12.644856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.644856 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a HTTP/1.1 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a'} Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:00:12.647639 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a does not exist Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-8c630242-f3f9-4623-8878-e61a7d85ca97'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:12.655977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41dbbe62-ba5f-4abb-b191-2bbca2211584 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a" status: 404 len: 194 microversion: 2.1 time: 0.110499 Jul 20 11:00:12.665673 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1433/2796] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:12 2022] DELETE /compute/v2.1/os-security-groups/3ad9ee63-4d32-4cd4-94d6-0f3ce7afed6a => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:12.665964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f3eeb80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.868136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:12.868782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:12.891198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.891685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:12.892451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:12.892888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:13.217780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:00:13.218385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group f00a5e59-c4db-400d-9038-a962cbb491f5 not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:00:13.218921 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.218921 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5 HTTP/1.1 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f00a5e59-c4db-400d-9038-a962cbb491f5'} Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:00:13.220883 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] Jul 20 11:00:13.225789 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.231368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group f00a5e59-c4db-400d-9038-a962cbb491f5 does not exist Jul 20 11:00:13.231368 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-3d0b4f35-a5fd-4fc6-9715-687f0b5c376d'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:13.231368 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b23e6f1-6fff-4b9b-a93e-446688578172 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5" status: 404 len: 194 microversion: 2.1 time: 0.570681 Jul 20 11:00:13.231368 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1364/2797] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:12 2022] DELETE /compute/v2.1/os-security-groups/f00a5e59-c4db-400d-9038-a962cbb491f5 => generated 194 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:13.242578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c614fc1d-dc2b-446f-b303-94c870d66949 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f2e8310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:13.367809 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c614fc1d-dc2b-446f-b303-94c870d66949 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c9c39c95-b887-48c7-b10f-4f7cf6eb4835" status: 200 len: 662 microversion: 2.1 time: 0.135095 Jul 20 11:00:13.375039 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1365/2798] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:13 2022] GET /compute/v2.1/images/c9c39c95-b887-48c7-b10f-4f7cf6eb4835 => generated 662 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:13.380081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:13.381752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:13.389231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:13.390023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:13.391050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:13.391746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:13.410345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:13.421902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef4e5805-d780-4cec-9e4e-cb33b7ac998b tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1308 microversion: 2.1 time: 0.563267 Jul 20 11:00:13.422732 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1434/2799] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:12 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:13.432876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f11ce50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:13.509359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:00:13.510513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:00:13.511338 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.511338 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a HTTP/1.1 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '983df0e4-6410-4fb0-9ea8-ca6b55d06f2a'} Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:00:13.513566 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] Jul 20 11:00:13.517715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.524727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 983df0e4-6410-4fb0-9ea8-ca6b55d06f2a does not exist Jul 20 11:00:13.524727 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-46d43a94-8f39-4490-b7ed-297bd644a643'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:13.525888 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-777e4a72-d313-4ea6-b751-8244106593f8 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a" status: 404 len: 194 microversion: 2.1 time: 0.100608 Jul 20 11:00:13.526878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1435/2800] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:13 2022] DELETE /compute/v2.1/os-security-groups/983df0e4-6410-4fb0-9ea8-ca6b55d06f2a => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:13.536777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e300721a-c486-48c4-b1df-0300376e53f1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f84d1f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:13.605985 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e300721a-c486-48c4-b1df-0300376e53f1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c9c39c95-b887-48c7-b10f-4f7cf6eb4835" status: 200 len: 662 microversion: 2.1 time: 0.077848 Jul 20 11:00:13.614689 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1436/2801] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:13 2022] GET /compute/v2.1/images/c9c39c95-b887-48c7-b10f-4f7cf6eb4835 => generated 662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:13.619882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c4c3c7ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:13.679525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:00:13.680526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Neutron security group 3b47fd7f-148b-46c3-bde8-96f58e3186da not found {{(pid=125885) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:00:13.681482 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.681482 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da HTTP/1.1 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3b47fd7f-148b-46c3-bde8-96f58e3186da'} Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:00:13.683722 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] Jul 20 11:00:13.688110 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:13.695312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Security group 3b47fd7f-148b-46c3-bde8-96f58e3186da does not exist Jul 20 11:00:13.695312 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-80ef8f79-4352-47d1-9393-0f0c85095fd4'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:13.696566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e7d6e32-8f4d-4321-829f-14800a959c69 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da" status: 404 len: 194 microversion: 2.1 time: 0.080623 Jul 20 11:00:13.697819 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1437/2802] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:13 2022] DELETE /compute/v2.1/os-security-groups/3b47fd7f-148b-46c3-bde8-96f58e3186da => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:13.707674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:13.712493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:13.737971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:13.738643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:13.739692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:13.743493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:14.053703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.071449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.073143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.077436 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-780bb4ca-94bc-4595-84d5-988d6b66a64d tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2710 microversion: 2.42 time: 0.700980 Jul 20 11:00:14.081992 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1366/2803] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:13 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2710 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:14.087829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:14.088797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:14.095332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:14.096161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:14.097218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:14.097894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:14.295092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.308454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.315298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.320800 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a86b8d2a-da20-42b7-be09-56db27a28e79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1365 microversion: 2.47 time: 0.236921 Jul 20 11:00:14.321408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1367/2804] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:14 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:14.332219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:14.333885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:14.351747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:14.352201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:14.352988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:14.353423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:14.423098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:14.479764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:14.487513 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fe4783b-8f1f-4630-af3d-8ab7296f639c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.788341 Jul 20 11:00:14.488096 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1438/2805] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:13 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:14.499692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:14.508303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2020354936", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:14.606807 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f697d361-7adc-4f9a-930b-7cd53d6bedaf tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 204 len: 0 microversion: 2.1 time: 0.283820 Jul 20 11:00:14.608160 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1368/2806] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:14 2022] DELETE /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:00:14.636688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] validate_networks() for None {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:00:15.030113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1646387466", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "1c9bce5f-9715-45a9-ac19-0e9e2de505c3"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:15.123582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] validate_networks() for [('1c9bce5f-9715-45a9-ac19-0e9e2de505c3', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:00:15.507221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:00:15.507659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:00:15.508146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:00:15.508549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:00:15.508964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:00:15.527158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:15.528038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:15.531253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:15.532924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:15.614899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Getting quotas for project 33bac6bd240c4b59aa1dcae4c652205d. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:00:15.647465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Getting quotas for user 9f03704b0dc44751ab391117a31449a8 and project 33bac6bd240c4b59aa1dcae4c652205d. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:00:15.670202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:00:15.672601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:00:15.781291 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-83d07906-724a-44f0-8810-5c3cd7d75b61 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284704 Jul 20 11:00:15.788185 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1439/2807] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:00:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:00:15.793621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a72b8304-811a-46fc-b4e7-c05f36f781f1 req-37ac5885-3f4c-4e1a-8491-d9149d3f4f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-deleted", "tag": "d4904062-7549-4970-b00f-51b1691b28cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:15.822589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a72b8304-811a-46fc-b4e7-c05f36f781f1 req-37ac5885-3f4c-4e1a-8491-d9149d3f4f56 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:15.823553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a72b8304-811a-46fc-b4e7-c05f36f781f1 req-37ac5885-3f4c-4e1a-8491-d9149d3f4f56 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:15.841419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a72b8304-811a-46fc-b4e7-c05f36f781f1 req-37ac5885-3f4c-4e1a-8491-d9149d3f4f56 service nova] Creating event network-vif-deleted:d4904062-7549-4970-b00f-51b1691b28cb for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:15.853642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a72b8304-811a-46fc-b4e7-c05f36f781f1 req-37ac5885-3f4c-4e1a-8491-d9149d3f4f56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063716 Jul 20 11:00:15.854935 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1440/2808] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:15.867053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:15.868715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:15.886316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:15.894984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:15.896111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:15.899400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:16.385460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:16.402606 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5bac99fa-d753-404b-a520-906c99f3f6e5 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1488 microversion: 2.1 time: 0.546142 Jul 20 11:00:16.416623 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1441/2809] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:15 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1488 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:16.422854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:16.424099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:16.431503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:16.432426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:16.433715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:16.434423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:16.729720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:00:16.731758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:00:16.733502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:00:16.735787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:00:16.739417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:00:16.757194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:16.769732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:16.772220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:16.773039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:16.838326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:16.856619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Getting quotas for project 8577fe0412844a95880d2da8dfd934ea. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:00:16.892029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Getting quotas for user 3839588956754d7c9503304f4a03d1dc and project 8577fe0412844a95880d2da8dfd934ea. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:00:16.911374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:00:16.917532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:00:16.991837 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b8ced09d-6ea3-47e5-adfe-74ac87bdbc8c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.382101 Jul 20 11:00:16.993418 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1369/2810] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:00:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:00:17.002485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:17.003660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:17.014553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:17.016197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:17.017691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:17.018602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:17.197431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.213069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-918b5414-e9cb-46de-b456-ef8b978ee51a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1643 microversion: 2.1 time: 0.795201 Jul 20 11:00:17.213661 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1442/2811] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:16 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1643 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:17.229111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:17.230299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:17.240954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:17.241636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:17.242532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:17.252583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:17.469869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.497211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.500525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.503466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd60f49b-d9f8-432b-8b33-0dc1d21364d7 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1371 microversion: 2.47 time: 0.288049 Jul 20 11:00:17.522066 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1443/2812] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:17 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:17.529467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:17.532030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:17.545631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:17.546528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:17.547690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:17.549377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:17.628476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.649472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.660038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:17.661714 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a4dd200-2ad6-4e7f-9c07-bc128a750ef7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2373 microversion: 2.42 time: 0.667044 Jul 20 11:00:17.663404 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1370/2813] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:16 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2373 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:17.678812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1861926242", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:17.784462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:00:18.126131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:18.137936 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59475560-c003-4a61-8a27-69e8a12b9b24 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.614183 Jul 20 11:00:18.138985 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1444/2814] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:17 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:18.155887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1820273519"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:18.157512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:18.191993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:18.193780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:18.194747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:18.197023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:18.462295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:00:18.462843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:00:18.463558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:00:18.464286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:00:18.465053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:00:18.493594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:18.494569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:18.497630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:18.499250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:18.561805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Getting quotas for project 33bac6bd240c4b59aa1dcae4c652205d. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:00:18.586943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Getting quotas for user 9f03704b0dc44751ab391117a31449a8 and project 33bac6bd240c4b59aa1dcae4c652205d. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:00:18.611967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:00:18.617429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:00:18.717460 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62aa382e-b59f-4474-a02f-e21dbcecd162 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053058 Jul 20 11:00:18.725038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1371/2815] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:00:18.744416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:18.753508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:18.806808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:18.813354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:18.814681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:18.815432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.000221 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f5bab228-06b6-446d-a9a5-99daff4aa6cd tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "POST /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.848137 Jul 20 11:00:19.003713 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1445/2816] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:00:18 2022] POST /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 11:00:19.023326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1ea485d9-0724-478d-8ee4-819f086ecbfa req-abb7fccd-f30d-4c1e-a51b-a9776737a846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-deleted", "tag": "cb2a6275-25f7-48cc-a346-d8cb908ad01b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:19.055820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1ea485d9-0724-478d-8ee4-819f086ecbfa req-abb7fccd-f30d-4c1e-a51b-a9776737a846 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.057293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1ea485d9-0724-478d-8ee4-819f086ecbfa req-abb7fccd-f30d-4c1e-a51b-a9776737a846 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.108314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1ea485d9-0724-478d-8ee4-819f086ecbfa req-abb7fccd-f30d-4c1e-a51b-a9776737a846 service nova] Creating event network-vif-deleted:cb2a6275-25f7-48cc-a346-d8cb908ad01b for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:19.129794 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1ea485d9-0724-478d-8ee4-819f086ecbfa req-abb7fccd-f30d-4c1e-a51b-a9776737a846 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121431 Jul 20 11:00:19.135421 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1446/2817] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:19.151902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:19.152648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:19.173581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.174029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.174820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.182364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.273216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.274840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.275339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lazy-loading 'fault' on Instance uuid bfa1e2c8-3a45-4264-a07f-332f65286c48 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:19.376530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:19.387287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b794f374-62a3-404c-bc97-6b5bd5923552 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1212 microversion: 2.1 time: 0.661000 Jul 20 11:00:19.388332 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1372/2818] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:18 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1212 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:19.397262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7f8cb980-2dd2-4956-b5a2-afd0e66841ac req-9b8840cb-2994-464d-a174-c76650ee7752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa1e2c8-3a45-4264-a07f-332f65286c48", "name": "network-vif-deleted", "tag": "ee7e336d-1377-4cfe-a7b6-77db083f1544"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:19.409324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7f8cb980-2dd2-4956-b5a2-afd0e66841ac req-9b8840cb-2994-464d-a174-c76650ee7752 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.410042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7f8cb980-2dd2-4956-b5a2-afd0e66841ac req-9b8840cb-2994-464d-a174-c76650ee7752 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.447267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da03854a50f4c55b53f6aabef37678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0e229c89d74c95bdca8735c4c660c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:19.461821 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-896b64a4-2408-403f-9d82-a0b9c9c345e7 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 200 len: 1306 microversion: 2.1 time: 0.324908 Jul 20 11:00:19.465683 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7f8cb980-2dd2-4956-b5a2-afd0e66841ac req-9b8840cb-2994-464d-a174-c76650ee7752 service nova] Creating event network-vif-deleted:ee7e336d-1377-4cfe-a7b6-77db083f1544 for instance bfa1e2c8-3a45-4264-a07f-332f65286c48 on n-h2-846219-10 Jul 20 11:00:19.472416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7f8cb980-2dd2-4956-b5a2-afd0e66841ac req-9b8840cb-2994-464d-a174-c76650ee7752 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082352 Jul 20 11:00:19.483083 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1373/2819] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:19.492688 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1447/2820] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:19 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 1306 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:19.496293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:19.497040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:19.497646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:19.498279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:19.517300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.517757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.518728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.520701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.523457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.526050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:19.529749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.531225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:19.588113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:20.042007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.057043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.058638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.059928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-281f26f3-4343-4eb1-9da5-d50fe92815ce tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1371 microversion: 2.47 time: 0.575686 Jul 20 11:00:20.060497 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1374/2821] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:19 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:20.085326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:20.085956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:20.092988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.093443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:20.094233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.094715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:20.435447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.444740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a90b1c3e-430e-4a1f-b9ff-848b04ac3cfe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1214 microversion: 2.1 time: 0.383146 Jul 20 11:00:20.445692 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1375/2822] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:20 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1214 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:20.460655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f8429d40-5c02-436d-9f2b-e0d1b2e99ace tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f3ee0d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:20.533501 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f8429d40-5c02-436d-9f2b-e0d1b2e99ace tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae" status: 200 len: 1414 microversion: 2.1 time: 0.085529 Jul 20 11:00:20.534468 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1376/2823] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:20 2022] GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:20.540809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:20.541802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:20.550675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.551434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:20.552454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.553988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:20.666814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.684451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.685980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:20.687236 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d4b8d50-a55d-4418-aa10-48d853cdc788 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 2213 microversion: 2.42 time: 1.193456 Jul 20 11:00:20.687845 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1448/2824] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:19 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 2213 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:20.704582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e0d36234-eb86-4dd5-9169-41735eb5ab03 req-16b29b79-691e-4e64-90e4-865d24290330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f917-76fe-4603-91c4-a23c061421df", "name": "network-vif-plugged", "status": "completed", "tag": "7effb974-44e8-4758-be70-43c689f6f6b8"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:20.719069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e0d36234-eb86-4dd5-9169-41735eb5ab03 req-16b29b79-691e-4e64-90e4-865d24290330 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.720223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e0d36234-eb86-4dd5-9169-41735eb5ab03 req-16b29b79-691e-4e64-90e4-865d24290330 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:20.753717 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e0d36234-eb86-4dd5-9169-41735eb5ab03 req-16b29b79-691e-4e64-90e4-865d24290330 service nova] Creating event network-vif-plugged:7effb974-44e8-4758-be70-43c689f6f6b8 for instance db57f917-76fe-4603-91c4-a23c061421df on n-h1-846219-10 Jul 20 11:00:20.779941 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e0d36234-eb86-4dd5-9169-41735eb5ab03 req-16b29b79-691e-4e64-90e4-865d24290330 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079147 Jul 20 11:00:20.782326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1449/2825] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:20.790378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:20.791403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:20.802194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.803837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:20.804772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:20.828307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.055834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:21.069481 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f50ded1-0a46-4e1e-92a7-bcf673aeb17e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1274 microversion: 2.1 time: 0.284609 Jul 20 11:00:21.070182 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1450/2826] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:20 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:21.079137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:21.079781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] [instance: bfa1e2c8-3a45-4264-a07f-332f65286c48] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:21.094871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.095305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.096065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.096504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.117118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] HTTP exception thrown: Instance bfa1e2c8-3a45-4264-a07f-332f65286c48 could not be found. Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Request method failure captured: Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 HTTP/1.1 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_UfruwKJwxRs1O3kWo8koxW8OTKK3bccEYE81vM-FAn_5JZEekZGWlt35PQaVC243rAd7uiz67Am2JI5SQStN_N6PNeRuK9HAsNnk9D_a_TDxt4CK_090xtP9AuE9a-HXfWpojD5nLBYrBlFfUmW8vjxDhLKFGy6l5V7TTgeIaSpY Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c0e229c89d74c95bdca8735c4c660c3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c0e229c89d74c95bdca8735c4c660c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 4c0e229c89d74c95bdca8735c4c660c3 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-954681427 Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2da03854a50f4c55b53f6aabef37678c Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupsTestJSON-954681427-project Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance bfa1e2c8-3a45-4264-a07f-332f65286c48 could not be found. Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'bfa1e2c8-3a45-4264-a07f-332f65286c48'} Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa1e2c8-3a45-4264-a07f-332f65286c48 could not be found. Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa1e2c8-3a45-4264-a07f-332f65286c48 could not be found. Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:21.124631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa1e2c8-3a45-4264-a07f-332f65286c48 could not be found. Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Returning 404 to user: Instance bfa1e2c8-3a45-4264-a07f-332f65286c48 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e63c2484-4ab0-460f-be2b-fd3a19054b8a tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48" status: 404 len: 111 microversion: 2.1 time: 0.053067 Jul 20 11:00:21.134039 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1451/2827] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:21 2022] GET /compute/v2.1/servers/bfa1e2c8-3a45-4264-a07f-332f65286c48 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:21.139075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dfc5a0fe-e87e-4198-955c-446258809868 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3eb31ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:21.213329 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dfc5a0fe-e87e-4198-955c-446258809868 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae" status: 200 len: 1414 microversion: 2.1 time: 0.086514 Jul 20 11:00:21.214440 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1452/2828] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:21 2022] GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae => generated 1414 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:21.220880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:21.221790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:21.230861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.231676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.232807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.233985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.400082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:21.418975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:21.421529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:21.423355 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65f25d39-e898-4ba5-8c5a-af1622612cec tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1356 microversion: 2.47 time: 0.207900 Jul 20 11:00:21.426310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:21.446069 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1453/2829] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:21 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1356 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:21.447928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b5038e4-cd31-4982-9be1-ff23bdb315ea tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.912221 Jul 20 11:00:21.448872 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1377/2830] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:20 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:21.453291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6103a025-279b-40c2-96e8-b9cb4c2cadd9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3ea84550>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:21.453975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b93b7f7-3d4f-4ef2-8da7-446321594900 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e7a1940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:21.796073 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b93b7f7-3d4f-4ef2-8da7-446321594900 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae" status: 204 len: 0 microversion: 2.1 time: 0.345577 Jul 20 11:00:21.798717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1378/2831] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:21 2022] DELETE /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:00:21.821564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b5836124-13f2-4b3e-957d-27ea7342a3fa req-0d7461ef-02f7-442f-b8c7-0be1bd88bc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-deleted", "tag": "06bceed4-358e-4d55-97b4-32bcd00f7e6a"}, {"server_uuid": "ea40658d-08bc-47b4-80de-6540f86e0472", "name": "network-vif-deleted", "tag": "55374b6a-08ec-41f5-a6cc-936f12ac152c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:21.846694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b5836124-13f2-4b3e-957d-27ea7342a3fa req-0d7461ef-02f7-442f-b8c7-0be1bd88bc08 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.847457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b5836124-13f2-4b3e-957d-27ea7342a3fa req-0d7461ef-02f7-442f-b8c7-0be1bd88bc08 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.878869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b5836124-13f2-4b3e-957d-27ea7342a3fa req-0d7461ef-02f7-442f-b8c7-0be1bd88bc08 service nova] Creating event network-vif-deleted:06bceed4-358e-4d55-97b4-32bcd00f7e6a for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:21.879974 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b5836124-13f2-4b3e-957d-27ea7342a3fa req-0d7461ef-02f7-442f-b8c7-0be1bd88bc08 service nova] Creating event network-vif-deleted:55374b6a-08ec-41f5-a6cc-936f12ac152c for instance ea40658d-08bc-47b4-80de-6540f86e0472 on n-h2-846219-10 Jul 20 11:00:21.894381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b5836124-13f2-4b3e-957d-27ea7342a3fa req-0d7461ef-02f7-442f-b8c7-0be1bd88bc08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085452 Jul 20 11:00:21.895709 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1379/2832] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:21.910926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:21.920014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:21.921216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Searching by: {'deleted': False, 'project_id': 'd77017ded15e4f81a415119025e888ce'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:00:21.935530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.937217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:21.939812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:21.940541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:22.223199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:00:22.472055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:22.513035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:22.514340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:22.550703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:22.574551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:22.813340 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1841b053-272e-432a-aaa1-270d1f624714 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.915354 Jul 20 11:00:22.814639 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1380/2833] 10.222.0.79 () {60 vars in 1186 bytes} [Wed Jul 20 11:00:21 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:22.820726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:22.823569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:22.852474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:22.854216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:22.856841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:22.857647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:22.918949 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6103a025-279b-40c2-96e8-b9cb4c2cadd9 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/67859ea8-3646-49e8-83ad-7b5236513355" status: 202 len: 0 microversion: 2.1 time: 1.471102 Jul 20 11:00:22.921373 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1454/2834] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:21 2022] DELETE /compute/v2.1/os-security-groups/67859ea8-3646-49e8-83ad-7b5236513355 => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:00:22.934247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:22.941778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:22.983623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:22.985376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:22.989114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:22.992888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:23.073864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:23.093451 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c934fd51-36b0-43dc-95ca-bbb02817d36c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1276 microversion: 2.1 time: 0.275077 Jul 20 11:00:23.097551 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1381/2835] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:22 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:23.109816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78a683ed-f8fe-46e1-969b-c35a605d9332 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3e7a1820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:23.201052 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-78a683ed-f8fe-46e1-969b-c35a605d9332 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Image not found. Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78a683ed-f8fe-46e1-969b-c35a605d9332 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae HTTP/1.1 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '13727743-8121-4f14-95f5-8a7c2c3493ae'} Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 13727743-8121-4f14-95f5-8a7c2c3493ae Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 11:00:23.205134 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13727743-8121-4f14-95f5-8a7c2c3493ae could not be found. Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:00:23.211983 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:23.219217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78a683ed-f8fe-46e1-969b-c35a605d9332 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:23.219217 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78a683ed-f8fe-46e1-969b-c35a605d9332 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae" status: 404 len: 62 microversion: 2.1 time: 0.119850 Jul 20 11:00:23.220843 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1382/2836] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:23 2022] GET /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:00:23.244398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:23.249428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:23.266521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:23.291738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:23.292866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:23.301101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:23.305091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:23.305672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:23.307693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:23.310731 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05320cb3-0ca2-4a71-90a5-c05b22f92586 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.385525 Jul 20 11:00:23.333684 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1455/2837] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:22 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:23.341366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:23.342371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:23.349591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:23.350459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:23.351590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:23.352270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:24.294547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:24.311336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d909bd0-b180-42b5-9826-3b70d33302d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1327 microversion: 2.1 time: 0.975393 Jul 20 11:00:24.311939 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1456/2838] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:23 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1327 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:24.321038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:24.321552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:24.335588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:24.346631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:24.347588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:24.348792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:24.349978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:24.364479 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a658d23e-2fc2-4710-8081-8ddd41496dd8 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1316 microversion: 2.1 time: 1.141899 Jul 20 11:00:24.377732 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1383/2839] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:23 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1316 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:24.393679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:24.415528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ab2d038-77b8-4984-aad7-40cd2ff819c4 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] Calling method '.version_select at 0x7f2c3f2e8310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:24.523252 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41cd8cd0-88b4-49e4-97a4-10f8a5420e1b tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 204 len: 0 microversion: 2.47 time: 0.208259 Jul 20 11:00:24.525148 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1457/2840] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:00:24 2022] DELETE /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:00:24.541915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:24.543527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:24.558430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:24.558897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:24.560051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:24.560720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.206665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:25.234119 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03da1f51-2937-4ecf-9577-4fd6edd4ad15 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1506 microversion: 2.1 time: 0.705966 Jul 20 11:00:25.234924 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1458/2841] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:24 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1506 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:25.257082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7dffca11-198d-4deb-b0e8-cffb49836b84 req-b746450d-886a-48fb-8ebe-4890fda0e454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47de751-278e-428b-ab72-71d40df77433", "tag": "bed05db6-be83-478a-83ec-6ef4461a3060"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:25.291301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7dffca11-198d-4deb-b0e8-cffb49836b84 req-b746450d-886a-48fb-8ebe-4890fda0e454 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.291758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7dffca11-198d-4deb-b0e8-cffb49836b84 req-b746450d-886a-48fb-8ebe-4890fda0e454 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.311954 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7dffca11-198d-4deb-b0e8-cffb49836b84 req-b746450d-886a-48fb-8ebe-4890fda0e454 service nova] Creating event network-changed:bed05db6-be83-478a-83ec-6ef4461a3060 for instance d47de751-278e-428b-ab72-71d40df77433 on n-h2-846219-10 Jul 20 11:00:25.333402 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7dffca11-198d-4deb-b0e8-cffb49836b84 req-b746450d-886a-48fb-8ebe-4890fda0e454 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095494 Jul 20 11:00:25.334364 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1459/2842] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:25.340365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:25.344107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:25.363085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.363845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.365339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.365965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.446901 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ab2d038-77b8-4984-aad7-40cd2ff819c4 tempest-SecurityGroupsTestJSON-954681427 tempest-SecurityGroupsTestJSON-954681427-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/8e276036-3c93-4d3a-b91c-b74677b86b6e" status: 202 len: 0 microversion: 2.1 time: 1.064123 Jul 20 11:00:25.448162 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1384/2843] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:00:24 2022] DELETE /compute/v2.1/os-security-groups/8e276036-3c93-4d3a-b91c-b74677b86b6e => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:00:25.453393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:25.454257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:25.470917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.471799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.472751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.473357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.568590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:25.651356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:25.662590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:25.667766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:25.669588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:25.677019 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56f90a84-048d-4b59-902f-3d4582bb8ce1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.226427 Jul 20 11:00:25.681366 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1385/2844] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:25 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:25.686450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:25.692119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:25.714720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.715722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.717194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.717841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.872118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:25.906055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebb4edea-8671-43b6-81e6-47aefecb184e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 0.567104 Jul 20 11:00:25.909731 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1460/2845] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:25 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:25.935122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:25.935948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:25.951048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.951816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.953018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:25.956846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:25.986026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:26.002733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:26.011324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:26.013036 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-51a2d071-6924-4d23-bbfb-9a1907cd832c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1362 microversion: 2.47 time: 0.330362 Jul 20 11:00:26.018775 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1386/2846] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:25 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:26.025827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:26.036438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:26.085777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:26.086360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:26.087444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:26.087894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.151440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:27.166170 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ba79d897-584c-425a-85f3-87fe1135d8ec tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1316 microversion: 2.1 time: 1.145660 Jul 20 11:00:27.167255 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1387/2847] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:26 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1316 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:27.180902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:27.181635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:27.194749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.196750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.197888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.199751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.287496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:27.298222 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f05d7df7-47c9-4606-ab93-236b7a2db765 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1507 microversion: 2.1 time: 1.386556 Jul 20 11:00:27.298832 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1461/2848] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:25 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1507 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:27.310994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:27.311911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:27.345218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.352016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.353145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.353775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.548037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:27.587213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:27.598957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:27.604118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebd3a23b-64b8-42b5-b987-d536b84a4cce tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.304137 Jul 20 11:00:27.618067 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1462/2849] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:27 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:27.618067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:27.618067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:27.627929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.629291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.631248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.632598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.692726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:27.715119 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81ba75a9-7ef5-4cee-b52a-b49b70a9de37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1506 microversion: 2.1 time: 0.546072 Jul 20 11:00:27.720399 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1388/2850] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:27 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1506 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:27.731781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:27.733402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:27.746508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.747790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.749948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.751051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.915091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:27.916370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:27.917498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lazy-loading 'fault' on Instance uuid a7830f1e-765d-4627-8414-3a477f83bc65 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:28.362715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:28.382232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:28.422801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:28.426900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:28.431429 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ba92c0d0-0970-4f5e-9aeb-9fe32245fa9a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 200 len: 1367 microversion: 2.47 time: 0.707303 Jul 20 11:00:28.434829 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1389/2851] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:27 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 1367 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:28.466400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:28.469012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:28.519511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:28.520515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:28.523703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:28.528337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.000982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:29.013492 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49e3214c-c866-40a2-8da8-6586d0ba1501 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 1.406944 Jul 20 11:00:29.014879 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1463/2852] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:27 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:29.020706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7c921d36-b927-42c1-ad96-56904b1c6336 req-f6e5306e-1dbe-49b9-9843-17314647bd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7db14d8-91de-4457-930a-567699823919", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:29.030912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7c921d36-b927-42c1-ad96-56904b1c6336 req-f6e5306e-1dbe-49b9-9843-17314647bd6b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.032391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7c921d36-b927-42c1-ad96-56904b1c6336 req-f6e5306e-1dbe-49b9-9843-17314647bd6b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.061427 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7c921d36-b927-42c1-ad96-56904b1c6336 req-f6e5306e-1dbe-49b9-9843-17314647bd6b service nova] Creating event network-changed:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:00:29.071081 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7c921d36-b927-42c1-ad96-56904b1c6336 req-f6e5306e-1dbe-49b9-9843-17314647bd6b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054603 Jul 20 11:00:29.073069 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1464/2853] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:29.082623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:29.083823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:29.131150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.131936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.133418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.133418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.201489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:29.214064 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a92f4584-17b1-4499-9fbe-7df20912e608 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1507 microversion: 2.1 time: 0.774911 Jul 20 11:00:29.217363 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1390/2854] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:28 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1507 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:29.227131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-851ee2de-467e-47e3-b7ca-68791434d3bf req-c3980189-5be3-4130-ab79-b8f036878b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be6c4205-eb71-4050-9527-adf95060d100", "tag": "84596e6f-53b6-49de-83af-236da2b3a9a4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:29.253444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-851ee2de-467e-47e3-b7ca-68791434d3bf req-c3980189-5be3-4130-ab79-b8f036878b72 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.254258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-851ee2de-467e-47e3-b7ca-68791434d3bf req-c3980189-5be3-4130-ab79-b8f036878b72 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.277955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-851ee2de-467e-47e3-b7ca-68791434d3bf req-c3980189-5be3-4130-ab79-b8f036878b72 service nova] Creating event network-changed:84596e6f-53b6-49de-83af-236da2b3a9a4 for instance be6c4205-eb71-4050-9527-adf95060d100 on n-h2-846219-10 Jul 20 11:00:29.296582 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-851ee2de-467e-47e3-b7ca-68791434d3bf req-c3980189-5be3-4130-ab79-b8f036878b72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077855 Jul 20 11:00:29.297930 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1391/2855] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:29.303512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0513643c-cdd8-48b7-bc86-c02a56ca5a58 req-18cdddbb-bdc4-4918-9e55-4df69fb04699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f5d25c-6e9e-4cb7-947b-7369ca519e7d", "name": "network-vif-plugged", "status": "completed", "tag": "852b9cb3-62a1-4a8a-b9fb-0f995c495622"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:29.312785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0513643c-cdd8-48b7-bc86-c02a56ca5a58 req-18cdddbb-bdc4-4918-9e55-4df69fb04699 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.313997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0513643c-cdd8-48b7-bc86-c02a56ca5a58 req-18cdddbb-bdc4-4918-9e55-4df69fb04699 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.328113 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0513643c-cdd8-48b7-bc86-c02a56ca5a58 req-18cdddbb-bdc4-4918-9e55-4df69fb04699 service nova] Creating event network-vif-plugged:852b9cb3-62a1-4a8a-b9fb-0f995c495622 for instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d on n-h1-846219-10 Jul 20 11:00:29.334250 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0513643c-cdd8-48b7-bc86-c02a56ca5a58 req-18cdddbb-bdc4-4918-9e55-4df69fb04699 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034215 Jul 20 11:00:29.335766 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1392/2856] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:29.343332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:29.344497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:29.353493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.354256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.355333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.356014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.689576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:29.706313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:29.707920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:29.709190 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9954376-612c-4869-a63b-bebb12703726 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.371551 Jul 20 11:00:29.709778 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1393/2857] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:29 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:29.732552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:29.733193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:29.746759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.747241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.748040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:29.748485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:29.984128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:30.003201 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8408555-e0fa-45f4-b2c3-9ac98e70c89b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1316 microversion: 2.1 time: 0.928286 Jul 20 11:00:30.021533 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1465/2858] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:29 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1316 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:30.038068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.038920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.048709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.050107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.051337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.052223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.105323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:30.133098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:30.148218 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-91e99d96-1e01-42d2-8eb1-81e53cf99c43 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1488 microversion: 2.1 time: 0.437353 Jul 20 11:00:30.148827 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1394/2859] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:29 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1488 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:30.167003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.168145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: a7830f1e-765d-4627-8414-3a477f83bc65] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.180783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.181253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.182071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.182514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.204316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:30.216633 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] HTTP exception thrown: Instance a7830f1e-765d-4627-8414-3a477f83bc65 could not be found. Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Request method failure captured: Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 HTTP/1.1 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-AOyvmfW2GIUIERO0g02JG8KTYYOmPoPFBmLsNg2iWeB41TJr3Nknnj2wPU1-SM07eUDNRjNIFrwbXJJp2OneHh3qgE5t3fLsaFApcpqKES-dQ-0GxYoGabMESLbvnPw8mACqNt747Cjn6d9kPSyhVEwWuurvLkTlSh0AGnWxmTgiE Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d77017ded15e4f81a415119025e888ce Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerShowV247Test-64563849 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d77017ded15e4f81a415119025e888ce", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d77017ded15e4f81a415119025e888ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d77017ded15e4f81a415119025e888ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d77017ded15e4f81a415119025e888ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerShowV247Test-64563849 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d77017ded15e4f81a415119025e888ce Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerShowV247Test-64563849 Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerShowV247Test-64563849-project Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: e537f090671f40d89b45310eb30a11cf Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerShowV247Test-64563849-project Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance a7830f1e-765d-4627-8414-3a477f83bc65 could not be found. Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a7830f1e-765d-4627-8414-3a477f83bc65'} Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7830f1e-765d-4627-8414-3a477f83bc65 could not be found. Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7830f1e-765d-4627-8414-3a477f83bc65 could not be found. Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:30.218666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7830f1e-765d-4627-8414-3a477f83bc65 could not be found. Jul 20 11:00:30.223307 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.224941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Returning 404 to user: Instance a7830f1e-765d-4627-8414-3a477f83bc65 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:30.226053 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-12f48dbe-2c6b-4b4f-8f10-69f55cfdae1a tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65" status: 404 len: 111 microversion: 2.47 time: 0.074088 Jul 20 11:00:30.227277 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1395/2860] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:30 2022] GET /compute/v2.1/servers/a7830f1e-765d-4627-8414-3a477f83bc65 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:00:30.245970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.254994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.259317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9dbd12f-117d-40d0-91d1-fe5fab772eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 204 len: 0 microversion: 2.1 time: 0.233136 Jul 20 11:00:30.262476 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1466/2861] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:30 2022] DELETE /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:00:30.275348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.275954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.277385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.278187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.278985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.279457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.294802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.295192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.296083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.296524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.374195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:30.571875 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89e6906d-5caa-49ea-ab5c-af156e626a2e tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 204 len: 0 microversion: 2.1 time: 0.306466 Jul 20 11:00:30.573201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1467/2862] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:30 2022] DELETE /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:00:30.582710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.584701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.592109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.594410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.596951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.597759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.602578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:30.638931 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-18541b29-99a3-480e-89cc-3530865e58aa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 0.410243 Jul 20 11:00:30.639885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1396/2863] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:30 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:30.650294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.651286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.662877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.664078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.665190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.666004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.673708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:30.816818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:30.834250 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3b8b521e-fc27-4179-bbf4-a5a11cd54fca tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "DELETE /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 204 len: 0 microversion: 2.47 time: 0.257819 Jul 20 11:00:30.835176 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1468/2864] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:00:30 2022] DELETE /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:00:30.858451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0f3fde6-168e-4fae-ba6d-b73241051d34 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f11c0d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.896666 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d0f3fde6-168e-4fae-ba6d-b73241051d34 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Image not found. Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0f3fde6-168e-4fae-ba6d-b73241051d34 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae HTTP/1.1 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '13727743-8121-4f14-95f5-8a7c2c3493ae'} Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 13727743-8121-4f14-95f5-8a7c2c3493ae to delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 13727743-8121-4f14-95f5-8a7c2c3493ae could not be found. Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.900994 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0f3fde6-168e-4fae-ba6d-b73241051d34 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0f3fde6-168e-4fae-ba6d-b73241051d34 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae" status: 404 len: 62 microversion: 2.1 time: 0.066272 Jul 20 11:00:30.906077 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1469/2865] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:30 2022] DELETE /compute/v2.1/images/13727743-8121-4f14-95f5-8a7c2c3493ae => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:00:30.920837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:30.926611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:30.954623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.955554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:30.956689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:30.957173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.074498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.089780 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-45992d63-dd1e-44c1-ae31-9aa253ec0cb7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1513 microversion: 2.1 time: 0.448529 Jul 20 11:00:31.091550 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1397/2866] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:30 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1513 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:31.097640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:31.098593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:31.117236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.118234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.120438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.121165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.122068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.137818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.139394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.140776 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3323d21-b610-4a22-af7b-2ed6463bf4bb tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.235145 Jul 20 11:00:31.156671 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1470/2867] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:30 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:31.169859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:31.170535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:31.201566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.202592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.203976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.204726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.256554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:31.308549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.345937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.351259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:31.356788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7f41e26-8347-4e07-988d-c5398b8bee6c tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 200 len: 1362 microversion: 2.47 time: 0.259618 Jul 20 11:00:31.357583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1398/2868] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:31 2022] GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:31.370891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:31.371830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:31.385461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.386298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.387522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.388408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.406671 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Instance is already in deleting state, ignoring this request Jul 20 11:00:31.408458 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c69391ec-fd56-43db-b0d2-7b680d51149c tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 204 len: 0 microversion: 2.1 time: 0.250701 Jul 20 11:00:31.409529 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1471/2869] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:31 2022] DELETE /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:00:31.421292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:31.423201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:31.435313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.438830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:31.448658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:31.449436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:32.071832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:32.455536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:32.494487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:32.505085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2ee9f39-3282-40ca-ade7-92181912d11f tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1494 microversion: 2.1 time: 1.090329 Jul 20 11:00:32.506211 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1472/2870] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:31 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1494 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:00:32.511321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:32.512058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:32.519101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:32.519586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:32.520488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:32.520634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:32.520892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:32.540799 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fdf3deb1-be7d-40a0-a4bc-34a1ec6ad6b1 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1316 microversion: 2.1 time: 1.180194 Jul 20 11:00:32.541460 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1399/2871] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:31 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1316 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:32.568680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-626781dd-01c2-4c01-88f6-39e5819d2936 req-ca161178-1299-4eee-9346-48f83c9aac62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47de751-278e-428b-ab72-71d40df77433", "name": "network-vif-plugged", "status": "completed", "tag": "bed05db6-be83-478a-83ec-6ef4461a3060"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:32.580120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-626781dd-01c2-4c01-88f6-39e5819d2936 req-ca161178-1299-4eee-9346-48f83c9aac62 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:32.581153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-626781dd-01c2-4c01-88f6-39e5819d2936 req-ca161178-1299-4eee-9346-48f83c9aac62 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:32.598754 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-626781dd-01c2-4c01-88f6-39e5819d2936 req-ca161178-1299-4eee-9346-48f83c9aac62 service nova] Creating event network-vif-plugged:bed05db6-be83-478a-83ec-6ef4461a3060 for instance d47de751-278e-428b-ab72-71d40df77433 on n-h2-846219-10 Jul 20 11:00:32.607615 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-626781dd-01c2-4c01-88f6-39e5819d2936 req-ca161178-1299-4eee-9346-48f83c9aac62 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052911 Jul 20 11:00:32.609024 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1400/2872] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:32.621753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:32.622732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:32.640806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:32.641301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:32.643501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:32.643902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.175525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.183719 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-812eb23b-c9ac-4752-8bb0-38349a23ae17 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 0.676175 Jul 20 11:00:33.194821 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1473/2873] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:32 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:33.199994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:33.200611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:33.207337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.207790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.209218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.209652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.263620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.284114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2a26710-f757-41af-b86e-8bd1d2793f31 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1513 microversion: 2.1 time: 0.672825 Jul 20 11:00:33.285760 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1401/2874] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:32 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1513 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:33.299656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:33.300798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:33.315613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.316228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.317143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.318227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.438166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.477663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.480774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.482649 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-10169170-c423-41da-9ebc-6a8b101acf83 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.286305 Jul 20 11:00:33.499837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1474/2875] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:33 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:33.522570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.528753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:33.529591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:33.535863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.542649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:33.542883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.543280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.544505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.545567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.556699 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aaa73f13-0313-47fb-89a0-ff75e19db11f tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 200 len: 1362 microversion: 2.47 time: 0.268807 Jul 20 11:00:33.571529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1402/2876] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:33 2022] GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:33.578794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:33.590235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:33.607344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.611533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:33.613018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:33.614301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:34.713477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:34.727087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:34.734965 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03b3e360-f2a7-49b9-aaaa-cae034081586 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1494 microversion: 2.1 time: 1.212960 Jul 20 11:00:34.735593 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1475/2877] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:33 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1494 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:34.741676 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d33a34a-3f41-43aa-83e1-571562f0c270 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1316 microversion: 2.1 time: 1.168763 Jul 20 11:00:34.750930 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1403/2878] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:33 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1316 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:34.750930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:34.751508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:34.757603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:34.758461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:34.774563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:34.775017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:34.776495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:34.777116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:34.778215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:34.778807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:34.786288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:34.787811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.594267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.606429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.618148 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5bac5e85-a0f4-4d46-9ed6-defde1a8faa9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1513 microversion: 2.1 time: 0.874503 Jul 20 11:00:35.621102 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2112f1b9-714a-411f-a075-4f1eeff6d336 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 0.884458 Jul 20 11:00:35.621907 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1476/2879] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:34 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:35.623472 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1404/2880] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:34 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1513 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:35.631885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:35.636659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:35.639487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:35.644148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:35.664717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.665477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.665703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.666377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.667679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.667846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.675617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.676353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.846576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.872019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.873770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.875656 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-410e80f4-576f-4e53-94f9-7a4fc039b273 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.252551 Jul 20 11:00:35.876709 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1477/2881] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:35 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:35.886518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-eda1222e-d307-44fa-8aa8-c04e7ace9802 req-62760a6c-f87d-45ae-a86f-62e8c9674752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f5d25c-6e9e-4cb7-947b-7369ca519e7d", "name": "network-vif-unplugged", "status": "completed", "tag": "852b9cb3-62a1-4a8a-b9fb-0f995c495622"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:35.886702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.902207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.904709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:35.907839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-768e2339-cab5-4f65-bbd2-cb02e41f4e69 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 200 len: 1362 microversion: 2.47 time: 0.283188 Jul 20 11:00:35.910274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-eda1222e-d307-44fa-8aa8-c04e7ace9802 req-62760a6c-f87d-45ae-a86f-62e8c9674752 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.915954 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1405/2882] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:35 2022] GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:35.916894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-eda1222e-d307-44fa-8aa8-c04e7ace9802 req-62760a6c-f87d-45ae-a86f-62e8c9674752 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.924771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:35.928167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:35.957914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-eda1222e-d307-44fa-8aa8-c04e7ace9802 req-62760a6c-f87d-45ae-a86f-62e8c9674752 service nova] Creating event network-vif-unplugged:852b9cb3-62a1-4a8a-b9fb-0f995c495622 for instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d on n-h1-846219-10 Jul 20 11:00:35.975610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.977586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:35.981988 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-eda1222e-d307-44fa-8aa8-c04e7ace9802 req-62760a6c-f87d-45ae-a86f-62e8c9674752 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103851 Jul 20 11:00:35.982625 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1478/2883] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:35.983512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:35.985218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.317188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:36.318961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:36.334037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.334990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.335997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.337250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.385977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.386739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.387470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lazy-loading 'fault' on Instance uuid 88f5d25c-6e9e-4cb7-947b-7369ca519e7d {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:36.588646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:36.603013 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84f2cbf5-a439-42fd-ae2a-f7d4f68bc88c tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1504 microversion: 2.1 time: 0.682647 Jul 20 11:00:36.610103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f1e2aa093b45c2b9063b057251feab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64590628f1014fd38936c3bfdd9cea02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:36.612920 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1406/2884] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:35 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1504 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:36.617489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:36.628759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-40c0e215-e9f4-4436-a49f-0be798a42fd8 req-06aeec3c-aaf1-4642-ac0a-04fcb67e57f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f5d25c-6e9e-4cb7-947b-7369ca519e7d", "name": "network-vif-deleted", "tag": "852b9cb3-62a1-4a8a-b9fb-0f995c495622"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:36.637804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b448562f-7883-4598-ad89-830d5248cfc7 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 200 len: 1298 microversion: 2.1 time: 0.652798 Jul 20 11:00:36.644301 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1479/2885] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:35 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 1298 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:36.658878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:36.672599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:36.679279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-40c0e215-e9f4-4436-a49f-0be798a42fd8 req-06aeec3c-aaf1-4642-ac0a-04fcb67e57f6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.683759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-40c0e215-e9f4-4436-a49f-0be798a42fd8 req-06aeec3c-aaf1-4642-ac0a-04fcb67e57f6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.723434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.726802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.729757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.736512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.751111 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-40c0e215-e9f4-4436-a49f-0be798a42fd8 req-06aeec3c-aaf1-4642-ac0a-04fcb67e57f6 service nova] Creating event network-vif-deleted:852b9cb3-62a1-4a8a-b9fb-0f995c495622 for instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d on n-h1-846219-10 Jul 20 11:00:36.775099 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-40c0e215-e9f4-4436-a49f-0be798a42fd8 req-06aeec3c-aaf1-4642-ac0a-04fcb67e57f6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158690 Jul 20 11:00:36.776035 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1407/2886] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:36.801171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:36.820238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:36.845188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.845943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.846902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:36.847572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:36.870790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:00:37.087706 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9c441a9a-587e-4d7c-97ec-1ee7690cf81e tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 204 len: 0 microversion: 2.1 time: 0.441258 Jul 20 11:00:37.090350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.091948 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1480/2887] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:36 2022] DELETE /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:00:37.106151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:37.106926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:37.115321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.115569 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b120ee8-c951-456f-bbba-9ce8859b2139 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 200 len: 1471 microversion: 2.1 time: 0.330880 Jul 20 11:00:37.119332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.120201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.120678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.125565 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1408/2888] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:36 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 1471 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:37.140589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:37.141216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:37.164311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:37.166297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.169073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.170219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.173785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.385942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.390379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:37.424603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.435539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.438232 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-49f9fcaa-fa50-4973-802e-61676d78cea0 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.311424 Jul 20 11:00:37.455391 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1409/2889] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:37 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:37.466216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:37.468026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:37.502613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.503436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.504471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.507803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.528787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.542273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e826450-a572-48b9-bb91-0859dde0f39a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 0.448133 Jul 20 11:00:37.558496 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1481/2890] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:37 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:37.573998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-07b223fe-2534-471e-95c5-90bc02fdcdd7 req-160a98b0-5180-42dc-9c26-086e80771ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f917-76fe-4603-91c4-a23c061421df", "name": "network-vif-deleted", "tag": "7effb974-44e8-4758-be70-43c689f6f6b8"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:37.577265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.578450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.579952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lazy-loading 'fault' on Instance uuid 253aabea-87ed-43d3-a20f-a6b75de37eb7 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:37.603618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-07b223fe-2534-471e-95c5-90bc02fdcdd7 req-160a98b0-5180-42dc-9c26-086e80771ade service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.605056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-07b223fe-2534-471e-95c5-90bc02fdcdd7 req-160a98b0-5180-42dc-9c26-086e80771ade service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.639342 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-07b223fe-2534-471e-95c5-90bc02fdcdd7 req-160a98b0-5180-42dc-9c26-086e80771ade service nova] Creating event network-vif-deleted:7effb974-44e8-4758-be70-43c689f6f6b8 for instance db57f917-76fe-4603-91c4-a23c061421df on n-h1-846219-10 Jul 20 11:00:37.647818 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-07b223fe-2534-471e-95c5-90bc02fdcdd7 req-160a98b0-5180-42dc-9c26-086e80771ade service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085964 Jul 20 11:00:37.648853 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1482/2891] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:37.659941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:37.662175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:37.671450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.672350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.683716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.684258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.878013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.887399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.889362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e537f090671f40d89b45310eb30a11cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd77017ded15e4f81a415119025e888ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:37.890806 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b56f778-ed8f-4846-b1fd-29c7bb37cc79 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 200 len: 1367 microversion: 2.47 time: 0.433990 Jul 20 11:00:37.892354 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1410/2892] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:37 2022] GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:37.900101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:37.901177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 88f5d25c-6e9e-4cb7-947b-7369ca519e7d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:37.911155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.911946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.913363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:37.914125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:37.938518 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d could not be found. Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d HTTP/1.1 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d could not be found. Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '88f5d25c-6e9e-4cb7-947b-7369ca519e7d'} Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d could not be found. Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d could not be found. Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:37.942422 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:37.953182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:37.953182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:37.953182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:37.953182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:37.953182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d could not be found. Jul 20 11:00:37.953182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:37.955660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance 88f5d25c-6e9e-4cb7-947b-7369ca519e7d could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:37.957162 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-223f6d24-70dd-4e12-941f-d4830b72cd36 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d" status: 404 len: 111 microversion: 2.1 time: 0.062581 Jul 20 11:00:37.959267 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1411/2893] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:37 2022] GET /compute/v2.1/servers/88f5d25c-6e9e-4cb7-947b-7369ca519e7d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:37.977321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b981a58-698f-49cf-bdbc-d4fb60a021a9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f493670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.018724 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0b981a58-698f-49cf-bdbc-d4fb60a021a9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Image not found. Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b981a58-698f-49cf-bdbc-d4fb60a021a9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 HTTP/1.1 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ab438c28-69f7-41ee-ab6d-d1316bf759a7'} Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ab438c28-69f7-41ee-ab6d-d1316bf759a7 to delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab438c28-69f7-41ee-ab6d-d1316bf759a7 could not be found. Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.022995 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:00:38.027122 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.034083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b981a58-698f-49cf-bdbc-d4fb60a021a9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.034968 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0b981a58-698f-49cf-bdbc-d4fb60a021a9 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7" status: 404 len: 62 microversion: 2.1 time: 0.070603 Jul 20 11:00:38.035949 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1412/2894] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:37 2022] DELETE /compute/v2.1/images/ab438c28-69f7-41ee-ab6d-d1316bf759a7 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 11:00:38.044253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.044867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.061764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.062656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.065214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.066391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.089467 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 HTTP/1.1 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ac2bd780-295a-4354-aafd-e973390e5dd2'} Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:38.092052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.096286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.100439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.101608 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1041fd21-4d52-43b4-87b5-e450e0587e6d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 404 len: 111 microversion: 2.1 time: 0.061234 Jul 20 11:00:38.103755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1413/2895] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:38 2022] DELETE /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:00:38.113424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.115809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: ac2bd780-295a-4354-aafd-e973390e5dd2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.133578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.140033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.141747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.143441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.189562 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 HTTP/1.1 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ac2bd780-295a-4354-aafd-e973390e5dd2'} Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.202017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.209511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.209511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.209511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.209511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.209511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. Jul 20 11:00:38.209511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.214932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance ac2bd780-295a-4354-aafd-e973390e5dd2 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.216914 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f2878de-f361-46a5-b9c0-e262023661bb tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2" status: 404 len: 111 microversion: 2.1 time: 0.109110 Jul 20 11:00:38.218654 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1414/2896] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:38 2022] GET /compute/v2.1/servers/ac2bd780-295a-4354-aafd-e973390e5dd2 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:38.229209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.231911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.240475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.241674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.243069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.243718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.270455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df HTTP/1.1 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'db57f917-76fe-4603-91c4-a23c061421df'} Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.275123 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.280645 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.280645 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.280645 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.280645 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.280645 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:00:38.280645 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.282250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.283726 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5da73b00-22ae-4d10-85e2-6d75f417dfd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 404 len: 111 microversion: 2.1 time: 0.062856 Jul 20 11:00:38.287104 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1415/2897] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:38 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:38.299533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5e9d8ae0-5d24-4eac-8712-20d4957c46de req-d3b936be-7372-4ca4-96e4-088e6b4c9a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7db14d8-91de-4457-930a-567699823919", "name": "network-vif-plugged", "status": "completed", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}, {"server_uuid": "be6c4205-eb71-4050-9527-adf95060d100", "name": "network-vif-plugged", "status": "completed", "tag": "84596e6f-53b6-49de-83af-236da2b3a9a4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:38.357805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e9d8ae0-5d24-4eac-8712-20d4957c46de req-d3b936be-7372-4ca4-96e4-088e6b4c9a24 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.363431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e9d8ae0-5d24-4eac-8712-20d4957c46de req-d3b936be-7372-4ca4-96e4-088e6b4c9a24 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.387064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:38.401369 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5e9d8ae0-5d24-4eac-8712-20d4957c46de req-d3b936be-7372-4ca4-96e4-088e6b4c9a24 service nova] Creating event network-vif-plugged:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:00:38.402198 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5e9d8ae0-5d24-4eac-8712-20d4957c46de req-d3b936be-7372-4ca4-96e4-088e6b4c9a24 service nova] Creating event network-vif-plugged:84596e6f-53b6-49de-83af-236da2b3a9a4 for instance be6c4205-eb71-4050-9527-adf95060d100 on n-h2-846219-10 Jul 20 11:00:38.408342 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8c05f8fe-7014-4d6c-a6d0-71af4bde3eea tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1510 microversion: 2.1 time: 0.749722 Jul 20 11:00:38.412218 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1483/2898] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:37 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1510 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:38.420746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df00deb2-f089-4274-9ace-cd2d4f188afc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3ea175e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.425060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5e9d8ae0-5d24-4eac-8712-20d4957c46de req-d3b936be-7372-4ca4-96e4-088e6b4c9a24 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.136171 Jul 20 11:00:38.436232 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1416/2899] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:38.457169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0c33b1d-18fe-4e95-8839-946244db3719 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '.version_select at 0x7f2c3f4efee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.514796 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0c33b1d-18fe-4e95-8839-946244db3719 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-key-783463060" status: 202 len: 0 microversion: 2.1 time: 0.076901 Jul 20 11:00:38.518134 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-df00deb2-f089-4274-9ace-cd2d4f188afc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Image not found. Jul 20 11:00:38.518929 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1417/2900] 10.222.0.79 () {58 vars in 1205 bytes} [Wed Jul 20 11:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-783463060 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df00deb2-f089-4274-9ace-cd2d4f188afc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 HTTP/1.1 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '7f03fccf-ba09-4d23-84f7-aec2e9bf9594'} Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f03fccf-ba09-4d23-84f7-aec2e9bf9594 to delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f03fccf-ba09-4d23-84f7-aec2e9bf9594 could not be found. Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.521604 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df00deb2-f089-4274-9ace-cd2d4f188afc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df00deb2-f089-4274-9ace-cd2d4f188afc tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594" status: 404 len: 62 microversion: 2.1 time: 0.109396 Jul 20 11:00:38.530890 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1484/2901] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:38 2022] DELETE /compute/v2.1/images/7f03fccf-ba09-4d23-84f7-aec2e9bf9594 => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:00:38.533156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.533629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.538194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.540843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.560989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.561485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.562887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.573452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.579521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.581698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.582590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.583044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.657655 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 HTTP/1.1 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'e42d9d15-9585-4fdf-9a76-ebcbe7eba769'} Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:38.667291 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.672023 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.673916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.674981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8b213a4-9135-45b6-9b74-0d510f81e590 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 404 len: 111 microversion: 2.1 time: 0.146824 Jul 20 11:00:38.676209 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1485/2902] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:38 2022] DELETE /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:00:38.688298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.692060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.708467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.708721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.709876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.719616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.893774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:38.910498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:38.912102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:38.921219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e7a089f3-24fa-41e2-9e0d-192b3b142cde tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.393270 Jul 20 11:00:38.924734 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1418/2903] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:38 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:38.938401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:38.939330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: e42d9d15-9585-4fdf-9a76-ebcbe7eba769] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:38.947089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.947941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.950043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:38.950695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:38.971111 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 HTTP/1.1 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e42d9d15-9585-4fdf-9a76-ebcbe7eba769'} Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.973120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:38.979511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:38.979511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:38.979511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:38.979511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:38.979511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. Jul 20 11:00:38.979511 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:38.981297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance e42d9d15-9585-4fdf-9a76-ebcbe7eba769 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:38.982778 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b88187cf-e15a-4673-a90a-ceb975baaef3 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769" status: 404 len: 111 microversion: 2.1 time: 0.056585 Jul 20 11:00:38.984660 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1419/2904] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:38 2022] GET /compute/v2.1/servers/e42d9d15-9585-4fdf-9a76-ebcbe7eba769 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:38.997052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-757899483", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:39.065756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:00:39.897293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:39.920521 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28b37010-c7c2-4f4f-ad7e-2f3bf97754de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1318 microversion: 2.1 time: 1.242848 Jul 20 11:00:39.921128 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1486/2905] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:38 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1318 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:39.927587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:39.932274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] [instance: 253aabea-87ed-43d3-a20f-a6b75de37eb7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:39.953266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:39.953726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:39.954527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:39.955232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:40.000994 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] HTTP exception thrown: Instance 253aabea-87ed-43d3-a20f-a6b75de37eb7 could not be found. Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Request method failure captured: Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 HTTP/1.1 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-AOyvmfW2GIUIERO0g02JG8KTYYOmPoPFBmLsNg2iWeB41TJr3Nknnj2wPU1-SM07eUDNRjNIFrwbXJJp2OneHh3qgE5t3fLsaFApcpqKES-dQ-0GxYoGabMESLbvnPw8mACqNt747Cjn6d9kPSyhVEwWuurvLkTlSh0AGnWxmTgiE Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d77017ded15e4f81a415119025e888ce Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerShowV247Test-64563849 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d77017ded15e4f81a415119025e888ce", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d77017ded15e4f81a415119025e888ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d77017ded15e4f81a415119025e888ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d77017ded15e4f81a415119025e888ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerShowV247Test-64563849 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d77017ded15e4f81a415119025e888ce Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerShowV247Test-64563849 Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerShowV247Test-64563849-project Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e537f090671f40d89b45310eb30a11cf Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerShowV247Test-64563849-project Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 253aabea-87ed-43d3-a20f-a6b75de37eb7 could not be found. Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '253aabea-87ed-43d3-a20f-a6b75de37eb7'} Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 253aabea-87ed-43d3-a20f-a6b75de37eb7 could not be found. Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 253aabea-87ed-43d3-a20f-a6b75de37eb7 could not be found. Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:40.002979 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 253aabea-87ed-43d3-a20f-a6b75de37eb7 could not be found. Jul 20 11:00:40.007653 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.009789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] Returning 404 to user: Instance 253aabea-87ed-43d3-a20f-a6b75de37eb7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:40.010940 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3af6d736-726b-4356-9a76-152da9da4975 tempest-ServerShowV247Test-64563849 tempest-ServerShowV247Test-64563849-project] 10.222.0.79 "GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7" status: 404 len: 111 microversion: 2.47 time: 0.088882 Jul 20 11:00:40.012088 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1487/2906] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:39 2022] GET /compute/v2.1/servers/253aabea-87ed-43d3-a20f-a6b75de37eb7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:00:40.021766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90907da2-d464-4956-822c-94b72d624c37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '.version_select at 0x7f2c3f9d5b80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:40.060993 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-90907da2-d464-4956-822c-94b72d624c37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Image not found. Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90907da2-d464-4956-822c-94b72d624c37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 HTTP/1.1 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865'} Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 to delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 could not be found. Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.063254 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90907da2-d464-4956-822c-94b72d624c37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:40.067199 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90907da2-d464-4956-822c-94b72d624c37 tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865" status: 404 len: 62 microversion: 2.1 time: 0.051580 Jul 20 11:00:40.071976 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1488/2907] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:40 2022] DELETE /compute/v2.1/images/1b5fc8f3-e94a-4fa6-a306-e4d8d5ef3865 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:00:40.076526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:40.088901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:40.104133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:40.104886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:40.106102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:40.106742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:41.072051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:41.108486 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-edc39841-0577-496d-a67b-afd3c70c3248 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1510 microversion: 2.1 time: 1.031430 Jul 20 11:00:41.109878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1489/2908] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:40 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1510 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:41.116688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:41.117628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:41.126126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:41.127029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:41.128775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:41.129613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:41.804221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:41.820923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:41.822656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:41.823939 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d52a138-6aa7-468a-bb27-4754c469fec7 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.711744 Jul 20 11:00:41.836471 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1490/2909] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:41 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:41.855559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:41.856329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:41.870189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:41.871589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:41.876594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:41.877256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:41.917478 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 HTTP/1.1 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '47561663-9022-4b9f-b8aa-91f078552c26'} Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:41.921864 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:41.926595 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:41.930503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:00:41.932096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:00:41.932885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:00:41.934191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:00:41.935567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:00:41.944500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:41.949701 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33381271-a38b-48a0-91a5-408e26160eac tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "DELETE /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 404 len: 111 microversion: 2.1 time: 0.111950 Jul 20 11:00:41.953813 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1491/2910] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:41 2022] DELETE /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:41.964250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:41.972877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:41.974447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:41.976873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:41.978510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:41.979250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.003213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.003682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.009678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.011444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.044977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:00:42.056861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:00:42.095811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:00:42.106570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:00:42.216183 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79950b0b-7a1f-422a-a6cf-4375130d0348 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.230059 Jul 20 11:00:42.217480 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1420/2911] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:00:42.222440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:42.224254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] [instance: 47561663-9022-4b9f-b8aa-91f078552c26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:42.231430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.232941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.233927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.234537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.293799 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] HTTP exception thrown: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Request method failure captured: Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 HTTP/1.1 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi198jo5e7tNjR-VbCzD4uxWmHwZsxhljgEGQBRDYBrhxSzgJL3j8AC0FF2-M6k37tElLnBZUTaBrGeb7XWi8OM1gzhRmQDsGlHzONcA3TqY5plcjoZ4hAcCruEMW5TNZVXJfPuUUyoG2O4rj2kkh_gFrFAwwJhPhgdDOEnitMbHGAdJ8 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_64590628f1014fd38936c3bfdd9cea02", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/64590628f1014fd38936c3bfdd9cea02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 64590628f1014fd38936c3bfdd9cea02 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesTestJSON-1644383861 Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 78f1e2aa093b45c2b9063b057251feab Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesTestJSON-1644383861-project Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '47561663-9022-4b9f-b8aa-91f078552c26'} Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:42.299424 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] Returning 404 to user: Instance 47561663-9022-4b9f-b8aa-91f078552c26 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c11f40dd-604d-45ec-bbdf-44896d546d8d tempest-ImagesTestJSON-1644383861 tempest-ImagesTestJSON-1644383861-project] 10.222.0.79 "GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26" status: 404 len: 111 microversion: 2.1 time: 0.085361 Jul 20 11:00:42.305669 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1421/2912] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:42 2022] GET /compute/v2.1/servers/47561663-9022-4b9f-b8aa-91f078552c26 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:42.327921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:42.328868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:42.344209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.344647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.345463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.358995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.710904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3839588956754d7c9503304f4a03d1dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8577fe0412844a95880d2da8dfd934ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:42.719551 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-150de5e3-477d-41e0-a1cf-ef8e76a6372d tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 200 len: 1301 microversion: 2.1 time: 0.406484 Jul 20 11:00:42.721262 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1422/2913] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:42 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 1301 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:42.727979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6f4de20-d402-4316-807f-522912cda8e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:42.729003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6f4de20-d402-4316-807f-522912cda8e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:42.743402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:42.774288 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44cf0317-98e7-4aba-bb3e-64da5c75a9cd tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1468 microversion: 2.1 time: 0.818830 Jul 20 11:00:42.775756 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1492/2914] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:41 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1468 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:42.791156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ffd7cc55-609f-4bbd-b9f6-15d14f59ff44 req-e000fe5e-1278-4c18-9c48-1490c09cb825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47de751-278e-428b-ab72-71d40df77433", "name": "network-vif-deleted", "tag": "bed05db6-be83-478a-83ec-6ef4461a3060"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:42.812130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ffd7cc55-609f-4bbd-b9f6-15d14f59ff44 req-e000fe5e-1278-4c18-9c48-1490c09cb825 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.814574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ffd7cc55-609f-4bbd-b9f6-15d14f59ff44 req-e000fe5e-1278-4c18-9c48-1490c09cb825 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.855786 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ffd7cc55-609f-4bbd-b9f6-15d14f59ff44 req-e000fe5e-1278-4c18-9c48-1490c09cb825 service nova] Creating event network-vif-deleted:bed05db6-be83-478a-83ec-6ef4461a3060 for instance d47de751-278e-428b-ab72-71d40df77433 on n-h2-846219-10 Jul 20 11:00:42.907483 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ffd7cc55-609f-4bbd-b9f6-15d14f59ff44 req-e000fe5e-1278-4c18-9c48-1490c09cb825 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124099 Jul 20 11:00:42.909575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1493/2915] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:42.926639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:42.927941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:42.937953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.938856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.940085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:42.940875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:42.974673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a6f4de20-d402-4316-807f-522912cda8e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:42.991887 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6f4de20-d402-4316-807f-522912cda8e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1208 microversion: 2.1 time: 0.265957 Jul 20 11:00:42.994833 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1423/2916] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:42 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1208 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:43.020155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:43.023663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:43.043397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.044174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.046092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.047469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.327395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:43.362302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:43.363988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:43.365727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3755266f-f062-46a1-827b-d2b406df602e tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1605 microversion: 2.42 time: 0.369246 Jul 20 11:00:43.366305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1424/2917] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:42 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1605 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:43.593496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:43.619847 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94dea885-9e6b-4d7e-9cea-0f692d202e26 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 200 len: 1467 microversion: 2.1 time: 0.708984 Jul 20 11:00:43.631919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1494/2918] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:42 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 1467 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:43.651200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2104786383"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:43.654044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:43.684358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.685460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.687426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.692174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.744841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:43.745788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:43.770596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.773638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.775595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.792923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.814788 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 HTTP/1.1 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd47de751-278e-428b-ab72-71d40df77433'} Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.816838 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.820824 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.825516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:43.826685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2cf98743-1f8b-4e4a-839c-6b3a518ad788 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 404 len: 111 microversion: 2.1 time: 0.088934 Jul 20 11:00:43.828122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1495/2919] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:43 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:00:43.849987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-759291090", "metadata": {"image_type": "test"}}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:43.852485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:43.861861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.862637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.863740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:43.865239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:43.892392 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433/action HTTP/1.1 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 111 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-759291090", "metadata": {"image_type": "test"}}} Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd47de751-278e-428b-ab72-71d40df77433', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-759291090', 'metadata': {'image_type': 'test'}}}} Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:00:43.895084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:43.899865 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.904699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:43.905826 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3db8bce1-37eb-4c8f-a0a5-080dbfd85fca tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "POST /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433/action" status: 404 len: 111 microversion: 2.1 time: 0.062732 Jul 20 11:00:43.907196 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1496/2920] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Jul 20 11:00:43 2022] POST /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:43.925815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-99b06c41-7463-4b5a-bb0a-082ed412d322 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-687872911", "metadata": {"image_type": "test"}}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:43.927912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-99b06c41-7463-4b5a-bb0a-082ed412d322 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Failed to fetch instance by id tempest-invalid-1290643466 {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 11:00:43.929071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-99b06c41-7463-4b5a-bb0a-082ed412d322 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance tempest-invalid-1290643466 could not be found. Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-99b06c41-7463-4b5a-bb0a-082ed412d322 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/tempest-invalid-1290643466/action HTTP/1.1 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 111 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-687872911", "metadata": {"image_type": "test"}}} Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance tempest-invalid-1290643466 could not be found. Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'tempest-invalid-1290643466', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-687872911', 'metadata': {'image_type': 'test'}}}} Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1290643466 could not be found. Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:43.931007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1290643466 could not be found. Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1290643466 could not be found. Jul 20 11:00:43.934715 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.939949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-99b06c41-7463-4b5a-bb0a-082ed412d322 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance tempest-invalid-1290643466 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:43.940821 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-99b06c41-7463-4b5a-bb0a-082ed412d322 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "POST /compute/v2.1/servers/tempest-invalid-1290643466/action" status: 404 len: 101 microversion: 2.1 time: 0.024479 Jul 20 11:00:43.941406 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1497/2921] 10.222.0.79 () {60 vars in 1248 bytes} [Wed Jul 20 11:00:43 2022] POST /compute/v2.1/servers/tempest-invalid-1290643466/action => generated 101 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:43.957572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a963b4e0-8a13-44d2-8f55-c894c6a54678 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1762315390"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:43.958205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a963b4e0-8a13-44d2-8f55-c894c6a54678 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 11:00:43.959891 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a963b4e0-8a13-44d2-8f55-c894c6a54678 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a963b4e0-8a13-44d2-8f55-c894c6a54678 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 57 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: {"createImage": {"name": "tempest-test-snap-1762315390"}} Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1762315390'}}} Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:43.961063 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a963b4e0-8a13-44d2-8f55-c894c6a54678 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a963b4e0-8a13-44d2-8f55-c894c6a54678 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.013173 Jul 20 11:00:43.970222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1498/2922] 10.222.0.79 () {60 vars in 1274 bytes} [Wed Jul 20 11:00:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:00:43.993723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b4ab59b-8c14-4fa4-ac2a-a56f2672c23b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1327961068"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:43.998838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b4ab59b-8c14-4fa4-ac2a-a56f2672c23b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 11:00:43.999542 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2b4ab59b-8c14-4fa4-ac2a-a56f2672c23b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b4ab59b-8c14-4fa4-ac2a-a56f2672c23b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 57 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: {"createImage": {"name": "tempest-test-snap-1327961068"}} Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1327961068'}}} Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:44.001918 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 20 11:00:44.007418 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.010147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b4ab59b-8c14-4fa4-ac2a-a56f2672c23b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:44.011219 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b4ab59b-8c14-4fa4-ac2a-a56f2672c23b tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032330 Jul 20 11:00:44.013402 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1499/2923] 10.222.0.79 () {60 vars in 1280 bytes} [Wed Jul 20 11:00:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:44.026982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:44.027761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:44.038253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.040261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.041401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.043960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.729099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:44.745619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7f758570-7831-4329-8a23-6132958dfe42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1260 microversion: 2.1 time: 0.727138 Jul 20 11:00:44.747453 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1500/2924] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:44 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1260 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:44.762204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:44.767470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:44.788952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.789332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.794235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.795369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.841528 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 HTTP/1.1 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd47de751-278e-428b-ab72-71d40df77433'} Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:44.846680 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:44.854562 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8021255-1299-4a7b-a3d1-a63a769d8b91 tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 404 len: 111 microversion: 2.1 time: 0.105415 Jul 20 11:00:44.856794 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1501/2925] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:00:44 2022] DELETE /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:44.864963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:44.866402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:44.884298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.884744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.890226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.891001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.981565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:44.983192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:44.984073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lazy-loading 'fault' on Instance uuid ea40658d-08bc-47b4-80de-6540f86e0472 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:00:45.034358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ba54e95d-745e-4037-b24d-c5b94ca9d193 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "POST /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919/action" status: 202 len: 0 microversion: 2.1 time: 1.369738 Jul 20 11:00:45.035572 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1425/2926] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:00:43 2022] POST /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919/action => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 11:00:45.042262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:45.053452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] [instance: d47de751-278e-428b-ab72-71d40df77433] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:45.073397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:45.074503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:45.075632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:45.076346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:45.122473 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] HTTP exception thrown: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Request method failure captured: Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 HTTP/1.1 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-A9885dO4V92wDVjooUAqNzbVC3494rkLgIQPxTJYeqtMRXYCkoqKsDrvDa8JFbALQM6wNSrTNCmP8CgblpwKN9H0pLgrU7HWwPfRXQnmYjSaiiWKx9Kf-JLKOvaEPgssDdQ2VAxz73STK-M-ZekWc1WiOHrAJGyl3DDa0_qUIBuFg Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8577fe0412844a95880d2da8dfd934ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8577fe0412844a95880d2da8dfd934ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8577fe0412844a95880d2da8dfd934ea Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1854098453 Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3839588956754d7c9503304f4a03d1dc Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesNegativeTestJSON-1854098453-project Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'd47de751-278e-428b-ab72-71d40df77433'} Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:45.147142 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. Jul 20 11:00:45.152002 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:00:45.177650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] Returning 404 to user: Instance d47de751-278e-428b-ab72-71d40df77433 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:45.180701 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6dc057e-b2bb-4ff6-b470-1fe9ff44fcfa tempest-ImagesNegativeTestJSON-1854098453 tempest-ImagesNegativeTestJSON-1854098453-project] 10.222.0.79 "GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433" status: 404 len: 111 microversion: 2.1 time: 0.143160 Jul 20 11:00:45.184531 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1426/2927] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:45 2022] GET /compute/v2.1/servers/d47de751-278e-428b-ab72-71d40df77433 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:00:45.191077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f1fb8c6-a127-4dbb-a27d-7ab117c10a4d tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f877b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:45.227225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:45.242976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:45.244873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f8ca8707ab044974b65cd49346ec2618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f595bedf58af4d0d9b1866f28148b42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:45.246152 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b9872549-458b-4fd7-8cdb-28fc72ba4aa1 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 200 len: 1610 microversion: 2.42 time: 0.390132 Jul 20 11:00:45.246760 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1502/2928] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:44 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 1610 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:00:45.298102 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f1fb8c6-a127-4dbb-a27d-7ab117c10a4d tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.111521 Jul 20 11:00:45.300958 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1427/2929] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:45 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:45.678875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c14f0c45-d652-4264-8b49-6c9553dbb1a4 tempest-AZV2TestJSON-833187367 tempest-AZV2TestJSON-833187367-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:45.680581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14f0c45-d652-4264-8b49-6c9553dbb1a4 tempest-AZV2TestJSON-833187367 tempest-AZV2TestJSON-833187367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:45.681038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14f0c45-d652-4264-8b49-6c9553dbb1a4 tempest-AZV2TestJSON-833187367 tempest-AZV2TestJSON-833187367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:45.681850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14f0c45-d652-4264-8b49-6c9553dbb1a4 tempest-AZV2TestJSON-833187367 tempest-AZV2TestJSON-833187367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:45.683479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14f0c45-d652-4264-8b49-6c9553dbb1a4 tempest-AZV2TestJSON-833187367 tempest-AZV2TestJSON-833187367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:45.717023 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c14f0c45-d652-4264-8b49-6c9553dbb1a4 tempest-AZV2TestJSON-833187367 tempest-AZV2TestJSON-833187367-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.208319 Jul 20 11:00:45.718263 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1503/2930] 10.222.0.79 () {58 vars in 1163 bytes} [Wed Jul 20 11:00:45 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:00:45.766103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:45.766731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:45.774609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:45.778831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:45.781109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:45.782316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:45.940789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:45.959980 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbfdbc5f-42de-419e-9d65-e5bdb92b5f83 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1266 microversion: 2.1 time: 0.197944 Jul 20 11:00:45.961035 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1428/2931] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:45 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:46.268176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:46.269517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:46.278169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:46.278724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:46.280088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:46.280760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:46.297262 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] HTTP exception thrown: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Request method failure captured: Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 HTTP/1.1 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1964bPSpVNDE9L12OiyZtDzbjIltKq3mQ2-zLVbEJPRuD4MtNDU-uhU7sFGLRSMX3sA1CGEX9sYIMiTfyZl8z_1B7cSQ1INyrQTRXzyo_Bl7QiX0PmjTuxbrQ7SFHwhJpiA5xxHFgoxxI_tpoRzRIsR3lB-ITWBwwXJkAgY0psZDyO4 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f595bedf58af4d0d9b1866f28148b42b Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f595bedf58af4d0d9b1866f28148b42b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f595bedf58af4d0d9b1866f28148b42b Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TaggedBootDevicesTest_v242-1688722382-project Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f8ca8707ab044974b65cd49346ec2618 Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1688722382-project Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ea40658d-08bc-47b4-80de-6540f86e0472'} Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:46.298956 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Returning 404 to user: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:00:46.305318 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b52c0f40-a91f-4ce9-ac3d-238337718526 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 404 len: 111 microversion: 2.42 time: 0.037635 Jul 20 11:00:46.312456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24526a52-bf91-40d9-ae09-b17505c6b628 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '.version_select at 0x7f2c3f354af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:46.319551 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1504/2932] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:00:46 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:00:46.327013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4f64b4b-23a2-47e2-839a-9d4657b51e96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea29670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:46.351845 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-24526a52-bf91-40d9-ae09-b17505c6b628 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823760745" status: 204 len: 0 microversion: 2.42 time: 0.044688 Jul 20 11:00:46.352756 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1429/2933] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 11:00:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823760745 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:00:46.407880 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4f64b4b-23a2-47e2-839a-9d4657b51e96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.086708 Jul 20 11:00:46.408898 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1505/2934] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:46 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:46.980902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:46.982084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:47.000032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:47.000769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:47.001920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:47.002620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:47.423047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a771aa6a-a04d-4578-be64-51fdf3632713 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:47.514333 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a771aa6a-a04d-4578-be64-51fdf3632713 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.096500 Jul 20 11:00:47.515568 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1506/2935] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:47 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:48.292564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:48.312276 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78d3cc6b-3570-4183-b4e4-03acdc7f2a82 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 1.332393 Jul 20 11:00:48.327187 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1430/2936] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:46 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:48.530533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd41358e-0de5-44a3-9670-ead943ad0a28 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea29820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:48.615289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd41358e-0de5-44a3-9670-ead943ad0a28 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.089164 Jul 20 11:00:48.618822 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1507/2937] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:48 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:49.332934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:49.335188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:49.346671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:49.351594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:49.352657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:49.353266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:49.634214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c275b103-30ab-4d15-b6d6-51f2410a29d8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:49.734921 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c275b103-30ab-4d15-b6d6-51f2410a29d8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.104862 Jul 20 11:00:49.738051 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1508/2938] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:49 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:50.142318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:50.153848 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-46796305-4370-4689-a9d6-9e0c73a1c012 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.825793 Jul 20 11:00:50.168474 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1431/2939] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:49 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:50.748856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79a979ba-9508-428b-aa16-2e31dcd03c5c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea7e5e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:50.833791 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79a979ba-9508-428b-aa16-2e31dcd03c5c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.088113 Jul 20 11:00:50.840936 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1509/2940] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:50 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:50.971420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-47315f69-9e28-46b5-bb30-2dff6d6d64b9 req-065fed86-0d0a-4213-9406-224034c6aff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77621b7b-77b5-4fda-a4c2-a0c086795678", "tag": "5b8e850a-1e2e-439b-a122-6fe742c0cc2d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:51.001874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-47315f69-9e28-46b5-bb30-2dff6d6d64b9 req-065fed86-0d0a-4213-9406-224034c6aff4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:51.003601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-47315f69-9e28-46b5-bb30-2dff6d6d64b9 req-065fed86-0d0a-4213-9406-224034c6aff4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:51.029643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-47315f69-9e28-46b5-bb30-2dff6d6d64b9 req-065fed86-0d0a-4213-9406-224034c6aff4 service nova] Creating event network-changed:5b8e850a-1e2e-439b-a122-6fe742c0cc2d for instance 77621b7b-77b5-4fda-a4c2-a0c086795678 on n-h1-846219-10 Jul 20 11:00:51.036843 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-47315f69-9e28-46b5-bb30-2dff6d6d64b9 req-065fed86-0d0a-4213-9406-224034c6aff4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071802 Jul 20 11:00:51.038533 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1432/2941] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:00:51.176098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:51.177271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:51.207768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:51.208875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:51.209685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:51.210127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:51.445334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3439cf57-e1e9-4f2a-83d9-7d205c0de0d5 req-7bf4abf9-6d08-4b4d-bc32-027abb067975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7db14d8-91de-4457-930a-567699823919", "name": "network-vif-plugged", "status": "completed", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:00:51.468142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3439cf57-e1e9-4f2a-83d9-7d205c0de0d5 req-7bf4abf9-6d08-4b4d-bc32-027abb067975 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:51.470445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3439cf57-e1e9-4f2a-83d9-7d205c0de0d5 req-7bf4abf9-6d08-4b4d-bc32-027abb067975 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:51.517660 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3439cf57-e1e9-4f2a-83d9-7d205c0de0d5 req-7bf4abf9-6d08-4b4d-bc32-027abb067975 service nova] Creating event network-vif-plugged:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:00:51.544566 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3439cf57-e1e9-4f2a-83d9-7d205c0de0d5 req-7bf4abf9-6d08-4b4d-bc32-027abb067975 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101185 Jul 20 11:00:51.549402 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1433/2942] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:00:51.854014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5ef3242-fd6e-42cf-be2a-6e8e9fc65bf1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f478d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:51.923070 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5ef3242-fd6e-42cf-be2a-6e8e9fc65bf1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.076649 Jul 20 11:00:51.924364 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1434/2943] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:51 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:00:52.589974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:52.660157 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67844f85-ac11-41e4-bb73-ae59bb24a3d6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 1.486191 Jul 20 11:00:52.660785 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1510/2944] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:51 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:52.935373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:52.941572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c876e3c5-1fcf-4d6f-82e6-72a81a07fd5a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc32ca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:52.984283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:53.043709 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c876e3c5-1fcf-4d6f-82e6-72a81a07fd5a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.110291 Jul 20 11:00:53.046506 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1435/2945] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:52 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:53.684929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:53.687124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:53.709635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:53.711221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:53.712698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:53.713806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:53.724069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:54.059429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b9a9f6a-7480-43c0-8603-b7e371972b3c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fd689d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:54.153078 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b9a9f6a-7480-43c0-8603-b7e371972b3c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.098464 Jul 20 11:00:54.154740 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1436/2946] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:54 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:54.747681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:54.763132 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7beb8ca-acf5-411b-b300-7e0d633de4ca tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 1.088537 Jul 20 11:00:54.777199 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1511/2947] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:53 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:55.182856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a09b77e3-97ef-4ed1-9e36-17fcef2277b8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fee4940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:55.324866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a09b77e3-97ef-4ed1-9e36-17fcef2277b8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.159264 Jul 20 11:00:55.326552 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1437/2948] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:55 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:55.797638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:55.798597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:55.812342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:00:55.814864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:55.815365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:55.816148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:55.824072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:56.341572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf88391d-d4e3-42b6-b4a2-c82f49317430 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c4dcc20d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:56.432498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf88391d-d4e3-42b6-b4a2-c82f49317430 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.090739 Jul 20 11:00:56.433046 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1438/2949] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:56 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:57.441885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6682e0b-713c-4a43-baa1-4c27e7636f5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc6db80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:57.519875 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6682e0b-713c-4a43-baa1-4c27e7636f5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.082692 Jul 20 11:00:57.522479 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1439/2950] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:57 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:00:57.593335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:57.606588 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f4a144fa-284c-4087-aaa0-69e33448f631 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 1.809923 Jul 20 11:00:57.608257 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1512/2951] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:55 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:58.540693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-694e150b-151e-40c6-9c8a-a68ec76c9509 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fd683a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:58.616035 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-694e150b-151e-40c6-9c8a-a68ec76c9509 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.084756 Jul 20 11:00:58.623232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:58.623993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:00:58.630591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:58.632828 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1440/2952] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:58 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:58.633576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:58.635388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:00:58.638624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:00:59.256802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:00:59.271212 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5aea4a17-d50c-4050-b1ee-858e6b2d4105 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.651432 Jul 20 11:00:59.272598 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1513/2953] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:00:58 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:00:59.631914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a7d25af5-0c25-4c03-926c-6341f2c9585a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f7c21f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:00:59.760419 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a7d25af5-0c25-4c03-926c-6341f2c9585a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.131427 Jul 20 11:00:59.773039 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1441/2954] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:00:59 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:00.289341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:00.290636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:00.303927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:00.310114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:00.311353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:00.311975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:00.784867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d328b2bd-18a9-4900-abaf-f34046bdc9ed tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c4dcc2700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:00.893073 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d328b2bd-18a9-4900-abaf-f34046bdc9ed tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.107103 Jul 20 11:01:00.895639 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1442/2955] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:00 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:01.065331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:01.073532 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43d77034-2bc5-435a-a017-2183dbc862da tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.788204 Jul 20 11:01:01.089306 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1514/2956] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:00 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:01.909193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a8e651e-b449-4801-9b4b-37d893c0fab3 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc6daf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:01.926838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:01.934087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:02.069609 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a8e651e-b449-4801-9b4b-37d893c0fab3 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.161930 Jul 20 11:01:02.073768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1443/2957] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:01 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:02.109085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:02.110854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:02.123159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:02.125861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:02.126599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:02.127742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:02.128336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:02.607688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:02.616455 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-91316601-09b5-47ec-b50b-85ffb25688c6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.518329 Jul 20 11:01:02.627945 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1515/2958] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:02 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:03.088540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f70e0227-4dd5-497c-8d34-6b6e3dcdc07c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f478b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:03.186551 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f70e0227-4dd5-497c-8d34-6b6e3dcdc07c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.103971 Jul 20 11:01:03.188330 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1444/2959] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:03 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:03.635571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:03.636842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:03.644045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:03.650327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:03.651465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:03.652078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:04.201673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4ab40185-c121-4b83-adb7-95690effb691 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa36820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:04.282032 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4ab40185-c121-4b83-adb7-95690effb691 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.084606 Jul 20 11:01:04.288060 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1445/2960] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:04 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:04.791534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:04.801018 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-721c7d73-fc94-4818-af15-f1e4f361b171 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 1.169223 Jul 20 11:01:04.804191 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1516/2961] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:03 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:05.300248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15795d50-9369-47b4-a3a5-aa6fb2aa7f25 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fd68b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:05.480886 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15795d50-9369-47b4-a3a5-aa6fb2aa7f25 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.188775 Jul 20 11:01:05.483757 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1446/2962] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:05 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:05.824236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:05.824853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:05.844416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:05.845768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:05.846916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:05.847644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:06.496602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3d0bf240-5ad1-4fad-9fa1-f3f3230eba48 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc6dc10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:06.595575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3d0bf240-5ad1-4fad-9fa1-f3f3230eba48 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.104444 Jul 20 11:01:06.596785 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1447/2963] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:06 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:06.763004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:06.763661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:06.774204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:06.774661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:06.775485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:06.775918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:06.784800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:06.801772 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-edde521c-e350-4186-be1c-ae596ae5f80a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.985376 Jul 20 11:01:06.821547 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1517/2964] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:05 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:06.851085 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] HTTP exception thrown: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Request method failure captured: Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 HTTP/1.1 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1964bPSpVNDE9L12OiyZtDzbjIltKq3mQ2-zLVbEJPRuD4MtNDU-uhU7sFGLRSMX3sA1CGEX9sYIMiTfyZl8z_1B7cSQ1INyrQTRXzyo_Bl7QiX0PmjTuxbrQ7SFHwhJpiA5xxHFgoxxI_tpoRzRIsR3lB-ITWBwwXJkAgY0psZDyO4 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f595bedf58af4d0d9b1866f28148b42b Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f595bedf58af4d0d9b1866f28148b42b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f595bedf58af4d0d9b1866f28148b42b Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TaggedBootDevicesTest_v242-1688722382-project Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: f8ca8707ab044974b65cd49346ec2618 Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1688722382-project Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'ea40658d-08bc-47b4-80de-6540f86e0472'} Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:01:06.853428 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.859439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.862902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Returning 404 to user: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:01:06.864385 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-69474e4a-34d1-4be2-abc2-749b33ec22f8 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 404 len: 111 microversion: 2.42 time: 0.105008 Jul 20 11:01:06.865423 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1448/2965] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:01:06 2022] DELETE /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:01:06.874025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:06.875406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] [instance: ea40658d-08bc-47b4-80de-6540f86e0472] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:06.885009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:06.885840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:06.887255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:06.888146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:06.908829 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] HTTP exception thrown: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Request method failure captured: Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 HTTP/1.1 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1964bPSpVNDE9L12OiyZtDzbjIltKq3mQ2-zLVbEJPRuD4MtNDU-uhU7sFGLRSMX3sA1CGEX9sYIMiTfyZl8z_1B7cSQ1INyrQTRXzyo_Bl7QiX0PmjTuxbrQ7SFHwhJpiA5xxHFgoxxI_tpoRzRIsR3lB-ITWBwwXJkAgY0psZDyO4 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.42 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f595bedf58af4d0d9b1866f28148b42b Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f595bedf58af4d0d9b1866f28148b42b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f595bedf58af4d0d9b1866f28148b42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f595bedf58af4d0d9b1866f28148b42b Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1688722382 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TaggedBootDevicesTest_v242-1688722382-project Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f8ca8707ab044974b65cd49346ec2618 Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1688722382-project Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ea40658d-08bc-47b4-80de-6540f86e0472'} Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.914216 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. Jul 20 11:01:06.918720 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:06.924686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] Returning 404 to user: Instance ea40658d-08bc-47b4-80de-6540f86e0472 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:01:06.928579 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d6618b2-d788-4c98-b5d1-1fa6c04b7c34 tempest-TaggedBootDevicesTest_v242-1688722382 tempest-TaggedBootDevicesTest_v242-1688722382-project] 10.222.0.79 "GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472" status: 404 len: 111 microversion: 2.42 time: 0.058687 Jul 20 11:01:06.937344 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1518/2966] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:01:06 2022] GET /compute/v2.1/servers/ea40658d-08bc-47b4-80de-6540f86e0472 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:01:07.610863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2372fc78-b676-4e06-b433-3d90f72923d4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f48f940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:07.737427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2372fc78-b676-4e06-b433-3d90f72923d4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.120307 Jul 20 11:01:07.741390 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1449/2967] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:07 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:07.825325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:07.826256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:07.837990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:07.841288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:07.845177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:07.845883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:08.370011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:08.382061 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2a03aa8-d311-459c-93d1-1bfe1b346b90 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.563582 Jul 20 11:01:08.384886 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1519/2968] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:07 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:08.755879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b96ee86-bbaf-40d9-9a3f-687bedc56600 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc32700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:08.866953 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1b96ee86-bbaf-40d9-9a3f-687bedc56600 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.118102 Jul 20 11:01:08.867723 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1450/2969] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:08 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:09.309766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-54fb4f46-8af1-4d70-b243-2da2dd930908 req-5e4ce9c9-90eb-4fa4-9037-19b5aac2ddf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77621b7b-77b5-4fda-a4c2-a0c086795678", "name": "network-vif-plugged", "status": "completed", "tag": "5b8e850a-1e2e-439b-a122-6fe742c0cc2d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:09.340635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-54fb4f46-8af1-4d70-b243-2da2dd930908 req-5e4ce9c9-90eb-4fa4-9037-19b5aac2ddf9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:09.340999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-54fb4f46-8af1-4d70-b243-2da2dd930908 req-5e4ce9c9-90eb-4fa4-9037-19b5aac2ddf9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:09.370537 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-54fb4f46-8af1-4d70-b243-2da2dd930908 req-5e4ce9c9-90eb-4fa4-9037-19b5aac2ddf9 service nova] Creating event network-vif-plugged:5b8e850a-1e2e-439b-a122-6fe742c0cc2d for instance 77621b7b-77b5-4fda-a4c2-a0c086795678 on n-h1-846219-10 Jul 20 11:01:09.379769 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-54fb4f46-8af1-4d70-b243-2da2dd930908 req-5e4ce9c9-90eb-4fa4-9037-19b5aac2ddf9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078202 Jul 20 11:01:09.384340 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1520/2970] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:09.413475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:09.414329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:09.427547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:09.428277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:09.445171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:09.447738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:09.782264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-26be48cd-1bb4-44fb-99a6-beb46a46d16b tempest-AbsoluteLimitsTestJSON-2127873329 tempest-AbsoluteLimitsTestJSON-2127873329-project] Calling method '.version_select at 0x7f2c3ea33820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:09.807531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26be48cd-1bb4-44fb-99a6-beb46a46d16b tempest-AbsoluteLimitsTestJSON-2127873329 tempest-AbsoluteLimitsTestJSON-2127873329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:09.808259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26be48cd-1bb4-44fb-99a6-beb46a46d16b tempest-AbsoluteLimitsTestJSON-2127873329 tempest-AbsoluteLimitsTestJSON-2127873329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:09.809349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26be48cd-1bb4-44fb-99a6-beb46a46d16b tempest-AbsoluteLimitsTestJSON-2127873329 tempest-AbsoluteLimitsTestJSON-2127873329-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:09.811861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26be48cd-1bb4-44fb-99a6-beb46a46d16b tempest-AbsoluteLimitsTestJSON-2127873329 tempest-AbsoluteLimitsTestJSON-2127873329-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:09.877409 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-26be48cd-1bb4-44fb-99a6-beb46a46d16b tempest-AbsoluteLimitsTestJSON-2127873329 tempest-AbsoluteLimitsTestJSON-2127873329-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.453176 Jul 20 11:01:09.899310 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1521/2971] 10.222.0.79 () {58 vars in 1121 bytes} [Wed Jul 20 11:01:09 2022] GET /compute/v2.1/limits => generated 511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:09.904289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a0a16bb-5b4e-4715-bacb-8d1fce809432 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17b80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:09.994349 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7a0a16bb-5b4e-4715-bacb-8d1fce809432 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.093800 Jul 20 11:01:10.000641 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1522/2972] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:09 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:10.272150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:10.298302 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-67fd9b93-4091-4b7c-ba17-79e444f5bc30 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 0.894584 Jul 20 11:01:10.315680 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1451/2973] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:09 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:10.569031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a0a16bb-5b4e-4715-bacb-8d1fce809432 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:10.570573 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7a0a16bb-5b4e-4715-bacb-8d1fce809432 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001883 Jul 20 11:01:10.571109 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1523/2974] 10.222.0.79 () {56 vars in 885 bytes} [Wed Jul 20 11:01:10 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 11:01:11.011516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58616a41-1248-4ada-9b95-5110532b47db tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f65d310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:11.123921 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58616a41-1248-4ada-9b95-5110532b47db tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.119632 Jul 20 11:01:11.124707 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1452/2975] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:11 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:11.317469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:11.318374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:11.343659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:11.345550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:11.350190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:11.350690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:12.138732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-41b385ac-db4e-4c18-9d45-dd56a166eb8c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc32ee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:12.299927 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-41b385ac-db4e-4c18-9d45-dd56a166eb8c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.165898 Jul 20 11:01:12.300519 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1453/2976] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:12 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:13.074083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:13.087106 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-07932f94-5df9-47d1-83d2-87f6b2744a42 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1308 microversion: 2.1 time: 1.774283 Jul 20 11:01:13.106397 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1524/2977] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:11 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1308 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:13.317687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-418357c4-b053-45d0-9808-183d09007e6f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f69b3a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:13.421626 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-418357c4-b053-45d0-9808-183d09007e6f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.111603 Jul 20 11:01:13.433432 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1454/2978] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:13 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:14.110836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:14.112209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:14.139869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:14.141452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:14.143875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:14.146363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:14.437439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-89c7e094-043d-4264-83d6-f664de894bac tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fd683a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:14.548942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-89c7e094-043d-4264-83d6-f664de894bac tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.117271 Jul 20 11:01:14.555072 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1455/2979] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:14 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:14.918041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3c3ee495-1e91-4496-8fc7-7c4a033dc4a0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Action: 'create', calling method: .version_select at 0x7f2c3f871e50>, body: {"keypair": {"name": "tempest-keypair-1097317527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfv1W75El8aOp7WwM5GAe7sTsFI+3oDrpX7tfoxGK9dDgUhv2yGyZ1QXfWPiLys09T3i4GeRwxaGc4Y62UGDULTPBI83WVrPoWAxan8L/THbc18Cy1IiZ/cSpQ9Zw0ZYg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:14.980214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3c3ee495-1e91-4496-8fc7-7c4a033dc4a0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Getting quotas for project a40e588b2fe24bfca9c216e619e69cf8. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:15.011857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3c3ee495-1e91-4496-8fc7-7c4a033dc4a0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Getting quotas for user e9569321bb7e4481ba94f6af7d7c0c4e and project a40e588b2fe24bfca9c216e619e69cf8. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:15.115064 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3c3ee495-1e91-4496-8fc7-7c4a033dc4a0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.561898 Jul 20 11:01:15.118571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1456/2980] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:01:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:15.214906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:15.232451 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c09b0ce-6e40-45e6-a687-ed2df66d6cd2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1489 microversion: 2.1 time: 1.126208 Jul 20 11:01:15.238549 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1525/2981] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:14 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1489 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:15.563872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11cf2614-12a8-4b16-86d0-fe58d9a39813 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f69b310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:15.631068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-757899483", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:15.687763 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11cf2614-12a8-4b16-86d0-fe58d9a39813 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.128896 Jul 20 11:01:15.694601 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1457/2982] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:15 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:15.767582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:01:16.705511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-333b1f86-d652-445f-8f99-23c9e5566ac3 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f65d5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:16.813387 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-333b1f86-d652-445f-8f99-23c9e5566ac3 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.115344 Jul 20 11:01:16.819502 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1458/2983] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:16 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:17.829809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-decbc56e-b0d4-49c6-89f2-6c2c80cfa296 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3edce3a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:17.971759 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-decbc56e-b0d4-49c6-89f2-6c2c80cfa296 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.148044 Jul 20 11:01:17.972652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1459/2984] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:17 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:18.987791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3962cd4-261e-40d3-9ac9-bc415e848e0b tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c4dcc2940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:19.079077 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3962cd4-261e-40d3-9ac9-bc415e848e0b tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1451 microversion: 2.1 time: 0.096926 Jul 20 11:01:19.080347 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1460/2985] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:18 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1451 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:19.727251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:01:19.727878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:01:19.728571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:01:19.729108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:01:19.730006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:01:19.752748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:19.755428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:19.756461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:19.757716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:19.810992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:19.825701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:19.859462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:01:19.870884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:01:19.946273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41a7d841-37cc-4eed-9e2c-f40925427e5c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.320674 Jul 20 11:01:19.947761 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1526/2986] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:01:19.959637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77f12fa8-ba76-468f-ad43-ed7e2f3a8e39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:19.961362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77f12fa8-ba76-468f-ad43-ed7e2f3a8e39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:20.096613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db366b6c-392a-4ec3-b9c8-8268cc3f3483 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:20.137337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77f12fa8-ba76-468f-ad43-ed7e2f3a8e39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:20.148229 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77f12fa8-ba76-468f-ad43-ed7e2f3a8e39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1208 microversion: 2.1 time: 0.194114 Jul 20 11:01:20.155489 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1461/2987] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:19 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1208 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:20.193835 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db366b6c-392a-4ec3-b9c8-8268cc3f3483 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1460 microversion: 2.1 time: 0.104026 Jul 20 11:01:20.195340 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1527/2988] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:20 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1460 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:20.207412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be3ea40d-7de2-4184-b07a-d69c3b819ebb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f48f940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:20.275923 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be3ea40d-7de2-4184-b07a-d69c3b819ebb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 200 len: 1460 microversion: 2.1 time: 0.072760 Jul 20 11:01:20.276909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1462/2989] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:20 2022] GET /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 1460 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:20.288952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:20.289831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:20.301571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:20.307864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:20.309202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:20.309852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:20.950028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:20.961712 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2b30246-d8a9-4ebe-885c-9e764aeae2de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 200 len: 1467 microversion: 2.1 time: 0.676840 Jul 20 11:01:20.968335 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1528/2990] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:20 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 1467 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:20.979667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:20.983918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-681542512"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:20.985038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:21.004696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:21.005160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:21.006175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:21.006796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:21.165919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:21.166550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:21.178014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:21.178635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:21.179764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:21.180287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:21.368472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:21.390360 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-858b426f-b170-4c15-a4f3-be4a96e0ae4b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1204 microversion: 2.1 time: 0.228184 Jul 20 11:01:21.395221 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1529/2991] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:21 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1204 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:21.630283 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-762db0af-31a8-4199-8cbb-42c19def694e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "POST /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100/action" status: 202 len: 0 microversion: 2.1 time: 0.651244 Jul 20 11:01:21.632829 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1463/2992] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:01:20 2022] POST /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 11:01:21.640659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-727c86fa-7c85-4572-b38e-fd2555286942 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f704dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:21.740250 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-727c86fa-7c85-4572-b38e-fd2555286942 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.103663 Jul 20 11:01:21.743584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1530/2993] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:21 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:22.413403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:22.414172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:22.434720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:22.435196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:22.436688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:22.437152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:22.758656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d34e095d-9447-4f93-be63-a668f827a6d8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea3d0d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:22.845595 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d34e095d-9447-4f93-be63-a668f827a6d8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.091023 Jul 20 11:01:22.846746 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1531/2994] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:22 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:23.418024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:23.431662 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f65ee8fc-01af-45bd-9c0f-faef27078f29 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1266 microversion: 2.1 time: 1.024312 Jul 20 11:01:23.432270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1464/2995] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:22 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1266 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:23.877543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5f4acba-4fff-4b70-ae90-0bf9d7fc4905 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea7e4c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:23.981911 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5f4acba-4fff-4b70-ae90-0bf9d7fc4905 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.125421 Jul 20 11:01:23.990004 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1532/2996] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:23 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:24.450635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:24.451345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:24.467632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:24.470681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:24.471634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:24.472093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:25.049363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9017e434-9819-443c-a8f0-04f893347f0d req-4f6ff083-437b-4ab9-abcd-ae05d9b1b0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7db14d8-91de-4457-930a-567699823919", "name": "network-vif-unplugged", "status": "completed", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:25.078796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9017e434-9819-443c-a8f0-04f893347f0d req-4f6ff083-437b-4ab9-abcd-ae05d9b1b0d4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:25.084196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9017e434-9819-443c-a8f0-04f893347f0d req-4f6ff083-437b-4ab9-abcd-ae05d9b1b0d4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:25.107946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:25.123029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6387a55-1734-420d-88fe-79356a8b9c26 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 0.676867 Jul 20 11:01:25.128232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=79 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:25.128617 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1465/2997] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:24 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:25.141668 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9017e434-9819-443c-a8f0-04f893347f0d req-4f6ff083-437b-4ab9-abcd-ae05d9b1b0d4 service nova] Creating event network-vif-unplugged:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:01:25.190683 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9017e434-9819-443c-a8f0-04f893347f0d req-4f6ff083-437b-4ab9-abcd-ae05d9b1b0d4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.576158 Jul 20 11:01:25.194838 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1533/2998] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:01:25.210937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7a5b863-d51e-4466-a7d1-4a298cc09331 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17e50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:25.263731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1780945517", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "d319a698-88a9-4733-8964-1eb7a08c5a1d"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:25.294900 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7a5b863-d51e-4466-a7d1-4a298cc09331 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.098378 Jul 20 11:01:25.300584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1534/2999] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:25 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:25.396002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] validate_networks() for [('d319a698-88a9-4733-8964-1eb7a08c5a1d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:01:26.148199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:26.149964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:26.195223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:26.198313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:26.205073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:26.205877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:27.286693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:27.304478 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d4cff9cd-e6c1-47cf-9e79-3d2f92d3703a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 1.153526 Jul 20 11:01:27.305600 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1535/3000] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:26 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:27.319252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63fb3168-f0c0-418f-a15f-f155580614b1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:27.450377 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-63fb3168-f0c0-418f-a15f-f155580614b1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.143460 Jul 20 11:01:27.451755 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1536/3001] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:27 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:27.463346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "30f03b62-e14f-492d-bc9c-b1c685266d35"}], "security_groups": [{"name": "tempest-securitygroup--2126133417"}], "key_name": "tempest-keypair-1097317527", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:27.759355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:01:27.761330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:01:27.762776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:01:27.763482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:01:27.764141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:01:27.785269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:27.789168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:27.791881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:27.794081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:27.856179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for project d427430f6c374ad183381dc509229fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:27.877528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for user c597235b7c47404da82b77cd60317eb3 and project d427430f6c374ad183381dc509229fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:27.916213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:01:27.937652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:01:28.049965 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff1bfd62-19c0-4ea6-8fc5-10ab56f6f6bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.918774 Jul 20 11:01:28.056427 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1466/3002] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:01:28.080229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-224ccb3e-5bff-4ac6-87f9-eb5b8666f0bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:28.089347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-224ccb3e-5bff-4ac6-87f9-eb5b8666f0bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:28.367132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-224ccb3e-5bff-4ac6-87f9-eb5b8666f0bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:28.373167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] validate_networks() for [('30f03b62-e14f-492d-bc9c-b1c685266d35', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:01:28.389679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-224ccb3e-5bff-4ac6-87f9-eb5b8666f0bc tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1225 microversion: 2.1 time: 0.327118 Jul 20 11:01:28.402009 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1467/3003] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:28 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1225 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:28.413341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:28.414307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:28.453487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:28.464838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:28.470094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:28.470625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:29.785310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:29.846202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:30.503543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:30.512743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dc9a9919-4b46-43fd-ad24-ee1f10fbf473 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 2.109453 Jul 20 11:01:30.517076 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1468/3004] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:28 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:30.531359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-67bf5c4c-e835-4d88-8ac0-13e45377472a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f69baf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:30.657988 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-67bf5c4c-e835-4d88-8ac0-13e45377472a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.138857 Jul 20 11:01:30.660028 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1469/3005] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:30 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:30.677993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-eb3e840a-384b-408c-9c07-7af1cf667a05 req-04c278bf-d402-4abf-a61e-605f7b7a1512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1e4d60-4653-4ffb-bca5-7d435d2373af", "tag": "867ad5ba-55ec-4e65-9ab6-ff3054974bdd"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:30.724295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eb3e840a-384b-408c-9c07-7af1cf667a05 req-04c278bf-d402-4abf-a61e-605f7b7a1512 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:30.726302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eb3e840a-384b-408c-9c07-7af1cf667a05 req-04c278bf-d402-4abf-a61e-605f7b7a1512 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:30.763201 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-eb3e840a-384b-408c-9c07-7af1cf667a05 req-04c278bf-d402-4abf-a61e-605f7b7a1512 service nova] Creating event network-changed:867ad5ba-55ec-4e65-9ab6-ff3054974bdd for instance fa1e4d60-4653-4ffb-bca5-7d435d2373af on n-h1-846219-10 Jul 20 11:01:30.781354 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-eb3e840a-384b-408c-9c07-7af1cf667a05 req-04c278bf-d402-4abf-a61e-605f7b7a1512 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118591 Jul 20 11:01:30.781989 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1470/3006] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:30.793432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:30.794147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:30.813975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:30.814439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:30.815267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:30.815716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:31.006133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:31.015057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5aa46d11-7ada-4313-9d94-0653599b8bf5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1283 microversion: 2.1 time: 0.231849 Jul 20 11:01:31.023206 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1471/3007] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:30 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1283 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:31.093466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:01:31.094548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:01:31.095035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:01:31.095485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:01:31.095906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:01:31.120232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:31.120684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:31.122903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:31.131568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:31.199904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Getting quotas for project a40e588b2fe24bfca9c216e619e69cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:31.212600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Getting quotas for user e9569321bb7e4481ba94f6af7d7c0c4e and project a40e588b2fe24bfca9c216e619e69cf8. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:31.230791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:01:31.233789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:01:31.305521 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cae171e9-5fb3-4075-9389-19bea9ecbac5 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.852413 Jul 20 11:01:31.306750 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1537/3008] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:01:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 3854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:01:31.316798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-556c0eef-eb61-40ba-aa8b-e925300ad81c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:31.317706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-556c0eef-eb61-40ba-aa8b-e925300ad81c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:31.537636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:31.539216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:31.552644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:31.553260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:31.554070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:31.554518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:31.604712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-556c0eef-eb61-40ba-aa8b-e925300ad81c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:31.619201 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-556c0eef-eb61-40ba-aa8b-e925300ad81c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1226 microversion: 2.1 time: 0.306125 Jul 20 11:01:31.620148 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1472/3009] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:31 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1226 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:31.674135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80bdba18-8430-4dc4-ae74-e6647ea78a9c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f4628b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:31.756081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80bdba18-8430-4dc4-ae74-e6647ea78a9c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.087463 Jul 20 11:01:31.757409 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1473/3010] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:31 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:32.041530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:32.042157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:32.044408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:32.057728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:32.058186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:32.058982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:32.062602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:33.223721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:33.239881 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3ebaaf3d-163b-40fc-bd52-72faa798c751 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1283 microversion: 2.1 time: 1.202662 Jul 20 11:01:33.244123 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1474/3011] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:32 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1283 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:33.269255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:33.273120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:33.302951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:33.305461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:33.315450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:33.321382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:33.815822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:33.825123 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b04e3dc2-1de9-4d36-9b08-9b7c13f9ce25 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 2.295285 Jul 20 11:01:33.836479 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1538/3012] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:31 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:33.851578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:33.856992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9be8051-6c32-4bc3-b9d5-1b56240e7bc7 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:33.861194 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ade8abc-033d-4f3e-914d-cbd4557b799a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1278 microversion: 2.1 time: 0.615996 Jul 20 11:01:33.868064 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1475/3013] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:33 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1278 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:33.964987 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9be8051-6c32-4bc3-b9d5-1b56240e7bc7 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.124206 Jul 20 11:01:33.965840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1539/3014] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:33 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:34.258383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:34.259070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:34.277240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:34.279693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:34.285078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:34.290023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:34.448015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:34.457244 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-846b5374-e805-45da-a7a4-2cf3c5632aee tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1283 microversion: 2.1 time: 0.203633 Jul 20 11:01:34.466780 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1476/3015] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:34 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1283 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:34.855242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:34.856843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:34.859578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:34.904826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:34.910701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:34.911455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:34.917645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:34.922424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:34.923749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:34.932943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:34.933738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:34.937048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:34.939579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:35.275372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:35.284294 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02aee461-e399-4996-94d9-7c8bb145299f tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1284 microversion: 2.1 time: 0.383933 Jul 20 11:01:35.285111 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1477/3016] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:34 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1284 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:35.312395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b9ce7cc4-ae20-4ff0-8e65-6554d71a98c0 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc32430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:35.430789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b9ce7cc4-ae20-4ff0-8e65-6554d71a98c0 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.122785 Jul 20 11:01:35.431421 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1478/3017] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:35 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:35.483816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:35.484492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:35.503797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:35.504417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:35.515333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:35.515826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:36.566378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:36.593969 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0224cf21-6758-4469-953f-3fc134445ae7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 1.743954 Jul 20 11:01:36.606692 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1540/3018] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:34 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:36.613488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a9433c7b-d953-43fb-b0f1-6a41e8eb8ea7 req-43188902-ecbe-41aa-99d4-db8791f09c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6c4205-eb71-4050-9527-adf95060d100", "name": "network-vif-plugged", "status": "completed", "tag": "84596e6f-53b6-49de-83af-236da2b3a9a4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:36.662328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a9433c7b-d953-43fb-b0f1-6a41e8eb8ea7 req-43188902-ecbe-41aa-99d4-db8791f09c50 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:36.670308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a9433c7b-d953-43fb-b0f1-6a41e8eb8ea7 req-43188902-ecbe-41aa-99d4-db8791f09c50 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:36.715533 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a9433c7b-d953-43fb-b0f1-6a41e8eb8ea7 req-43188902-ecbe-41aa-99d4-db8791f09c50 service nova] Creating event network-vif-plugged:84596e6f-53b6-49de-83af-236da2b3a9a4 for instance be6c4205-eb71-4050-9527-adf95060d100 on n-h2-846219-10 Jul 20 11:01:36.734015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a9433c7b-d953-43fb-b0f1-6a41e8eb8ea7 req-43188902-ecbe-41aa-99d4-db8791f09c50 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125201 Jul 20 11:01:36.738469 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1541/3019] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:36.756617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:36.757816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:36.766318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:36.767324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:36.768561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:36.770390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:37.037024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:37.058901 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16a9ded3-56ca-4c3e-b98e-23b5668bbc79 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 1.577136 Jul 20 11:01:37.062937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1479/3020] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:35 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:37.078930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1885fd7c-ba19-4e6c-9ae6-3b83069e0e6e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3edce700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:37.190820 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1885fd7c-ba19-4e6c-9ae6-3b83069e0e6e tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.126019 Jul 20 11:01:37.198708 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1480/3021] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:37 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:37.310912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:37.333262 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-66e5cc60-60f2-4db7-ab8f-55f8ace05ca0 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1284 microversion: 2.1 time: 0.588140 Jul 20 11:01:37.334337 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1542/3022] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:36 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1284 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:37.622379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:37.623006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:37.642780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:37.644181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:37.645411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:37.646095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:37.826187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:37.941472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-518a32b3-9155-4eee-8aad-1f91d03d0825 tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] Calling method '.version_select at 0x7f2c3ea17dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:38.086292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-518a32b3-9155-4eee-8aad-1f91d03d0825 tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06/defaults" status: 200 len: 371 microversion: 2.1 time: 0.430707 Jul 20 11:01:38.086966 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1543/3023] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 11:01:37 2022] GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06/defaults => generated 371 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:38.110306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:38.112304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:38.123309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:38.126205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:38.127276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:38.133141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:39.012248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:39.038446 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c794a79-ba05-45fd-8525-a250e84581f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 1.420346 Jul 20 11:01:39.044065 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1481/3024] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:37 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:39.075712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12ee6911-e91d-4ae9-b4fb-1b575a06154a tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] Calling method '.version_select at 0x7f2c3f4628b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:39.234219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-12ee6911-e91d-4ae9-b4fb-1b575a06154a tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06" status: 200 len: 371 microversion: 2.1 time: 0.188778 Jul 20 11:01:39.235523 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1482/3025] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 11:01:39 2022] GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:39.241484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ddfed04-907f-4837-8790-69aa55f2176c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f82bee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:39.325425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:39.345090 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-11a7bc67-df34-4892-b2de-903dbead5b89 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 1.247300 Jul 20 11:01:39.355504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0ddfed04-907f-4837-8790-69aa55f2176c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.118544 Jul 20 11:01:39.356700 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1483/3026] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:39 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:39.362024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:39.366350 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1544/3027] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:38 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:39.366761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:39.375727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:39.376825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:39.378044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:39.379004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:39.388945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a8c7f2c-aafc-4fe8-84ae-438930ad734f tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] Calling method '.version_select at 0x7f2c3ea17430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:39.567114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a8c7f2c-aafc-4fe8-84ae-438930ad734f tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06/defaults" status: 200 len: 371 microversion: 2.1 time: 0.192028 Jul 20 11:01:39.571704 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1545/3028] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 11:01:39 2022] GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06/defaults => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:39.585334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7208f25e-b5fe-4232-8e90-c82d00372cf6 tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] Calling method '.version_select at 0x7f2c3ea7cc10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:39.722520 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7208f25e-b5fe-4232-8e90-c82d00372cf6 tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06" status: 200 len: 371 microversion: 2.1 time: 0.143903 Jul 20 11:01:39.723429 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1546/3029] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 11:01:39 2022] GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06 => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:01:39.736907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0348b80d-f225-448f-bd90-1ad479f08b0e tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] Calling method '.version_select at 0x7f2c3ea3d1f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:39.838778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0348b80d-f225-448f-bd90-1ad479f08b0e tempest-QuotasTestJSON-1475626705 tempest-QuotasTestJSON-1475626705-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06?user_id=974e0d8950cf4f95816c3ade1b439337" status: 200 len: 371 microversion: 2.1 time: 0.107299 Jul 20 11:01:39.840099 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1547/3030] 10.222.0.79 () {58 vars in 1322 bytes} [Wed Jul 20 11:01:39 2022] GET /compute/v2.1/os-quota-sets/10664237e4d949b285d5c1871cfd0c06?user_id=974e0d8950cf4f95816c3ade1b439337 => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:40.058178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:40.058814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:40.072392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:40.072869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:40.073656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:40.074099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:40.207756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:40.219696 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fc7bca8-de81-41da-8218-6d05b8ba0d5a tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 0.861595 Jul 20 11:01:40.235903 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1484/3031] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:39 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:40.372238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e617cf38-c255-465f-8d8d-2513c082d7e2 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f69b280>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:40.464403 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e617cf38-c255-465f-8d8d-2513c082d7e2 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.096636 Jul 20 11:01:40.470628 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1485/3032] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:40 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:40.478872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:40.479643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:40.505817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:40.506233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:40.509543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:40.511017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:40.565955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:40.591060 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e59e698-038b-42a7-95ea-243c7d18e07d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 0.534344 Jul 20 11:01:40.598201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1548/3033] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:40 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:41.201831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b1ddd540-afcf-4f86-9ce1-09fe49ca4bb0 req-e5ce2728-5f6c-4cd3-b75f-951680e55734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55eb4564-a96b-491d-85c0-3b5fd106a293", "tag": "22feaab9-afe4-4f6c-8685-953810b22c94"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:41.227631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:41.231720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b1ddd540-afcf-4f86-9ce1-09fe49ca4bb0 req-e5ce2728-5f6c-4cd3-b75f-951680e55734 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:41.239815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b1ddd540-afcf-4f86-9ce1-09fe49ca4bb0 req-e5ce2728-5f6c-4cd3-b75f-951680e55734 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:41.273354 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b1ddd540-afcf-4f86-9ce1-09fe49ca4bb0 req-e5ce2728-5f6c-4cd3-b75f-951680e55734 service nova] Creating event network-changed:22feaab9-afe4-4f6c-8685-953810b22c94 for instance 55eb4564-a96b-491d-85c0-3b5fd106a293 on n-h2-846219-10 Jul 20 11:01:41.289918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b1ddd540-afcf-4f86-9ce1-09fe49ca4bb0 req-e5ce2728-5f6c-4cd3-b75f-951680e55734 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093334 Jul 20 11:01:41.293206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1549/3034] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:41.310387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:41.312003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:41.321301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:41.321936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:41.322816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:41.323571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:41.386138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:41.401040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0bec27e-38bc-410b-9f38-f12488726a07 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 0.926317 Jul 20 11:01:41.407253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1486/3035] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:40 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:41.480605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b8bbab8e-98a9-40c4-a9e8-51cbf60aacd5 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f6985e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:41.573504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b8bbab8e-98a9-40c4-a9e8-51cbf60aacd5 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.098442 Jul 20 11:01:41.574116 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1487/3036] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:41 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:41.615352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:41.615987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:41.626279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:41.635381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:41.639253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:41.639869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:42.598803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:42.606756 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a042db0-d70e-4845-b5bc-04f9f5d020bf tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 1.312214 Jul 20 11:01:42.617323 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1550/3037] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:41 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:42.618574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:42.619223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:42.634238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:42.634692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:42.639193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:42.639699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:42.727044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:42.748022 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b011a099-e2a4-412b-842c-c269d2c93ac9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 1.137637 Jul 20 11:01:42.762459 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1488/3038] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:41 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:42.768695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-37d61020-466c-40ab-a032-7389c26b649a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c4dcc20d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:42.832245 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-37d61020-466c-40ab-a032-7389c26b649a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.067697 Jul 20 11:01:42.833537 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1489/3039] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:42 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:42.941777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f8e75fc6-c47f-43c0-ae3f-19bfe236226d req-440dae91-7a46-4663-90e5-eb1d05e96760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1e4d60-4653-4ffb-bca5-7d435d2373af", "name": "network-vif-plugged", "status": "completed", "tag": "867ad5ba-55ec-4e65-9ab6-ff3054974bdd"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:42.970331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f8e75fc6-c47f-43c0-ae3f-19bfe236226d req-440dae91-7a46-4663-90e5-eb1d05e96760 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:42.970675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f8e75fc6-c47f-43c0-ae3f-19bfe236226d req-440dae91-7a46-4663-90e5-eb1d05e96760 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:43.007414 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f8e75fc6-c47f-43c0-ae3f-19bfe236226d req-440dae91-7a46-4663-90e5-eb1d05e96760 service nova] Creating event network-vif-plugged:867ad5ba-55ec-4e65-9ab6-ff3054974bdd for instance fa1e4d60-4653-4ffb-bca5-7d435d2373af on n-h1-846219-10 Jul 20 11:01:43.026663 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f8e75fc6-c47f-43c0-ae3f-19bfe236226d req-440dae91-7a46-4663-90e5-eb1d05e96760 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090874 Jul 20 11:01:43.027686 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1490/3040] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:01:43.290924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:43.306142 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-78ea1427-cdeb-4354-ae55-eb7d42813efd tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 0.691556 Jul 20 11:01:43.308635 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1551/3041] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:42 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:43.624358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:43.625102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:43.660463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:43.660980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:43.661857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:43.662308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:43.747630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:43.779450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:43.780083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:43.801687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:43.806352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:43.807508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:43.809199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:44.285563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:44.302967 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99819dab-7f75-4191-823d-3b453f6af579 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 0.683501 Jul 20 11:01:44.303621 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1491/3042] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:43 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:44.321774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4cce5138-5fc7-401f-88c7-b7ce58ae5e0b tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa36820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:44.359822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:44.368976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0412641b-f60c-4524-9507-48b5521abc1b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1308 microversion: 2.1 time: 0.593663 Jul 20 11:01:44.379574 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1552/3043] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:43 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:44.384975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:44.385603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:44.395758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:44.396222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:44.397053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:44.397491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:44.472866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4cce5138-5fc7-401f-88c7-b7ce58ae5e0b tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.167580 Jul 20 11:01:44.478250 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1492/3044] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:44 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:44.746454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-12f8a334-5f18-4f6e-a58d-9913164440f0 req-f7cc92c0-25ab-4f5f-b6d4-8a03748dca8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae475aa-a8c7-4cf1-91ca-d0222af7303f", "tag": "c16384de-2258-4bf6-a08b-724fd70fb91e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:44.760828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-12f8a334-5f18-4f6e-a58d-9913164440f0 req-f7cc92c0-25ab-4f5f-b6d4-8a03748dca8c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:44.766746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-12f8a334-5f18-4f6e-a58d-9913164440f0 req-f7cc92c0-25ab-4f5f-b6d4-8a03748dca8c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:44.796417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-12f8a334-5f18-4f6e-a58d-9913164440f0 req-f7cc92c0-25ab-4f5f-b6d4-8a03748dca8c service nova] Creating event network-changed:c16384de-2258-4bf6-a08b-724fd70fb91e for instance bae475aa-a8c7-4cf1-91ca-d0222af7303f on n-h2-846219-10 Jul 20 11:01:44.821893 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-12f8a334-5f18-4f6e-a58d-9913164440f0 req-f7cc92c0-25ab-4f5f-b6d4-8a03748dca8c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338425 Jul 20 11:01:44.822529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1493/3045] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:44.916214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-291cd8ff-d3ea-4fc2-90ff-6299c1381294 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Action: 'create', calling method: .version_select at 0x7f2c3f2bef70>, body: {"keypair": {"name": "tempest-keypair-582753333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWjZQE7sPhqt05O4JdRc7PBlhazXf+3Q1nDK8QewB+JjHMcx7/Mt00NDaGnS4Ujdj2SANq1UaQ0FkYvHmDEH+jjLPU5sgVNiJEcXp+eTDpDnDhypF6WTcz2v6lu1zl4Rg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:44.949679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=19 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:44.964229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-291cd8ff-d3ea-4fc2-90ff-6299c1381294 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Getting quotas for project ce87571224664ecab6897c49d2b9676e. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:44.997610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-291cd8ff-d3ea-4fc2-90ff-6299c1381294 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Getting quotas for user ace70568b79b41be95eb0a10844b0640 and project ce87571224664ecab6897c49d2b9676e. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:45.118823 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-291cd8ff-d3ea-4fc2-90ff-6299c1381294 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.291578 Jul 20 11:01:45.121251 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1494/3046] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:01:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:45.138594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:45.151623 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42121d5f-a6b9-45a0-aad7-2b24e064e92f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 0.770833 Jul 20 11:01:45.162166 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1553/3047] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:44 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:45.321387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:45.322704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:45.338774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:45.339688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:45.340924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:45.341683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:45.386508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:45.387144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:45.434370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:45.435089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:45.436302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:45.448456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:46.632310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:46.651158 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f0aff6b2-16fa-4908-b8a7-0a8561d4d67d tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 1.332714 Jul 20 11:01:46.653360 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1495/3048] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:45 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:46.664644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3c411ed0-29f9-46f4-b7da-d54e6c508fd1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f4931f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:46.736034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:46.759501 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c2419233-b054-4cae-99d8-e415fb9b8be1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1488 microversion: 2.1 time: 1.370921 Jul 20 11:01:46.771150 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1554/3049] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:45 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1488 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:46.771150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:46.771722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:46.785107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:46.786023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3c411ed0-29f9-46f4-b7da-d54e6c508fd1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.129751 Jul 20 11:01:46.786707 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1496/3050] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:46 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:46.787313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:46.788259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:46.789903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:46.809199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:46.818612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:46.837733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:46.838249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:46.842842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:46.843449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:47.745251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:47.754274 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6dccb3b3-e16e-44bb-afc2-5f9e1c57d0a3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 0.992479 Jul 20 11:01:47.760827 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1555/3051] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:46 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:47.791401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:47.795039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:47.808242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:47.811896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:47.813099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:47.818081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:48.533962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:48.558912 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-29ed8953-2392-471a-81ab-599a00911d28 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1489 microversion: 2.1 time: 1.763984 Jul 20 11:01:48.576238 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1497/3052] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:46 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1489 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:48.589732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-279fc85c-c268-4b35-95bf-a39770a6d9a4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc6daf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:48.676577 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-279fc85c-c268-4b35-95bf-a39770a6d9a4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.092639 Jul 20 11:01:48.677655 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1498/3053] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:48 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:48.990944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-deeda452-0af6-4687-8ce9-174ea13f6183 tempest-ComputeTenantNetworksTest-454236764 tempest-ComputeTenantNetworksTest-454236764-project] Calling method '.version_select at 0x7f2c3fc32700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:49.449590 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-deeda452-0af6-4687-8ce9-174ea13f6183 tempest-ComputeTenantNetworksTest-454236764 tempest-ComputeTenantNetworksTest-454236764-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.770422 Jul 20 11:01:49.451463 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1499/3054] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 11:01:48 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:49.465060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:49.470393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:49.491559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:49.501960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:49.504351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:49.509330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:49.832043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:50.322018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:50.344073 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea4a9740-e601-4b5f-bc55-776db0d805a4 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 2.578617 Jul 20 11:01:50.354019 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1556/3055] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:47 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 2592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:50.368130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:50.371356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:50.401505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:50.402295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:50.404112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:50.406561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.115762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:51.148939 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-49620d59-978b-447d-84a6-deb8d366b954 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1488 microversion: 2.1 time: 1.696159 Jul 20 11:01:51.154771 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1500/3056] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:49 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1488 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:51.168700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83dd66bb-759b-4695-8a16-5093865fa391 tempest-ComputeTenantNetworksTest-454236764 tempest-ComputeTenantNetworksTest-454236764-project] Calling method '.version_select at 0x7f2c3fc6dc10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:51.200372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:51.214330 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-54a345ee-e5f7-438c-93c8-33167bfa1da5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 0.858861 Jul 20 11:01:51.215611 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1557/3057] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:50 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:51.223482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-52f74446-fba4-4853-b7eb-211d1c959323 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3e9c64c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:51.334904 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-52f74446-fba4-4853-b7eb-211d1c959323 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.115775 Jul 20 11:01:51.336076 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1558/3058] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:51 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:51.351366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:51.361426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:51.380382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.381100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.386191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.386832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.424349 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83dd66bb-759b-4695-8a16-5093865fa391 tempest-ComputeTenantNetworksTest-454236764 tempest-ComputeTenantNetworksTest-454236764-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks/e5b5e61d-a6b9-4a94-8f42-3be7d5d56da9" status: 200 len: 140 microversion: 2.1 time: 0.267131 Jul 20 11:01:51.427481 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1501/3059] 10.222.0.79 () {58 vars in 1268 bytes} [Wed Jul 20 11:01:51 2022] GET /compute/v2.1/os-tenant-networks/e5b5e61d-a6b9-4a94-8f42-3be7d5d56da9 => generated 140 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:51.436368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:51.437357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:51.445960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:01:51.446656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.447403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.448919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.449830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.521092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:51.655624 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3e84a761-7cb8-4fea-b678-46f51e5e249e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 204 len: 0 microversion: 2.1 time: 0.317924 Jul 20 11:01:51.664377 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1559/3060] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:01:51 2022] DELETE /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:01:51.672921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0c92e27b-7fde-430a-8d0f-91206d25eeaf req-78ec6e7f-1e90-4939-ab50-2c92a9e8e58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eb4564-a96b-491d-85c0-3b5fd106a293", "name": "network-vif-plugged", "status": "completed", "tag": "22feaab9-afe4-4f6c-8685-953810b22c94"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:51.689114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0c92e27b-7fde-430a-8d0f-91206d25eeaf req-78ec6e7f-1e90-4939-ab50-2c92a9e8e58c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.689957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0c92e27b-7fde-430a-8d0f-91206d25eeaf req-78ec6e7f-1e90-4939-ab50-2c92a9e8e58c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.704552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0c92e27b-7fde-430a-8d0f-91206d25eeaf req-78ec6e7f-1e90-4939-ab50-2c92a9e8e58c service nova] Creating event network-vif-plugged:22feaab9-afe4-4f6c-8685-953810b22c94 for instance 55eb4564-a96b-491d-85c0-3b5fd106a293 on n-h2-846219-10 Jul 20 11:01:51.714070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0c92e27b-7fde-430a-8d0f-91206d25eeaf req-78ec6e7f-1e90-4939-ab50-2c92a9e8e58c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047532 Jul 20 11:01:51.720196 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1560/3061] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:51.741042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:51.742047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:51.763840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.764576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:51.765571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:51.766180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:52.132303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:52.146645 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bb980130-4d8d-402e-b370-258522939ac2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1494 microversion: 2.1 time: 0.424837 Jul 20 11:01:52.148423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1561/3062] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:51 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1494 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:52.187994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:52.232448 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6717298e-c0e3-4f40-8178-946873d40f6e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 0.776585 Jul 20 11:01:52.233219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:52.233918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:52.236078 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1502/3063] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:51 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:52.242361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:52.254855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:52.255854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:52.256313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:52.350127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c3538e7-89fc-4d0b-a41d-eb501e30de0b tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fe38af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:52.418244 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c3538e7-89fc-4d0b-a41d-eb501e30de0b tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.073268 Jul 20 11:01:52.418933 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1503/3064] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:52 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:53.092421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:53.129496 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55e519ed-b593-468f-a64a-e7b503a71bba tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1325 microversion: 2.1 time: 0.889712 Jul 20 11:01:53.138304 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1562/3065] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:52 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1325 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:53.184197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:53.184825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:53.207740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:53.208376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:53.210748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:53.210748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:53.254104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:53.255350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:53.265030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:53.265777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:53.268164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:53.269381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:54.188593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:54.210813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:54.236548 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4533c82d-15e9-4659-930e-ff532b1c2887 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 0.986314 Jul 20 11:01:54.246089 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1563/3066] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:53 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:54.247074 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9639ff42-1a6e-4075-ab3d-e309244fa2b2 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1494 microversion: 2.1 time: 1.066074 Jul 20 11:01:54.251775 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1504/3067] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:53 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1494 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:54.289499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7282e0c-cb06-4d2f-8e4a-3ee0fc75cb08 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea17a60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:54.298470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:54.299600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:54.327424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:54.327936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:54.340822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:54.343055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:54.410924 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7282e0c-cb06-4d2f-8e4a-3ee0fc75cb08 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1450 microversion: 2.1 time: 0.160987 Jul 20 11:01:54.411608 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1564/3068] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:54 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:54.783434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:54.792597 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4555e509-7a68-45b9-bda9-3653a6c9c2be tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.536774 Jul 20 11:01:54.803567 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1505/3069] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:54 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:54.816833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:54.817469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:54.840668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:54.841608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:54.844104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:54.853836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:55.266591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:55.267974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:55.271068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:55.280882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:55.293747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:55.294977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:55.295790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:55.783558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:55.783558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73c971ed-56e7-4069-8a96-c34f6561f37a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.961222 Jul 20 11:01:55.792372 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1565/3070] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:54 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:55.797975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:55.800448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:55.838374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:55.838374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:55.838374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:55.838374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:56.012974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:56.026662 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61ba5049-c2dd-42b2-9bde-b92f75dbe4bf tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 200 len: 1452 microversion: 2.1 time: 0.232932 Jul 20 11:01:56.027593 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1566/3071] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:55 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 1452 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:56.034328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15a2cdcb-5eed-4d82-a42b-cae54580358f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3e9c54c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:56.142428 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-15a2cdcb-5eed-4d82-a42b-cae54580358f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1459 microversion: 2.1 time: 0.113542 Jul 20 11:01:56.143050 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1567/3072] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:56 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1459 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:56.182039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1154355483", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d3a73878-5277-49df-bcc8-39456d0b326d"}], "security_groups": [{"name": "tempest-securitygroup--1905381315"}], "key_name": "tempest-keypair-582753333", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:56.234809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:56.244410 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aec71549-3289-4dd8-9040-3d165a18e6f1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 0.982048 Jul 20 11:01:56.248173 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1506/3073] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:55 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:56.522824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d939513b-562d-431f-8ff4-aaae7bd50e9f req-3f869eb7-8850-4df2-b3b4-7c4c1dec2368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1e4d60-4653-4ffb-bca5-7d435d2373af", "name": "network-vif-deleted", "tag": "867ad5ba-55ec-4e65-9ab6-ff3054974bdd"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:56.540563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d939513b-562d-431f-8ff4-aaae7bd50e9f req-3f869eb7-8850-4df2-b3b4-7c4c1dec2368 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:56.541853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d939513b-562d-431f-8ff4-aaae7bd50e9f req-3f869eb7-8850-4df2-b3b4-7c4c1dec2368 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:56.567309 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d939513b-562d-431f-8ff4-aaae7bd50e9f req-3f869eb7-8850-4df2-b3b4-7c4c1dec2368 service nova] Creating event network-vif-deleted:867ad5ba-55ec-4e65-9ab6-ff3054974bdd for instance fa1e4d60-4653-4ffb-bca5-7d435d2373af on n-h1-846219-10 Jul 20 11:01:56.594490 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d939513b-562d-431f-8ff4-aaae7bd50e9f req-3f869eb7-8850-4df2-b3b4-7c4c1dec2368 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.344827 Jul 20 11:01:56.595891 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1507/3074] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:56.605063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9b188fd-b1e9-4747-a3b0-567cc7c57545 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1630476109", "metadata": {"": ""}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9b188fd-b1e9-4747-a3b0-567cc7c57545 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action HTTP/1.1 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 107 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1630476109", "metadata": {"": ""}}} Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1630476109', 'metadata': {'': ''}}}} Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'': ''} Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:01:56.618982 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:56.623999 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:56.628773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9b188fd-b1e9-4747-a3b0-567cc7c57545 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:01:56.632472 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c9b188fd-b1e9-4747-a3b0-567cc7c57545 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action" status: 400 len: 170 microversion: 2.1 time: 0.033800 Jul 20 11:01:56.633991 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1508/3075] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Jul 20 11:01:56 2022] POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action => generated 170 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:01:56.641147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b9513045-fd09-40d0-979d-3bc5ed91bed6 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f44db80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:56.710628 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b9513045-fd09-40d0-979d-3bc5ed91bed6 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 200 len: 1459 microversion: 2.1 time: 0.073132 Jul 20 11:01:56.711408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1509/3076] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:56 2022] GET /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 1459 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:56.726474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] validate_networks() for [('d3a73878-5277-49df-bcc8-39456d0b326d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:01:56.729408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:56.730934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:56.756486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:56.757045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:56.758110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:56.758769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.176005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:57.189727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44899faf-8819-4290-81a0-4b945d7dc377 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.475878 Jul 20 11:01:57.196765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1510/3077] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:56 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:57.217363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:57.218239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:57.236691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.237629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.240256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.241037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.685322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Getting quotas for project ce87571224664ecab6897c49d2b9676e. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:57.694206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Getting quotas for user ace70568b79b41be95eb0a10844b0640 and project ce87571224664ecab6897c49d2b9676e. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:57.704008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:57.712159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:01:57.712852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:01:57.713580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:01:57.714225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:01:57.714835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:01:57.716061 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-675a32cf-487e-4645-96db-3d4eb71e36e9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1468 microversion: 2.1 time: 0.516752 Jul 20 11:01:57.727270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1511/3078] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:57 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1468 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:57.727270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:57.727270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:57.734040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.734502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.735672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.736825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.737150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.738557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.739634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.740342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.756419 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af HTTP/1.1 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fa1e4d60-4653-4ffb-bca5-7d435d2373af'} Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:57.757997 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c60c12b2-dd57-4be4-92e2-85b2d9982535 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 404 len: 111 microversion: 2.1 time: 0.040525 Jul 20 11:01:57.762378 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1512/3079] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:57 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:01:57.767341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5d8d0f51-d62a-4ea8-b8ba-455554137abd req-12a9d60b-b3f1-4d8a-8594-fc9e929cc0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae475aa-a8c7-4cf1-91ca-d0222af7303f", "name": "network-vif-plugged", "status": "completed", "tag": "c16384de-2258-4bf6-a08b-724fd70fb91e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:57.773979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Getting quotas for project ce87571224664ecab6897c49d2b9676e. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:01:57.777903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5d8d0f51-d62a-4ea8-b8ba-455554137abd req-12a9d60b-b3f1-4d8a-8594-fc9e929cc0f3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.778359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5d8d0f51-d62a-4ea8-b8ba-455554137abd req-12a9d60b-b3f1-4d8a-8594-fc9e929cc0f3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.782050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Getting quotas for user ace70568b79b41be95eb0a10844b0640 and project ce87571224664ecab6897c49d2b9676e. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:01:57.793779 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5d8d0f51-d62a-4ea8-b8ba-455554137abd req-12a9d60b-b3f1-4d8a-8594-fc9e929cc0f3 service nova] Creating event network-vif-plugged:c16384de-2258-4bf6-a08b-724fd70fb91e for instance bae475aa-a8c7-4cf1-91ca-d0222af7303f on n-h2-846219-10 Jul 20 11:01:57.797807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:01:57.800706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:01:57.801449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5d8d0f51-d62a-4ea8-b8ba-455554137abd req-12a9d60b-b3f1-4d8a-8594-fc9e929cc0f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037015 Jul 20 11:01:57.802857 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1513/3080] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:57.810029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:57.811084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:57.820696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.821185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.822815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.823771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.881818 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-881abfe0-bc4a-4ab7-914c-c524c19aa91d tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.736871 Jul 20 11:01:57.887670 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1568/3081] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:01:56 2022] POST /compute/v2.1/servers => generated 407 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:01:57.894685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:57.896252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:57.904475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.905294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:57.906473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:57.907195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.260254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:58.278308 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48e8dd72-5412-4ab6-8d2b-49d2184ae4d5 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.470837 Jul 20 11:01:58.279383 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1514/3082] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:57 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:58.290203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1223020245"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:58.296056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:58.297302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:58.311393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.311393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.311393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.311393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.331667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f09fa3d8-b4d8-457a-9293-0008ce791b5e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1352 microversion: 2.1 time: 0.441502 Jul 20 11:01:58.332583 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1569/3083] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:57 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1352 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:58.340010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:58.340928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:58.351020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.351735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.355217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.355883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.403972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:01:58.631935 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1d876c8-164c-463e-af9a-d2b1945cc058 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 204 len: 0 microversion: 2.1 time: 0.297289 Jul 20 11:01:58.635245 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1570/3084] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:01:58 2022] DELETE /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:01:58.655708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-995d9c68-4bae-48c8-b900-e59e21b0dbf7 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:58.656821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-995d9c68-4bae-48c8-b900-e59e21b0dbf7 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:58.666701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:58.735380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-995d9c68-4bae-48c8-b900-e59e21b0dbf7 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:58.749304 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-995d9c68-4bae-48c8-b900-e59e21b0dbf7 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1269 microversion: 2.1 time: 0.113868 Jul 20 11:01:58.759966 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1571/3085] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:58 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:58.764968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8152bec1-441b-491c-80ed-36c95839f08e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1133534514", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8152bec1-441b-491c-80ed-36c95839f08e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action HTTP/1.1 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 619 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1133534514", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1133534514', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:01:58.768281 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 20 11:01:58.771496 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:01:58.775980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8152bec1-441b-491c-80ed-36c95839f08e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:01:58.777229 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8152bec1-441b-491c-80ed-36c95839f08e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action" status: 400 len: 938 microversion: 2.1 time: 0.016228 Jul 20 11:01:58.778354 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1572/3086] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Jul 20 11:01:58 2022] POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action => generated 938 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:01:58.785775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:58.786647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:58.793545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.794351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.795916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.796441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.835839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-610c0a49-9be4-4395-b98c-b492c5a339e1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "POST /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919/action" status: 202 len: 0 microversion: 2.1 time: 0.554674 Jul 20 11:01:58.836516 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1515/3087] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:01:58 2022] POST /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 11:01:58.853507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:58.854236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:58.861037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.861503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:58.863005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:58.863757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.094501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:59.107323 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b9f65166-c497-4d9a-a80a-ec2f19816bb1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1495 microversion: 2.1 time: 0.326748 Jul 20 11:01:59.116459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:59.124271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1573/3088] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:58 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1495 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:59.130155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d8eddf8-f239-43de-ac1f-5b35c53227db tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3e9c6700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.139702 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c31db700-448e-44b5-bbce-13b0ba58a9e9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.294272 Jul 20 11:01:59.139702 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1516/3089] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:58 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:59.178314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.182804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:59.205316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.206374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.208641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.209327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.237988 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d8eddf8-f239-43de-ac1f-5b35c53227db tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.111624 Jul 20 11:01:59.238980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1574/3090] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:59.351568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.352210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:59.364610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.366261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.367127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.367779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.475611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:59.484748 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e6695344-2c28-418d-b3b3-bc2ce40a5dc8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.328920 Jul 20 11:01:59.488263 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1517/3091] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:59.504344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81795204-81ff-447d-aac9-25420f826208 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81795204-81ff-447d-aac9-25420f826208 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action HTTP/1.1 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 285 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.507278 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:01:59.511015 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:01:59.514037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81795204-81ff-447d-aac9-25420f826208 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:01:59.515155 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81795204-81ff-447d-aac9-25420f826208 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action" status: 400 len: 619 microversion: 2.1 time: 0.014817 Jul 20 11:01:59.515941 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1518/3092] 10.222.0.79 () {60 vars in 1278 bytes} [Wed Jul 20 11:01:59 2022] POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:01:59.527265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.528240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:59.539013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.539758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.540498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.540922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.547332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:01:59.632814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:59.641055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-487b2fe9-3dda-4a74-aae7-9daa4838d138 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1542 microversion: 2.1 time: 0.296017 Jul 20 11:01:59.642033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1575/3093] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1542 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:01:59.660436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.661524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:59.669621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.670541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.671610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.672277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.710151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:01:59.718577 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d99e8db-43b8-4b8f-ab2c-467c80763a3a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.198207 Jul 20 11:01:59.720021 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1519/3094] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:01:59.749261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.749961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:59.778296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.778757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.779588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.780034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.835769 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5fbfe89a-5735-484a-a8c0-683adee49680 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180292 Jul 20 11:01:59.837191 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1576/3095] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:01:59.842636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:01:59.843094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:01:59.852758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.853291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:01:59.854178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:01:59.854846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.031496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:00.047314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-46af5311-a84f-40fc-bb00-8a800e9f653a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1265 microversion: 2.1 time: 0.208513 Jul 20 11:02:00.051321 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1577/3096] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:00.072869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:00.087218 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f9b3105-0c21-4220-916a-411625d90251 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.349815 Jul 20 11:02:00.101188 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1520/3097] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:01:59 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:00.105760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1929102905"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:00.106890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:00.115089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.116970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.122727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.123204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.131768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:00.132611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:00.142959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.144108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.144949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.145578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.424593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:00.435812 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dec862cb-fac9-4d33-9176-d323696e048c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1495 microversion: 2.1 time: 0.309579 Jul 20 11:02:00.437176 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1521/3098] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:00 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1495 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:00.444115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3662ec1f-5428-4221-b83c-ac4d179acfb5 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc6dd30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:00.549199 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3662ec1f-5428-4221-b83c-ac4d179acfb5 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.102956 Jul 20 11:02:00.555348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1522/3099] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:00 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:00.850557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-893051b5-6a57-4d21-8ddd-bcb55e534445 req-4ef95b38-9572-4160-b1c2-e7acdad8922f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6c4205-eb71-4050-9527-adf95060d100", "name": "network-vif-unplugged", "status": "completed", "tag": "84596e6f-53b6-49de-83af-236da2b3a9a4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:00.868386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-893051b5-6a57-4d21-8ddd-bcb55e534445 req-4ef95b38-9572-4160-b1c2-e7acdad8922f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.869243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-893051b5-6a57-4d21-8ddd-bcb55e534445 req-4ef95b38-9572-4160-b1c2-e7acdad8922f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.899417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-893051b5-6a57-4d21-8ddd-bcb55e534445 req-4ef95b38-9572-4160-b1c2-e7acdad8922f service nova] Creating event network-vif-unplugged:84596e6f-53b6-49de-83af-236da2b3a9a4 for instance be6c4205-eb71-4050-9527-adf95060d100 on n-h2-846219-10 Jul 20 11:02:00.910596 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-394308c3-0060-4709-8467-29d95a256384 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action" status: 202 len: 0 microversion: 2.1 time: 0.809736 Jul 20 11:02:00.912859 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-893051b5-6a57-4d21-8ddd-bcb55e534445 req-4ef95b38-9572-4160-b1c2-e7acdad8922f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070441 Jul 20 11:02:00.914472 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1578/3100] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:02:00 2022] POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 11:02:00.915625 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1523/3101] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:00.928438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-731718789"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:00.929717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:00.941025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.941630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.942489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:00.943187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:00.954017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:01.013225 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Cannot 'createImage' instance 55eb4564-a96b-491d-85c0-3b5fd106a293 while it is in task_state image_snapshot_pending Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action HTTP/1.1 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 84 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-731718789"}} Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot 'createImage' instance 55eb4564-a96b-491d-85c0-3b5fd106a293 while it is in task_state image_snapshot_pending Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-731718789'}}} Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:02:01.015035 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 55eb4564-a96b-491d-85c0-3b5fd106a293 while it is in task_state image_snapshot_pending Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 55eb4564-a96b-491d-85c0-3b5fd106a293 while it is in task_state image_snapshot_pending Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 409 to user: Cannot 'createImage' instance 55eb4564-a96b-491d-85c0-3b5fd106a293 while it is in task_state image_snapshot_pending {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e1ce0c21-296e-499d-9358-3550c810c44e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action" status: 409 len: 167 microversion: 2.1 time: 0.096964 Jul 20 11:02:01.023218 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1579/3102] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:02:00 2022] POST /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293/action => generated 167 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:02:01.031948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-551da433-35be-4e6b-bc33-9767fe586fe6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '.version_select at 0x7f2c3fc6db80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:01.069311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:01.070192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:01.084717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.085433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.087411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.090010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.314140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:01.327574 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-551da433-35be-4e6b-bc33-9767fe586fe6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/images/2814bbb0-19f0-4376-9546-f0fcea9a2e0e" status: 204 len: 0 microversion: 2.1 time: 0.301918 Jul 20 11:02:01.329159 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1524/3103] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:01 2022] DELETE /compute/v2.1/images/2814bbb0-19f0-4376-9546-f0fcea9a2e0e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:01.331601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09f48fec-25cd-40bf-8760-dd345d9d5faa tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1339 microversion: 2.1 time: 0.266415 Jul 20 11:02:01.335250 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1580/3104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:01 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:01.342219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:01.343306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:01.364579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.365328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.366244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.366692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.472240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:01.473783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:01.482128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.482559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.483876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.484429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.652006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:01.668993 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35562e28-eb08-49d9-8fe9-31381594a283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 200 len: 1453 microversion: 2.1 time: 0.218309 Jul 20 11:02:01.679570 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1581/3105] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:01 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 1453 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:01.686011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2b0ab78-42e4-44bf-a470-0dc9776e9d3c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3e9c64c0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:01.750340 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2b0ab78-42e4-44bf-a470-0dc9776e9d3c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.078206 Jul 20 11:02:01.750925 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1582/3106] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:01 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:01.821400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:01.836229 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66940d05-cdfb-4bee-81c6-4d19d5f2cdc2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1533 microversion: 2.1 time: 0.502292 Jul 20 11:02:01.837838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1525/3107] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:01 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1533 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:01.845761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d6a0b212-e36c-4e27-b46b-a85fa6516145 req-bf7f41dd-c97b-4776-8a07-18c9d3e5e34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77621b7b-77b5-4fda-a4c2-a0c086795678", "name": "network-vif-deleted", "tag": "5b8e850a-1e2e-439b-a122-6fe742c0cc2d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:01.859142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d6a0b212-e36c-4e27-b46b-a85fa6516145 req-bf7f41dd-c97b-4776-8a07-18c9d3e5e34e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:01.859142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d6a0b212-e36c-4e27-b46b-a85fa6516145 req-bf7f41dd-c97b-4776-8a07-18c9d3e5e34e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:01.871491 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d6a0b212-e36c-4e27-b46b-a85fa6516145 req-bf7f41dd-c97b-4776-8a07-18c9d3e5e34e service nova] Creating event network-vif-deleted:5b8e850a-1e2e-439b-a122-6fe742c0cc2d for instance 77621b7b-77b5-4fda-a4c2-a0c086795678 on n-h1-846219-10 Jul 20 11:02:01.878293 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d6a0b212-e36c-4e27-b46b-a85fa6516145 req-bf7f41dd-c97b-4776-8a07-18c9d3e5e34e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038676 Jul 20 11:02:01.879935 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1583/3108] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:02.352740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:02.355190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:02.362967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:02.365108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:02.365796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:02.367830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:02.368568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:02.458283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:02.478770 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b8f5b498-0881-448a-8bac-0b5b353336f3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1327 microversion: 2.1 time: 0.130688 Jul 20 11:02:02.479417 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1526/3109] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:02 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1327 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:02.688770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:02.689857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:02.712634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:02.718339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:02.723751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:02.726746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:02.766237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-03f052aa-8811-4f54-915a-fa377e897f05 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f44d8b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:02.781012 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 HTTP/1.1 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '77621b7b-77b5-4fda-a4c2-a0c086795678'} Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:02.784922 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:02.790602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:02.790602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:02.790602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:02.790602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:02.790602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:02:02.790602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:02.792464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:02.796015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41c2c7cd-f7bc-4bb8-8325-e99870fcf16a tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 404 len: 111 microversion: 2.1 time: 0.111578 Jul 20 11:02:02.799334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1584/3110] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:02 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:02:02.861318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:02.866959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:02.871503 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-03f052aa-8811-4f54-915a-fa377e897f05 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.110868 Jul 20 11:02:02.872110 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1527/3111] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:02 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:02.895010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:02.895613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:02.896489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:02.897107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:03.140281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-61eb3533-38b0-40d2-806b-e684aa322511 req-662e9b21-bcaf-47f8-91d9-1590f3617578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae475aa-a8c7-4cf1-91ca-d0222af7303f", "tag": "c16384de-2258-4bf6-a08b-724fd70fb91e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:03.171325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-61eb3533-38b0-40d2-806b-e684aa322511 req-662e9b21-bcaf-47f8-91d9-1590f3617578 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:03.172829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-61eb3533-38b0-40d2-806b-e684aa322511 req-662e9b21-bcaf-47f8-91d9-1590f3617578 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:03.207693 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-61eb3533-38b0-40d2-806b-e684aa322511 req-662e9b21-bcaf-47f8-91d9-1590f3617578 service nova] Creating event network-changed:c16384de-2258-4bf6-a08b-724fd70fb91e for instance bae475aa-a8c7-4cf1-91ca-d0222af7303f on n-h2-846219-10 Jul 20 11:02:03.209381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:03.217220 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-61eb3533-38b0-40d2-806b-e684aa322511 req-662e9b21-bcaf-47f8-91d9-1590f3617578 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085692 Jul 20 11:02:03.217922 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-579a98bd-7981-4fb8-803e-489c4b84073b tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1539 microversion: 2.1 time: 0.362836 Jul 20 11:02:03.221954 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1528/3112] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:02:03.232085 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1585/3113] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:02 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1539 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:03.232658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1983007284", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:03.340859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:02:03.497025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:03.498598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:03.519152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:03.521519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:03.522381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:03.523213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:04.347282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:04.365739 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7c312e1c-532e-4231-a4d4-9f8131a3a3bd tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1395 microversion: 2.1 time: 0.873172 Jul 20 11:02:04.366334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1586/3114] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:03 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1395 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:04.388160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08328a8c-9159-472a-8b0a-6b69531fb2b8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea84dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:04.493974 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08328a8c-9159-472a-8b0a-6b69531fb2b8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.109528 Jul 20 11:02:04.498455 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1587/3115] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:04 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:04.521362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:04.522546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:04.551505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:04.561290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:04.566041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:04.566697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:05.768276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:05.779849 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ae9fed4-3153-4cb3-b7cf-f6305645879a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1534 microversion: 2.1 time: 1.280240 Jul 20 11:02:05.783094 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1588/3116] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:04 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1534 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:05.800309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6a96e9f7-2b88-4589-850f-f4c81c661276 req-28f558f5-a045-4215-8bd0-17bb62528781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b2f6f9-89bb-423b-881f-896cdc5a7c0f", "tag": "096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:05.819998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6a96e9f7-2b88-4589-850f-f4c81c661276 req-28f558f5-a045-4215-8bd0-17bb62528781 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:05.820734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6a96e9f7-2b88-4589-850f-f4c81c661276 req-28f558f5-a045-4215-8bd0-17bb62528781 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:05.844946 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6a96e9f7-2b88-4589-850f-f4c81c661276 req-28f558f5-a045-4215-8bd0-17bb62528781 service nova] Creating event network-changed:096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1 for instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f on n-h1-846219-10 Jul 20 11:02:05.860027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6a96e9f7-2b88-4589-850f-f4c81c661276 req-28f558f5-a045-4215-8bd0-17bb62528781 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072819 Jul 20 11:02:05.864128 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1589/3117] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:05.881354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:05.887249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:05.907007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:05.907850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:05.913504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:05.914538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:05.936198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:02:05.937872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:02:05.938602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:02:05.939352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:02:05.940140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:02:05.965670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:05.971452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:05.978036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:05.979294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:06.032348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:02:06.042988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:02:06.061371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:02:06.066593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:02:06.195909 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee9837bd-b391-4ab6-8115-f1c9eccb5e77 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.972295 Jul 20 11:02:06.202757 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1529/3118] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:02:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:02:06.210346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ac3e7b46-882c-44e5-8006-92fb593ccc34 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f1dc940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:06.342491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ac3e7b46-882c-44e5-8006-92fb593ccc34 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.137173 Jul 20 11:02:06.343099 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1530/3119] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:06 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:06.362109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-63af0b68-cef4-46b1-99fb-e4f17e043025 req-f65f804d-0fd8-4dea-8d6a-314dfb683e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7db14d8-91de-4457-930a-567699823919", "name": "network-vif-plugged", "status": "completed", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:06.395615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-63af0b68-cef4-46b1-99fb-e4f17e043025 req-f65f804d-0fd8-4dea-8d6a-314dfb683e5a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:06.396075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-63af0b68-cef4-46b1-99fb-e4f17e043025 req-f65f804d-0fd8-4dea-8d6a-314dfb683e5a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:06.436840 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-63af0b68-cef4-46b1-99fb-e4f17e043025 req-f65f804d-0fd8-4dea-8d6a-314dfb683e5a service nova] Creating event network-vif-plugged:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:02:06.457778 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-63af0b68-cef4-46b1-99fb-e4f17e043025 req-f65f804d-0fd8-4dea-8d6a-314dfb683e5a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105261 Jul 20 11:02:06.463946 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1531/3120] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:06.493691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c3ff3c4-fe75-45a2-9dd5-add5e3606eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:06.499064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c3ff3c4-fe75-45a2-9dd5-add5e3606eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:06.875156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7c3ff3c4-fe75-45a2-9dd5-add5e3606eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:06.895555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:06.918256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c3ff3c4-fe75-45a2-9dd5-add5e3606eb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1209 microversion: 2.1 time: 0.450393 Jul 20 11:02:06.921090 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1532/3121] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:06 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1209 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:06.924893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dca343c8-e99c-44b1-821f-29c77c4c7c78 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1395 microversion: 2.1 time: 1.052163 Jul 20 11:02:06.938717 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1590/3122] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:05 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1395 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:06.949587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:06.953973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:06.992101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:06.993330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:06.996374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:06.996817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:07.269444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:07.290899 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-262cc3a6-a7e1-4781-b558-505979fc04fe tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1521 microversion: 2.1 time: 0.367808 Jul 20 11:02:07.292849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1533/3123] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:06 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:07.318429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:07.320573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:07.358590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-769c963b-c624-4f35-817f-de4f384d0a64 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa369d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:07.360472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:07.361659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:07.364566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:07.366454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:07.454929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:02:07.480070 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-769c963b-c624-4f35-817f-de4f384d0a64 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.126345 Jul 20 11:02:07.480682 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1534/3124] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:07 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:07.651004 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1c54955-74cf-4cd3-8449-d54c99cbdeec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 204 len: 0 microversion: 2.1 time: 0.342901 Jul 20 11:02:07.655629 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1591/3125] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:02:07 2022] DELETE /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:07.663441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:07.664123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:07.676691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:07.677160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:07.678413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:07.678863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:07.939421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:07.940738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:07.943077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:07.959955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:07.960416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:07.965326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:07.966012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:08.180223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:08.202518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e44bca0-5023-4851-8483-926cc29c2883 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1213 microversion: 2.1 time: 0.267630 Jul 20 11:02:08.205167 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1592/3126] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:07 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:08.225984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:08.226862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:08.235122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:08.235839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:08.236819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:08.238175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:08.423230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:08.441189 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5303ad7-5c3d-47c2-a006-f5f641999f0a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1527 microversion: 2.1 time: 0.783078 Jul 20 11:02:08.442138 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1535/3127] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:07 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1527 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:08.495210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5c1c56be-3560-4164-9e7d-34a8b6da876b req-e0fff747-fe0e-4e1e-ab9b-6a7012d2aebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eb4564-a96b-491d-85c0-3b5fd106a293", "name": "network-vif-plugged", "status": "completed", "tag": "22feaab9-afe4-4f6c-8685-953810b22c94"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:08.511780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5c1c56be-3560-4164-9e7d-34a8b6da876b req-e0fff747-fe0e-4e1e-ab9b-6a7012d2aebf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:08.512494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5c1c56be-3560-4164-9e7d-34a8b6da876b req-e0fff747-fe0e-4e1e-ab9b-6a7012d2aebf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:08.526959 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5c1c56be-3560-4164-9e7d-34a8b6da876b req-e0fff747-fe0e-4e1e-ab9b-6a7012d2aebf service nova] Creating event network-vif-plugged:22feaab9-afe4-4f6c-8685-953810b22c94 for instance 55eb4564-a96b-491d-85c0-3b5fd106a293 on n-h2-846219-10 Jul 20 11:02:08.544499 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5c1c56be-3560-4164-9e7d-34a8b6da876b req-e0fff747-fe0e-4e1e-ab9b-6a7012d2aebf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058298 Jul 20 11:02:08.545514 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1536/3128] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:02:08.553696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-decd99d7-6961-4c38-a59a-882760b87460 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fb618b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:08.626814 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-decd99d7-6961-4c38-a59a-882760b87460 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.079973 Jul 20 11:02:08.629758 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1537/3129] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:08 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:08.677620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:08.688883 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a68ec98-d385-4b76-9631-723ecbb0deb3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1395 microversion: 2.1 time: 0.480234 Jul 20 11:02:08.689480 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1593/3130] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:08 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1395 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:09.231095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:09.232054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:09.247922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:09.251696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:09.253894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:09.255784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:09.459601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:09.460985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:09.464938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:09.496985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:09.499862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:09.504737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:09.506662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:09.589303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:09.604603 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-63454d07-e569-4ba9-bb84-346bb84abce5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1205 microversion: 2.1 time: 0.378408 Jul 20 11:02:09.609052 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1538/3131] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:09 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1205 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:09.642156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-53618cf4-1f6b-481f-be59-4aada882aafb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f354670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:09.786602 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-53618cf4-1f6b-481f-be59-4aada882aafb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.147857 Jul 20 11:02:09.795939 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1539/3132] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:09 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:09.802947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:09.804061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:09.812897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:09.813362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:09.814146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:09.814582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:11.030946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:11.050588 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e19b70b2-f6ba-4c44-921d-215ba20a30e3 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1527 microversion: 2.1 time: 1.595144 Jul 20 11:02:11.052092 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1594/3133] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:09 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1527 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:11.061881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:11.072015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:11.082922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:11.088395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:11.092168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:11.092809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:11.439783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:11.445308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:11.456552 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15f03c7e-d225-478c-bcf5-3b6c905e57d3 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1395 microversion: 2.1 time: 1.658112 Jul 20 11:02:11.462500 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3b7899a6-3d40-471e-bd7c-62955a1d9032 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1267 microversion: 2.1 time: 0.408181 Jul 20 11:02:11.464098 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1595/3134] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:11 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:11.469540 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1540/3135] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:09 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1395 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:11.478576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b91ead0a-125b-4280-8e71-8022799a5fc1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea74c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:11.569959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b91ead0a-125b-4280-8e71-8022799a5fc1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.104525 Jul 20 11:02:11.573171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1596/3136] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:11 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:12.070548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:12.075221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:12.083066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.083912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:12.085045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.085934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:12.284680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7039799a-9118-4542-b178-e018c5b4cfe0 req-fb1e7da4-3657-4dec-bfb0-b3f28eb923c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55eb4564-a96b-491d-85c0-3b5fd106a293", "name": "network-vif-deleted", "tag": "22feaab9-afe4-4f6c-8685-953810b22c94"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:12.302444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:12.315785 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a1a467ad-0c6f-4dcf-85ae-14f94dc2b90a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 200 len: 1485 microversion: 2.1 time: 0.248421 Jul 20 11:02:12.320862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7039799a-9118-4542-b178-e018c5b4cfe0 req-fb1e7da4-3657-4dec-bfb0-b3f28eb923c3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.321330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7039799a-9118-4542-b178-e018c5b4cfe0 req-fb1e7da4-3657-4dec-bfb0-b3f28eb923c3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:12.329255 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1541/3137] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:12 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 1485 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:12.389211 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7039799a-9118-4542-b178-e018c5b4cfe0 req-fb1e7da4-3657-4dec-bfb0-b3f28eb923c3 service nova] Creating event network-vif-deleted:22feaab9-afe4-4f6c-8685-953810b22c94 for instance 55eb4564-a96b-491d-85c0-3b5fd106a293 on n-h2-846219-10 Jul 20 11:02:12.401335 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7039799a-9118-4542-b178-e018c5b4cfe0 req-fb1e7da4-3657-4dec-bfb0-b3f28eb923c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168880 Jul 20 11:02:12.406348 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1597/3138] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:12.490644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:12.491473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:12.499315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:12.500412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:12.536466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.540221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.541683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:12.542476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:12.544782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.547391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:12.548983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:12.551730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:13.040287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:13.057916 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-68fe9dbd-489b-4c34-bd66-b23baae33599 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1267 microversion: 2.1 time: 0.579750 Jul 20 11:02:13.063323 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1598/3139] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:12 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1267 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:13.085268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c19b1da-c639-485b-b6c5-62130d5c092f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3e9c5820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:13.211552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9c19b1da-c639-485b-b6c5-62130d5c092f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.146174 Jul 20 11:02:13.212197 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1599/3140] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:13 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:13.230926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-66b01c55-1c70-42fb-8ef1-6f79fa284208 req-890fab42-c0a8-42b2-ad29-fd9c489445c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b2f6f9-89bb-423b-881f-896cdc5a7c0f", "name": "network-vif-plugged", "status": "completed", "tag": "096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:13.266273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-66b01c55-1c70-42fb-8ef1-6f79fa284208 req-890fab42-c0a8-42b2-ad29-fd9c489445c0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:13.266936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-66b01c55-1c70-42fb-8ef1-6f79fa284208 req-890fab42-c0a8-42b2-ad29-fd9c489445c0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:13.325209 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-66b01c55-1c70-42fb-8ef1-6f79fa284208 req-890fab42-c0a8-42b2-ad29-fd9c489445c0 service nova] Creating event network-vif-plugged:096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1 for instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f on n-h1-846219-10 Jul 20 11:02:13.336466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-66b01c55-1c70-42fb-8ef1-6f79fa284208 req-890fab42-c0a8-42b2-ad29-fd9c489445c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113654 Jul 20 11:02:13.338042 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1600/3141] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:13.344332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:13.347748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:13.348925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:13.354260 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-efb56c62-28b1-4665-b003-9ea6e8c53d50 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1395 microversion: 2.1 time: 0.881551 Jul 20 11:02:13.356756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:13.357492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:13.359194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:13.359967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:13.368673 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1542/3142] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:12 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1395 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:13.427350 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 HTTP/1.1 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293'} Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:13.429028 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:13.435597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-123b255f-02c9-464e-87d8-1fa244e5d828 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 404 len: 111 microversion: 2.1 time: 0.089788 Jul 20 11:02:13.443294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bcff688c-3705-4dfb-b356-7948c6c2aff4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'create', calling method: .version_select at 0x7f2c3f9e0940>, body: {"keypair": {"name": "tempest-keypair-1492607362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61g+jveV+WCjEwtFjgGB0XQAZ0U14EkBgK+1yaHeRHxJ5PF2i2dC7syRtCN++hUuoSv/85iFkmj261L3WM+gIZnmwI1qdUVgMg2Q6opXhSML2uMb4vJITMsgAG0HZBuA=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:13.451728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1601/3143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:13 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:02:13.476061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-bcff688c-3705-4dfb-b356-7948c6c2aff4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for project d427430f6c374ad183381dc509229fe3. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:02:13.494718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-bcff688c-3705-4dfb-b356-7948c6c2aff4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for user c597235b7c47404da82b77cd60317eb3 and project d427430f6c374ad183381dc509229fe3. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:02:13.519896 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:02:13.520118 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:02:13.565973 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bcff688c-3705-4dfb-b356-7948c6c2aff4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126462 Jul 20 11:02:13.572328 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1543/3144] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:02:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:14.086892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:14.088020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:14.126734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:14.127231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:14.136151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:14.136553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:14.226195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-905af753-91dd-45c7-ba77-acd7be7e179a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3e7b6e50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:14.256632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:14.353637 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-905af753-91dd-45c7-ba77-acd7be7e179a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.128204 Jul 20 11:02:14.354295 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1544/3145] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:14 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:14.383141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:14.384299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:14.395077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:14.395487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:14.396288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:14.396727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:14.969605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:14.990227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-802203ed-33c1-4846-9c2a-88264eda74f8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.902768 Jul 20 11:02:15.004580 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1602/3146] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:14 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:15.047731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:15.067807 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3248d2c0-3966-4c5a-afa4-0f1751c1443e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1395 microversion: 2.1 time: 0.692208 Jul 20 11:02:15.072397 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1545/3147] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:14 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1395 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:15.367225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-941bb844-a296-40a5-996b-6fba037d1d1a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea33c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:15.511381 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-941bb844-a296-40a5-996b-6fba037d1d1a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.149342 Jul 20 11:02:15.517186 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1603/3148] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:15 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:16.011990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:16.013307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:16.027265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:16.054197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:16.055683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:16.058776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:16.060922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:16.094345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:16.096746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:16.114089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:16.114543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:16.115385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:16.115828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:16.740540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:16.756665 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3a8bc81c-82b1-4eff-8b55-4ce599b568bb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.749620 Jul 20 11:02:16.774167 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1546/3149] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:16 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:16.796790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d09c562-3f2f-4f3e-b5b1-ac06db88644c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa8ff70>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:16.975296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:16.989301 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b81d797-8dad-4661-a27b-256b47dcb09a tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1577 microversion: 2.1 time: 0.899145 Jul 20 11:02:16.999709 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1604/3150] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:16 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1577 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:17.014410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:17.014915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:17.036528 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d09c562-3f2f-4f3e-b5b1-ac06db88644c tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.259811 Jul 20 11:02:17.038320 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1547/3151] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:16 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:17.066364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:17.066899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:17.067807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:17.084342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:17.359479 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03dd6816-7539-4d12-b917-64a585644f34 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.350975 Jul 20 11:02:17.360641 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1605/3152] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:02:17 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:17.789613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:17.790322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:17.802893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:17.803385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:17.804555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:17.822213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:18.056760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f40f4ced-5f3a-41f6-ace4-d5ab44b2de8d tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea74430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:18.218516 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f40f4ced-5f3a-41f6-ace4-d5ab44b2de8d tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.170523 Jul 20 11:02:18.235837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1606/3153] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:18 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:19.247946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23523ba0-76f3-407f-97e4-eebc095e9386 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3eaa7550>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:19.414933 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-23523ba0-76f3-407f-97e4-eebc095e9386 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.182215 Jul 20 11:02:19.423311 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1607/3154] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:19 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:19.656399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:19.693282 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-013a06d1-e1fb-4a31-b163-5487cb326164 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 1.906962 Jul 20 11:02:19.706922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1548/3155] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:17 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:20.432634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8fa4ccf0-577a-4ba8-94d5-3e25bf79a3d1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c4e4bf160>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:20.470751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4ec8bb8d-1d0a-452d-8740-790a8a18c907 req-3cdfe9ff-1fa3-4c75-bb56-761b17edf279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c39850-ed05-449f-ae49-2ee3c6df6099", "tag": "95b9dbc5-21d1-4e71-bbb1-6448b587c081"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:20.500606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4ec8bb8d-1d0a-452d-8740-790a8a18c907 req-3cdfe9ff-1fa3-4c75-bb56-761b17edf279 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:20.513649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4ec8bb8d-1d0a-452d-8740-790a8a18c907 req-3cdfe9ff-1fa3-4c75-bb56-761b17edf279 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:20.589737 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4ec8bb8d-1d0a-452d-8740-790a8a18c907 req-3cdfe9ff-1fa3-4c75-bb56-761b17edf279 service nova] Creating event network-changed:95b9dbc5-21d1-4e71-bbb1-6448b587c081 for instance d3c39850-ed05-449f-ae49-2ee3c6df6099 on n-h1-846219-10 Jul 20 11:02:20.631112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4ec8bb8d-1d0a-452d-8740-790a8a18c907 req-3cdfe9ff-1fa3-4c75-bb56-761b17edf279 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173386 Jul 20 11:02:20.632151 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1549/3156] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:20.741978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:20.754437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:20.781838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8fa4ccf0-577a-4ba8-94d5-3e25bf79a3d1 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.355704 Jul 20 11:02:20.787056 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1608/3157] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:20 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:20.798534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:20.800212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:20.812379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:20.815531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:21.467064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1584708579", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:21.625847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:21.642686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:21.665149 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-55d93b1f-3c9f-4802-a908-96c114c06890 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.941843 Jul 20 11:02:21.665765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1550/3158] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:20 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:21.734981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] validate_networks() for [('ad49b68f-ce22-49a7-ac18-e29f72bbad1d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:02:21.806079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aa29673d-1130-42d4-8f97-b0d554f87a43 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ee3e0d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:21.929455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aa29673d-1130-42d4-8f97-b0d554f87a43 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.128923 Jul 20 11:02:21.938466 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1551/3159] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:21 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:22.711848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:22.712499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:22.729703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:22.730581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:22.731834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:22.732539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:23.506719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=12 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:24.047421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:24.056920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b18b4f62-157f-49a6-992a-efd365a51ff9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 1.370819 Jul 20 11:02:24.057533 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1552/3160] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:22 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:24.092517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-039fcddb-3252-46e8-8f27-9359153f00de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f478d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:24.181715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-039fcddb-3252-46e8-8f27-9359153f00de tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.103460 Jul 20 11:02:24.183596 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1553/3161] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:24 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:24.314165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1422533958", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:24.483030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] validate_networks() for [('d319a698-88a9-4733-8964-1eb7a08c5a1d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:02:27.134392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=15 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:27.526922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:02:27.527522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:02:27.527787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:02:27.528329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:02:27.528863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:02:27.533962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:02:27.534555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:02:27.536037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:02:27.536464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:02:27.536886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:02:27.569492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:27.569681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:27.570078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:27.570790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:27.571288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:27.576433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:27.589466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:27.590091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:27.631953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Getting quotas for project b388e2b9c80c476eb61facd15bf729f1. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:02:27.640359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Getting quotas for user c3a0ea360267458882dc782fb606c7f1 and project b388e2b9c80c476eb61facd15bf729f1. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:02:27.666880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:02:27.669285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:02:27.701742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for project d427430f6c374ad183381dc509229fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:02:27.718014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for user c597235b7c47404da82b77cd60317eb3 and project d427430f6c374ad183381dc509229fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:02:27.765195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:02:27.777850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:02:27.895553 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-80a90f6b-7e0e-4c39-b10c-17af46717c52 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.009586 Jul 20 11:02:27.896491 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1609/3162] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:02:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 7032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:02:27.915260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:27.916098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:27.949863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:27.952198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:27.960985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:27.965970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:28.034430 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f7a5bd79-2c8f-409f-a0ab-d10bd6d5ca18 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.719398 Jul 20 11:02:28.061092 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1554/3163] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:02:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:02:28.085100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:28.086258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:28.169346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:28.180576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:28.183548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:28.195895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:28.333614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:28.354125 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8617074e-bb55-43b8-acd2-2d0af67a0f05 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1577 microversion: 2.1 time: 0.444973 Jul 20 11:02:28.357307 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1610/3164] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:27 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1577 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:28.387770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-779f0fee-53f3-44f9-abd1-ff2b96e3ffdd req-43ed0c45-2180-4192-8806-92aa2c7f7841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b2f6f9-89bb-423b-881f-896cdc5a7c0f", "tag": "096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:28.434818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-779f0fee-53f3-44f9-abd1-ff2b96e3ffdd req-43ed0c45-2180-4192-8806-92aa2c7f7841 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:28.439132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-779f0fee-53f3-44f9-abd1-ff2b96e3ffdd req-43ed0c45-2180-4192-8806-92aa2c7f7841 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:28.506046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-779f0fee-53f3-44f9-abd1-ff2b96e3ffdd req-43ed0c45-2180-4192-8806-92aa2c7f7841 service nova] Creating event network-changed:096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1 for instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f on n-h1-846219-10 Jul 20 11:02:28.538936 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-779f0fee-53f3-44f9-abd1-ff2b96e3ffdd req-43ed0c45-2180-4192-8806-92aa2c7f7841 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175342 Jul 20 11:02:28.546509 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1611/3165] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:28.572017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0634efeb-27f2-4648-bc08-e99a162d76df tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea745e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:28.647759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:28.656402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f8261b6-239a-4c65-8101-781a8f56ea37 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.592368 Jul 20 11:02:28.659657 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1555/3166] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:28 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:28.666986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee01473d-159d-47cf-a371-221bfb0eaccc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:28.673982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee01473d-159d-47cf-a371-221bfb0eaccc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:28.707342 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0634efeb-27f2-4648-bc08-e99a162d76df tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.158550 Jul 20 11:02:28.708796 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1612/3167] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:28 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:28.716908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-665a8bf7-e493-45eb-8768-6cee93281483 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:28.719435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-665a8bf7-e493-45eb-8768-6cee93281483 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:28.724993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:29.006678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-665a8bf7-e493-45eb-8768-6cee93281483 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:29.014649 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-665a8bf7-e493-45eb-8768-6cee93281483 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1225 microversion: 2.1 time: 0.304439 Jul 20 11:02:29.016611 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1613/3168] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:28 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:29.038733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee01473d-159d-47cf-a371-221bfb0eaccc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:29.082269 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee01473d-159d-47cf-a371-221bfb0eaccc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1214 microversion: 2.1 time: 0.414271 Jul 20 11:02:29.083223 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1556/3169] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:28 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1214 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:29.676600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:29.678309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:29.708877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:29.709827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:29.713215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:29.714480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:29.723775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-82535fdb-647c-45b7-b0ef-3304e0391f51 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f36ea60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:29.863413 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-82535fdb-647c-45b7-b0ef-3304e0391f51 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.145684 Jul 20 11:02:29.864660 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1557/3170] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:29 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:30.036765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:30.037729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:30.046422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:30.047232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:30.048364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:30.049099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:30.262623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:30.276804 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e8f3d6f1-b8f7-40de-8cf4-3a600a2b8b69 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1277 microversion: 2.1 time: 0.246149 Jul 20 11:02:30.278432 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1558/3171] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:30 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:30.299473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:30.300639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:30.330245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:30.333261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:30.335324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:30.342834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:30.413723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:30.427680 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-709c5bdc-321c-4f26-a971-d1eec9c2a08d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.755438 Jul 20 11:02:30.428567 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1614/3172] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:29 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:30.580037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:30.593904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8bb54bba-e031-4676-a746-06427448448f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1284 microversion: 2.1 time: 0.308008 Jul 20 11:02:30.594513 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1559/3173] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:30 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:30.880340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-763c1771-452b-4203-a7dd-26470e295109 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f077ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:30.987220 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-763c1771-452b-4203-a7dd-26470e295109 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.112479 Jul 20 11:02:30.998991 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1615/3174] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:30 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:31.303731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:31.306932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:31.317576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:31.318542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:31.320362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:31.321431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:31.466147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:31.469467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:31.553796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:31.557422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:31.562620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:31.567205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:31.709117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:31.730152 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85ea003c-6d7e-4744-9370-3b0a6be34160 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1283 microversion: 2.1 time: 0.425143 Jul 20 11:02:31.747397 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1560/3175] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:31 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1283 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:31.758330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:31.759397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:31.768662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:31.769453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:31.771091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:31.771790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:31.993784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:32.005725 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9fd8b79-9dbb-4c8d-ad3f-f68e29f895b5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1272 microversion: 2.1 time: 0.255808 Jul 20 11:02:32.008045 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1561/3176] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:31 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:32.022844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04cecb47-760d-4ad9-94e0-f345442fc52f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa36820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:32.082489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:32.094452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f2f1e2f-8934-449d-87c5-82a1fd9f6040 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.651370 Jul 20 11:02:32.110926 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1616/3177] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:31 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:32.134103 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04cecb47-760d-4ad9-94e0-f345442fc52f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1451 microversion: 2.1 time: 0.118097 Jul 20 11:02:32.137170 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1562/3178] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:32 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:32.758001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:32.758829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:32.770861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:32.773487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:32.774815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:32.777999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:33.031968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:33.033224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:33.042551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:33.055905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:33.056677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:33.057482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:33.058559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:33.091995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:33.104313 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fc83789b-5f79-4c67-bf32-673a8130709c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.350689 Jul 20 11:02:33.107938 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1617/3179] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:32 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:33.126308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:33.127030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:33.157233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:33.157732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:33.160303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:33.161143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:33.765590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:33.778314 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7865847-1906-419a-86fe-ef1dff1f4770 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.755799 Jul 20 11:02:33.789742 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1563/3180] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:33 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:33.795630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1ab7e2b9-5692-44eb-9810-6db37b0e7a1a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3eeea4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:33.829930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:33.879924 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6a5e879-5c44-46f9-a1fc-3993568741e7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.751559 Jul 20 11:02:33.880912 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1618/3181] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:33 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:33.922228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d2d322d8-b172-4a55-bc6b-de167e5127d6 req-4cd0df96-d2d6-496a-8862-f1446e17f02a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c39850-ed05-449f-ae49-2ee3c6df6099", "name": "network-vif-plugged", "status": "completed", "tag": "95b9dbc5-21d1-4e71-bbb1-6448b587c081"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:33.946516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1ab7e2b9-5692-44eb-9810-6db37b0e7a1a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1460 microversion: 2.1 time: 0.155016 Jul 20 11:02:33.948755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1564/3182] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:33 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1460 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:33.960666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-36e61738-2f28-43cf-b170-d0cf023a1264 req-e8bf6629-e88e-4320-bc6b-86196c4de2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde82f59-00a5-434e-a924-b318e7d04d89", "tag": "53af59fd-b6eb-4149-b1df-0e374df5ed25"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:33.963274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d2d322d8-b172-4a55-bc6b-de167e5127d6 req-4cd0df96-d2d6-496a-8862-f1446e17f02a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:33.966405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d2d322d8-b172-4a55-bc6b-de167e5127d6 req-4cd0df96-d2d6-496a-8862-f1446e17f02a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:33.980885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-36e61738-2f28-43cf-b170-d0cf023a1264 req-e8bf6629-e88e-4320-bc6b-86196c4de2e2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:33.981776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-36e61738-2f28-43cf-b170-d0cf023a1264 req-e8bf6629-e88e-4320-bc6b-86196c4de2e2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:34.020800 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d2d322d8-b172-4a55-bc6b-de167e5127d6 req-4cd0df96-d2d6-496a-8862-f1446e17f02a service nova] Creating event network-vif-plugged:95b9dbc5-21d1-4e71-bbb1-6448b587c081 for instance d3c39850-ed05-449f-ae49-2ee3c6df6099 on n-h1-846219-10 Jul 20 11:02:34.032893 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-36e61738-2f28-43cf-b170-d0cf023a1264 req-e8bf6629-e88e-4320-bc6b-86196c4de2e2 service nova] Creating event network-changed:53af59fd-b6eb-4149-b1df-0e374df5ed25 for instance cde82f59-00a5-434e-a924-b318e7d04d89 on n-h2-846219-10 Jul 20 11:02:34.045386 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-36e61738-2f28-43cf-b170-d0cf023a1264 req-e8bf6629-e88e-4320-bc6b-86196c4de2e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094300 Jul 20 11:02:34.048830 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1565/3183] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:34.049352 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d2d322d8-b172-4a55-bc6b-de167e5127d6 req-4cd0df96-d2d6-496a-8862-f1446e17f02a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154121 Jul 20 11:02:34.059291 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1619/3184] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:34.076004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8acebcf7-bc22-4a1b-ad3c-398e63be6a0f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3eeeadc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:34.130345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:34.131537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:34.143700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:34.145447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:34.146398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:34.146850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:34.152131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8acebcf7-bc22-4a1b-ad3c-398e63be6a0f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 200 len: 1460 microversion: 2.1 time: 0.100501 Jul 20 11:02:34.157958 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1566/3185] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:34 2022] GET /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 1460 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:34.183002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:34.192367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:34.205046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:34.207917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:34.211486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:34.217355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:34.800028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:34.812913 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe5fbb93-d96c-4d9f-9098-e10b55ed4d37 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.689329 Jul 20 11:02:34.814150 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1620/3186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:34 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:34.819553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:34.820427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:34.827194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:34.827928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:34.829762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:34.833927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:35.028740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:35.055155 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2144bf5a-40ef-4aa6-8a87-7e9040ebf598 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 200 len: 1467 microversion: 2.1 time: 0.880955 Jul 20 11:02:35.071770 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1567/3187] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:34 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 1467 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:35.071770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.071770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:35.071770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:35.071770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:35.072399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:35.073066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:35.233976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:35.249106 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3547cab3-f695-4785-be74-5e020de1a64f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.433439 Jul 20 11:02:35.250294 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1621/3188] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:34 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:35.259791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-270258f6-3c73-4b0c-93ca-ddfb9b8cd2f2 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fc52700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.361276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:35.375024 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95149b4b-50aa-419c-b346-dc3787d2ef10 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.316593 Jul 20 11:02:35.386505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1568/3189] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:35.392938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-88320463-c62f-455a-92ee-9e5aa371d72e req-749cb4a0-b53e-44ae-b8aa-130011a977a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0", "tag": "3f95b9a1-49f6-4e90-8bb8-a6fde137e014"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:35.402511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-88320463-c62f-455a-92ee-9e5aa371d72e req-749cb4a0-b53e-44ae-b8aa-130011a977a6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:35.403008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-88320463-c62f-455a-92ee-9e5aa371d72e req-749cb4a0-b53e-44ae-b8aa-130011a977a6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:35.403254 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-270258f6-3c73-4b0c-93ca-ddfb9b8cd2f2 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?changes-since=2022-07-20T11%3A00%3A12Z" status: 200 len: 1903 microversion: 2.1 time: 0.151039 Jul 20 11:02:35.404360 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1622/3190] 10.222.0.79 () {58 vars in 1198 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/images?changes-since=2022-07-20T11%3A00%3A12Z => generated 1903 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:35.420218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7e5b3815-13fa-47dc-b8aa-48d95d3d1317 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea84820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.428028 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-88320463-c62f-455a-92ee-9e5aa371d72e req-749cb4a0-b53e-44ae-b8aa-130011a977a6 service nova] Creating event network-changed:3f95b9a1-49f6-4e90-8bb8-a6fde137e014 for instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 on n-h2-846219-10 Jul 20 11:02:35.434137 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-88320463-c62f-455a-92ee-9e5aa371d72e req-749cb4a0-b53e-44ae-b8aa-130011a977a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045683 Jul 20 11:02:35.434693 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1569/3191] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:35.514222 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7e5b3815-13fa-47dc-b8aa-48d95d3d1317 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1408536922" status: 200 len: 485 microversion: 2.1 time: 0.099697 Jul 20 11:02:35.515430 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1623/3192] 10.222.0.79 () {58 vars in 1230 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1408536922 => generated 485 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:02:35.530012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a17c1edb-8d28-459f-8aef-56ab9dc99f1f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f4a2a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.649171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a17c1edb-8d28-459f-8aef-56ab9dc99f1f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?server=f7db14d8-91de-4457-930a-567699823919" status: 200 len: 958 microversion: 2.1 time: 0.124707 Jul 20 11:02:35.650673 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1570/3193] 10.222.0.79 () {58 vars in 1208 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/images?server=f7db14d8-91de-4457-930a-567699823919 => generated 958 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:35.666540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e8c81f0-3ead-447e-b1a1-1c0bf6dbe58a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f11c040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.808965 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e8c81f0-3ead-447e-b1a1-1c0bf6dbe58a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 484 microversion: 2.1 time: 0.148972 Jul 20 11:02:35.815961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1624/3194] 10.222.0.79 () {58 vars in 1316 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100 => generated 484 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:35.827676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a80780e9-1df0-4493-aba2-018a7cadeadb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f354af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.834397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:35.836710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:35.860468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:35.863533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:35.864727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:35.866603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:35.951877 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a80780e9-1df0-4493-aba2-018a7cadeadb tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 484 microversion: 2.1 time: 0.134123 Jul 20 11:02:35.954299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1571/3195] 10.222.0.79 () {58 vars in 1302 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100 => generated 484 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:35.972975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-048b124c-6598-4d13-ae01-7291d07c6dcf tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa8fe50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:36.252297 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-048b124c-6598-4d13-ae01-7291d07c6dcf tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.286527 Jul 20 11:02:36.254690 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1572/3196] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:36.268419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-14369ff3-0f40-4ff2-890c-c2413957d8b7 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fe57790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:36.345290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:36.360393 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67954b06-920c-4f38-95fe-cd40ccecf4c4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.532261 Jul 20 11:02:36.378609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1625/3197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:35 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:36.391652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:36.396020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:36.419660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:36.420359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:36.422046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:36.422750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:36.492498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-14369ff3-0f40-4ff2-890c-c2413957d8b7 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.226570 Jul 20 11:02:36.495407 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1573/3198] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 11:02:36 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:36.511897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:36.512668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:36.527818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:36.531805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:36.539814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:36.541574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:36.902130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:36.914169 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-739a675a-ddf6-47f7-baf9-969017a291b8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.532320 Jul 20 11:02:36.918458 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1626/3199] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:36 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:36.930762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9051bf7-9799-480b-a2ea-6196534ef5fa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3faa31f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:36.964054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:36.974449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef6d1a6c-4ae0-4e35-a2a9-1cd953ddbac4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1309 microversion: 2.1 time: 0.477619 Jul 20 11:02:36.975419 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1574/3200] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:36 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1309 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.080813 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9051bf7-9799-480b-a2ea-6196534ef5fa tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.159330 Jul 20 11:02:37.100609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1627/3201] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 11:02:36 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:37.117628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-55e35ad9-5fc9-4951-bb96-97ebf40cfda3 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f478310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.257982 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-55e35ad9-5fc9-4951-bb96-97ebf40cfda3 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?changes-since=2022-07-20T11%3A00%3A05Z" status: 200 len: 6321 microversion: 2.1 time: 0.148029 Jul 20 11:02:37.272288 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1575/3202] 10.222.0.79 () {58 vars in 1219 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-20T11%3A00%3A05Z => generated 6321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.279964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-889c7fb9-9940-43f2-a9b4-8255ab7954f8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea339d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.361017 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-889c7fb9-9940-43f2-a9b4-8255ab7954f8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1408536922" status: 200 len: 665 microversion: 2.1 time: 0.085604 Jul 20 11:02:37.370098 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1628/3203] 10.222.0.79 () {58 vars in 1251 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1408536922 => generated 665 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:37.385766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.386389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:37.386526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da6192f2-7734-440d-bf43-d905cd769a1f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3faa33a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.404510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:37.405460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:37.406894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:37.409084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:37.478657 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da6192f2-7734-440d-bf43-d905cd769a1f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1462 microversion: 2.1 time: 0.090502 Jul 20 11:02:37.488840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1629/3204] 10.222.0.79 () {58 vars in 1337 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100 => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.501371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-faa721f2-5127-46ba-a24c-3c9f29db35a5 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ea338b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.588088 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-faa721f2-5127-46ba-a24c-3c9f29db35a5 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1462 microversion: 2.1 time: 0.098035 Jul 20 11:02:37.598609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1630/3205] 10.222.0.79 () {58 vars in 1323 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2Fbe6c4205-eb71-4050-9527-adf95060d100 => generated 1462 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.604208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-911772e3-af07-458d-b2e4-12485ac52d3d tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3eb1baf0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.612732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:37.623617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:37.764079 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-911772e3-af07-458d-b2e4-12485ac52d3d tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7096 microversion: 2.1 time: 0.160346 Jul 20 11:02:37.764219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:37.776893 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1631/3206] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7096 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.780522 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1761b75b-b181-40e1-972e-0e70e5d41fd1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.398364 Jul 20 11:02:37.784766 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1576/3207] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.790972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a9dc51d0-dee5-49f7-8350-c274aa1a131f req-b44dfa48-b6a2-42de-b5f7-f8e9a68d1214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7db14d8-91de-4457-930a-567699823919", "name": "network-vif-unplugged", "status": "completed", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:37.804874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a9dc51d0-dee5-49f7-8350-c274aa1a131f req-b44dfa48-b6a2-42de-b5f7-f8e9a68d1214 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:37.805034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76912969-cf89-4973-a7e3-4f4bfdbadede tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f30f4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.805726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a9dc51d0-dee5-49f7-8350-c274aa1a131f req-b44dfa48-b6a2-42de-b5f7-f8e9a68d1214 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:37.829394 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a9dc51d0-dee5-49f7-8350-c274aa1a131f req-b44dfa48-b6a2-42de-b5f7-f8e9a68d1214 service nova] Creating event network-vif-unplugged:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:02:37.843393 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a9dc51d0-dee5-49f7-8350-c274aa1a131f req-b44dfa48-b6a2-42de-b5f7-f8e9a68d1214 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063863 Jul 20 11:02:37.844408 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1632/3208] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:37.906628 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76912969-cf89-4973-a7e3-4f4bfdbadede tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4364 microversion: 2.1 time: 0.119893 Jul 20 11:02:37.907821 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1577/3209] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4364 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:37.925251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6480d38a-59c5-49fc-8002-86c765c8f489 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f11c8b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.939543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:37.940778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:37.951850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:37.956684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:37.957741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:37.958339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.010566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6480d38a-59c5-49fc-8002-86c765c8f489 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/478de60b-94fe-4326-bea5-987154e218b6" status: 200 len: 784 microversion: 2.1 time: 0.091475 Jul 20 11:02:38.012337 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1633/3210] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/images/478de60b-94fe-4326-bea5-987154e218b6 => generated 784 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:38.045193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:38.046620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:38.055733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.056402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.057380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.057978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.191143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:38.208338 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79530bcd-df82-4ab9-ace9-3b952fd04e45 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.277627 Jul 20 11:02:38.217321 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1578/3211] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:37 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:38.220266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3b60fc7-915c-40ed-b46c-a1b2f426fcbe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f354c10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:38.303616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3b60fc7-915c-40ed-b46c-a1b2f426fcbe tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1607 microversion: 2.1 time: 0.089792 Jul 20 11:02:38.305468 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1579/3212] 10.222.0.79 () {58 vars in 1157 bytes} [Wed Jul 20 11:02:38 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1607 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:38.330276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:38.335504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ffb6685-95da-450b-aaef-074c4b862864 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ee825e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:38.343542 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13c717fb-b18d-446c-91f3-737f7e12b435 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1489 microversion: 2.1 time: 0.326264 Jul 20 11:02:38.356921 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1634/3213] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:38 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1489 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:38.368041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:38.370133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:38.378480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.379885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.381341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.381975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.540528 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8fe7d826-976d-497c-8883-f5d89249798e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "PUT /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1084 microversion: 2.1 time: 0.179043 Jul 20 11:02:38.541282 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1635/3214] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:02:38 2022] PUT /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1084 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:38.559352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:38.560110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:38.568284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.568866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.569667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.570246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.762361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:38.771344 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d216b67-e8a4-4b60-bb9d-b5f52771fcc8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1510 microversion: 2.1 time: 0.216196 Jul 20 11:02:38.782207 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1636/3215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:38 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:38.789401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:38.793116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:38.804721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.805182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:38.806060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:38.806771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.013954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:39.020342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:39.033840 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-064f7560-2ddd-4e1a-a0d3-019d963644f5 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1510 microversion: 2.1 time: 0.248029 Jul 20 11:02:39.046747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1637/3216] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:38 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:39.046747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:39.046747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:39.049164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:39.054931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.055943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.058520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.059421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.299725 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ffb6685-95da-450b-aaef-074c4b862864 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447" status: 204 len: 0 microversion: 2.1 time: 0.974743 Jul 20 11:02:39.301152 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1580/3217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:38 2022] DELETE /compute/v2.1/images/d42bf51b-5d33-4304-9e8d-c446c6658447 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:39.312438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:39.314868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:39.332189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:39.332533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.333466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.336760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.337913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.359694 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57eb0d6d-ac90-40ae-adba-296ca2be7eaf tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.323503 Jul 20 11:02:39.360301 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1638/3218] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:39 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:39.378229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:39.378927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:39.386122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:02:39.386347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.386579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.398727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.401440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.444234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:39.535496 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d06fc6a3-6803-4b87-a04b-c97133673e67 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 204 len: 0 microversion: 2.1 time: 0.232472 Jul 20 11:02:39.538718 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1581/3219] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:02:39 2022] DELETE /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:39.552112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-646ccfe7-de06-46b1-b6ac-d332ff62c901 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fe57040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:39.663570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:39.672231 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-feb756aa-3cda-4200-8b35-05073e435cfe tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.299696 Jul 20 11:02:39.683892 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1639/3220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:39 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:39.694011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:39.695213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:39.702589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.704442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.707450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:39.708957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:39.974354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:39.990070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2ae1540-3ca9-4268-b1eb-b8208076b102 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1516 microversion: 2.1 time: 0.304386 Jul 20 11:02:39.991756 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1640/3221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:39 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:40.009393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ebc7e4f5-cdc0-4b0f-addc-20e6973d9abf req-4766e06f-5622-412b-891e-fad019162d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde82f59-00a5-434e-a924-b318e7d04d89", "name": "network-vif-plugged", "status": "completed", "tag": "53af59fd-b6eb-4149-b1df-0e374df5ed25"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:40.044975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ebc7e4f5-cdc0-4b0f-addc-20e6973d9abf req-4766e06f-5622-412b-891e-fad019162d9a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:40.045490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ebc7e4f5-cdc0-4b0f-addc-20e6973d9abf req-4766e06f-5622-412b-891e-fad019162d9a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:40.089636 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ebc7e4f5-cdc0-4b0f-addc-20e6973d9abf req-4766e06f-5622-412b-891e-fad019162d9a service nova] Creating event network-vif-plugged:53af59fd-b6eb-4149-b1df-0e374df5ed25 for instance cde82f59-00a5-434e-a924-b318e7d04d89 on n-h2-846219-10 Jul 20 11:02:40.108219 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ebc7e4f5-cdc0-4b0f-addc-20e6973d9abf req-4766e06f-5622-412b-891e-fad019162d9a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112746 Jul 20 11:02:40.108870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1641/3222] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:40.382727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:40.384230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:40.391445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:40.392209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:40.393894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:40.394639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:40.448663 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-646ccfe7-de06-46b1-b6ac-d332ff62c901 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef" status: 204 len: 0 microversion: 2.1 time: 0.907330 Jul 20 11:02:40.449566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1582/3223] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:39 2022] DELETE /compute/v2.1/images/465d90a2-b995-40b9-ab61-e9fba1e030ef => generated 0 bytes in 910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:40.460036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2d742ef5-6b74-4354-a8d5-35aba0641584 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3ee82280>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:40.606564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:40.618865 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c0da4594-e952-4055-8e6c-5fa4bbdb8418 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.242429 Jul 20 11:02:40.619656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1642/3224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:40 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:40.693132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:40.693773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:40.707664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:40.715713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:40.717010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:40.718536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:40.970915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:40.982360 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4ac9cfb-ea59-4c5d-9b00-2ec267c11705 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.295470 Jul 20 11:02:40.984106 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1643/3225] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:40 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:40.992055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:40.996122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:41.008911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.009803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.011917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.012516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.056998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:02:41.294011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd21b62a-21b5-4e77-86cc-6341d5068778 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 204 len: 0 microversion: 2.1 time: 0.306959 Jul 20 11:02:41.299194 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1644/3226] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:02:40 2022] DELETE /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:41.314158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:41.315932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:41.331356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.332008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.333190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.333890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.654945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:41.668581 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f5c7c973-cf48-43ef-be0c-ca228f4dd2a7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1516 microversion: 2.1 time: 0.367069 Jul 20 11:02:41.671676 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1645/3227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:41 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:41.685247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:41.685988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:41.703482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.707573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.708637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.709116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.872924 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2d742ef5-6b74-4354-a8d5-35aba0641584 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc" status: 204 len: 0 microversion: 2.1 time: 1.417974 Jul 20 11:02:41.873511 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1583/3228] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:40 2022] DELETE /compute/v2.1/images/c76dc848-5eb9-4d48-a3b2-720e9bf58dbc => generated 0 bytes in 1419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:41.881194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:41.882253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:41.889566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.890246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:41.891251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:41.892242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.030984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:42.051812 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da0c98b8-9f57-47d7-8c79-88b8d4f2f196 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1667 microversion: 2.1 time: 0.378321 Jul 20 11:02:42.052751 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1646/3229] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:41 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1667 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:42.068935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:42.069835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:42.077295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.077996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.079347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.079990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.112641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:02:42.181414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:42.187883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:42.190959 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-999adc57-6c34-43a1-8097-62f7fe96d2cb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1325 microversion: 2.1 time: 0.316062 Jul 20 11:02:42.191384 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1584/3230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:41 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:42.200524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:42.206908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:42.222100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.222964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.228236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.229034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.323472 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-058784a8-afd2-4834-b150-bb535b189a5f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 204 len: 0 microversion: 2.1 time: 0.258577 Jul 20 11:02:42.327714 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1647/3231] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:02:42 2022] DELETE /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:42.339715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b71d3dd1-99c7-4517-a958-68712c85d828 req-05b28cd1-079e-4a71-b6b8-0e2983da9283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0", "name": "network-vif-plugged", "status": "completed", "tag": "3f95b9a1-49f6-4e90-8bb8-a6fde137e014"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:42.354618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b71d3dd1-99c7-4517-a958-68712c85d828 req-05b28cd1-079e-4a71-b6b8-0e2983da9283 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.355650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b71d3dd1-99c7-4517-a958-68712c85d828 req-05b28cd1-079e-4a71-b6b8-0e2983da9283 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.370051 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b71d3dd1-99c7-4517-a958-68712c85d828 req-05b28cd1-079e-4a71-b6b8-0e2983da9283 service nova] Creating event network-vif-plugged:3f95b9a1-49f6-4e90-8bb8-a6fde137e014 for instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 on n-h2-846219-10 Jul 20 11:02:42.378165 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b71d3dd1-99c7-4517-a958-68712c85d828 req-05b28cd1-079e-4a71-b6b8-0e2983da9283 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047486 Jul 20 11:02:42.378905 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1648/3232] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:42.384862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:42.385803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:42.409794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.410871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.411950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.412399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.750510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:42.771128 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79d5fd45-26e3-4326-970f-21b905624459 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.574393 Jul 20 11:02:42.773482 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1585/3233] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:42 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:42.797385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c778d1a6-ad5a-44ab-acb6-7756233fc052 req-18858112-2293-4d19-b3f3-89e7b7edf251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c39850-ed05-449f-ae49-2ee3c6df6099", "name": "network-vif-deleted", "tag": "95b9dbc5-21d1-4e71-bbb1-6448b587c081"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:42.824565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c778d1a6-ad5a-44ab-acb6-7756233fc052 req-18858112-2293-4d19-b3f3-89e7b7edf251 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.824798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c778d1a6-ad5a-44ab-acb6-7756233fc052 req-18858112-2293-4d19-b3f3-89e7b7edf251 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.844542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c778d1a6-ad5a-44ab-acb6-7756233fc052 req-18858112-2293-4d19-b3f3-89e7b7edf251 service nova] Creating event network-vif-deleted:95b9dbc5-21d1-4e71-bbb1-6448b587c081 for instance d3c39850-ed05-449f-ae49-2ee3c6df6099 on n-h1-846219-10 Jul 20 11:02:42.883942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c778d1a6-ad5a-44ab-acb6-7756233fc052 req-18858112-2293-4d19-b3f3-89e7b7edf251 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108790 Jul 20 11:02:42.885456 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1586/3234] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:42.892286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:42.893401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:42.900540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.900990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.901798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.902239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.915491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:42.929997 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bde62d94-4ee4-4b2b-996b-d97386d8012f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1474 microversion: 2.1 time: 0.549533 Jul 20 11:02:42.943529 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1649/3235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:42 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1474 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:42.982007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:42.982840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:42.983818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lazy-loading 'fault' on Instance uuid d3c39850-ed05-449f-ae49-2ee3c6df6099 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:02:43.066878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:43.073599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:43.074322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:43.083421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.084069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.085137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.085718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.086184 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b556dd8-d4df-453f-8969-5c9009f9bbe6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 200 len: 1320 microversion: 2.1 time: 0.199199 Jul 20 11:02:43.087533 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1587/3236] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:42 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:43.217410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:43.218606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:43.231378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.232643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.234636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.235596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.320022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:43.334667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-71c24437-a244-4612-809a-bdf2f0954f5c tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1667 microversion: 2.1 time: 0.265289 Jul 20 11:02:43.337658 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1650/3237] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:43 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1667 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:43.504190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:43.515353 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b10e1315-1a49-4e98-a20a-5c94e637341f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1521 microversion: 2.1 time: 0.307975 Jul 20 11:02:43.516645 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1588/3238] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:43 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:43.545555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:43.546185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:43.560582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.564544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.565820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.566287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.750048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:43.761835 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c13b145-4679-4d9f-8a4b-8598c6cfdbc9 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1521 microversion: 2.1 time: 0.220986 Jul 20 11:02:43.762456 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1651/3239] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:43 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:43.780106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2067701889"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:43.781097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:43.790922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.791664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.792218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:43.792531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.793200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.794512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:43.803883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.804340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:43.805195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:43.805828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.085953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:44.105808 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc645042-16cf-4fd6-ba01-aa7831b7f150 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.318600 Jul 20 11:02:44.106845 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1652/3240] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:43 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:44.116047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:44.117002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:44.123735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.124867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.125921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.126532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.229264 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eebd2820-d91c-4158-8797-bab8820680ec tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89/action" status: 202 len: 0 microversion: 2.1 time: 0.452964 Jul 20 11:02:44.231474 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1589/3241] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:02:43 2022] POST /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 20 11:02:44.242421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:44.243795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:44.259354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.260072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.261141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.261829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.283080 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 HTTP/1.1 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'd3c39850-ed05-449f-ae49-2ee3c6df6099'} Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.286998 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.291955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:44.291955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:44.291955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:44.291955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:44.291955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:02:44.291955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.295795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:44.296876 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21d8ebb7-dffc-498a-a6f8-1813abb3d238 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 404 len: 111 microversion: 2.1 time: 0.064065 Jul 20 11:02:44.299221 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1590/3242] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:44 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:02:44.304710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1056836e-470c-4456-bfb8-5f1842a0f328 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '.version_select at 0x7f2c3f44d9d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:44.489956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:44.506921 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-551cd8c7-e05b-46ff-b715-c456271d5ec8 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1474 microversion: 2.1 time: 0.397731 Jul 20 11:02:44.511548 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1653/3243] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:44 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:44.530207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:44.534423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:44.549106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.549810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.550869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.551349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.562122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:44.656871 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1056836e-470c-4456-bfb8-5f1842a0f328 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb" status: 204 len: 0 microversion: 2.1 time: 0.355924 Jul 20 11:02:44.659618 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1591/3244] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:44 2022] DELETE /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:44.668958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-800174335", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "41e27fff-cc61-42f6-93a3-860aa555433f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:44.774248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] validate_networks() for [('41e27fff-cc61-42f6-93a3-860aa555433f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:02:44.860160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:44.878502 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1c46a960-820d-4ae4-99e8-514b17cea7d1 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1667 microversion: 2.1 time: 0.362652 Jul 20 11:02:44.879285 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1654/3245] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:44 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1667 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:44.884496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a2a90a7-8d24-4b7d-ace7-e3712a07d120 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '.version_select at 0x7f2c3ea841f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:44.915202 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3a2a90a7-8d24-4b7d-ace7-e3712a07d120 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Image not found. Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a2a90a7-8d24-4b7d-ace7-e3712a07d120 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb HTTP/1.1 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: exception: Image not found. Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb'} Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 20 11:02:44.918190 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb could not be found. Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a2a90a7-8d24-4b7d-ace7-e3712a07d120 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Image not found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3a2a90a7-8d24-4b7d-ace7-e3712a07d120 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb" status: 404 len: 62 microversion: 2.1 time: 0.038978 Jul 20 11:02:44.926677 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1655/3246] 10.222.0.79 () {58 vars in 1232 bytes} [Wed Jul 20 11:02:44 2022] GET /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:02:44.934893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:44.934893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:44.946188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.947065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:44.948185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:44.948930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.332898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:45.343787 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da29daa6-1109-48b4-9059-d27f61bfb287 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1533 microversion: 2.1 time: 0.416203 Jul 20 11:02:45.344473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1656/3247] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:44 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1533 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:45.369940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:45.377171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:45.415135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:45.420451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.422565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:45.424570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.697066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:02:45.698797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:02:45.699883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:02:45.701334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:02:45.703018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:02:45.734707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:45.737640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.738853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:45.739524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.775314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:02:45.782557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Getting quotas for user 02c78114f72443b490dcbff5f6e7444b and project ac35979520ac4728862ea0465a13b67c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:02:45.804191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:02:45.807419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:02:45.925666 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a5d4afaf-4471-42d4-9cf2-3d6e92d59471 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264184 Jul 20 11:02:45.940025 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1592/3248] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:02:45.946214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:45.958199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:45.959662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:45.971497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:45.972559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.974085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:45.976353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:45.980108 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ccf04989-9c96-4381-b771-047426b1401b tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1314 microversion: 2.1 time: 0.629986 Jul 20 11:02:46.011070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1657/3249] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:45 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:46.035472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f264e711-49aa-401a-a80f-b8354775ae97 req-37ebce4b-c692-419f-9a7c-f0be185067a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be6c4205-eb71-4050-9527-adf95060d100", "name": "network-vif-deleted", "tag": "84596e6f-53b6-49de-83af-236da2b3a9a4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:46.075342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:46.077052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f264e711-49aa-401a-a80f-b8354775ae97 req-37ebce4b-c692-419f-9a7c-f0be185067a4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:46.078169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f264e711-49aa-401a-a80f-b8354775ae97 req-37ebce4b-c692-419f-9a7c-f0be185067a4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:46.083351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:46.084533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lazy-loading 'fault' on Instance uuid be6c4205-eb71-4050-9527-adf95060d100 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:02:46.156983 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f264e711-49aa-401a-a80f-b8354775ae97 req-37ebce4b-c692-419f-9a7c-f0be185067a4 service nova] Creating event network-vif-deleted:84596e6f-53b6-49de-83af-236da2b3a9a4 for instance be6c4205-eb71-4050-9527-adf95060d100 on n-h2-846219-10 Jul 20 11:02:46.177218 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f264e711-49aa-401a-a80f-b8354775ae97 req-37ebce4b-c692-419f-9a7c-f0be185067a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160908 Jul 20 11:02:46.178573 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1658/3250] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:46.196140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:46.200570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:46.227641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:46.228460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:46.235867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:46.237773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:46.276047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:46.299271 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bdba5b18-e0d6-4913-97af-8ca45ce77b96 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 200 len: 1308 microversion: 2.1 time: 0.348435 Jul 20 11:02:46.300260 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1593/3251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:45 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:46.335514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d8e9ab5-83a4-4cd4-bc9f-56be01bcf283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:46.339489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d8e9ab5-83a4-4cd4-bc9f-56be01bcf283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:46.524840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9569321bb7e4481ba94f6af7d7c0c4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40e588b2fe24bfca9c216e619e69cf8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:46.561575 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05e8771f-339e-4237-a2dd-40cf4a32cb39 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 200 len: 1599 microversion: 2.1 time: 0.364100 Jul 20 11:02:46.566524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d8e9ab5-83a4-4cd4-bc9f-56be01bcf283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:46.576464 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1659/3252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:46 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 1599 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:46.585514 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d8e9ab5-83a4-4cd4-bc9f-56be01bcf283 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1208 microversion: 2.1 time: 0.263196 Jul 20 11:02:46.591461 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1594/3253] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:46 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1208 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:46.595053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:46.598461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:46.627412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:46.633130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:46.636530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:46.637491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:46.911960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:46.921901 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c81b8244-d911-4582-8064-d9dd879010a1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1539 microversion: 2.1 time: 0.349193 Jul 20 11:02:46.922971 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1660/3254] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:46 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1539 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:46.999333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:47.000915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.010338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.011127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.012435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.013132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.227961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:47.238784 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-539cb478-7099-47cf-923c-42919cce6e85 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1498 microversion: 2.1 time: 0.244543 Jul 20 11:02:47.239666 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1595/3255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:46 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:47.259801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:47.267032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.306980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.315150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.316608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.317202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.332631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:47.340177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: be6c4205-eb71-4050-9527-adf95060d100] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.378763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.379704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.387544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lazy-loading 'flavor' on Instance uuid c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:02:47.390315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.391432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.443256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] HTTP exception thrown: Instance be6c4205-eb71-4050-9527-adf95060d100 could not be found. Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Request method failure captured: Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 HTTP/1.1 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-A0mSHknisWpni4Vl7gHPraRI_rj8pzbOlQ1jdsu5LEsbds4AyjOqvTQS9ml47Fhn_9WDKeGUFSKX40R_7O-6MOD2cpn4dcXUhUFnqMUD-QohEg8yd1YhajnQRVQ3tIhvQGEZulPM82OebD-tejVAb9i3gYOOZMYrjOLfvxHPCEwMI Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 33bac6bd240c4b59aa1dcae4c652205d Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListImageFiltersTestJSON-64269164 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_33bac6bd240c4b59aa1dcae4c652205d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/33bac6bd240c4b59aa1dcae4c652205d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/33bac6bd240c4b59aa1dcae4c652205d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/33bac6bd240c4b59aa1dcae4c652205d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListImageFiltersTestJSON-64269164 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 33bac6bd240c4b59aa1dcae4c652205d Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-64269164 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListImageFiltersTestJSON-64269164-project Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9f03704b0dc44751ab391117a31449a8 Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListImageFiltersTestJSON-64269164-project Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance be6c4205-eb71-4050-9527-adf95060d100 could not be found. Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'be6c4205-eb71-4050-9527-adf95060d100'} Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be6c4205-eb71-4050-9527-adf95060d100 could not be found. Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be6c4205-eb71-4050-9527-adf95060d100 could not be found. Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:47.446612 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be6c4205-eb71-4050-9527-adf95060d100 could not be found. Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Returning 404 to user: Instance be6c4205-eb71-4050-9527-adf95060d100 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50c34b7d-88bb-40a2-8fa9-c818fd94a1ca tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100" status: 404 len: 111 microversion: 2.1 time: 0.123891 Jul 20 11:02:47.450955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1596/3256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:47 2022] GET /compute/v2.1/servers/be6c4205-eb71-4050-9527-adf95060d100 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:02:47.462766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:47.463905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.474112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.474766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.476169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.477189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.538165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:02:47.564437 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35a90920-7586-4547-be92-e3d52dece275 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "POST /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0/action" status: 200 len: 32 microversion: 2.1 time: 0.306708 Jul 20 11:02:47.571856 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1661/3257] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:02:47 2022] POST /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:02:47.592714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:47.593620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.629768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.630224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.631014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.631495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.717407 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-110fee1a-ecc8-4965-ba1a-bdc06354afe9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 204 len: 0 microversion: 2.1 time: 0.260468 Jul 20 11:02:47.719246 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1597/3258] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:02:47 2022] DELETE /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 11:02:47.732875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:47.738243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] [instance: bae475aa-a8c7-4cf1-91ca-d0222af7303f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.759370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.761636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.763307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.765147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.807470 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] HTTP exception thrown: Instance bae475aa-a8c7-4cf1-91ca-d0222af7303f could not be found. Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Request method failure captured: Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f HTTP/1.1 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-B60eJ1lMiYjOnDzemUUlArhg9ujvpx6tGdUlD1LUe7sE8ibZ8yS_VBAqmy8uYtCQj41NlNoOy7oE9pNJGs4nZbvJVocqVt6zItyauBpCJoRMMV4bzMa1ThkgW5incXuzD7RJsu39gXCKKyLCOiUdeIqTNAAvKBGNAntiUUsFm3boI Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: a40e588b2fe24bfca9c216e619e69cf8 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersTestFqdnHostnames-754867090 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a40e588b2fe24bfca9c216e619e69cf8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a40e588b2fe24bfca9c216e619e69cf8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a40e588b2fe24bfca9c216e619e69cf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a40e588b2fe24bfca9c216e619e69cf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersTestFqdnHostnames-754867090 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: a40e588b2fe24bfca9c216e619e69cf8 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-754867090 Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersTestFqdnHostnames-754867090-project Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: e9569321bb7e4481ba94f6af7d7c0c4e Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersTestFqdnHostnames-754867090-project Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance bae475aa-a8c7-4cf1-91ca-d0222af7303f could not be found. Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'bae475aa-a8c7-4cf1-91ca-d0222af7303f'} Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae475aa-a8c7-4cf1-91ca-d0222af7303f could not be found. Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae475aa-a8c7-4cf1-91ca-d0222af7303f could not be found. Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:47.811028 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae475aa-a8c7-4cf1-91ca-d0222af7303f could not be found. Jul 20 11:02:47.818399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:47.825027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Returning 404 to user: Instance bae475aa-a8c7-4cf1-91ca-d0222af7303f could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:47.827079 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0cf9078f-6d29-4d6e-be44-ed00ca5772f7 tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f" status: 404 len: 111 microversion: 2.1 time: 0.104810 Jul 20 11:02:47.835112 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1598/3259] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:47 2022] GET /compute/v2.1/servers/bae475aa-a8c7-4cf1-91ca-d0222af7303f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:02:47.847828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:47.848951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:47.868733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.869375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:47.877468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:47.879998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:48.037586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:48.048484 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05ce3a0d-a9be-4d30-a5aa-d27423c12885 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1260 microversion: 2.1 time: 0.211839 Jul 20 11:02:48.052485 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1599/3260] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:47 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:48.058353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:48.059240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:48.085709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:48.087142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:48.089694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:48.090272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:48.090987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:48.103389 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38cd3c9a-13c0-4d7b-bc4a-517bbbf498b1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.526314 Jul 20 11:02:48.104151 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1662/3261] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:47 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:48.114349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30ada35f-1c61-4781-bb6d-ed8eb592f68e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] Calling method '.version_select at 0x7f2c3eaa7820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:48.167198 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30ada35f-1c61-4781-bb6d-ed8eb592f68e tempest-ServersTestFqdnHostnames-754867090 tempest-ServersTestFqdnHostnames-754867090-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097317527" status: 202 len: 0 microversion: 2.1 time: 0.061702 Jul 20 11:02:48.169661 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1663/3262] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 11:02:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097317527 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:02:48.211856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:48.213369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:48.231412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:48.238171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:48.239764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:48.240407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:48.575384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:48.607442 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e8c16c6-5558-4cc0-8f81-5a72e3b61458 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 200 len: 1473 microversion: 2.1 time: 0.540538 Jul 20 11:02:48.609255 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1600/3263] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:48 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 1473 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:48.616154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-eae4a81e-b6f6-44aa-99ed-853108600991 req-2173da3b-cb9e-4e24-9932-6efedc37bda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae475aa-a8c7-4cf1-91ca-d0222af7303f", "name": "network-vif-deleted", "tag": "c16384de-2258-4bf6-a08b-724fd70fb91e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:48.628810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eae4a81e-b6f6-44aa-99ed-853108600991 req-2173da3b-cb9e-4e24-9932-6efedc37bda4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:48.629644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eae4a81e-b6f6-44aa-99ed-853108600991 req-2173da3b-cb9e-4e24-9932-6efedc37bda4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:48.650144 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-eae4a81e-b6f6-44aa-99ed-853108600991 req-2173da3b-cb9e-4e24-9932-6efedc37bda4 service nova] Creating event network-vif-deleted:c16384de-2258-4bf6-a08b-724fd70fb91e for instance bae475aa-a8c7-4cf1-91ca-d0222af7303f on n-h2-846219-10 Jul 20 11:02:48.665878 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-eae4a81e-b6f6-44aa-99ed-853108600991 req-2173da3b-cb9e-4e24-9932-6efedc37bda4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054259 Jul 20 11:02:48.667534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:48.672436 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1601/3264] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:48.686677 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-186be3f8-47d7-4ec6-a6cb-757dfb0fa792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1534 microversion: 2.1 time: 0.515699 Jul 20 11:02:48.691617 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1664/3265] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:48 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1534 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:49.070598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:49.072120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:49.092593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.094132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.097183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.099781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.127409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:49.128686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:49.148188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.150521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.154881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.157042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.278218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:49.290057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be87d791-7179-4de0-b1f9-9c37808a17b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1266 microversion: 2.1 time: 0.224817 Jul 20 11:02:49.305621 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1602/3266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:49 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:49.527978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:49.546270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c7752a18-a00e-4283-b90e-1bc6bc939837 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.426617 Jul 20 11:02:49.546880 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1665/3267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:49 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:49.628825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:49.629635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:49.650885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.651511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.652436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.653666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.715776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:49.717931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:49.737441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:49.740080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.740972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:49.742588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:49.743555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:50.394852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:50.403615 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5a94ead0-cb8d-4e64-a9e2-1564ed0192ab tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1521 microversion: 2.1 time: 0.693256 Jul 20 11:02:50.413332 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1666/3268] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:49 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:02:50.418534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:50.419564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:50.436023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:50.436494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:50.445918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:50.446486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:50.575751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:50.580374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:50.600445 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-88a3459b-ca5e-448d-a214-2dd8ec30063f tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 200 len: 1473 microversion: 2.1 time: 0.972009 Jul 20 11:02:50.601123 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1603/3269] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:49 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 1473 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:50.611861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:50.615025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:50.669994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:50.672968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:50.677890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:50.682400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:50.786111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:02:50.939610 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b667abe9-d6cc-4a47-a666-7aec6d60bae6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 204 len: 0 microversion: 2.1 time: 0.336559 Jul 20 11:02:50.940832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1604/3270] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:02:50 2022] DELETE /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:50.952193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:50.953071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:50.961559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:50.962010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:50.963018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:50.963623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:51.854107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:51.882188 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58091741-06a9-48fb-9eec-2044621ffaa1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 1.467463 Jul 20 11:02:51.893414 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1667/3271] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:50 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:51.916564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:51.917775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:51.925474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:51.926682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:51.928094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:51.928801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:51.946490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:51.958195 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d60e2ea8-9314-458d-ad41-427420b3a9c2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 1.014813 Jul 20 11:02:51.970278 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1605/3272] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:50 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:51.977050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-cb17d89f-5e69-4185-abe0-b4823684e6d9 req-eee85367-4b66-4526-8241-87d89d7d83d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7db14d8-91de-4457-930a-567699823919", "name": "network-vif-deleted", "tag": "c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:51.991806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cb17d89f-5e69-4185-abe0-b4823684e6d9 req-eee85367-4b66-4526-8241-87d89d7d83d7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:51.996258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cb17d89f-5e69-4185-abe0-b4823684e6d9 req-eee85367-4b66-4526-8241-87d89d7d83d7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:52.016060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-cb17d89f-5e69-4185-abe0-b4823684e6d9 req-eee85367-4b66-4526-8241-87d89d7d83d7 service nova] Creating event network-vif-deleted:c516d4a7-8cb8-4ade-b4d9-5f9b3c61e689 for instance f7db14d8-91de-4457-930a-567699823919 on n-h2-846219-10 Jul 20 11:02:52.025916 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-cb17d89f-5e69-4185-abe0-b4823684e6d9 req-eee85367-4b66-4526-8241-87d89d7d83d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053059 Jul 20 11:02:52.027312 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1606/3273] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:52.043851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-955534a4-7014-4fb6-a893-4d75df589dbf req-250cde2d-cd9d-4a5c-aca6-dcf5fb4f9de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde82f59-00a5-434e-a924-b318e7d04d89", "name": "network-vif-plugged", "status": "completed", "tag": "53af59fd-b6eb-4149-b1df-0e374df5ed25"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:52.050697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:52.064435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-955534a4-7014-4fb6-a893-4d75df589dbf req-250cde2d-cd9d-4a5c-aca6-dcf5fb4f9de2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:52.064991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-955534a4-7014-4fb6-a893-4d75df589dbf req-250cde2d-cd9d-4a5c-aca6-dcf5fb4f9de2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:52.101520 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-955534a4-7014-4fb6-a893-4d75df589dbf req-250cde2d-cd9d-4a5c-aca6-dcf5fb4f9de2 service nova] Creating event network-vif-plugged:53af59fd-b6eb-4149-b1df-0e374df5ed25 for instance cde82f59-00a5-434e-a924-b318e7d04d89 on n-h2-846219-10 Jul 20 11:02:52.125216 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-955534a4-7014-4fb6-a893-4d75df589dbf req-250cde2d-cd9d-4a5c-aca6-dcf5fb4f9de2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083902 Jul 20 11:02:52.126136 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1607/3274] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:52.141601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:52.143500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:52.153629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:52.154744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:52.155792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:52.156415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:52.321546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f03704b0dc44751ab391117a31449a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33bac6bd240c4b59aa1dcae4c652205d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:52.343337 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2925dbe4-528e-4d6b-a7c0-7af4f4875fe4 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 200 len: 1431 microversion: 2.1 time: 0.210052 Jul 20 11:02:52.356361 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1608/3275] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:52 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 1431 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:52.454810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:52.473003 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4ebcdfc-4bfb-4303-8303-30e17512391e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1527 microversion: 2.1 time: 0.577965 Jul 20 11:02:52.474023 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1668/3276] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:51 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1527 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:52.903118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:52.903884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:52.924489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:52.925278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:52.926246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:52.926920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:52.992208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:52.992957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:53.009875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:53.010775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:53.014866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:53.019100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:53.641432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:53.652372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:53.655475 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-138fbb84-339e-4971-8063-ee89bd801fb8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.755941 Jul 20 11:02:53.659402 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1609/3277] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:52 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:53.683444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:53.686536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] [instance: f7db14d8-91de-4457-930a-567699823919] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:53.689377 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d9108ce-e147-4f70-8ac9-9867e0ed7670 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.704241 Jul 20 11:02:53.692661 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1669/3278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:52 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:53.716774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:53.717458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:53.727092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:53.728528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:53.729207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:53.730299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:53.785573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] HTTP exception thrown: Instance f7db14d8-91de-4457-930a-567699823919 could not be found. Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Request method failure captured: Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 HTTP/1.1 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-A0mSHknisWpni4Vl7gHPraRI_rj8pzbOlQ1jdsu5LEsbds4AyjOqvTQS9ml47Fhn_9WDKeGUFSKX40R_7O-6MOD2cpn4dcXUhUFnqMUD-QohEg8yd1YhajnQRVQ3tIhvQGEZulPM82OebD-tejVAb9i3gYOOZMYrjOLfvxHPCEwMI Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 33bac6bd240c4b59aa1dcae4c652205d Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListImageFiltersTestJSON-64269164 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_33bac6bd240c4b59aa1dcae4c652205d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/33bac6bd240c4b59aa1dcae4c652205d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/33bac6bd240c4b59aa1dcae4c652205d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/33bac6bd240c4b59aa1dcae4c652205d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListImageFiltersTestJSON-64269164 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 33bac6bd240c4b59aa1dcae4c652205d Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-64269164 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListImageFiltersTestJSON-64269164-project Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9f03704b0dc44751ab391117a31449a8 Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListImageFiltersTestJSON-64269164-project Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f7db14d8-91de-4457-930a-567699823919 could not be found. Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f7db14d8-91de-4457-930a-567699823919'} Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7db14d8-91de-4457-930a-567699823919 could not be found. Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7db14d8-91de-4457-930a-567699823919 could not be found. Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:53.793195 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7db14d8-91de-4457-930a-567699823919 could not be found. Jul 20 11:02:53.799655 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:02:53.800213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:53.800213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:53.802164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Returning 404 to user: Instance f7db14d8-91de-4457-930a-567699823919 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:53.808423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:53.809225 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a799c1ec-8081-46f9-9278-9cfc18193459 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919" status: 404 len: 111 microversion: 2.1 time: 0.142712 Jul 20 11:02:53.810837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:53.812329 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1610/3279] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:53 2022] GET /compute/v2.1/servers/f7db14d8-91de-4457-930a-567699823919 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:02:53.820881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-967ce404-908e-4a23-bd7b-a1c618051ee9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3f1dcee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:54.646887 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-967ce404-908e-4a23-bd7b-a1c618051ee9 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/images/c9c39c95-b887-48c7-b10f-4f7cf6eb4835" status: 204 len: 0 microversion: 2.1 time: 0.830079 Jul 20 11:02:54.650487 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1611/3280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:53 2022] DELETE /compute/v2.1/images/c9c39c95-b887-48c7-b10f-4f7cf6eb4835 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:54.653078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c42e0681-252d-4d04-8f0c-5a268434dae7 req-b31b616b-659f-46de-a25d-6a9bedc247c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde82f59-00a5-434e-a924-b318e7d04d89", "name": "network-vif-deleted", "tag": "53af59fd-b6eb-4149-b1df-0e374df5ed25"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:54.676044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c42e0681-252d-4d04-8f0c-5a268434dae7 req-b31b616b-659f-46de-a25d-6a9bedc247c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:54.676783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c42e0681-252d-4d04-8f0c-5a268434dae7 req-b31b616b-659f-46de-a25d-6a9bedc247c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:54.691505 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c42e0681-252d-4d04-8f0c-5a268434dae7 req-b31b616b-659f-46de-a25d-6a9bedc247c7 service nova] Creating event network-vif-deleted:53af59fd-b6eb-4149-b1df-0e374df5ed25 for instance cde82f59-00a5-434e-a924-b318e7d04d89 on n-h2-846219-10 Jul 20 11:02:54.703257 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c42e0681-252d-4d04-8f0c-5a268434dae7 req-b31b616b-659f-46de-a25d-6a9bedc247c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053859 Jul 20 11:02:54.713503 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1612/3281] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:54.722219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-26be2a46-0963-44f6-997a-8c95e0c8ea00 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c3fa36820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:54.812877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:54.830729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c52f5a10-a252-4db2-9751-39be35b7e0eb tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 200 len: 1527 microversion: 2.1 time: 1.134688 Jul 20 11:02:54.831941 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1670/3282] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:53 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 1527 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:54.839555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:54.852138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:54.859259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:54.859983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:54.862720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:54.863480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:54.916272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:55.444967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:55.458273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af90305b-0716-498b-826f-c5579fe17c8d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.625037 Jul 20 11:02:55.469534 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1671/3283] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:54 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:55.469534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:55.469534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:55.484508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:55.484862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:55.486242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:55.489615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:55.749767 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-26be2a46-0963-44f6-997a-8c95e0c8ea00 tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/images/b10aa3e3-23f4-430c-87d9-39952d3ebba3" status: 204 len: 0 microversion: 2.1 time: 1.034618 Jul 20 11:02:55.752317 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1613/3284] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:54 2022] DELETE /compute/v2.1/images/b10aa3e3-23f4-430c-87d9-39952d3ebba3 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:55.754698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:55.769049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-58f976bf-0b42-4268-9441-b1a7e7ed62ab req-45b56692-4e86-48e8-bfcc-e5515f09b7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19bb41d-4bcc-4ebf-91e4-8a161e79867f", "tag": "b41cc77a-f099-473f-8c3f-7dee9e4653cb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:55.785237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-58f976bf-0b42-4268-9441-b1a7e7ed62ab req-45b56692-4e86-48e8-bfcc-e5515f09b7b4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:55.786041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-58f976bf-0b42-4268-9441-b1a7e7ed62ab req-45b56692-4e86-48e8-bfcc-e5515f09b7b4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:55.801541 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-58f976bf-0b42-4268-9441-b1a7e7ed62ab req-45b56692-4e86-48e8-bfcc-e5515f09b7b4 service nova] Creating event network-changed:b41cc77a-f099-473f-8c3f-7dee9e4653cb for instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f on n-h1-846219-10 Jul 20 11:02:55.810001 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-58f976bf-0b42-4268-9441-b1a7e7ed62ab req-45b56692-4e86-48e8-bfcc-e5515f09b7b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055706 Jul 20 11:02:55.811762 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1614/3285] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:02:55.820493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1809b8fe-703b-4e13-8603-490c81867a0a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] Calling method '.version_select at 0x7f2c4dcc2af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:55.932280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:55.951647 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-be98615d-f411-48c8-aa64-b895937fc51e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.490494 Jul 20 11:02:55.954257 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1672/3286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:55 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:55.961808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:55.962799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:55.970599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:55.971090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:55.971907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:55.972353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:55.994197 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 HTTP/1.1 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'cde82f59-00a5-434e-a924-b318e7d04d89'} Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:55.995879 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:02:56.003503 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3e4513df-52a6-4f35-ac21-79cf0ef0e468 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 404 len: 111 microversion: 2.1 time: 0.040736 Jul 20 11:02:56.008210 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1673/3287] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:55 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:02:56.288793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1445448159", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:02:56.366000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] validate_networks() for [('d319a698-88a9-4733-8964-1eb7a08c5a1d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:02:56.583116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:02:57.105308 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1809b8fe-703b-4e13-8603-490c81867a0a tempest-ListImageFiltersTestJSON-64269164 tempest-ListImageFiltersTestJSON-64269164-project] 10.222.0.79 "DELETE /compute/v2.1/images/be15003d-0485-4cfe-a367-cf8642343005" status: 204 len: 0 microversion: 2.1 time: 1.291524 Jul 20 11:02:57.105894 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1615/3288] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:55 2022] DELETE /compute/v2.1/images/be15003d-0485-4cfe-a367-cf8642343005 => generated 0 bytes in 1293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:02:57.113153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:57.113920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:57.129181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:57.129642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:57.130435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:57.130878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:57.539860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:57.549135 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b6eb3a4-5c4c-4215-b652-b6dbc92c6461 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.441472 Jul 20 11:02:57.549805 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1616/3289] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:57 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:57.566006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:57.566642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:57.573294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:57.573805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:57.574606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:57.575105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:57.788788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:02:57.789327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:02:57.789960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:02:57.790484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:02:57.791384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:02:57.805077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:57.805809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:57.806900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:57.807601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:57.841884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for project d427430f6c374ad183381dc509229fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:02:57.847426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Getting quotas for user c597235b7c47404da82b77cd60317eb3 and project d427430f6c374ad183381dc509229fe3. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:02:57.863427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:02:57.865953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:02:57.921978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a8331178-c953-4182-93c9-57f1ebb43ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.637573 Jul 20 11:02:57.923612 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1674/3290] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:02:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:02:57.940810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5a97008-8724-4fbb-bb1b-97d802d64d28 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:57.941436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5a97008-8724-4fbb-bb1b-97d802d64d28 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:57.946199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:57.976030 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23d9b7bf-2287-402a-a3d1-b7bb1203fb92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.422836 Jul 20 11:02:57.977302 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1617/3291] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:57 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:58.060856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5a97008-8724-4fbb-bb1b-97d802d64d28 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:58.069407 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5a97008-8724-4fbb-bb1b-97d802d64d28 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1225 microversion: 2.1 time: 0.134578 Jul 20 11:02:58.070007 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1675/3292] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:57 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:58.570539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:58.571507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:58.586948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:58.587835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:58.588969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:58.589483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:58.960515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:58.973946 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-791ee5c9-c56d-4c7f-baae-57a7264771be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.408804 Jul 20 11:02:58.975116 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1618/3293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:58 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:58.999319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:59.000628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:59.024469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:59.032832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:59.034787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:59.035503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:59.111910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:59.112730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:02:59.127973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:59.128491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:59.131267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:02:59.133041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:02:59.288308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:59.301452 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2f4c75da-4a36-477b-baf1-a4be48061c2e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1221 microversion: 2.1 time: 0.194228 Jul 20 11:02:59.302051 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1619/3294] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:59 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1221 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:59.342641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:02:59.355691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f05b593-0d5b-46b8-b61c-22e626b71352 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.359899 Jul 20 11:02:59.357656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1676/3295] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:58 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:02:59.993210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:02:59.993901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:00.010522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:00.011009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:00.011959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:00.014772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:00.320388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:00.322054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:00.336922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:00.338144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:00.339821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:00.342341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:00.533720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:00.544257 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8df89fc1-71cc-4b0f-8ae1-f8289458a5e8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.556191 Jul 20 11:03:00.548965 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1620/3296] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:02:59 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:00.554324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:00.555297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:00.559688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:00.567271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:00.569174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:00.570899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:00.571622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:00.572085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94c23395-46fc-480f-9e64-32576942657a tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1283 microversion: 2.1 time: 0.256966 Jul 20 11:03:00.586632 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1677/3297] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:00 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1283 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:01.041231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:01.070669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-daccf69e-3814-4b80-b79f-45fcb5c76c3f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.520269 Jul 20 11:03:01.078520 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1621/3298] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:00 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:01.569565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:01.570327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:01.582094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:01.587345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:01.591874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:01.592692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:01.592941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:01.593605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:01.625046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:01.634682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:01.637343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:01.646100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:02.001881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:02.018639 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f347d6d3-b709-465f-a71e-308020433889 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.458637 Jul 20 11:03:02.033566 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1678/3299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:01 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:02.107266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:02.108010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:02.123323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:02.125019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:02.125569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:02.127795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:02.128496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:02.139593 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c14e47f2-4074-4b7e-99c3-35b70d15d625 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1325 microversion: 2.1 time: 0.551723 Jul 20 11:03:02.150729 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1622/3300] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:01 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:02.496680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:02.508833 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f114eb1-7883-4290-8746-abc2e9d00d67 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.406617 Jul 20 11:03:02.511093 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1679/3301] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:02 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:02.827795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6cc377d5-d83a-4578-bec8-324b505bf35b req-798542cc-3871-4773-80a2-80cc7a0aa286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568151a8-83e4-4be8-ab5f-b432269a7a9d", "tag": "bca0eb2e-0e32-46ed-a65d-6fab2254fba4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:02.847345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6cc377d5-d83a-4578-bec8-324b505bf35b req-798542cc-3871-4773-80a2-80cc7a0aa286 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:02.848601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6cc377d5-d83a-4578-bec8-324b505bf35b req-798542cc-3871-4773-80a2-80cc7a0aa286 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:02.907555 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6cc377d5-d83a-4578-bec8-324b505bf35b req-798542cc-3871-4773-80a2-80cc7a0aa286 service nova] Creating event network-changed:bca0eb2e-0e32-46ed-a65d-6fab2254fba4 for instance 568151a8-83e4-4be8-ab5f-b432269a7a9d on n-h2-846219-10 Jul 20 11:03:02.929390 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6cc377d5-d83a-4578-bec8-324b505bf35b req-798542cc-3871-4773-80a2-80cc7a0aa286 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109921 Jul 20 11:03:02.932341 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1623/3302] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:03.040253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:03.041193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:03.061777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:03.062242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:03.066447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:03.067144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:03.166579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:03.167809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:03.202740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:03.208771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:03.213835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:03.216262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:04.107023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:04.118461 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7f0466c-4912-4abb-96ca-2b786bc57798 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 1.082482 Jul 20 11:03:04.118461 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1680/3303] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:03 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:04.124367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:04.130442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:04.140230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:04.147912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:04.149055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:04.149691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:04.474111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:04.499921 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0de66ca-385c-4ce2-b5fa-5be6e8679ae8 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1325 microversion: 2.1 time: 1.340015 Jul 20 11:03:04.504142 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1624/3304] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:03 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1325 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:04.521808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-40e2a092-07c1-4ee7-ae96-297c980ab600 req-fd037bff-c224-4df3-b41c-21d670c9e7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19bb41d-4bcc-4ebf-91e4-8a161e79867f", "name": "network-vif-plugged", "status": "completed", "tag": "b41cc77a-f099-473f-8c3f-7dee9e4653cb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:04.549695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-40e2a092-07c1-4ee7-ae96-297c980ab600 req-fd037bff-c224-4df3-b41c-21d670c9e7dc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:04.550341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-40e2a092-07c1-4ee7-ae96-297c980ab600 req-fd037bff-c224-4df3-b41c-21d670c9e7dc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:04.574455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-40e2a092-07c1-4ee7-ae96-297c980ab600 req-fd037bff-c224-4df3-b41c-21d670c9e7dc service nova] Creating event network-vif-plugged:b41cc77a-f099-473f-8c3f-7dee9e4653cb for instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f on n-h1-846219-10 Jul 20 11:03:04.584219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-40e2a092-07c1-4ee7-ae96-297c980ab600 req-fd037bff-c224-4df3-b41c-21d670c9e7dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077926 Jul 20 11:03:04.585336 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1625/3305] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:04.604257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:04.615748 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b66e9f0-39e5-4d86-992c-00ca27d082ff tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.496303 Jul 20 11:03:04.627674 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1681/3306] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:04 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:05.146929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:05.149877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:05.169374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:05.170133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:05.174396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:05.175899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:05.241011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:05.526196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:05.526825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:05.537212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:05.546651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:05.548724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:05.549698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:05.765210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:05.781676 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3f8aa74c-fd7a-4a17-8563-14156e5acb3b tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1308 microversion: 2.1 time: 0.649227 Jul 20 11:03:05.787308 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1626/3307] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:05 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:05.798896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:05.804457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:05.819535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:05.821245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:05.822523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:05.822980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:06.094567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:06.105380 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-86df2d62-b0b5-4270-adf8-2b75da653c7c tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1325 microversion: 2.1 time: 0.583013 Jul 20 11:03:06.107955 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1682/3308] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:05 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:06.516661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:06.540173 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-099722c0-4107-4c52-81ee-12553c089344 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.747798 Jul 20 11:03:06.547566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1627/3309] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:05 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:06.808898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:06.811967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:06.838307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:06.838984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:06.840083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:06.840533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.128128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:07.129635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:07.149862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.151604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.152598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.155742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.393441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:07.402846 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-23033607-f605-4f72-882b-b295353f0f88 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1488 microversion: 2.1 time: 0.601556 Jul 20 11:03:07.403484 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1683/3310] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:06 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1488 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:07.422643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1367288393"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:07.424253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:07.440068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.440550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.441544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.442158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.517345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:07.533627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3a561181-2210-48f8-a31f-6d05725084a2 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1325 microversion: 2.1 time: 0.408724 Jul 20 11:03:07.536515 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1628/3311] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:07 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1325 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:07.566707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:07.567409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:07.581356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.581969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.586528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.587286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.619144 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bf44d02e-b36d-4be5-8eb6-db14892c92ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "PUT /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1074 microversion: 2.1 time: 0.200884 Jul 20 11:03:07.625084 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1684/3312] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:03:07 2022] PUT /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1074 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:07.640203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:07.640823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:07.655462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.655821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.660470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:07.663930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:07.821360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:08.069033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:08.238364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:08.248573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8fe01991-a207-4e57-9d25-043832c92888 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.687709 Jul 20 11:03:08.249180 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1629/3313] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:07 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:08.282470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:08.296051 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-971e0e42-ea0d-4054-ba17-ff748d55e7ab tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1500 microversion: 2.1 time: 0.660829 Jul 20 11:03:08.299724 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1685/3314] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:07 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1500 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:08.319342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:08.319946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:08.333978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.334431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:08.338239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.338916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:08.582963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:08.584101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:08.591014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:08.618889 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c78f290a-1636-4be5-8524-451f48a9e1b0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1500 microversion: 2.1 time: 0.303269 Jul 20 11:03:08.621095 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1630/3315] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:08 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1500 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:08.627573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.628410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:08.637889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.638683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:08.662575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5b6472f-c9ef-4667-a333-02dbe6ac2384 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:08.672706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5b6472f-c9ef-4667-a333-02dbe6ac2384 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.674629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5b6472f-c9ef-4667-a333-02dbe6ac2384 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:08.711130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5b6472f-c9ef-4667-a333-02dbe6ac2384 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Going to try to stop instance {{(pid=125886) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:03:08.835395 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5b6472f-c9ef-4667-a333-02dbe6ac2384 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "POST /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f/action" status: 202 len: 0 microversion: 2.1 time: 0.176575 Jul 20 11:03:08.839736 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1631/3316] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:03:08 2022] POST /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:03:08.850065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:08.850511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:08.880241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.882862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:08.884194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:08.886171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:09.092262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:09.100911 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09ddf049-4649-4b6c-af16-79b51f33a1f1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1325 microversion: 2.1 time: 0.546662 Jul 20 11:03:09.115075 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1686/3317] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:08 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:09.196117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:09.208849 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1232c5c5-ff19-434f-9629-33017ebfe9d3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.367712 Jul 20 11:03:09.210054 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1632/3318] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:08 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:09.266229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:09.268150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:09.276351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:09.278767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:09.280936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:09.281773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:09.651722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:09.675126 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2e4addd-5d73-4047-9761-f2e7fe310393 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.412957 Jul 20 11:03:09.677426 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1687/3319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:09 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:10.024262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e5ad3d60-fbfa-4338-b602-fd2e9c3a8897 req-d1a746dd-7d26-4f54-9f4b-9760875de2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568151a8-83e4-4be8-ab5f-b432269a7a9d", "name": "network-vif-plugged", "status": "completed", "tag": "bca0eb2e-0e32-46ed-a65d-6fab2254fba4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:10.033168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e5ad3d60-fbfa-4338-b602-fd2e9c3a8897 req-d1a746dd-7d26-4f54-9f4b-9760875de2e3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:10.033954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e5ad3d60-fbfa-4338-b602-fd2e9c3a8897 req-d1a746dd-7d26-4f54-9f4b-9760875de2e3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:10.057930 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e5ad3d60-fbfa-4338-b602-fd2e9c3a8897 req-d1a746dd-7d26-4f54-9f4b-9760875de2e3 service nova] Creating event network-vif-plugged:bca0eb2e-0e32-46ed-a65d-6fab2254fba4 for instance 568151a8-83e4-4be8-ab5f-b432269a7a9d on n-h2-846219-10 Jul 20 11:03:10.071874 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e5ad3d60-fbfa-4338-b602-fd2e9c3a8897 req-d1a746dd-7d26-4f54-9f4b-9760875de2e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050968 Jul 20 11:03:10.080926 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1633/3320] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:10.121268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:10.122132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:10.141162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:10.143418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:10.146088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:10.149204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:10.231996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:10.232809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:10.261561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:10.262022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:10.262838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:10.263303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:11.043495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:11.064330 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b581ff8f-7d83-4171-a0d6-6b3c4423940f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1325 microversion: 2.1 time: 0.946879 Jul 20 11:03:11.065970 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1688/3321] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:10 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1325 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:11.088763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:11.098838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:11.125123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:11.125856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:11.129187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:11.129648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:11.146188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:11.158471 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a577ab9-ad75-4133-94dc-45ed706bb721 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.933042 Jul 20 11:03:11.167159 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1634/3322] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:10 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:11.591241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:11.596148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:11.607906 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-98a0c55e-d71b-4dd0-b76f-dbba04c2ec30 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.540644 Jul 20 11:03:11.617711 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1689/3323] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:11 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:12.084692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:12.085802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:12.104241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.111697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.112728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.113408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.186241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:12.187670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:12.219105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.221766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.223043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.228288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.727771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:12.746052 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-91592a73-3bba-4866-93e5-b4375ff78429 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1521 microversion: 2.1 time: 0.667264 Jul 20 11:03:12.761701 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1635/3324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:12 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1521 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:12.785748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:12.789505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:12.798852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:12.810321 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f7381dea-e7f4-4bf2-bb9b-7cba96e54fc7 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.627709 Jul 20 11:03:12.818010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.819352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.820034 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1690/3325] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:12 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:12.820749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.823985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.840773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:12.841386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:12.870348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.871090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.878077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:12.878874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:12.966040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:03:13.182703 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea50581b-f64b-4232-967b-674fc487c58f tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 204 len: 0 microversion: 2.1 time: 0.360734 Jul 20 11:03:13.184146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1691/3326] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:12 2022] DELETE /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:13.200702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:13.202904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:13.213448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:13.214197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:13.215429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:13.216452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:13.218177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:13.240113 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f85908b-0ec6-4bd6-ad8f-becd52f021e0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.471462 Jul 20 11:03:13.268130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1636/3327] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:12 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:13.568554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:13.583140 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-774da490-e7f9-4490-8377-30e144b60fd7 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1527 microversion: 2.1 time: 0.394764 Jul 20 11:03:13.584113 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1692/3328] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:13 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1527 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:13.840938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:13.842020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:13.869994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:13.876714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:13.877633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:13.878230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:14.238197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:14.254749 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b3256302-7b5f-4a74-89ee-2969b5bf8dad tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.410445 Jul 20 11:03:14.258209 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1637/3329] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:13 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:14.264374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:14.265017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:14.278278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:14.278762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:14.290212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:14.290595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:14.561014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:14.589310 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f9f5e931-f588-4ba0-98db-59959c1e1212 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.333914 Jul 20 11:03:14.590330 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1693/3330] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:14 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:14.619838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:14.620640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:14.632583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:14.638959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:14.640751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:14.641522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:14.957277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:14.965393 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-22a20912-30f6-4e32-81f2-760044f2386e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1527 microversion: 2.1 time: 0.349465 Jul 20 11:03:14.966130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1638/3331] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:14 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1527 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:15.285576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:15.286623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:15.297702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:15.298066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:15.299343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:15.299778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:15.480492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-507930788", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "6c740025-ac3c-4e30-9c2d-99c8f1333193"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:15.612620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:15.616570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] validate_networks() for [('6c740025-ac3c-4e30-9c2d-99c8f1333193', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:03:15.622764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16c7e126-d4d5-4c6f-9312-dad410436c74 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.351875 Jul 20 11:03:15.624327 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1639/3332] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:15 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:15.629717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:15.630654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:15.648912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:15.649389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:15.650237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:15.650685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:15.898901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:15.915146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60ba6aa7-7564-45e2-8fe8-ea78dcd506e8 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.287050 Jul 20 11:03:15.915832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1640/3333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:15 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:15.985024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:15.985726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:16.007580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.017548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.018534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.018992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.193319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:16.218694 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-43b47791-09c1-4056-97b3-8abb441f804e tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1485 microversion: 2.1 time: 0.233250 Jul 20 11:03:16.231832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1641/3334] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:15 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1485 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:16.269823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a01c1d94-6a61-4e82-8163-e96040eda0cd req-11d175d0-ca31-4672-9bbf-18616d1f4f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568151a8-83e4-4be8-ab5f-b432269a7a9d", "name": "network-vif-deleted", "tag": "bca0eb2e-0e32-46ed-a65d-6fab2254fba4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:16.299488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a01c1d94-6a61-4e82-8163-e96040eda0cd req-11d175d0-ca31-4672-9bbf-18616d1f4f8f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.304262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a01c1d94-6a61-4e82-8163-e96040eda0cd req-11d175d0-ca31-4672-9bbf-18616d1f4f8f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.330015 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a01c1d94-6a61-4e82-8163-e96040eda0cd req-11d175d0-ca31-4672-9bbf-18616d1f4f8f service nova] Creating event network-vif-deleted:bca0eb2e-0e32-46ed-a65d-6fab2254fba4 for instance 568151a8-83e4-4be8-ab5f-b432269a7a9d on n-h2-846219-10 Jul 20 11:03:16.356286 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a01c1d94-6a61-4e82-8163-e96040eda0cd req-11d175d0-ca31-4672-9bbf-18616d1f4f8f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100919 Jul 20 11:03:16.361200 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1642/3335] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:16.425432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:03:16.426168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:03:16.426908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:03:16.427383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:03:16.427849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:03:16.440200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.446519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.447734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.448355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.476692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Getting quotas for project f9662a26e6ec4789adac8707d0b279ee. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:16.486975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Getting quotas for user 013e6cb7f7a34317ab8e2ef7c4b9dc53 and project f9662a26e6ec4789adac8707d0b279ee. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:16.508158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:03:16.510760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:03:16.604014 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e4c426f-86b0-48a8-8bb1-4c558f1fe888 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358729 Jul 20 11:03:16.609768 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1694/3336] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:03:16.622715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b66c9a34-201c-46b2-b7be-f00493822228 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:16.623745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b66c9a34-201c-46b2-b7be-f00493822228 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:16.639951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:16.640935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:16.666753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.667286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.668111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.668614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.883867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b66c9a34-201c-46b2-b7be-f00493822228 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:16.894202 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b66c9a34-201c-46b2-b7be-f00493822228 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1217 microversion: 2.1 time: 0.277884 Jul 20 11:03:16.896189 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1643/3337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:16 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:16.936561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:16.937200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:16.957660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.958122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:16.962028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:16.962482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:17.025747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:17.039929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:17.056447 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42b1bb10-37c2-44da-adb7-69974d86207d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.417731 Jul 20 11:03:17.058803 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1695/3338] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:16 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:17.240245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:17.240971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:17.254266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:17.255075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:17.256091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:17.257924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:17.367083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:17.370921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:17.372931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lazy-loading 'fault' on Instance uuid 568151a8-83e4-4be8-ab5f-b432269a7a9d {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:03:17.445326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:17.474147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb113b24-bbd7-46e7-8f65-cedcfb32fba3 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1504 microversion: 2.1 time: 0.544222 Jul 20 11:03:17.480326 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1644/3339] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:16 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:17.527366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c597235b7c47404da82b77cd60317eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd427430f6c374ad183381dc509229fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:17.543203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-217c3c01-8d66-43a5-8143-917ce803b6ad tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 200 len: 1315 microversion: 2.1 time: 0.305812 Jul 20 11:03:17.546015 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1696/3340] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:17 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:17.918554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:17.925704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:17.951208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:17.954429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:17.959492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:17.961558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:18.102934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:18.113929 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d2016d9-e35d-40f2-8b40-0e0231ba259e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1221 microversion: 2.1 time: 0.205230 Jul 20 11:03:18.115652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1645/3341] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:17 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1221 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:18.120764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:18.121766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:18.131124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:18.145670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:18.147152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:18.153603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:18.244072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1024803657", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "48505f82-50cb-4c5a-9df5-074c53429d4a"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:18.259259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:18.392332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] validate_networks() for [('48505f82-50cb-4c5a-9df5-074c53429d4a', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:03:18.889123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:18.909943 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60d5e783-001d-4ff0-8d07-c809680076a1 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.789967 Jul 20 11:03:18.913387 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1646/3342] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:18 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:18.929244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:18.930468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:18.951494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:18.954658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:18.959733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:18.960443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.292248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:19.301892 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b114aa9b-71b1-46a1-b92f-a3598bfcb336 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1484 microversion: 2.1 time: 0.386617 Jul 20 11:03:19.307656 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1647/3343] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:18 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1484 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:19.317612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:19.318234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 568151a8-83e4-4be8-ab5f-b432269a7a9d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:19.337992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.338385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.339226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.343838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.399940 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance 568151a8-83e4-4be8-ab5f-b432269a7a9d could not be found. Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d HTTP/1.1 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 568151a8-83e4-4be8-ab5f-b432269a7a9d could not be found. Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '568151a8-83e4-4be8-ab5f-b432269a7a9d'} Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568151a8-83e4-4be8-ab5f-b432269a7a9d could not be found. Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568151a8-83e4-4be8-ab5f-b432269a7a9d could not be found. Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.402671 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568151a8-83e4-4be8-ab5f-b432269a7a9d could not be found. Jul 20 11:03:19.409499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.412085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance 568151a8-83e4-4be8-ab5f-b432269a7a9d could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:19.414735 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6979a366-3714-466b-a58e-d3c1c886d883 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d" status: 404 len: 111 microversion: 2.1 time: 0.103448 Jul 20 11:03:19.416538 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1648/3344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:19 2022] GET /compute/v2.1/servers/568151a8-83e4-4be8-ab5f-b432269a7a9d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:19.434822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:19.437296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:19.458670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.459529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.463781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.467024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.468346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:03:19.468933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:03:19.469260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:03:19.470601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:03:19.471239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:03:19.488979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.490604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.493194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.493980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.556548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Getting quotas for project ccb456ec3887447d984f0803f35bdc20. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:19.589103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Getting quotas for user 42bbb9c8278c423680b2d5f5313e8c27 and project ccb456ec3887447d984f0803f35bdc20. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:19.627945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Going to run 2 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:03:19.635137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:03:19.637135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:19.653112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3fb7632-de81-41dc-b513-acdb9a779947 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1275 microversion: 2.1 time: 0.233523 Jul 20 11:03:19.654043 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1649/3345] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:19 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:19.662710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-545ac15d-2390-428f-890e-063fcc5581f4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '.version_select at 0x7f2c3ee97af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:19.715460 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-545ac15d-2390-428f-890e-063fcc5581f4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Image not found. Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-545ac15d-2390-428f-890e-063fcc5581f4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb HTTP/1.1 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb'} Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb to delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb could not be found. Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:19.717241 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-545ac15d-2390-428f-890e-063fcc5581f4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-545ac15d-2390-428f-890e-063fcc5581f4 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb" status: 404 len: 62 microversion: 2.1 time: 0.063126 Jul 20 11:03:19.725556 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1650/3346] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:19 2022] DELETE /compute/v2.1/images/3f47c6ea-53f0-4fbe-96cc-312ca9b3d3cb => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:03:19.736764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1804959571", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:19.781539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=4fc4918a-86ff-4528-b50a-5a98b4e29b83,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:03:19.941095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] validate_networks() for [('ad49b68f-ce22-49a7-ac18-e29f72bbad1d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:03:19.957644 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65bc934e-8747-46f5-beba-f0648c80886a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.908480 Jul 20 11:03:19.959066 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1697/3347] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:03:19.965561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:19.966347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:19.974513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:19.975429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:19.977995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:20.001185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 HTTP/1.1 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'cde82f59-00a5-434e-a924-b318e7d04d89'} Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:20.066605 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e5a92920-7068-462a-8269-66a64e7b1756 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 404 len: 111 microversion: 2.1 time: 0.106933 Jul 20 11:03:20.071878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1698/3348] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:19 2022] DELETE /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:20.085913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:20.086537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:20.093724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:20.095262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:20.097239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:20.098205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:20.886616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:20.903972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c08585ea-157d-4954-85e8-3abf7fc4b8c0 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.823391 Jul 20 11:03:20.908749 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1699/3349] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:20 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:20.927336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:20.952702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:20.957515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Searching by: {'deleted': False, 'project_id': 'ccb456ec3887447d984f0803f35bdc20'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:03:21.043022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:21.049316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:21.050717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:21.053708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:21.208316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08e2ef39-edea-4b1a-9170-868e2b0ef02c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.293494 Jul 20 11:03:21.215390 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1700/3350] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 11:03:20 2022] GET /compute/v2.1/servers => generated 677 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:21.220885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:21.227275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: cde82f59-00a5-434e-a924-b318e7d04d89] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:21.257341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:21.258503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:21.267795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:21.273061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:21.318728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 HTTP/1.1 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'cde82f59-00a5-434e-a924-b318e7d04d89'} Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:21.324548 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:21.337640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance cde82f59-00a5-434e-a924-b318e7d04d89 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:21.339999 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-29116e34-91a1-48e4-b670-12c14c072c33 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89" status: 404 len: 111 microversion: 2.1 time: 0.118978 Jul 20 11:03:21.357684 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1701/3351] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:21 2022] GET /compute/v2.1/servers/cde82f59-00a5-434e-a924-b318e7d04d89 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:21.362438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:21.364137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:21.379267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:21.388493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:21.395969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:21.402339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:22.462313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:22.499154 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a6c0b8c6-9143-43e9-9d32-10dd2419086b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 1.129305 Jul 20 11:03:22.500530 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1702/3352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:21 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:22.518424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:22.519541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:22.533992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:22.538929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:22.540619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:22.542616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:22.559948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:03:22.560585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:03:22.560979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:03:22.561822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:03:22.562270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:03:22.567554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=84 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:22.598923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:22.599421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:22.603613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:22.604337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:22.664990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Getting quotas for project b388e2b9c80c476eb61facd15bf729f1. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:22.681539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Getting quotas for user c3a0ea360267458882dc782fb606c7f1 and project b388e2b9c80c476eb61facd15bf729f1. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:22.761738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:03:22.773794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:03:22.786867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:22.796135 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a66fa422-732b-4a07-9758-091883f6aab5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1224 microversion: 2.1 time: 0.281330 Jul 20 11:03:22.810196 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1703/3353] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:22 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1224 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:22.816788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a4415ea-823e-4297-becd-4ffdd4e399d1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '.version_select at 0x7f2c3f796430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:22.877622 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1bd6ddd3-7e9a-42a9-973c-813c53596e5d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.153078 Jul 20 11:03:22.883595 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1651/3354] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:03:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:03:22.899053 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7a4415ea-823e-4297-becd-4ffdd4e399d1 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492607362" status: 202 len: 0 microversion: 2.1 time: 0.086144 Jul 20 11:03:22.902602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:22.908158 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1704/3355] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 11:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492607362 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:03:22.929616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:22.930197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78a243ed-7e10-4372-b54c-b119d2b33051 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:22.931037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-78a243ed-7e10-4372-b54c-b119d2b33051 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:22.958812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:22.961605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:22.962573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:22.963029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:23.168914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-78a243ed-7e10-4372-b54c-b119d2b33051 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:23.187429 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-78a243ed-7e10-4372-b54c-b119d2b33051 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1214 microversion: 2.1 time: 0.270474 Jul 20 11:03:23.201646 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1705/3356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:22 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:23.525383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:23.527203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:23.581002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:23.581577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:23.582488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:23.583307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:23.584214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:23.632395 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dced4fac-b036-4337-a753-f285dc05a1d8 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.722548 Jul 20 11:03:23.638844 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1652/3357] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:22 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:23.830418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:23.832293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:23.865378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:23.865852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:23.866864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:23.874425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:24.107845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:24.123030 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0a159bc-3f24-4f9a-aa32-ec488787f3a2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1280 microversion: 2.1 time: 0.311215 Jul 20 11:03:24.126003 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1653/3358] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:23 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1280 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:24.205313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:24.206023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:24.242084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:24.245465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:24.249581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:24.254414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:25.148765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:25.164865 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-044b1818-5480-45fc-9d75-bf30593acd40 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1218 microversion: 2.1 time: 0.968167 Jul 20 11:03:25.166953 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1654/3359] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:24 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1218 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:25.174624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:25.180578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:25.181136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:25.220858 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b57d146-dd8f-4f54-bdd5-bb4c18aff7eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 1.697043 Jul 20 11:03:25.222749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:25.223886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:25.227351 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1706/3360] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:23 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:25.228891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:25.231588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:25.265801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:25.267294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:25.289523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:25.290292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:25.295672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:25.303678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:25.596625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:25.605546 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8b19bbbb-a157-4460-b988-a39a993a0a4b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1278 microversion: 2.1 time: 0.365474 Jul 20 11:03:25.614962 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1707/3361] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:25 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1278 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:25.645426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1092d7ac-63ee-43ea-8004-c64fa545f01a req-912a9733-bb9a-42f6-89b6-667ec926995d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f4a07e-6bfa-44fd-8ff6-0186a36a1366", "tag": "6a26f912-c913-4934-ab84-6731d83b3cbb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:25.666942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1092d7ac-63ee-43ea-8004-c64fa545f01a req-912a9733-bb9a-42f6-89b6-667ec926995d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:25.667518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1092d7ac-63ee-43ea-8004-c64fa545f01a req-912a9733-bb9a-42f6-89b6-667ec926995d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:25.703845 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1092d7ac-63ee-43ea-8004-c64fa545f01a req-912a9733-bb9a-42f6-89b6-667ec926995d service nova] Creating event network-changed:6a26f912-c913-4934-ab84-6731d83b3cbb for instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 on n-h2-846219-10 Jul 20 11:03:25.720393 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1092d7ac-63ee-43ea-8004-c64fa545f01a req-912a9733-bb9a-42f6-89b6-667ec926995d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078452 Jul 20 11:03:25.722313 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1708/3362] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:26.149982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:26.160963 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bd00e349-6f46-4e6b-85f2-e604fb697ed6 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.992685 Jul 20 11:03:26.165151 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1655/3363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:25 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:26.182855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:26.183625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:26.192085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:26.192538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:26.193317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:26.193756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:26.243624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:26.244199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:26.257608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:26.258035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:26.258817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:26.259278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:26.825413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:26.841187 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19d413de-28f0-4af6-a961-ca9ac1d031ed tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1272 microversion: 2.1 time: 0.662316 Jul 20 11:03:26.843925 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1709/3364] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:26 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1272 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:26.851880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:26.864442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:26.874979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:26.876148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:26.880164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:26.880880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:26.926287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:27.018918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:27.027365 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50f1363d-ebe2-469c-88da-7f621e716a5e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1278 microversion: 2.1 time: 0.181649 Jul 20 11:03:27.035611 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1710/3365] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:26 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:27.181633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:27.182286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:27.210050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:27.221613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:27.223917 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6e74b69a-240c-42a7-8c0d-34c764b34783 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 0.984064 Jul 20 11:03:27.224763 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1656/3366] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:26 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:27.236007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:27.236791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:27.239653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:27.861482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:27.862329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:27.886415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:27.888128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:27.893492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:27.894526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:28.104566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:28.130553 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2cb26330-27ff-4680-b62a-9b066e1314e2 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1272 microversion: 2.1 time: 0.267371 Jul 20 11:03:28.132220 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1657/3367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:27 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:28.137202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:28.137833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:28.154082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:28.154476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:28.155304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:28.161021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:28.724130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:28.740417 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-74b58eaf-d92d-4a0f-96fc-78ecb14f12aa tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 1.565164 Jul 20 11:03:28.744635 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1711/3368] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:27 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:28.780489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:28.783122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:28.795873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:28.796751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:28.797860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:28.798735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:28.858484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:28.867892 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ba8c483-242e-405f-b5aa-ee604219095b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.734547 Jul 20 11:03:28.873066 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1658/3369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:28 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:28.879772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ef0840b-a53b-447b-af5f-57496ed42792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '.version_select at 0x7f2c3f901310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:28.928259 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-7ef0840b-a53b-447b-af5f-57496ed42792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Image not found. Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ef0840b-a53b-447b-af5f-57496ed42792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/images/2814bbb0-19f0-4376-9546-f0fcea9a2e0e HTTP/1.1 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: exception: Image not found. Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2814bbb0-19f0-4376-9546-f0fcea9a2e0e'} Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2814bbb0-19f0-4376-9546-f0fcea9a2e0e to delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2814bbb0-19f0-4376-9546-f0fcea9a2e0e could not be found. Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:28.937491 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 20 11:03:28.945029 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:28.950244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ef0840b-a53b-447b-af5f-57496ed42792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Image not found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:28.951398 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ef0840b-a53b-447b-af5f-57496ed42792 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/images/2814bbb0-19f0-4376-9546-f0fcea9a2e0e" status: 404 len: 62 microversion: 2.1 time: 0.076190 Jul 20 11:03:28.953106 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1659/3370] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:28 2022] DELETE /compute/v2.1/images/2814bbb0-19f0-4376-9546-f0fcea9a2e0e => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:03:28.982086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:28.982443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:28.993467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:28.993993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:28.994809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:28.995279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.020818 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 HTTP/1.1 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293'} Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:29.022673 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f2a0b84-3314-49c1-984b-b2bca8ed50c6 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "DELETE /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 404 len: 111 microversion: 2.1 time: 0.066481 Jul 20 11:03:29.028228 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1660/3371] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:28 2022] DELETE /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:29.035550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:29.036483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] [instance: 55eb4564-a96b-491d-85c0-3b5fd106a293] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:29.044773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.045309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.046114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.046565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.072184 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] HTTP exception thrown: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Request method failure captured: Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 HTTP/1.1 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-CEFfsiH8LrLYfdKthdkLU5cy10WiappcBm8DqHDuCmX5X9sWp6-l8OtNrmgw6BUen3_Tu90og0-wx0obu9mwqVrB8dIkFOZlsZfPSQha9ZSMbEdYUx_l5i_YdfM7RQaNO9XQBMSDslEfNWpiZTNpBD3USmzdn7ZLqYIvozrfIz6iU Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d427430f6c374ad183381dc509229fe3", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d427430f6c374ad183381dc509229fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d427430f6c374ad183381dc509229fe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: d427430f6c374ad183381dc509229fe3 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: c597235b7c47404da82b77cd60317eb3 Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1452887757-project Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '55eb4564-a96b-491d-85c0-3b5fd106a293'} Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.073879 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] Returning 404 to user: Instance 55eb4564-a96b-491d-85c0-3b5fd106a293 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2655279d-8d42-4f06-9eef-c401d9aa1400 tempest-ImagesOneServerNegativeTestJSON-1452887757 tempest-ImagesOneServerNegativeTestJSON-1452887757-project] 10.222.0.79 "GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293" status: 404 len: 111 microversion: 2.1 time: 0.044022 Jul 20 11:03:29.078294 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1661/3372] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:29 2022] GET /compute/v2.1/servers/55eb4564-a96b-491d-85c0-3b5fd106a293 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:29.150350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:29.151792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:29.184698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.185153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.185950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.186590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.428561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:29.440869 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-47739d1b-4992-4894-a9c6-1ef734bbe269 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 0.680060 Jul 20 11:03:29.441491 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1712/3373] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:28 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:29.768019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:29.768789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:29.780324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.780707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.781511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.781994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.817209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:29.835147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-117926f9-bb0f-4136-be4f-4a2591a611a4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.690547 Jul 20 11:03:29.836365 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1662/3374] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:29 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:29.891611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:29.892956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:29.911112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.911891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:29.913278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:29.913898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:30.389484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:30.411133 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51c97177-1d03-4a3d-ac79-d3baee7a7d3d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.648806 Jul 20 11:03:30.414500 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1713/3375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:29 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:30.461621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:30.462807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:30.471159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:30.474758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:30.475120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:30.478839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:30.479574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:30.497304 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a4bb91c-e62e-47e9-b970-80be00e6e498 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.611142 Jul 20 11:03:30.497665 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1663/3376] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:29 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:30.856927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:30.857554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:30.867551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:30.868004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:30.868812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:30.869251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:31.064131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:31.251561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:31.269246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7f90a789-5d75-44b6-9f86-3cfbc4234204 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 0.815055 Jul 20 11:03:31.270485 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1714/3377] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:30 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:31.287622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d4a18e9d-5b2b-4196-9cba-8afea85761af req-c720adbf-bb32-4231-8311-98249d041fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d74f97d-911e-4c80-8faf-d0eb1507553f", "tag": "dfb38da3-95c7-4e87-aed8-d0c85e37ddb9"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:31.303335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d4a18e9d-5b2b-4196-9cba-8afea85761af req-c720adbf-bb32-4231-8311-98249d041fae service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:31.303929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d4a18e9d-5b2b-4196-9cba-8afea85761af req-c720adbf-bb32-4231-8311-98249d041fae service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:31.324977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d4a18e9d-5b2b-4196-9cba-8afea85761af req-c720adbf-bb32-4231-8311-98249d041fae service nova] Creating event network-changed:dfb38da3-95c7-4e87-aed8-d0c85e37ddb9 for instance 6d74f97d-911e-4c80-8faf-d0eb1507553f on n-h2-846219-10 Jul 20 11:03:31.349765 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d4a18e9d-5b2b-4196-9cba-8afea85761af req-c720adbf-bb32-4231-8311-98249d041fae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077735 Jul 20 11:03:31.355512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1715/3378] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:31.435259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:31.436470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:31.445873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:31.446630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:31.447667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:31.448277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:31.729279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:31.739784 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f011ee9-7dd3-4076-9741-e5aeed3c79c7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.890375 Jul 20 11:03:31.755539 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1664/3379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:30 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:31.771036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:31.771992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:31.788642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:31.789489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:31.826090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:31.831721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:32.633363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:32.679277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:32.690828 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d5ce74e-a223-41db-84f7-c3ff849d37fb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 1.261163 Jul 20 11:03:32.692062 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1716/3380] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:31 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:32.726930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:32.729452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:32.741452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:32.751322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:32.752111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:32.752977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:32.753426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:32.877060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:32.882273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:32.895551 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8227a0f8-3253-4e11-82b6-02e06394e9a0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 1.137985 Jul 20 11:03:32.897920 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1665/3381] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:31 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:32.906500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4143eeef-c323-4e96-b88d-a18e1eeb5334 req-1e66c54a-c672-4544-88a2-b1f764aa4f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc4918a-86ff-4528-b50a-5a98b4e29b83", "tag": "f42d73eb-8d26-4bc7-a48a-f5098149cca4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:32.920206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4143eeef-c323-4e96-b88d-a18e1eeb5334 req-1e66c54a-c672-4544-88a2-b1f764aa4f34 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:32.920898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4143eeef-c323-4e96-b88d-a18e1eeb5334 req-1e66c54a-c672-4544-88a2-b1f764aa4f34 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:32.934075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4143eeef-c323-4e96-b88d-a18e1eeb5334 req-1e66c54a-c672-4544-88a2-b1f764aa4f34 service nova] Creating event network-changed:f42d73eb-8d26-4bc7-a48a-f5098149cca4 for instance 4fc4918a-86ff-4528-b50a-5a98b4e29b83 on n-h1-846219-10 Jul 20 11:03:32.940552 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4143eeef-c323-4e96-b88d-a18e1eeb5334 req-1e66c54a-c672-4544-88a2-b1f764aa4f34 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041040 Jul 20 11:03:32.941611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1666/3382] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:32.948547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:32.948835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:32.957932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:32.958738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:32.960201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:32.961239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:33.181992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=14 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:33.292089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:33.301316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-32ba6731-bb39-4b87-ade0-286e4733f3cd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 0.607993 Jul 20 11:03:33.302835 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1717/3383] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:32 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:33.379330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:33.394389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-153aa916-d76f-47f0-8cfc-8ec9efa9faf9 req-19194854-6a73-4038-bb9e-79dfa5bf64a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39badb54-8019-4eaf-b2f6-7409d7e7fb35", "tag": "987d4be3-82c1-4226-970f-350cce4c1655"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:33.399522 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e3424d2-a22d-402f-92a2-0a80be9ba3f9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.456275 Jul 20 11:03:33.401908 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1667/3384] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:32 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:33.417834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-153aa916-d76f-47f0-8cfc-8ec9efa9faf9 req-19194854-6a73-4038-bb9e-79dfa5bf64a5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:33.418643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-153aa916-d76f-47f0-8cfc-8ec9efa9faf9 req-19194854-6a73-4038-bb9e-79dfa5bf64a5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:33.436810 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-153aa916-d76f-47f0-8cfc-8ec9efa9faf9 req-19194854-6a73-4038-bb9e-79dfa5bf64a5 service nova] Creating event network-changed:987d4be3-82c1-4226-970f-350cce4c1655 for instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 on n-h1-846219-10 Jul 20 11:03:33.444871 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-153aa916-d76f-47f0-8cfc-8ec9efa9faf9 req-19194854-6a73-4038-bb9e-79dfa5bf64a5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059750 Jul 20 11:03:33.446383 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1718/3385] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:33.568110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-66c0ecf6-ad52-4b22-bc11-acf848a9fb5e req-1717a382-24b4-4009-8af1-83a1f415d435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f4a07e-6bfa-44fd-8ff6-0186a36a1366", "name": "network-vif-plugged", "status": "completed", "tag": "6a26f912-c913-4934-ab84-6731d83b3cbb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:33.576602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-66c0ecf6-ad52-4b22-bc11-acf848a9fb5e req-1717a382-24b4-4009-8af1-83a1f415d435 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:33.577395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-66c0ecf6-ad52-4b22-bc11-acf848a9fb5e req-1717a382-24b4-4009-8af1-83a1f415d435 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:33.598504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-66c0ecf6-ad52-4b22-bc11-acf848a9fb5e req-1717a382-24b4-4009-8af1-83a1f415d435 service nova] Creating event network-vif-plugged:6a26f912-c913-4934-ab84-6731d83b3cbb for instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 on n-h2-846219-10 Jul 20 11:03:33.614242 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-66c0ecf6-ad52-4b22-bc11-acf848a9fb5e req-1717a382-24b4-4009-8af1-83a1f415d435 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049932 Jul 20 11:03:33.622442 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1668/3386] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:33.709522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:33.710229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:33.726949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:33.727678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:33.729500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:33.730407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:33.918931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:33.919840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:33.928747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:33.929863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:33.931155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:33.931937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:34.136556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:34.148447 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4c1783f-9f15-492f-8b4c-e9838a99df39 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.442930 Jul 20 11:03:34.149124 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1719/3387] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:33 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:34.320572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:34.321585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:34.334423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:34.334707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:34.335155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:34.336148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:34.336798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:34.349280 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-534fb0ae-de17-4745-af8a-1d7596e1a276 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.436473 Jul 20 11:03:34.350327 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1669/3388] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:33 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:34.418932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:34.420040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:34.428137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:34.428976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:34.429992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:34.430792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:34.677146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:34.693368 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d858d3db-aff3-4c3b-9664-48ffc588f4c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1317 microversion: 2.1 time: 0.377771 Jul 20 11:03:34.725463 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1720/3389] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:34 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:34.763120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:34.775098 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6cc7c58-787a-4b56-81f6-740cd392c50c tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.360620 Jul 20 11:03:34.784979 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1670/3390] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:34 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:35.169105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:35.169961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:35.186706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.187160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.188810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.189166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.369265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:35.369987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:35.381314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.393169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.394487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.395741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.554938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:35.573608 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3b7711c-a0e6-4552-8dd3-73f2924ba0bc tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1510 microversion: 2.1 time: 0.409440 Jul 20 11:03:35.593806 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1721/3391] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:35 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:35.645458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:35.665964 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a0fb7ce-0713-4123-96b3-a7c987fb7f31 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.303412 Jul 20 11:03:35.670854 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1671/3392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:35 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:35.725703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:35.726314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:35.741200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.741653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.742635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.745986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.793329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:35.794231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:35.803477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.804217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:35.805185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:35.805800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:36.287378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:36.296657 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e917e636-a8e2-455b-b460-c92519f70cdb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1508 microversion: 2.1 time: 0.575073 Jul 20 11:03:36.298485 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1722/3393] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:35 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1508 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:36.329017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:36.330550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:36.342879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:36.344445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:36.345961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:36.346682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:36.702901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:36.722127 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4f4d64e-00e8-41e3-b413-180c85b81439 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.933643 Jul 20 11:03:36.726910 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1672/3394] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:35 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:36.734726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:36.740503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:36.749352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:36.750085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:36.751209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:36.752004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:36.970463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:36.994736 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad7bdfd7-ce14-4e3c-886a-5e523679160e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1508 microversion: 2.1 time: 0.671831 Jul 20 11:03:36.995563 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1723/3395] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:36 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1508 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:37.013094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:37.015005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:37.022924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.023972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.025032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.025719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.377161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:37.418361 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68ea12ed-74a4-4aeb-a170-52fad6476166 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1487 microversion: 2.1 time: 0.689508 Jul 20 11:03:37.419127 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1673/3396] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:36 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1487 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:37.427361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:37.429563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:37.449803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.457755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.459906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.460902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.586309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:37.618408 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-868d2ecd-96b8-4171-9352-66285d4ef7a3 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.621408 Jul 20 11:03:37.621831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1724/3397] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:36 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:37.631161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1273460414"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:37.638709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:37.652234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.655417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.658555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.659387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.681054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:03:37.686506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:03:37.690362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:03:37.690781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:03:37.691663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:03:37.817379 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e2adac65-156a-4e53-a8bc-d38d08e1f205 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "PUT /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1060 microversion: 2.1 time: 0.194282 Jul 20 11:03:37.817567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:37.820378 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1725/3398] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:03:37 2022] PUT /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1060 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:37.834045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.834805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.835771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:37.836939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.837577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:37.838257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.848378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.851047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.852425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.853237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.901874 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c30395ca-fb6c-4bfd-9574-fb7505af37b7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "POST /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366/action" status: 202 len: 1110 microversion: 2.1 time: 0.480094 Jul 20 11:03:37.904144 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1674/3399] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:03:37 2022] POST /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366/action => generated 1110 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 11:03:37.926780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:37.927766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:37.947091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.947941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:37.948783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:37.949222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.463918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:38.483668 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e82aeb45-c2d9-4efc-8b66-72acd40560b9 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.659179 Jul 20 11:03:38.484711 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1726/3400] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:37 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:38.495860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:38.499379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:38.501602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:38.511103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.511621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6f5a9a1-e7cf-41e2-b5ba-7f90b2d230be tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1487 microversion: 2.1 time: 0.594297 Jul 20 11:03:38.512240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.513317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.513496 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1675/3401] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:37 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1487 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:38.527302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.817634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:38.822868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:38.833569 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e40949a1-3b47-45fd-8bca-c400a3bed859 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.345787 Jul 20 11:03:38.834810 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1727/3402] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:38 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:38.840177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:38.841018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:38.854888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Calling method '.version_select at 0x7f2c3ee8dee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:38.857025 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:03:38.857025 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:03:38.858222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.858668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.865326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.866068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.867061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.867634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.876033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.876484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.889435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.889896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.897792 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68b8659d-9a7e-4d6b-98c1-89221e90286f tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2064684894-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.375431 Jul 20 11:03:38.898395 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1676/3403] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 11:03:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:38.904062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-131f094d-b128-4706-a2c3-09b628129830 req-e72707c3-99a1-4391-a223-0579733e66f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d74f97d-911e-4c80-8faf-d0eb1507553f", "name": "network-vif-plugged", "status": "completed", "tag": "dfb38da3-95c7-4e87-aed8-d0c85e37ddb9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:38.928368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-131f094d-b128-4706-a2c3-09b628129830 req-e72707c3-99a1-4391-a223-0579733e66f3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:38.928368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-131f094d-b128-4706-a2c3-09b628129830 req-e72707c3-99a1-4391-a223-0579733e66f3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:38.957589 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-131f094d-b128-4706-a2c3-09b628129830 req-e72707c3-99a1-4391-a223-0579733e66f3 service nova] Creating event network-vif-plugged:dfb38da3-95c7-4e87-aed8-d0c85e37ddb9 for instance 6d74f97d-911e-4c80-8faf-d0eb1507553f on n-h2-846219-10 Jul 20 11:03:38.969914 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-131f094d-b128-4706-a2c3-09b628129830 req-e72707c3-99a1-4391-a223-0579733e66f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069677 Jul 20 11:03:38.970589 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1677/3404] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:38.975698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:38.976437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:38.993564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.003522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.004650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.005936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.062205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:39.075294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5357f410-6f27-4afe-8cce-5e222a0286c9 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1487 microversion: 2.1 time: 0.239161 Jul 20 11:03:39.075895 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1728/3405] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:38 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1487 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:39.093832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:39.097068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:39.118751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.119366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.120362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.122997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.158893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:03:39.238473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:39.247860 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0c6e9a53-53fa-4e88-893a-c0ef857cbc57 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.276023 Jul 20 11:03:39.249153 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1678/3406] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:38 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:39.302454 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a15821b-a0df-4489-b988-8f139fa28d43 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 204 len: 0 microversion: 2.1 time: 0.213308 Jul 20 11:03:39.303761 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1729/3407] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:39 2022] DELETE /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 11:03:39.312345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:39.314095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:39.322948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.324000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.325012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.325625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.503955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:39.505597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:39.519913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:39.528108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.530010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.534315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.535794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.537079 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a2295340-17e5-47a0-85aa-40da1d0bae1e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1493 microversion: 2.1 time: 0.229235 Jul 20 11:03:39.543644 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1679/3408] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:39 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1493 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:39.707392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:39.722695 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e27aceff-576c-41e6-91e3-a4bc560d2b90 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.224995 Jul 20 11:03:39.727608 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1730/3409] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:39 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:39.858239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:39.860425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:39.870082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.870793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:39.872051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:39.872886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.089449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:40.102527 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-973f9f57-218e-404a-b047-a3b6e7b66252 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.254559 Jul 20 11:03:40.104765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1680/3410] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:39 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:40.265894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:40.266552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:40.278158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:40.278626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.279437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:40.279877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.488881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:40.499591 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-255d48ea-0589-445b-8e81-48380e310e9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1320 microversion: 2.1 time: 0.237801 Jul 20 11:03:40.501753 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1731/3411] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:40 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1320 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:40.566527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:40.568219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:40.584093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:40.585345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.586994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:40.588179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.741559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:40.742252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:40.761375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:40.762029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.762981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:40.763631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:40.938470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:40.973714 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62165dc8-8617-46f1-87ee-8bb05cc9190e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1493 microversion: 2.1 time: 0.413854 Jul 20 11:03:40.974646 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1681/3412] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:40 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1493 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:41.015146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:41.029540 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bb72cc5c-339a-46a8-83d4-d9c7475985c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.291999 Jul 20 11:03:41.035135 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1732/3413] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:40 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:41.122074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:41.122812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:41.124690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-64a12d73-b1e0-4afb-8f93-c5e6e30b8049 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3ee5adc0>, body: {"keypair": {"name": "tempest-keypair-1248963615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvzN8poOgPNaU2vTkQZq+MTQovCy63hmtydLIFiJT3dKj9+EqtweYfqE3m9SeRiPYihGDv2rORT7xX/5RK2ef7v0WzB0dFTSczN6rXVttIAzdB4unUml9aUaDCiWrnB2A=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:41.126778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:41.142047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-64a12d73-b1e0-4afb-8f93-c5e6e30b8049 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:41.143202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:41.143754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:41.144652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:41.145184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:41.151433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-64a12d73-b1e0-4afb-8f93-c5e6e30b8049 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:41.189925 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-64a12d73-b1e0-4afb-8f93-c5e6e30b8049 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.212027 Jul 20 11:03:41.190873 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1682/3414] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 11:03:41.204815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6fd3664-df8a-409f-af22-b94655714bd0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3f1c4ca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:41.217493 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6fd3664-df8a-409f-af22-b94655714bd0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1248963615" status: 200 len: 513 microversion: 2.2 time: 0.020188 Jul 20 11:03:41.220346 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1683/3415] 10.222.0.79 () {60 vars in 1257 bytes} [Wed Jul 20 11:03:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1248963615 => generated 513 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:41.233907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3cd9ae81-cf0f-4a67-b3f8-ce056745df4a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3f43f820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:41.271279 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3cd9ae81-cf0f-4a67-b3f8-ce056745df4a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248963615" status: 204 len: 0 microversion: 2.2 time: 0.043585 Jul 20 11:03:41.271689 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1684/3416] 10.222.0.79 () {60 vars in 1260 bytes} [Wed Jul 20 11:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248963615 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:41.284792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81e606dd-10b4-46c7-8e2a-3d16fce5c85e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3e7baaf0>, body: {"keypair": {"name": "tempest-keypair-367051093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1TCgXeZn2tJnrGrVPVzyvtKDTMP75d5QCPSP6HkutTUvqfE9WFS7+f1vXXmvC4C6g338LzBHTVDJ1wuN+tptLil711BnggOO+pMMrT298F4n+JYnA1oqtM+fwKtTJxUQ=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:41.307091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-81e606dd-10b4-46c7-8e2a-3d16fce5c85e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:41.318965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:41.328268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-81e606dd-10b4-46c7-8e2a-3d16fce5c85e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:41.383149 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81e606dd-10b4-46c7-8e2a-3d16fce5c85e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.102356 Jul 20 11:03:41.391278 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1685/3417] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 11:03:41.398297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-70ba8e6e-934d-4b37-ac2d-8b750dc72e8a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3f1c43a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:41.438107 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-70ba8e6e-934d-4b37-ac2d-8b750dc72e8a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367051093" status: 204 len: 0 microversion: 2.2 time: 0.042899 Jul 20 11:03:41.452335 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1686/3418] 10.222.0.79 () {60 vars in 1257 bytes} [Wed Jul 20 11:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367051093 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:41.471591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6174fc35-e800-40fd-9d46-33d52117f4f9 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3f368430>, body: {"keypair": {"name": "tempest-keypair-1432751563", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:41.511832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6174fc35-e800-40fd-9d46-33d52117f4f9 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:41.528729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6174fc35-e800-40fd-9d46-33d52117f4f9 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:41.572839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6174fc35-e800-40fd-9d46-33d52117f4f9 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.113736 Jul 20 11:03:41.574054 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1687/3419] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:41 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 20 11:03:41.581223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:41.582839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:41.597345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:41.597918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:41.599051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:41.599655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:41.633796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:41.638583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:41.646784 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12afac0b-216f-4e25-a008-6b53ad386383 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.529121 Jul 20 11:03:41.647413 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1733/3420] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:41 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:41.664562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce5cf3b8-8659-4c0b-bb31-1f6b841937c5 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3f9d55e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:41.697152 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce5cf3b8-8659-4c0b-bb31-1f6b841937c5 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432751563" status: 204 len: 0 microversion: 2.2 time: 0.048356 Jul 20 11:03:41.699778 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1734/3421] 10.222.0.79 () {60 vars in 1260 bytes} [Wed Jul 20 11:03:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432751563 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:41.712467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ae5afa8a-65b3-4399-80d5-b9e9eeb78b95 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3f901dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1637301872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlikQcfPad07BYMvcrxphnWg88Ng6x81sydLaTIay6MYIbxVCJSFkUUy76TVaYv90oSz0dHrZWxfIIGr2QvWTh5AJjYQqek3+87pb42b9KQJ0kArSeV/K9aifGdFTodNw=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:41.745776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ae5afa8a-65b3-4399-80d5-b9e9eeb78b95 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:41.756918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ae5afa8a-65b3-4399-80d5-b9e9eeb78b95 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:41.810864 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ae5afa8a-65b3-4399-80d5-b9e9eeb78b95 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.102311 Jul 20 11:03:41.811512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1735/3422] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 104 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 20 11:03:41.824879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7f84c82f-aea2-4f6b-90fe-37fa3ae36b3c tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3fa96790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1301889511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAq2MRkb+hwuAOdm66rY1pJr1bqnjmE9LUUKC9e+KKCECaKJ8vzHxzcOKMRiZBz8I6Xw1n/ZWcTTLksg+NDpHSw3AdqFGrTCMpMdt2GBeEKE1rYQt/FeVYf5hc54ngtCag=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:41.871551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-7f84c82f-aea2-4f6b-90fe-37fa3ae36b3c tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:41.878509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-7f84c82f-aea2-4f6b-90fe-37fa3ae36b3c tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:41.926695 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7f84c82f-aea2-4f6b-90fe-37fa3ae36b3c tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.106131 Jul 20 11:03:41.930610 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1736/3423] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:41 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 11:03:41.945300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58bfb44d-1020-41dd-a261-85ae325acc51 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3f7960d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-905015244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWDGw0hBX+s+9RQRm/ctPsM2Du1QNMykEVPsXA/ti3x7nbimEVFchI4+J1i13epq07LVDSVLr221s8w6w1YilAkPjYyXZNMnxfG3GHdlf0zQ0KpaToZ8smivCP7dGXSZw=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:41.982442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-58bfb44d-1020-41dd-a261-85ae325acc51 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:41.998814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-58bfb44d-1020-41dd-a261-85ae325acc51 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:42.056550 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58bfb44d-1020-41dd-a261-85ae325acc51 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.120438 Jul 20 11:03:42.059771 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1737/3424] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 20 11:03:42.071134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:42.075686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:42.090682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.095472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.096595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.097217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.463440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:42.483758 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fc44095f-60d5-496e-b173-e7ab4104090e tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 200 len: 1451 microversion: 2.1 time: 0.421999 Jul 20 11:03:42.485223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1738/3425] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:42 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 1451 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:42.494808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:42.496265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:42.524551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.525291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.526668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.527402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.749645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:42.768606 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a2292165-ae6b-42a1-9d25-d3939a800824 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 200 len: 1508 microversion: 2.1 time: 1.192942 Jul 20 11:03:42.775663 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1688/3426] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:41 2022] GET /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 1508 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:42.780854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ff7eec8-0f68-4310-9960-ca0b9f322771 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3ede1dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:42.785502 n-d-846219-10 devstack@n-api.service[125886]: WARNING oslo_db.sqlalchemy.utils [None req-6ff7eec8-0f68-4310-9960-ca0b9f322771 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 11:03:42.793067 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ff7eec8-0f68-4310-9960-ca0b9f322771 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.015863 Jul 20 11:03:42.806744 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1689/3427] 10.222.0.79 () {60 vars in 1176 bytes} [Wed Jul 20 11:03:42 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:42.816138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-13bd85e6-53b5-4d14-8064-d1ef43f5fa51 req-3f71891b-7f7b-41c1-8374-d460a09bba7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39badb54-8019-4eaf-b2f6-7409d7e7fb35", "name": "network-vif-plugged", "status": "completed", "tag": "987d4be3-82c1-4226-970f-350cce4c1655"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:42.826508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-13bd85e6-53b5-4d14-8064-d1ef43f5fa51 req-3f71891b-7f7b-41c1-8374-d460a09bba7e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.827226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-13bd85e6-53b5-4d14-8064-d1ef43f5fa51 req-3f71891b-7f7b-41c1-8374-d460a09bba7e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.842402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-13bd85e6-53b5-4d14-8064-d1ef43f5fa51 req-3f71891b-7f7b-41c1-8374-d460a09bba7e service nova] Creating event network-vif-plugged:987d4be3-82c1-4226-970f-350cce4c1655 for instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 on n-h1-846219-10 Jul 20 11:03:42.849331 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-13bd85e6-53b5-4d14-8064-d1ef43f5fa51 req-3f71891b-7f7b-41c1-8374-d460a09bba7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040851 Jul 20 11:03:42.850422 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1690/3428] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:42.856869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-beb6c5cb-edb5-4283-888d-59d29dbf94e8 req-324ef6e8-c98a-433e-bed2-70caa7859df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19bb41d-4bcc-4ebf-91e4-8a161e79867f", "name": "network-vif-deleted", "tag": "b41cc77a-f099-473f-8c3f-7dee9e4653cb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:42.869375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-beb6c5cb-edb5-4283-888d-59d29dbf94e8 req-324ef6e8-c98a-433e-bed2-70caa7859df9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.870198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-beb6c5cb-edb5-4283-888d-59d29dbf94e8 req-324ef6e8-c98a-433e-bed2-70caa7859df9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.884527 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-beb6c5cb-edb5-4283-888d-59d29dbf94e8 req-324ef6e8-c98a-433e-bed2-70caa7859df9 service nova] Creating event network-vif-deleted:b41cc77a-f099-473f-8c3f-7dee9e4653cb for instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f on n-h1-846219-10 Jul 20 11:03:42.889597 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-beb6c5cb-edb5-4283-888d-59d29dbf94e8 req-324ef6e8-c98a-433e-bed2-70caa7859df9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037625 Jul 20 11:03:42.890955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1691/3429] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:42.897591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:42.898428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:42.905798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.907250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:42.908492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:42.909209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.192829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:43.206801 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0f23cea9-2dfd-42be-abb5-46735d906bd5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.719253 Jul 20 11:03:43.212914 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1739/3430] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:42 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:43.222219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.222861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.229714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.230607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.231867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.232608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.376424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:43.384598 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e42af386-8dc5-4993-94e9-191463b9ccca tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.492246 Jul 20 11:03:43.385187 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1692/3431] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:42 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:43.389991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c6cd91d9-6ba5-4b80-9100-8770445e6edf tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3fb61310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.415437 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c6cd91d9-6ba5-4b80-9100-8770445e6edf tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-905015244" status: 204 len: 0 microversion: 2.2 time: 0.028981 Jul 20 11:03:43.416611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1693/3432] 10.222.0.79 () {60 vars in 1317 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-905015244 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:43.425357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-41a00b1d-bbf3-4ec9-86f6-57fda3923974 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3e7ba670>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.446495 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-41a00b1d-bbf3-4ec9-86f6-57fda3923974 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1301889511" status: 204 len: 0 microversion: 2.2 time: 0.025274 Jul 20 11:03:43.447103 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1694/3433] 10.222.0.79 () {60 vars in 1320 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1301889511 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:43.456726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5474fdb1-6188-40f3-9241-a4e7786bbeea tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3ede1700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.476901 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5474fdb1-6188-40f3-9241-a4e7786bbeea tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1637301872" status: 204 len: 0 microversion: 2.2 time: 0.024678 Jul 20 11:03:43.483291 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1695/3434] 10.222.0.79 () {60 vars in 1320 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1637301872 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 11:03:43.483546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:43.490528 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c258cac-c1c8-4be1-892a-1c189e021c55 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83" status: 200 len: 1320 microversion: 2.1 time: 0.276222 Jul 20 11:03:43.491764 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1740/3435] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83 => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:43.492503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6be335be-2808-4cdc-b345-ea83ed81901a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3f1c4670>, body: {"keypair": {"name": "tempest-keypair-783537764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt1LmvU1S/1Zmb3D9CpQgF96u8TMCVgUix6hz3ICX9FxNofe0zW0/GXz61GgG5igT7re20TooCwF3S6+OMZYe2Buffq7wfQuxhamBdMfquhvibl1p0WalT646GEQL+H5A=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:43.506671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.507343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.512468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6be335be-2808-4cdc-b345-ea83ed81901a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:43.515078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.516485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.517633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.518215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.519438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6be335be-2808-4cdc-b345-ea83ed81901a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:43.534751 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f HTTP/1.1 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'b19bb41d-4bcc-4ebf-91e4-8a161e79867f'} Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.536485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43630341-6152-4050-8c7c-8fd016846c6c tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 404 len: 111 microversion: 2.1 time: 0.036004 Jul 20 11:03:43.543644 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1741/3436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.554759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.555406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.559105 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6be335be-2808-4cdc-b345-ea83ed81901a tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.071311 Jul 20 11:03:43.565637 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1696/3437] 10.222.0.79 () {62 vars in 1198 bytes} [Wed Jul 20 11:03:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 20 11:03:43.567484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.568052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.568973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.569868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.570601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d59d8130-8bd1-4667-b3ef-c477380c3df5 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3ede1310>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.579927 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d59d8130-8bd1-4667-b3ef-c477380c3df5 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-783537764" status: 200 len: 512 microversion: 2.2 time: 0.012646 Jul 20 11:03:43.585818 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1697/3438] 10.222.0.79 () {60 vars in 1254 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-783537764 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:43.588063 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f HTTP/1.1 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'b19bb41d-4bcc-4ebf-91e4-8a161e79867f'} Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.589764 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.594902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d0dd822-c2b5-4eab-af43-22bffb26b268 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 404 len: 111 microversion: 2.1 time: 0.041007 Jul 20 11:03:43.595969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-514668a9-87fa-4499-84a2-87b27d72ab36 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3f47f1f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.596088 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1742/3439] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.599426 n-d-846219-10 devstack@n-api.service[125886]: WARNING oslo_db.sqlalchemy.utils [None req-514668a9-87fa-4499-84a2-87b27d72ab36 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 11:03:43.601651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.602190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: b19bb41d-4bcc-4ebf-91e4-8a161e79867f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.608481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.609014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.609565 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-514668a9-87fa-4499-84a2-87b27d72ab36 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.021474 Jul 20 11:03:43.610128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.610646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.610961 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1698/3440] 10.222.0.79 () {60 vars in 1176 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:43.621881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a468c386-3b5d-494c-b5ff-ddb4fe906bc3 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3e7ba820>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.630365 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f HTTP/1.1 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'b19bb41d-4bcc-4ebf-91e4-8a161e79867f'} Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.632362 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.638380 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.638380 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.638380 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.638380 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.638380 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. Jul 20 11:03:43.638380 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.640424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance b19bb41d-4bcc-4ebf-91e4-8a161e79867f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.642179 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9dd170b0-96ba-40ec-bee3-7f1854aff28d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f" status: 404 len: 111 microversion: 2.1 time: 0.044322 Jul 20 11:03:43.642940 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1743/3441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/servers/b19bb41d-4bcc-4ebf-91e4-8a161e79867f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:03:43.648368 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a468c386-3b5d-494c-b5ff-ddb4fe906bc3 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783537764" status: 204 len: 0 microversion: 2.2 time: 0.030782 Jul 20 11:03:43.653680 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1699/3442] 10.222.0.79 () {60 vars in 1257 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783537764 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:43.653931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.654569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.660124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Action: 'create', calling method: .version_select at 0x7f2c3edc0d30>, body: {"keypair": {"name": "tempest-keypair-587894217", "type": "x509"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:43.668535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.669006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.669825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.670266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.678691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:43.686417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:43.688241 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 HTTP/1.1 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd3c39850-ed05-449f-ae49-2ee3c6df6099'} Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.690788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.696043 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.697802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.699022 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2a14f2c5-2b6a-40b2-a1e2-20c957cd4953 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 404 len: 111 microversion: 2.1 time: 0.051511 Jul 20 11:03:43.700248 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1744/3443] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:03:43.709262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.processutils [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpmvnugap1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmvnugap1/temp.key -subj /CN=10179a20d5154240b3e11b79cd8cf581 -extensions v3_req_client {{(pid=125886) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 11:03:43.713524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.714456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: d3c39850-ed05-449f-ae49-2ee3c6df6099] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.725045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.725497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.726365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.726806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.753288 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 HTTP/1.1 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd3c39850-ed05-449f-ae49-2ee3c6df6099'} Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.755049 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance d3c39850-ed05-449f-ae49-2ee3c6df6099 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f951e9b8-f3c2-4f7e-b84b-cf49d20da131 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099" status: 404 len: 111 microversion: 2.1 time: 0.051327 Jul 20 11:03:43.763075 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1745/3444] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/servers/d3c39850-ed05-449f-ae49-2ee3c6df6099 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.769492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.770109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.779535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.780194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.781139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.782252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.799195 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af HTTP/1.1 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fa1e4d60-4653-4ffb-bca5-7d435d2373af'} Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.802122 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-37ae098b-42da-41d7-8507-4b138b7b8bde tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 404 len: 111 microversion: 2.1 time: 0.039042 Jul 20 11:03:43.807222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1746/3445] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.813761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.814519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: fa1e4d60-4653-4ffb-bca5-7d435d2373af] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.823482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.824052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.825163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.826513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.852999 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af HTTP/1.1 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fa1e4d60-4653-4ffb-bca5-7d435d2373af'} Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.854781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance fa1e4d60-4653-4ffb-bca5-7d435d2373af could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.861200 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5a1030e7-4d83-448b-98b4-b79ee5a04804 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af" status: 404 len: 111 microversion: 2.1 time: 0.048466 Jul 20 11:03:43.863980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1747/3446] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/servers/fa1e4d60-4653-4ffb-bca5-7d435d2373af => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.871371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.872030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.880815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.881565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.883137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.883750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.901059 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 HTTP/1.1 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '77621b7b-77b5-4fda-a4c2-a0c086795678'} Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.902675 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.907955 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7a699c24-3d23-4d12-90d6-2c785845d76d tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 404 len: 111 microversion: 2.1 time: 0.040133 Jul 20 11:03:43.910906 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1748/3447] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.916512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.917363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 77621b7b-77b5-4fda-a4c2-a0c086795678] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.924664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.925305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.926300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.927046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.946562 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 HTTP/1.1 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '77621b7b-77b5-4fda-a4c2-a0c086795678'} Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.948301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 77621b7b-77b5-4fda-a4c2-a0c086795678 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:43.954991 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ff917b8-0f88-4992-919f-ecd24e132c49 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678" status: 404 len: 111 microversion: 2.1 time: 0.038218 Jul 20 11:03:43.955885 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1749/3448] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:43 2022] GET /compute/v2.1/servers/77621b7b-77b5-4fda-a4c2-a0c086795678 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:43.957586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.processutils [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpmvnugap1/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpmvnugap1/temp.key -subj /CN=10179a20d5154240b3e11b79cd8cf581 -extensions v3_req_client" returned: 0 in 0.247s {{(pid=125886) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 11:03:43.959794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.processutils [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpmvnugap1/temp.key -password pass: {{(pid=125886) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 20 11:03:43.965401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:43.965916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:43.978968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.978968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.978968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:43.978968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:43.994780 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df HTTP/1.1 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'db57f917-76fe-4603-91c4-a23c061421df'} Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:43.997401 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da5721c3-d28d-4f0b-b42e-648e7cd41fd3 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 404 len: 111 microversion: 2.1 time: 0.041470 Jul 20 11:03:44.005733 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1750/3449] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:43 2022] DELETE /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:44.014251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.processutils [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpmvnugap1/temp.key -password pass:" returned: 0 in 0.054s {{(pid=125886) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 20 11:03:44.020545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.021170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: db57f917-76fe-4603-91c4-a23c061421df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.029368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.029865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.030894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.031536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.047677 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df HTTP/1.1 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'db57f917-76fe-4603-91c4-a23c061421df'} Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.050059 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance db57f917-76fe-4603-91c4-a23c061421df could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-47f47e93-176a-4749-acf0-0e1cc36be037 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df" status: 404 len: 111 microversion: 2.1 time: 0.037237 Jul 20 11:03:44.055756 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1751/3450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/db57f917-76fe-4603-91c4-a23c061421df => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:44.061330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.061905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.074353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.074353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.074353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.074353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.096064 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a HTTP/1.1 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '66debb22-763c-40cc-9f4a-baaaf24e176a'} Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:44.098523 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:44.105976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9426c9fc-7ad5-4c76-98e6-68d9a8452417 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 404 len: 111 microversion: 2.1 time: 0.046416 Jul 20 11:03:44.107141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:44.107307 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1752/3451] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:44 2022] DELETE /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:44.117079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.117866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 66debb22-763c-40cc-9f4a-baaaf24e176a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.122978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Getting quotas for user 10179a20d5154240b3e11b79cd8cf581 and project 34d41d9feeef4cd0adbdfc004c023115. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:44.124986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.126758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.127086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.127744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.146706 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a HTTP/1.1 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '66debb22-763c-40cc-9f4a-baaaf24e176a'} Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.148453 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 66debb22-763c-40cc-9f4a-baaaf24e176a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ac5c23e2-2d7f-4196-bf13-5d1518701a84 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a" status: 404 len: 111 microversion: 2.1 time: 0.041968 Jul 20 11:03:44.155614 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1753/3452] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/66debb22-763c-40cc-9f4a-baaaf24e176a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:44.164573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d0e0cde-bac0-44cf-9435-b152647ecde0 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.503406 Jul 20 11:03:44.165365 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1700/3453] 10.222.0.79 () {62 vars in 1197 bytes} [Wed Jul 20 11:03:43 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 510 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:44.170782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69d4ad4d-34c7-410e-a26f-dea949f992c4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.170782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69d4ad4d-34c7-410e-a26f-dea949f992c4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.173273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e298c66a-0f63-4902-9524-3e81272150b4 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3ede13a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.179999 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-69d4ad4d-34c7-410e-a26f-dea949f992c4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69d4ad4d-34c7-410e-a26f-dea949f992c4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 HTTP/1.1 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '194a3a07-136c-4c88-a902-40ddafedf828'} Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.181583 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69d4ad4d-34c7-410e-a26f-dea949f992c4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69d4ad4d-34c7-410e-a26f-dea949f992c4 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828" status: 404 len: 111 microversion: 2.1 time: 0.023262 Jul 20 11:03:44.187033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1754/3454] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:44 2022] DELETE /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:44.192440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bed6aa95-8a14-4792-981e-efdd6cb0ebcb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.193088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bed6aa95-8a14-4792-981e-efdd6cb0ebcb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: 194a3a07-136c-4c88-a902-40ddafedf828] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.194800 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e298c66a-0f63-4902-9524-3e81272150b4 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-587894217" status: 200 len: 1533 microversion: 2.2 time: 0.027802 Jul 20 11:03:44.195508 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1701/3455] 10.222.0.79 () {60 vars in 1254 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-587894217 => generated 1533 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:44.206456 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-bed6aa95-8a14-4792-981e-efdd6cb0ebcb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.207364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbc3af35-894a-41dd-b1b9-946c0621026e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3f47f0d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bed6aa95-8a14-4792-981e-efdd6cb0ebcb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 HTTP/1.1 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '194a3a07-136c-4c88-a902-40ddafedf828'} Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:44.209499 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:44.214060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:44.214060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:44.214060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. Jul 20 11:03:44.214060 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:44.214366 n-d-846219-10 devstack@n-api.service[125886]: WARNING oslo_db.sqlalchemy.utils [None req-cbc3af35-894a-41dd-b1b9-946c0621026e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 20 11:03:44.214467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bed6aa95-8a14-4792-981e-efdd6cb0ebcb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance 194a3a07-136c-4c88-a902-40ddafedf828 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:44.214467 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bed6aa95-8a14-4792-981e-efdd6cb0ebcb tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828" status: 404 len: 111 microversion: 2.1 time: 0.025380 Jul 20 11:03:44.215089 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1755/3456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/194a3a07-136c-4c88-a902-40ddafedf828 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:44.215776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbc3af35-894a-41dd-b1b9-946c0621026e tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.014160 Jul 20 11:03:44.227265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1702/3457] 10.222.0.79 () {60 vars in 1176 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:44.228326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.229005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.239745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.240373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.241803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.247875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.248889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.249475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.250943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.251462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.253125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.253571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.362884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:03:44.435918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:44.458772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:44.468984 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4cf572c2-dda8-468d-9526-c357cc9c192e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.240285 Jul 20 11:03:44.474838 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1703/3458] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:44.480238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a5de7684-f14f-4d5b-840e-d82e5e88f441 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] Calling method '.version_select at 0x7f2c3e7ba940>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.508716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8803ced-1eca-4311-ad8a-869d44a61337 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 204 len: 0 microversion: 2.1 time: 0.287395 Jul 20 11:03:44.510514 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1756/3459] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:44 2022] DELETE /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:44.520767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.522140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.525669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a5de7684-f14f-4d5b-840e-d82e5e88f441 tempest-KeyPairsV22TestJSON-1345138550 tempest-KeyPairsV22TestJSON-1345138550-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587894217" status: 204 len: 0 microversion: 2.2 time: 0.048948 Jul 20 11:03:44.530677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.532249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.533532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.534275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.537455 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1704/3460] 10.222.0.79 () {60 vars in 1257 bytes} [Wed Jul 20 11:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587894217 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:44.549229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.556514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.573968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.575120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.580797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.581663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.894168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:44.908155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f705e7d6-55ca-4f04-af60-6b616b8f9983 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.395836 Jul 20 11:03:44.908767 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1757/3461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:44.915416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:44.916514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:44.922960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:44.930991 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-69575e4b-9640-4e3a-baa1-39ab4c986b9a tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83" status: 200 len: 1320 microversion: 2.1 time: 0.391018 Jul 20 11:03:44.931639 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1705/3462] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83 => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:44.936349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d7f79abf-3d48-4c2c-ad73-9c9f1fe324b4 req-ff6a786f-b9fe-481a-83d2-e2f3aae6e681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc4918a-86ff-4528-b50a-5a98b4e29b83", "name": "network-vif-plugged", "status": "completed", "tag": "f42d73eb-8d26-4bc7-a48a-f5098149cca4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:44.938164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.938803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.939857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.940478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.954317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:44.961522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d7f79abf-3d48-4c2c-ad73-9c9f1fe324b4 req-ff6a786f-b9fe-481a-83d2-e2f3aae6e681 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:44.962698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d7f79abf-3d48-4c2c-ad73-9c9f1fe324b4 req-ff6a786f-b9fe-481a-83d2-e2f3aae6e681 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:44.979610 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d7f79abf-3d48-4c2c-ad73-9c9f1fe324b4 req-ff6a786f-b9fe-481a-83d2-e2f3aae6e681 service nova] Creating event network-vif-plugged:f42d73eb-8d26-4bc7-a48a-f5098149cca4 for instance 4fc4918a-86ff-4528-b50a-5a98b4e29b83 on n-h1-846219-10 Jul 20 11:03:44.985841 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d7f79abf-3d48-4c2c-ad73-9c9f1fe324b4 req-ff6a786f-b9fe-481a-83d2-e2f3aae6e681 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052760 Jul 20 11:03:44.987088 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1706/3463] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:45.165827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:45.178115 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df242b5e-7fee-4634-9a21-ada7937b89ae tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1478 microversion: 2.1 time: 0.267859 Jul 20 11:03:45.178965 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1758/3464] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:44 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1478 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:45.488663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:45.489760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:45.506284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:45.507019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:45.508089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:45.508630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:45.802343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:45.815203 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a148751-46fc-4b13-bc8e-290160c903dc tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1314 microversion: 2.1 time: 0.332207 Jul 20 11:03:45.817221 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1707/3465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:45 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:45.931729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:45.932923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:45.949171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:45.954302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:45.968333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:45.971012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:45.976240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:45.976700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:45.983760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:45.989518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:45.991407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:45.992698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:46.661769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:46.698866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f4f02c0-24c7-4fbb-950b-7575c31cda6d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83" status: 200 len: 1320 microversion: 2.1 time: 0.754508 Jul 20 11:03:46.700543 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1708/3466] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:45 2022] GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83 => generated 1320 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:46.721571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:46.722777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:46.732074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:46.738231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:46.741866 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-acfda74c-7661-4af9-b08e-be109d4e0f5b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.819203 Jul 20 11:03:46.748797 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1759/3467] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:45 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:46.750808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:46.754194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:46.757280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:46.836950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:46.837565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:46.852184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:46.852609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:46.853401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:46.853833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.354491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:47.367021 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b79ada4-5e08-4d02-9f14-de83ec33501f tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1478 microversion: 2.1 time: 0.663311 Jul 20 11:03:47.371246 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1709/3468] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:46 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1478 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:47.393281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-cefc3eda-47e8-4d47-8cc7-47b1db29c660 req-f3b837c8-1ebd-486b-a803-56fdccf99e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6", "name": "network-vif-deleted", "tag": "9b20f129-faf3-47cf-ab0f-a45a462c9ecb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:47.409798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:47.419368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cefc3eda-47e8-4d47-8cc7-47b1db29c660 req-f3b837c8-1ebd-486b-a803-56fdccf99e00 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.419554 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d9e9854-d1a0-41b9-bac9-b683774ab5da tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1498 microversion: 2.1 time: 0.586646 Jul 20 11:03:47.419861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cefc3eda-47e8-4d47-8cc7-47b1db29c660 req-f3b837c8-1ebd-486b-a803-56fdccf99e00 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.431939 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1760/3469] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:46 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1498 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:47.438861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:47.440354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:47.444436 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-cefc3eda-47e8-4d47-8cc7-47b1db29c660 req-f3b837c8-1ebd-486b-a803-56fdccf99e00 service nova] Creating event network-vif-deleted:9b20f129-faf3-47cf-ab0f-a45a462c9ecb for instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 on n-h1-846219-10 Jul 20 11:03:47.447238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.447912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.448872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.449485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.462734 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-cefc3eda-47e8-4d47-8cc7-47b1db29c660 req-f3b837c8-1ebd-486b-a803-56fdccf99e00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087168 Jul 20 11:03:47.477335 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1710/3470] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:47.500233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lazy-loading 'flavor' on Instance uuid 39badb54-8019-4eaf-b2f6-7409d7e7fb35 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:03:47.616267 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-353f7ff8-7c43-465a-9833-caad19bdf546 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "POST /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35/action" status: 200 len: 32 microversion: 2.1 time: 0.181491 Jul 20 11:03:47.618296 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1761/3471] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:03:47 2022] POST /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:03:47.629891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:47.632901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:47.642691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.643600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.645289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.645988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.735312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:47.737158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:47.747239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.755228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:47.756748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:47.758566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:48.010709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:48.036476 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-285de579-2a10-4a15-8e21-c7689a4bbe3a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.412965 Jul 20 11:03:48.039339 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1711/3472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:47 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:48.061603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:48.063522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:48.075274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:48.076051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:48.077057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:48.080116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:48.108552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:48.117347 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-935f9e7a-0453-4aba-b2a2-39b494793bfc tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83" status: 200 len: 1320 microversion: 2.1 time: 0.386802 Jul 20 11:03:48.136932 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1762/3473] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:47 2022] GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:48.361054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:48.374439 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-019b2fa3-c58b-4e15-b83e-b2a526fa0eac tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.332113 Jul 20 11:03:48.376406 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1712/3474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:48 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:48.390824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:48.391468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:48.400758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:48.406825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:48.412718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:48.413874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:48.499921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:48.509592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:48.510789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:48.511556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lazy-loading 'fault' on Instance uuid ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:03:48.600178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02c78114f72443b490dcbff5f6e7444b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac35979520ac4728862ea0465a13b67c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:48.609495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2221ab03-c306-4748-b602-716727328393 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 200 len: 1282 microversion: 2.1 time: 0.222662 Jul 20 11:03:48.610808 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1763/3475] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:48 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:49.063576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:49.064557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:49.079980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.082791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.083679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.088825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.134038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:49.135217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:49.149676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.150149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.153171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.163284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.643110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:49.663256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b733361d-0b85-4ca3-8ca3-113d43c92895 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.600623 Jul 20 11:03:49.664711 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1713/3476] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:49 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:49.691206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:49.692110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:49.713187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.713981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.717675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.718416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.871143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:49.880898 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d633ec42-66e2-4bdd-8df2-a8bb783b0303 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83" status: 200 len: 1508 microversion: 2.1 time: 0.750729 Jul 20 11:03:49.895528 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1764/3477] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:49 2022] GET /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83 => generated 1508 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:49.901667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:49.902603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] [instance: ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:49.909721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.910472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.911465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.912070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.928179 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] HTTP exception thrown: Instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 could not be found. Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Request method failure captured: Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 HTTP/1.1 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi19_ruh-kxB4rWkJOA4fq778L40qHXQJX9CR-yR443Nsc0zRgcaNKrCHymbaH9tmU2TyO0lYobfylkj-znOsztZN46O1yI8EZtBxOK-gOQWnOyKQIvyrbb2I3csWXUCdrAdQ05vTTbjnThlUHUeps-Z_mDWbc7L_lTGJtMg_O314UMO8 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac35979520ac4728862ea0465a13b67c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac35979520ac4728862ea0465a13b67c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-863347762 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ac35979520ac4728862ea0465a13b67c Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-863347762 Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-863347762-project Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 02c78114f72443b490dcbff5f6e7444b Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-863347762-project Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 could not be found. Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6'} Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 could not be found. Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 could not be found. Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:49.930151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:03:49.935562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:03:49.935562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:03:49.935562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:03:49.935562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:03:49.935562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 could not be found. Jul 20 11:03:49.935562 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:03:49.937047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] Returning 404 to user: Instance ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:03:49.938991 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ba4a8041-54d5-4689-b44e-9646a0bf9e71 tempest-ServersTestJSON-863347762 tempest-ServersTestJSON-863347762-project] 10.222.0.79 "GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6" status: 404 len: 111 microversion: 2.1 time: 0.042180 Jul 20 11:03:49.939905 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1765/3478] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:49 2022] GET /compute/v2.1/servers/ff8869f3-a0f3-46f0-bed2-c2bdaa04e1d6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:03:49.945708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:49.946472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:49.954821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.955552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.956828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:49.957443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:49.990826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 4fc4918a-86ff-4528-b50a-5a98b4e29b83] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:03:50.183733 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3fa2f44-cf1b-4de4-b42a-0882b51b65e1 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83" status: 204 len: 0 microversion: 2.1 time: 0.242153 Jul 20 11:03:50.186628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:50.190653 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1766/3479] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:49 2022] DELETE /compute/v2.1/servers/4fc4918a-86ff-4528-b50a-5a98b4e29b83 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:50.196445 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f463538-a92a-42a9-b9cd-3bc0d80cd8cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.514859 Jul 20 11:03:50.199851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1714/3480] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:49 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:50.202332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:50.203934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:50.214795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:50.215655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:50.216612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:50.217342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:50.250930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 6d74f97d-911e-4c80-8faf-d0eb1507553f] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:03:50.317016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:50.360069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0b565f3-a3eb-4546-aaf1-08c1e6c959cd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f" status: 204 len: 0 microversion: 2.1 time: 0.167378 Jul 20 11:03:50.364575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1767/3481] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:50 2022] DELETE /compute/v2.1/servers/6d74f97d-911e-4c80-8faf-d0eb1507553f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:50.529579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-769190433", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "48505f82-50cb-4c5a-9df5-074c53429d4a"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:50.632045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] validate_networks() for [('48505f82-50cb-4c5a-9df5-074c53429d4a', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:03:50.681266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:50.681985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:50.688896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:50.689266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:50.690038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:50.690472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:51.444475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:51.474804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51f63928-d3a7-4915-8b87-ce6d8fe591c0 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.797786 Jul 20 11:03:51.489558 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1768/3482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:50 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:51.520151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:51.521122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:51.540496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:51.543593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:51.546475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:51.549914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:51.872980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:51.882853 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4dd00b65-f44b-49d4-8ba4-a99dc6bddf31 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.391099 Jul 20 11:03:51.894356 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1769/3483] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:51 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:52.089949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:03:52.090509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:03:52.090827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:03:52.091265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:03:52.092754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:03:52.106608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.107068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.107910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.108354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.184959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Getting quotas for project ccb456ec3887447d984f0803f35bdc20. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:03:52.192056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Getting quotas for user 42bbb9c8278c423680b2d5f5313e8c27 and project ccb456ec3887447d984f0803f35bdc20. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:03:52.208441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Going to run 2 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:03:52.211680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:03:52.304603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=f387b41e-1dab-4efe-9c38-280794c56361,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:03:52.402573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aa7e6054-aa10-4891-9740-de0ed2b2b3d5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.875409 Jul 20 11:03:52.411157 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1715/3484] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:03:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 1887 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 20 11:03:52.418416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:52.427225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:52.429775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Searching by: {'deleted': False, 'project_id': 'ce87571224664ecab6897c49d2b9676e'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:03:52.436769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:52.443229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:52.446133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.446730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.447421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.447863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.451085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:52.454060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Searching by: {'deleted': False, 'project_id': 'ccb456ec3887447d984f0803f35bdc20'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:03:52.490650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.491121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.492121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.492568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.512457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:03:52.522315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:03:52.585731 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-50237762-d10f-41d3-8630-dca3c52e2378 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.157331 Jul 20 11:03:52.593662 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8867541-10ce-47c5-8a3c-91fb05f52570 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.178784 Jul 20 11:03:52.594742 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1716/3486] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 11:03:52 2022] GET /compute/v2.1/servers => generated 1335 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:52.599540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:52.600163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:52.602171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1770/3486] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 11:03:52 2022] GET /compute/v2.1/servers => generated 334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:52.608629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6416aaed-0a17-49f7-b0c6-91175f1fd2c2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:52.608986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6416aaed-0a17-49f7-b0c6-91175f1fd2c2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:52.619816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.621078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.622099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.622703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.682949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6416aaed-0a17-49f7-b0c6-91175f1fd2c2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:52.691546 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6416aaed-0a17-49f7-b0c6-91175f1fd2c2 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1217 microversion: 2.1 time: 0.088607 Jul 20 11:03:52.701396 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1771/3487] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:52 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:52.711922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:52.715927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:52.716859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Searching by: {'deleted': False, 'project_id': 'ce87571224664ecab6897c49d2b9676e'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:03:52.723438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.723938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.724749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.725335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.779859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:03:52.846621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:52.854177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.855599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.866309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:52.884701 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3f6f5eac-7c9e-4513-91c4-fe62dda9adeb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.288870 Jul 20 11:03:52.885603 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1717/3488] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:52 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:52.903742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:52.904625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:52.917392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.918505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:52.920004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:52.921249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:53.183942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1655761a-c56a-4957-93dd-3313885273ec tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.481334 Jul 20 11:03:53.184984 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1772/3489] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 11:03:52 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:53.208388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cee40517-972d-441a-890b-145876f2c6e0 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:53.227956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:53.236627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f69767b-5134-4862-86c3-8f7611eedb53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.336673 Jul 20 11:03:53.246686 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1718/3490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:52 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:53.247004 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cee40517-972d-441a-890b-145876f2c6e0 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043013 Jul 20 11:03:53.247004 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1773/3491] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 11:03:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:03:53.563072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:53.564316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:53.595792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:53.596989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:53.599302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:53.600574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:53.701118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:03:53.709720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3dca28fe-dd49-44fc-b34e-d2155e19b332 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:53.711013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3dca28fe-dd49-44fc-b34e-d2155e19b332 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:53.764058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:03:53.890021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3dca28fe-dd49-44fc-b34e-d2155e19b332 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:53.902451 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3dca28fe-dd49-44fc-b34e-d2155e19b332 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1217 microversion: 2.1 time: 0.196610 Jul 20 11:03:53.903602 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1774/3492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:53 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1217 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:53.910264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:53.911337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:53.920258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:53.921126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:53.922436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:53.923122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:54.018347 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4e284450-9787-471e-a43a-2bbda4fdd68e tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 204 len: 0 microversion: 2.1 time: 0.460131 Jul 20 11:03:54.019617 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1719/3493] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:03:53 2022] DELETE /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:03:54.035248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:54.036292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:54.058286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:54.059144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:54.060243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:54.061145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:54.352346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:54.380586 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a944f804-3c62-487a-84a1-e043c9552c03 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.475361 Jul 20 11:03:54.381776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1775/3494] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:53 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:54.392678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:54.393768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:54.419025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:54.424057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:54.432988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:54.433705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:54.460864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:54.470733 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3f53a47-4ecf-4d74-b842-901c0c1f079b tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1702 microversion: 2.1 time: 0.445268 Jul 20 11:03:54.471411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1720/3495] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:54 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1702 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:54.711834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:54.725026 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-afb19359-3b53-4c91-bb53-5f58bbd65ffa tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.341773 Jul 20 11:03:54.731785 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1776/3496] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:54 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:54.923749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:54.924796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:54.938865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:54.940817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:54.942333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:54.946476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:55.073149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:55.082491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b09ea90f-be71-426c-b098-6d328823629c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1287 microversion: 2.1 time: 0.163883 Jul 20 11:03:55.083901 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1721/3497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:54 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:55.399811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:55.400716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:55.426494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:55.428711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:55.429836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:55.430561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:55.489359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:55.490631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:55.519233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:55.519703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:55.520506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:55.526790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:55.882146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:55.892187 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ebd5742-f820-4bfd-9978-bbfe322753bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.496390 Jul 20 11:03:55.907309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1777/3498] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:55 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:55.930817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:55.933150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:55.946076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:55.954804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:55.956334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:55.957061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:56.189387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:56.232603 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b4db542d-64f8-4373-a717-321a8f867706 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1702 microversion: 2.1 time: 0.742603 Jul 20 11:03:56.248005 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1722/3499] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:55 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1702 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:56.255151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:56.256193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:56.280782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:56.288491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:56.290282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:56.291459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:56.369910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:56.382099 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-061c4f92-6e80-4f02-933e-920e6e9bc77f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.467106 Jul 20 11:03:56.394909 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1778/3500] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:55 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:56.452484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:56.472121 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95d17a51-5749-45c4-ad14-f3a538285235 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1275 microversion: 2.1 time: 0.222484 Jul 20 11:03:56.473167 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1723/3501] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:56 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:56.540387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b60fd6e5-090c-4ddf-a651-98b0dacf20da req-4b2b8b1c-0995-4f20-9541-644aae61a8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc4918a-86ff-4528-b50a-5a98b4e29b83", "name": "network-vif-deleted", "tag": "f42d73eb-8d26-4bc7-a48a-f5098149cca4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:56.572927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b60fd6e5-090c-4ddf-a651-98b0dacf20da req-4b2b8b1c-0995-4f20-9541-644aae61a8f7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:56.573818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b60fd6e5-090c-4ddf-a651-98b0dacf20da req-4b2b8b1c-0995-4f20-9541-644aae61a8f7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:56.633760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b60fd6e5-090c-4ddf-a651-98b0dacf20da req-4b2b8b1c-0995-4f20-9541-644aae61a8f7 service nova] Creating event network-vif-deleted:f42d73eb-8d26-4bc7-a48a-f5098149cca4 for instance 4fc4918a-86ff-4528-b50a-5a98b4e29b83 on n-h1-846219-10 Jul 20 11:03:56.641097 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b60fd6e5-090c-4ddf-a651-98b0dacf20da req-4b2b8b1c-0995-4f20-9541-644aae61a8f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105350 Jul 20 11:03:56.648748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1779/3502] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:56.925381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:56.927285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:56.939529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:56.940334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:56.941214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:56.945391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.259860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:57.260616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:57.298663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:57.299504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.300354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:57.300801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.449206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:57.463164 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-848fdee1-1bcc-4d84-bdc1-8816aecdc4ae tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.542682 Jul 20 11:03:57.465483 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1724/3503] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:56 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:57.479587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:57.480277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:57.497216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:57.497682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.498690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:57.499930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.832695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:57.849039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-02529041-faa6-475e-8712-ac11da90e786 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1702 microversion: 2.1 time: 0.591404 Jul 20 11:03:57.858982 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1780/3504] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:57 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1702 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:57.858982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:57.863139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:57.877686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:57.878146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.878939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:57.884504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:57.979915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:57.995524 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d59a5aa6-258f-4e0a-ab73-dfd6b66dea43 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.525314 Jul 20 11:03:57.996927 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1725/3505] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:57 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:58.106983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:58.115786 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f1f2bdd6-e8cb-4248-898f-ab081dbedf9d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1275 microversion: 2.1 time: 0.264501 Jul 20 11:03:58.116386 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1781/3506] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:57 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:58.538788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:58.540865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:58.561707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:58.575301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:58.580974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:58.582648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:58.869371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:58.870198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:58.903666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:58.904513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:58.908663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:58.909401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:59.114568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace70568b79b41be95eb0a10844b0640', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce87571224664ecab6897c49d2b9676e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:59.147030 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a53abd32-bd18-401d-868d-11f98e3e5699 tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 200 len: 1634 microversion: 2.1 time: 0.281899 Jul 20 11:03:59.149419 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1782/3507] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:58 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 1634 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:03:59.177732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:59.178171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:59.201283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:03:59.220989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:59.221452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:59.222259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:59.222705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:59.236032 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-32b5ac1d-f812-4090-a92c-af2612194991 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.754537 Jul 20 11:03:59.238831 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1726/3508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:58 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:03:59.254758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-850e33c2-294f-4d1b-b61f-117d77612f16 req-8a161d55-2ada-4bfe-828e-1153be7357f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b2f6f9-89bb-423b-881f-896cdc5a7c0f", "name": "network-vif-deleted", "tag": "096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:03:59.307069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-850e33c2-294f-4d1b-b61f-117d77612f16 req-8a161d55-2ada-4bfe-828e-1153be7357f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:59.310466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-850e33c2-294f-4d1b-b61f-117d77612f16 req-8a161d55-2ada-4bfe-828e-1153be7357f1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:59.370458 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-850e33c2-294f-4d1b-b61f-117d77612f16 req-8a161d55-2ada-4bfe-828e-1153be7357f1 service nova] Creating event network-vif-deleted:096d2ba5-99bc-4d16-afb1-55fc0d8aa8d1 for instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f on n-h1-846219-10 Jul 20 11:03:59.380452 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-850e33c2-294f-4d1b-b61f-117d77612f16 req-8a161d55-2ada-4bfe-828e-1153be7357f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139557 Jul 20 11:03:59.389267 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1727/3509] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:03:59.407965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:03:59.409098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:03:59.426253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:59.429420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:03:59.431666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:03:59.432511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:00.562137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:00.573553 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fccf4321-dfb8-436d-8a78-90029cb2342b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 1.177377 Jul 20 11:04:00.581485 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1728/3510] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:59 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:00.592556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6e2801f0-b078-46e0-b42c-69392c7f3001 req-8c119de6-28ed-46f4-b46d-5509e19e9e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d74f97d-911e-4c80-8faf-d0eb1507553f", "name": "network-vif-deleted", "tag": "dfb38da3-95c7-4e87-aed8-d0c85e37ddb9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:00.631714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6e2801f0-b078-46e0-b42c-69392c7f3001 req-8c119de6-28ed-46f4-b46d-5509e19e9e12 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:00.641207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6e2801f0-b078-46e0-b42c-69392c7f3001 req-8c119de6-28ed-46f4-b46d-5509e19e9e12 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:00.648306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:00.673716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5258309c-d944-49d1-8f98-362874fe4277 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 1.520486 Jul 20 11:04:00.674393 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1783/3511] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:03:59 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:00.683369 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6e2801f0-b078-46e0-b42c-69392c7f3001 req-8c119de6-28ed-46f4-b46d-5509e19e9e12 service nova] Creating event network-vif-deleted:dfb38da3-95c7-4e87-aed8-d0c85e37ddb9 for instance 6d74f97d-911e-4c80-8faf-d0eb1507553f on n-h2-846219-10 Jul 20 11:04:00.693353 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6e2801f0-b078-46e0-b42c-69392c7f3001 req-8c119de6-28ed-46f4-b46d-5509e19e9e12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110458 Jul 20 11:04:00.693995 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1729/3512] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:00.705592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:00.707305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:00.713953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:00.716599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] [instance: 73b2f6f9-89bb-423b-881f-896cdc5a7c0f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:00.733688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:00.735495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:00.739545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:00.741406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:00.742310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:00.742456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:00.745247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:00.745896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:00.801357 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] HTTP exception thrown: Instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f could not be found. Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Request method failure captured: Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f HTTP/1.1 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-CYMUYrktdSxSbYbWV9lWKJJ38MvSYGktiLC1XB19i5nbWYgwb2QGdBVoyUcMI5do2y80EIH2F_neK1PVOzeWz6UwumNooionj2nzcNCUTuGNwkj3udSYgH8wNQDMYfirec--B8csm2VHwNRg6uzqrK-GVdNPAS7AWXv5Tohd9i-Mc Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ce87571224664ecab6897c49d2b9676e Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersTestJSON-1712063733 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ce87571224664ecab6897c49d2b9676e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ce87571224664ecab6897c49d2b9676e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ce87571224664ecab6897c49d2b9676e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ce87571224664ecab6897c49d2b9676e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersTestJSON-1712063733 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ce87571224664ecab6897c49d2b9676e Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersTestJSON-1712063733 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersTestJSON-1712063733-project Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: ace70568b79b41be95eb0a10844b0640 Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersTestJSON-1712063733-project Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f could not be found. Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '73b2f6f9-89bb-423b-881f-896cdc5a7c0f'} Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f could not be found. Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f could not be found. Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:00.810700 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f could not be found. Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Returning 404 to user: Instance 73b2f6f9-89bb-423b-881f-896cdc5a7c0f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:00.818249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e932ba47-9b57-4f04-9f4c-de98af9f5f4c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f" status: 404 len: 111 microversion: 2.1 time: 0.128124 Jul 20 11:04:00.820396 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1784/3513] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:00 2022] GET /compute/v2.1/servers/73b2f6f9-89bb-423b-881f-896cdc5a7c0f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:04:00.834932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e91d168-75cd-4e27-b5b4-04cd6313a76c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] Calling method '.version_select at 0x7f2c3f909430>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:00.909585 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9e91d168-75cd-4e27-b5b4-04cd6313a76c tempest-ServersTestJSON-1712063733 tempest-ServersTestJSON-1712063733-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582753333" status: 202 len: 0 microversion: 2.1 time: 0.083806 Jul 20 11:04:00.912428 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1785/3514] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:04:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582753333 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:01.603038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:01.604353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:01.637892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:01.639963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:01.643895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:01.644612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:01.861956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:01.870878 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-31f74cec-756e-4f87-9de0-dc9dfa0383b4 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 1.175392 Jul 20 11:04:01.879776 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1730/3515] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:00 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:01.894756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:01.908304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:01.929754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:01.930215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:01.931014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:01.931489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:02.111954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:02.126779 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ddb6652-48b2-4678-9687-23830a2c1986 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.527496 Jul 20 11:04:02.140784 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1786/3516] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:01 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:02.201851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=30 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:02.505329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:02.567341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:02.586677 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb8e84d5-4878-4fc5-bd46-64b37cb2474c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.697393 Jul 20 11:04:02.595694 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1731/3517] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:01 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:02.888296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:02.895569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:02.896746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:02.919208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:02.922670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:02.924192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:02.927247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:03.146647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:03.147912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:03.181339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:03.181807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:03.182612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:03.183057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:03.894859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:04.122714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:04.150968 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e96a86a7-32e3-4025-95b2-c70e76d2c865 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 1.262657 Jul 20 11:04:04.155264 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1787/3518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:02 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:04.181526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:04.195223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:04.201350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72401b42-ac5e-4c4c-95fa-a998da73ce2f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 1.059794 Jul 20 11:04:04.205318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:04.209521 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1732/3519] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:03 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:04.228254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:04.228874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:04.232184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:04.232824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:04.263781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:04.678602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d653c375-ef76-4a2a-85a9-70de43f979a1 req-c61905fd-742f-4c9a-b2a8-f623bdbe1a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c69fc27-d616-4f46-927c-8f2172de06df", "tag": "82268b50-ef6f-45a2-a08a-761acd3e817a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:04.688116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d653c375-ef76-4a2a-85a9-70de43f979a1 req-c61905fd-742f-4c9a-b2a8-f623bdbe1a35 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:04.688838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d653c375-ef76-4a2a-85a9-70de43f979a1 req-c61905fd-742f-4c9a-b2a8-f623bdbe1a35 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:04.717305 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d653c375-ef76-4a2a-85a9-70de43f979a1 req-c61905fd-742f-4c9a-b2a8-f623bdbe1a35 service nova] Creating event network-changed:82268b50-ef6f-45a2-a08a-761acd3e817a for instance 5c69fc27-d616-4f46-927c-8f2172de06df on n-h2-846219-10 Jul 20 11:04:04.734740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d653c375-ef76-4a2a-85a9-70de43f979a1 req-c61905fd-742f-4c9a-b2a8-f623bdbe1a35 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059861 Jul 20 11:04:04.740161 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1733/3520] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:04:04.753759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:04.768379 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2a8da07b-9e0b-463f-b424-3097a5ac5397 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1515 microversion: 2.1 time: 0.594105 Jul 20 11:04:04.769156 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1788/3521] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:04 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1515 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:05.175028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:05.175793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:05.191271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:05.191984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:05.192499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:05.192942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:05.235078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:05.236862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:05.252824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:05.283382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:05.284426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:05.285265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:05.850839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:05.866832 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a26a9b0f-2ee2-4596-8bb7-11bf2e3cde1f tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.643298 Jul 20 11:04:05.878019 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1789/3522] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:05 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:05.883321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:05.884196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:05.891978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:05.892696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:05.893721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:05.894338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:05.925770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:05.936056 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e531e1e-eb64-43c2-9d83-81f411e7be4a tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.766105 Jul 20 11:04:05.943499 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1734/3523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:05 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:06.438818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:06.456665 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-53bfd029-8fef-4a71-bee2-f5b26ca3d32d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1521 microversion: 2.1 time: 0.577173 Jul 20 11:04:06.460664 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1790/3524] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:05 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:06.804591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-23813005-efb5-455f-9f08-2090dfc150fa req-2cc2d189-34e7-43ce-bc42-24c92803d0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f387b41e-1dab-4efe-9c38-280794c56361", "tag": "37b7737f-1eb1-4556-a072-315a2246fef9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:06.822548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-23813005-efb5-455f-9f08-2090dfc150fa req-2cc2d189-34e7-43ce-bc42-24c92803d0db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:06.822548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-23813005-efb5-455f-9f08-2090dfc150fa req-2cc2d189-34e7-43ce-bc42-24c92803d0db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:06.843838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-23813005-efb5-455f-9f08-2090dfc150fa req-2cc2d189-34e7-43ce-bc42-24c92803d0db service nova] Creating event network-changed:37b7737f-1eb1-4556-a072-315a2246fef9 for instance f387b41e-1dab-4efe-9c38-280794c56361 on n-h1-846219-10 Jul 20 11:04:06.868705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-23813005-efb5-455f-9f08-2090dfc150fa req-2cc2d189-34e7-43ce-bc42-24c92803d0db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069296 Jul 20 11:04:06.869834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1735/3525] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:06.886451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:06.888434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:06.918113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:06.919623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:06.924476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:06.932346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:07.216979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97c79bc5-3354-42d2-aad6-1f5610ae97f3 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3fbbf8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1637697282", "description": "tempest-description-974038119"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:07.531490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:07.565471 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-267223fd-4af7-40bc-ab3e-57018cad2613 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.681190 Jul 20 11:04:07.568503 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1736/3526] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:06 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:07.580936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:07.583086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:07.612967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:07.613655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:07.615559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:07.616427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:09.148118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97c79bc5-3354-42d2-aad6-1f5610ae97f3 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.287021 Jul 20 11:04:09.149130 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1791/3527] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:04:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:09.161534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:09.162424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:09.185540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:09.189101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:09.211528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:09.212032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:09.636218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:09.644109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:09.662899 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6da38ea-205e-4098-94b2-0350d94d3f9e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 2.092205 Jul 20 11:04:09.669517 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1737/3528] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:07 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:09.698385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:09.703557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:09.726677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:09.727855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:09.728844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:09.729452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:10.099961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:10.117252 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5f5aa72f-a615-4edc-b16d-99b2bc04dda8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1521 microversion: 2.1 time: 0.964623 Jul 20 11:04:10.122960 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1792/3529] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:09 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1521 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:10.131671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a933dd0-1591-47be-b10a-340a85f5f0c8 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3fb5faf0>, body: {"security_group_rule": {"parent_group_id": "8c828141-b915-4125-9aca-41e26feace02", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:10.224892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:10.237210 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05a866fd-bd3a-4289-9639-bd1f679744aa tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.565642 Jul 20 11:04:10.239717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1738/3530] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:09 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:10.684816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:10.688558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:10.706745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:10.708932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:10.712893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:10.714093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:11.614635 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a933dd0-1591-47be-b10a-340a85f5f0c8 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.490485 Jul 20 11:04:11.616138 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1793/3531] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:11.623743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:11.624501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:11.633719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:11.647097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:11.647919 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4193913a-438d-4034-887f-65ccf167ca3d tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.970562 Jul 20 11:04:11.648598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:11.650937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:11.652752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:11.658451 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1739/3532] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:10 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:11.668926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:11.679305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:11.687574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:11.688224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:11.688923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:11.689374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:12.075130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:12.086329 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8679363f-3e32-4caf-82d5-e36fdd87fb7e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.426652 Jul 20 11:04:12.086940 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1740/3533] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:11 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:12.107630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1abfa468-0ee2-419d-96c8-f6027c988a3a tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3e70a550>, body: {"security_group_rule": {"parent_group_id": "8c828141-b915-4125-9aca-41e26feace02", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:12.441926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:12.450815 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03b2c97b-7cfa-4aae-b225-461d065e72b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1521 microversion: 2.1 time: 0.832954 Jul 20 11:04:12.452115 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1794/3534] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:11 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1521 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:12.543921 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1abfa468-0ee2-419d-96c8-f6027c988a3a tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: This rule already exists in group 8c828141-b915-4125-9aca-41e26feace02 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1abfa468-0ee2-419d-96c8-f6027c988a3a tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 138 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: {"security_group_rule": {"parent_group_id": "8c828141-b915-4125-9aca-41e26feace02", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: exception: This rule already exists in group 8c828141-b915-4125-9aca-41e26feace02 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8c828141-b915-4125-9aca-41e26feace02', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 8c828141-b915-4125-9aca-41e26feace02 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 8c828141-b915-4125-9aca-41e26feace02 Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:12.545697 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:12.552777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:12.552777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:12.552777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 8c828141-b915-4125-9aca-41e26feace02 Jul 20 11:04:12.552777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:12.552777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1abfa468-0ee2-419d-96c8-f6027c988a3a tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 400 to user: This rule already exists in group 8c828141-b915-4125-9aca-41e26feace02 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:12.552777 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1abfa468-0ee2-419d-96c8-f6027c988a3a tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.460130 Jul 20 11:04:12.557896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b6a7682-a667-46cc-bf9e-a315dd76e0a2 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3fb5f310>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:12.562670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1741/3535] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:12 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:04:12.672496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:12.673553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:12.698514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:12.702894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:12.704420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:12.705415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:13.397905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:13.408664 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5303b20c-5609-42a6-bead-9aa2ffb68a86 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.742447 Jul 20 11:04:13.412575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1742/3536] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:12 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:04:13.421788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:13.425157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:13.445602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:13.446500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:13.447903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:13.448597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:13.514537 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b6a7682-a667-46cc-bf9e-a315dd76e0a2 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/41f83f7c-b0a6-40d9-903f-6bec7f9b5edd" status: 202 len: 0 microversion: 2.1 time: 0.960098 Jul 20 11:04:13.514537 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1795/3537] 10.222.0.79 () {58 vars in 1286 bytes} [Wed Jul 20 11:04:12 2022] DELETE /compute/v2.1/os-security-group-rules/41f83f7c-b0a6-40d9-903f-6bec7f9b5edd => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:13.521784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-dfdf3365-0a54-4c73-9dd2-c346163cdc92 req-35dccea6-7f6b-4f3d-8670-d1c11182388e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c69fc27-d616-4f46-927c-8f2172de06df", "name": "network-vif-plugged", "status": "completed", "tag": "82268b50-ef6f-45a2-a08a-761acd3e817a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:13.550056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-dfdf3365-0a54-4c73-9dd2-c346163cdc92 req-35dccea6-7f6b-4f3d-8670-d1c11182388e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:13.550778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-dfdf3365-0a54-4c73-9dd2-c346163cdc92 req-35dccea6-7f6b-4f3d-8670-d1c11182388e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:13.567797 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-dfdf3365-0a54-4c73-9dd2-c346163cdc92 req-35dccea6-7f6b-4f3d-8670-d1c11182388e service nova] Creating event network-vif-plugged:82268b50-ef6f-45a2-a08a-761acd3e817a for instance 5c69fc27-d616-4f46-927c-8f2172de06df on n-h2-846219-10 Jul 20 11:04:13.575015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-dfdf3365-0a54-4c73-9dd2-c346163cdc92 req-35dccea6-7f6b-4f3d-8670-d1c11182388e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059439 Jul 20 11:04:13.576233 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1796/3538] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:13.587021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:13.588615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:13.618140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:13.618811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:13.620383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:13.620991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:14.181710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:14.194801 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-549950d4-ee66-49cb-90d9-cc5d2388336c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1521 microversion: 2.1 time: 0.616322 Jul 20 11:04:14.199012 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1797/3539] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:13 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:14.213078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa88af84-5788-41cc-a0f8-b0b0aa299d05 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3f796d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-338212166", "description": "tempest-description-7445039"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:14.221467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:14.235847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3584233e-834d-453e-9592-e4f28b17a2e8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.821872 Jul 20 11:04:14.238765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1743/3540] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:13 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:14.430617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:14.431270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:14.450837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:14.451587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:14.453096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:14.453762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:15.127838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa88af84-5788-41cc-a0f8-b0b0aa299d05 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 252 microversion: 2.1 time: 0.927482 Jul 20 11:04:15.129626 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1798/3541] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:04:14 2022] POST /compute/v2.1/os-security-groups => generated 252 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:15.140987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3adddf87-02f8-4e21-bba3-0bee15c57a7f tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3fef0dc0>, body: {"security_group_rule": {"parent_group_id": "2a29fc10-1383-42a3-b919-d777e1908c9a", "ip_protocol": "tcp", "from_port": 380114645, "to_port": 22}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:15.292060 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3adddf87-02f8-4e21-bba3-0bee15c57a7f tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Invalid port range 380114645:22. Former value cannot be greater than the later Jul 20 11:04:15.293723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3adddf87-02f8-4e21-bba3-0bee15c57a7f tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 145 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: {"security_group_rule": {"parent_group_id": "2a29fc10-1383-42a3-b919-d777e1908c9a", "ip_protocol": "tcp", "from_port": 380114645, "to_port": 22}} Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid port range 380114645:22. Former value cannot be greater than the later Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2a29fc10-1383-42a3-b919-d777e1908c9a', 'ip_protocol': 'tcp', 'from_port': 380114645, 'to_port': 22}}} Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 380114645:22. Former value cannot be greater than the later Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 380114645:22. Former value cannot be greater than the later Jul 20 11:04:15.297322 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 380114645:22. Former value cannot be greater than the later Jul 20 11:04:15.301871 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.303812 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9075576c-f059-4ac0-bfc0-03ab5a3fcae6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1484 microversion: 2.1 time: 0.877733 Jul 20 11:04:15.306005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3adddf87-02f8-4e21-bba3-0bee15c57a7f tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 400 to user: Invalid port range 380114645:22. Former value cannot be greater than the later {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:15.307889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3adddf87-02f8-4e21-bba3-0bee15c57a7f tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.171318 Jul 20 11:04:15.309077 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1744/3542] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:14 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1484 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:04:15.309993 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1799/3543] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:15 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 11:04:15.314158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:15.314791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:15.322675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:15.324965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:15.332243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:15.333909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:15.334373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:15.335213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:15.335735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:15.352339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:15.353609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:15.356228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:15.359760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:15.927607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:15.932359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:15.940621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d4b5219-0f80-447c-be5d-448cf6b130f8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1521 microversion: 2.1 time: 0.630285 Jul 20 11:04:15.941027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-653ab4c1-a5df-44ed-bf4a-2b67489c0b1d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1317 microversion: 2.1 time: 0.629623 Jul 20 11:04:15.944370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1800/3544] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:15 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:15.949901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e59fd10-74fd-449c-9204-8ee4679d260d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3eb1bf70>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2086357933", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:15.952188 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1745/3545] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:15 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:15.954184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-0e59fd10-74fd-449c-9204-8ee4679d260d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Security group id should be uuid Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e59fd10-74fd-449c-9204-8ee4679d260d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 131 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2086357933", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group id should be uuid Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2086357933', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:15.956203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:15.961601 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 20 11:04:15.961601 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:15.964989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e59fd10-74fd-449c-9204-8ee4679d260d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 400 to user: Security group id should be uuid {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:15.972873 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e59fd10-74fd-449c-9204-8ee4679d260d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026921 Jul 20 11:04:15.979365 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1801/3546] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:15 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:04:15.990022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:15.993144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:15.996454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2c830739-31f2-4b77-88c3-0e81083412db req-a7d26201-8531-4225-8776-6268fc9487a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f4a07e-6bfa-44fd-8ff6-0186a36a1366", "name": "network-vif-plugged", "status": "completed", "tag": "6a26f912-c913-4934-ab84-6731d83b3cbb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:16.006043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.013430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.014615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.015907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.018015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2c830739-31f2-4b77-88c3-0e81083412db req-a7d26201-8531-4225-8776-6268fc9487a9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.018474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2c830739-31f2-4b77-88c3-0e81083412db req-a7d26201-8531-4225-8776-6268fc9487a9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.069588 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2c830739-31f2-4b77-88c3-0e81083412db req-a7d26201-8531-4225-8776-6268fc9487a9 service nova] Creating event network-vif-plugged:6a26f912-c913-4934-ab84-6731d83b3cbb for instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 on n-h2-846219-10 Jul 20 11:04:16.083102 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2c830739-31f2-4b77-88c3-0e81083412db req-a7d26201-8531-4225-8776-6268fc9487a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098193 Jul 20 11:04:16.085748 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1746/3547] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:16.100454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77f15a64-ae9f-459d-8a37-2eea8e270353 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3e5dc790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1869004690", "description": "tempest-description-1221337751"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:16.180542 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b22ca9a2-d75d-4725-9b67-ec3360f48143 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "POST /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35/action" status: 202 len: 0 microversion: 2.1 time: 0.199226 Jul 20 11:04:16.184578 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1802/3548] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:04:15 2022] POST /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:16.194806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:16.207487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:16.220175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.226860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.228063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.230760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.648295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:16.663813 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-745db9c1-f66e-4182-9d78-94fd75f7d4f5 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1492 microversion: 2.1 time: 0.476899 Jul 20 11:04:16.664404 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1803/3549] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:16 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1492 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:16.749816 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77f15a64-ae9f-459d-8a37-2eea8e270353 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.662196 Jul 20 11:04:16.757458 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1747/3550] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:04:16 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:16.764470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd8a813f-a051-4d4f-9179-e163ff117c5d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3f901550>, body: {"security_group_rule": {"parent_group_id": "9e76f227-120f-4e6b-b53b-f7f2e9dbe9d6", "ip_protocol": "tempest-999-2115311825", "from_port": 22, "to_port": 22}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:16.961857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:16.962659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:16.976133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.978275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.979419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:16.984780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:16.986506 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-dd8a813f-a051-4d4f-9179-e163ff117c5d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Invalid IP protocol tempest-999-2115311825. Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd8a813f-a051-4d4f-9179-e163ff117c5d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 157 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: {"security_group_rule": {"parent_group_id": "9e76f227-120f-4e6b-b53b-f7f2e9dbe9d6", "ip_protocol": "tempest-999-2115311825", "from_port": 22, "to_port": 22}} Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid IP protocol tempest-999-2115311825. Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9e76f227-120f-4e6b-b53b-f7f2e9dbe9d6', 'ip_protocol': 'tempest-999-2115311825', 'from_port': 22, 'to_port': 22}}} Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-2115311825. Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-2115311825. Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:16.988752 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-2115311825. Jul 20 11:04:16.996719 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:17.001090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd8a813f-a051-4d4f-9179-e163ff117c5d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 400 to user: Invalid IP protocol tempest-999-2115311825. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:17.003716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd8a813f-a051-4d4f-9179-e163ff117c5d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.245528 Jul 20 11:04:17.004820 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1804/3551] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:16 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:04:17.014378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:17.016240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:17.037145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:17.038722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:17.042020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:17.042759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:17.445517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:17.459919 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33be37fe-c2c9-4314-b048-3e0fd64df25d tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 200 len: 1505 microversion: 2.1 time: 0.504516 Jul 20 11:04:17.460740 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1748/3552] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:16 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:17.465357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf90fd37-375a-4342-9f0a-5f1c23ce85d1 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3e5dc1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-301976345", "description": "tempest-description-226994003"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:17.812804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:17.821972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ee4cae5-ec96-4001-a605-c3015501166b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1521 microversion: 2.1 time: 0.815835 Jul 20 11:04:17.826937 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1805/3553] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:17 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1521 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:17.848841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:17.849881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:17.876163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:17.876635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:17.877442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:17.877891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:18.592110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:18.612314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49fe9208-d49a-42a6-bd7d-bf6ca44c2f72 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1317 microversion: 2.1 time: 0.778827 Jul 20 11:04:18.617275 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1806/3554] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:17 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1317 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:18.628239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:18.633555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:18.635865 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf90fd37-375a-4342-9f0a-5f1c23ce85d1 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.173404 Jul 20 11:04:18.636767 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1749/3555] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:04:17 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:18.644906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4de4adb3-9c18-41be-8387-865ecfe98bc7 req-d8b83227-619f-42f0-9942-8e6f296affe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f387b41e-1dab-4efe-9c38-280794c56361", "name": "network-vif-plugged", "status": "completed", "tag": "37b7737f-1eb1-4556-a072-315a2246fef9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:18.648566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:18.653134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:18.657414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:18.658392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:18.658950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:18.668804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4de4adb3-9c18-41be-8387-865ecfe98bc7 req-d8b83227-619f-42f0-9942-8e6f296affe1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:18.669527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4de4adb3-9c18-41be-8387-865ecfe98bc7 req-d8b83227-619f-42f0-9942-8e6f296affe1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:18.693047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4de4adb3-9c18-41be-8387-865ecfe98bc7 req-d8b83227-619f-42f0-9942-8e6f296affe1 service nova] Creating event network-vif-plugged:37b7737f-1eb1-4556-a072-315a2246fef9 for instance f387b41e-1dab-4efe-9c38-280794c56361 on n-h1-846219-10 Jul 20 11:04:18.700669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4de4adb3-9c18-41be-8387-865ecfe98bc7 req-d8b83227-619f-42f0-9942-8e6f296affe1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062030 Jul 20 11:04:18.701942 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1750/3556] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:18.709225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e6fc149-1cc3-41bc-a492-e94587f155ac tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3e5dca60>, body: {"security_group_rule": {"parent_group_id": "0bcc4b97-dc6e-4ad6-b347-4df3d5d5bffd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:19.196655 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1e6fc149-1cc3-41bc-a492-e94587f155ac tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e6fc149-1cc3-41bc-a492-e94587f155ac tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 138 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: {"security_group_rule": {"parent_group_id": "0bcc4b97-dc6e-4ad6-b347-4df3d5d5bffd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0bcc4b97-dc6e-4ad6-b347-4df3d5d5bffd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 11:04:19.198309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e6fc149-1cc3-41bc-a492-e94587f155ac tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e6fc149-1cc3-41bc-a492-e94587f155ac tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.496695 Jul 20 11:04:19.204363 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1751/3557] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:18 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:04:19.210181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:19.220663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:19.234906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:19.239928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:19.247107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:19.247603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:19.374324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:19.416960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3e52cccf-edd1-462e-8930-247e13debb39 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1492 microversion: 2.1 time: 0.798454 Jul 20 11:04:19.417572 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1807/3558] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:18 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1492 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:19.438432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9996e205-48a3-4b8f-945a-1627d35b0ad6 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3fee2c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1882821401", "description": "tempest-description-1404422562"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:20.597472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:20.612868 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05137849-9b08-4541-84a0-5a3bc1eedf12 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1506 microversion: 2.1 time: 1.410418 Jul 20 11:04:20.618345 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1752/3559] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:19 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1506 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:20.646789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:20.650591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:20.673019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:20.675964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:20.679045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:20.680780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:20.818943 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9996e205-48a3-4b8f-945a-1627d35b0ad6 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.400290 Jul 20 11:04:20.819960 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1808/3560] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:04:19 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:20.825777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:20.826631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:20.847261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:20.851050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:20.852454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:20.853153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.249874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:21.275453 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fedcde11-2782-408b-873b-c08edccc7031 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1317 microversion: 2.1 time: 0.649238 Jul 20 11:04:21.276667 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1753/3561] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:20 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:21.284005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:21.284718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:21.293451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:21.294242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.295250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:21.300399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.359101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:21.372595 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ccadbe6e-06a3-4dff-8caf-6df25a5fc896 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1498 microversion: 2.1 time: 0.550025 Jul 20 11:04:21.376445 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1809/3562] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:20 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1498 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:21.405075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c94dd853-a99c-4298-8367-2c8b4a7790eb tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3f844ca0>, body: {"security_group_rule": {"parent_group_id": "d63afedd-a0c5-44b5-a2fe-fb259660754c", "ip_protocol": "tcp", "from_port": 22, "to_port": 11496341}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:21.652317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c94dd853-a99c-4298-8367-2c8b4a7790eb tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Invalid port range 22:11496341. Valid TCP ports should be between 1-65535 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c94dd853-a99c-4298-8367-2c8b4a7790eb tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 144 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: {"security_group_rule": {"parent_group_id": "d63afedd-a0c5-44b5-a2fe-fb259660754c", "ip_protocol": "tcp", "from_port": 22, "to_port": 11496341}} Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid port range 22:11496341. Valid TCP ports should be between 1-65535 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd63afedd-a0c5-44b5-a2fe-fb259660754c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 11496341}}} Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:11496341. Valid TCP ports should be between 1-65535 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:11496341. Valid TCP ports should be between 1-65535 Jul 20 11:04:21.654513 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:11496341. Valid TCP ports should be between 1-65535 Jul 20 11:04:21.659080 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.663611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c94dd853-a99c-4298-8367-2c8b4a7790eb tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 400 to user: Invalid port range 22:11496341. Valid TCP ports should be between 1-65535 {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:21.665036 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c94dd853-a99c-4298-8367-2c8b4a7790eb tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 117 microversion: 2.1 time: 0.264481 Jul 20 11:04:21.665906 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1810/3563] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:21 2022] POST /compute/v2.1/os-security-group-rules => generated 117 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:04:21.683666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:21.685554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:21.711912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:21.716216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.719656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:21.722640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.768565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:21.786968 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92346784-1b64-49ea-86fc-c63cfa7d01da tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 200 len: 1506 microversion: 2.1 time: 0.506525 Jul 20 11:04:21.790085 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1754/3564] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:21 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 1506 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:21.802132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Action: 'create', calling method: .version_select at 0x7f2c3e63a9d0>, body: {"security_group_rule": {"parent_group_id": "4849041d-5a3c-4996-89b6-efab3c6c29f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:21.820656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:04:21.886991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG neutronclient.v2_0.client [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist", "detail": ""}} {{(pid=125886) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:04:21.888442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Neutron security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 not found {{(pid=125886) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 20 11:04:21.889001 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.889001 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 138 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: {"security_group_rule": {"parent_group_id": "4849041d-5a3c-4996-89b6-efab3c6c29f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: exception: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4849041d-5a3c-4996-89b6-efab3c6c29f3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:04:21.890964 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 404 to user: Security group 4849041d-5a3c-4996-89b6-efab3c6c29f3 does not exist Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: Neutron server returns request_ids: ['req-d110936e-bb9b-4d13-84bb-ae73a9dcf2c5'] {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:21.896120 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-731b2f4f-9570-46c9-a6f8-956a84f02c52 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.101092 Jul 20 11:04:21.903507 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1755/3565] 10.222.0.79 () {60 vars in 1194 bytes} [Wed Jul 20 11:04:21 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:04:21.903507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:21.903717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:21.927821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:21.928733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.931739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:21.932406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:21.994197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:04:22.040233 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d6e78117-da08-4e38-bde4-e3161ff4ea4f tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "DELETE /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 204 len: 0 microversion: 2.1 time: 0.372586 Jul 20 11:04:22.042205 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1811/3566] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:04:21 2022] DELETE /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:04:22.062507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3f901790>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:22.226029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b67c001-b343-4ab9-a20c-3510cec34a3d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 204 len: 0 microversion: 2.1 time: 0.326447 Jul 20 11:04:22.226650 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1756/3567] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:04:21 2022] DELETE /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:04:22.236653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:22.238745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:22.277695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:22.290874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:22.293427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:22.296528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:22.863546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG neutronclient.v2_0.client [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist", "detail": ""}} {{(pid=125885) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 20 11:04:22.864960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.security_group_api [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Neutron security group rule 23e6f20e-ea41-4d22-91d9-386557793915 not found {{(pid=125885) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 20 11:04:22.865770 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] HTTP exception thrown: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.865770 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Request method failure captured: Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-security-group-rules/23e6f20e-ea41-4d22-91d9-386557793915 HTTP/1.1 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Emt6blmNVrs2bgakFjd2Gdev31PlLVDHcv9gwv4_RT4AfIxzeDkbb70YkSDuMFC0-GSQA8D-eNDcnHMklTFvlYviBMEVZCquGONdS2PBQerxdbyffdMwPv2okGoZ5FdoSpdkNnQLl8G3Xs4RASKxRK3MINMzzDOGz05pFUR40azSs Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1ad7b55cca1d4111b1fc46187bcb8c4a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1ad7b55cca1d4111b1fc46187bcb8c4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 1ad7b55cca1d4111b1fc46187bcb8c4a Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 445032755e704c8db95946f85b1466b5 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: exception: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '23e6f20e-ea41-4d22-91d9-386557793915'} Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 20 11:04:22.868441 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] Jul 20 11:04:22.872915 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:22.877678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Returning 404 to user: Security group rule 23e6f20e-ea41-4d22-91d9-386557793915 does not exist Jul 20 11:04:22.877678 n-d-846219-10 devstack@n-api.service[125885]: Neutron server returns request_ids: ['req-cef7d2e0-e4e8-4167-af07-34920d87e4e8'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:22.879040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-427ad4a6-2c92-490c-9373-0ceef0b88730 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/23e6f20e-ea41-4d22-91d9-386557793915" status: 404 len: 199 microversion: 2.1 time: 0.834987 Jul 20 11:04:22.880301 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1812/3568] 10.222.0.79 () {58 vars in 1286 bytes} [Wed Jul 20 11:04:22 2022] DELETE /compute/v2.1/os-security-group-rules/23e6f20e-ea41-4d22-91d9-386557793915 => generated 199 bytes in 837 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:04:22.895240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:22.899639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:22.916954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:22.918042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:22.918859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:22.920135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:22.955893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:23.559197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:23.569486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-246dd9ac-6bd7-4716-82a5-2d1f44f66a98 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 1.341316 Jul 20 11:04:23.570815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1757/3569] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:22 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:23.584612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-931042858", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "6c740025-ac3c-4e30-9c2d-99c8f1333193"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:23.692644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] validate_networks() for [('6c740025-ac3c-4e30-9c2d-99c8f1333193', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:04:23.765657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:23.780710 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79e81219-a9c6-4a24-ba13-c5c2976f14a8 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1317 microversion: 2.1 time: 0.897944 Jul 20 11:04:23.783629 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1813/3570] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:22 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:23.793946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-10595311-4e36-498f-b916-090629388a6b tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3fe35280>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:26.156855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:04:26.157873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:04:26.159186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:04:26.159903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:04:26.160538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:04:26.180796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:26.183268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:26.185917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:26.187064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:26.240126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Getting quotas for project f9662a26e6ec4789adac8707d0b279ee. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:04:26.268274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Getting quotas for user 013e6cb7f7a34317ab8e2ef7c4b9dc53 and project f9662a26e6ec4789adac8707d0b279ee. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:04:26.311631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:04:26.316969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:04:26.528213 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f8197722-2424-4a3c-82cf-2c18a1133b32 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.953812 Jul 20 11:04:26.529391 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1758/3571] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:04:26.539037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:26.553621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:26.603111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:26.604028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:26.606975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:26.607456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:27.286468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:27.290494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:27.301569 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c0c4e09-40ab-4e6f-a262-a7835439aa92 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.770966 Jul 20 11:04:27.305153 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1759/3572] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:26 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:27.312977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:27.319841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:27.354183 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-10595311-4e36-498f-b916-090629388a6b tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d63afedd-a0c5-44b5-a2fe-fb259660754c" status: 202 len: 0 microversion: 2.1 time: 3.569445 Jul 20 11:04:27.355629 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1814/3573] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:04:23 2022] DELETE /compute/v2.1/os-security-groups/d63afedd-a0c5-44b5-a2fe-fb259660754c => generated 0 bytes in 3571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:27.363250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69e9a809-2df0-4b7b-9d28-ff37852529fd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:27.364848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69e9a809-2df0-4b7b-9d28-ff37852529fd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:27.375130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:27.377465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:27.379359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:27.381254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:27.985448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69e9a809-2df0-4b7b-9d28-ff37852529fd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:27.997385 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69e9a809-2df0-4b7b-9d28-ff37852529fd tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1217 microversion: 2.1 time: 0.640329 Jul 20 11:04:28.010339 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1815/3574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:27 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1217 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:28.024530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c60f34f6-fc5a-4b3f-a794-0fdf28c82fbf tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3f85a8b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:28.556065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:28.579731 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f3c66350-0975-4338-9da8-57d6825803bd tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1505 microversion: 2.1 time: 1.269098 Jul 20 11:04:28.584012 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1760/3575] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:27 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1505 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:28.603506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4102335f-fe06-4cbd-998b-efce1a2e1413 req-9a372ed9-f124-4e55-8bd1-8f7ba6c96aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f4a07e-6bfa-44fd-8ff6-0186a36a1366", "name": "network-vif-deleted", "tag": "6a26f912-c913-4934-ab84-6731d83b3cbb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:28.632330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4102335f-fe06-4cbd-998b-efce1a2e1413 req-9a372ed9-f124-4e55-8bd1-8f7ba6c96aac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:28.633306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4102335f-fe06-4cbd-998b-efce1a2e1413 req-9a372ed9-f124-4e55-8bd1-8f7ba6c96aac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:28.681326 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4102335f-fe06-4cbd-998b-efce1a2e1413 req-9a372ed9-f124-4e55-8bd1-8f7ba6c96aac service nova] Creating event network-vif-deleted:6a26f912-c913-4934-ab84-6731d83b3cbb for instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 on n-h2-846219-10 Jul 20 11:04:28.710036 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4102335f-fe06-4cbd-998b-efce1a2e1413 req-9a372ed9-f124-4e55-8bd1-8f7ba6c96aac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121005 Jul 20 11:04:28.713265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1761/3576] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:28.725253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:28.729193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:28.750804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:28.751907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:28.753005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:28.753803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:29.679828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:29.689189 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c48ea3b-381d-44f7-8a1c-642b0c66ced6 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 200 len: 1504 microversion: 2.1 time: 0.973133 Jul 20 11:04:29.689795 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1762/3577] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:28 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 1504 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:29.698612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:29.705275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:29.719719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:29.723938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:29.735350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:29.736408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:29.799723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:04:29.981365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e81765b6-ec96-4745-bc2b-074dc4ce9815 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 204 len: 0 microversion: 2.1 time: 0.283151 Jul 20 11:04:29.982119 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1763/3578] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:04:29 2022] DELETE /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:04:30.000547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:30.001356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:30.008760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:30.009479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:30.011357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:30.011979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:30.674879 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c60f34f6-fc5a-4b3f-a794-0fdf28c82fbf tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/0bcc4b97-dc6e-4ad6-b347-4df3d5d5bffd" status: 202 len: 0 microversion: 2.1 time: 2.663451 Jul 20 11:04:30.676328 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1816/3579] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:04:28 2022] DELETE /compute/v2.1/os-security-groups/0bcc4b97-dc6e-4ad6-b347-4df3d5d5bffd => generated 0 bytes in 2665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:30.770896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:30.787792 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3406abc1-b3d2-4629-98b2-abe78fb641c0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1317 microversion: 2.1 time: 0.796720 Jul 20 11:04:30.789039 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1764/3580] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:29 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1317 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:30.794091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:30.799780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:30.812994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:30.816489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:30.820501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:30.822052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:30.893810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:04:30.980361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-445613073", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:31.083104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] validate_networks() for [('27c7b58b-4f85-421a-aaca-e450cd9c7adf', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:04:31.092997 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b00d031-5f75-484e-b87d-32d8cba89a9b tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 204 len: 0 microversion: 2.1 time: 0.302163 Jul 20 11:04:31.096635 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1765/3581] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:04:30 2022] DELETE /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:04:31.104093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c0c5974c-8904-425a-8f96-6ce47adecbc9 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3e5e50d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:32.759126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:04:32.766609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:04:32.768103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:04:32.771149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:04:32.771926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:04:32.800644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:32.801203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:32.805876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:32.806435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:32.851074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Getting quotas for project dd30cad7692d421aac0440ee0f4d3d73. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:04:32.864466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Getting quotas for user 4f42fd8232fe4c57873fe233ef39af9c and project dd30cad7692d421aac0440ee0f4d3d73. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:04:32.893026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:04:32.901456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:04:32.991416 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1475681b-eb62-4f5b-bd01-c3a5a8e899df tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313764 Jul 20 11:04:32.997980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1817/3582] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:04:33.005356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:33.006336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: 39badb54-8019-4eaf-b2f6-7409d7e7fb35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:33.015458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.016238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.017288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.018235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.055378 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] HTTP exception thrown: Instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 could not be found. Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Request method failure captured: Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 HTTP/1.1 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-C8w8ExPDDrTYTs67ERq_1O00JSuqE8GL2TTkk9KMoihV-fIeISCJXBpHi3NB5zjaAD_Eh-lIWJKlrDkLle1r6LYH6uEw6NpFLX959-iqYtPMTb-91sCQ5BlbGqeDmFbzDZ6fd2tJCmWOczWYP5TUmz6FDV4zUOd-B2wh4I4Up4S6U Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b388e2b9c80c476eb61facd15bf729f1 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueTestJSON-457178833 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b388e2b9c80c476eb61facd15bf729f1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b388e2b9c80c476eb61facd15bf729f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b388e2b9c80c476eb61facd15bf729f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b388e2b9c80c476eb61facd15bf729f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueTestJSON-457178833 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b388e2b9c80c476eb61facd15bf729f1 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueTestJSON-457178833 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueTestJSON-457178833-project Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c3a0ea360267458882dc782fb606c7f1 Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueTestJSON-457178833-project Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 could not be found. Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '39badb54-8019-4eaf-b2f6-7409d7e7fb35'} Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 could not be found. Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 could not be found. Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:33.057251 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 could not be found. Jul 20 11:04:33.063665 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:33.067450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Returning 404 to user: Instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:33.068859 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-026e140e-b218-4234-9376-a94cda405554 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35" status: 404 len: 111 microversion: 2.1 time: 0.068482 Jul 20 11:04:33.069633 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1818/3583] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:32 2022] GET /compute/v2.1/servers/39badb54-8019-4eaf-b2f6-7409d7e7fb35 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:04:33.078859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ac565cc1-eb41-4207-aaf1-a96fffd08aae req-1f00abf8-89df-45f1-8901-43484d3907f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39badb54-8019-4eaf-b2f6-7409d7e7fb35", "name": "network-vif-deleted", "tag": "987d4be3-82c1-4226-970f-350cce4c1655"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:33.090181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ac565cc1-eb41-4207-aaf1-a96fffd08aae req-1f00abf8-89df-45f1-8901-43484d3907f8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.090937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ac565cc1-eb41-4207-aaf1-a96fffd08aae req-1f00abf8-89df-45f1-8901-43484d3907f8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.110543 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ac565cc1-eb41-4207-aaf1-a96fffd08aae req-1f00abf8-89df-45f1-8901-43484d3907f8 service nova] Creating event network-vif-deleted:987d4be3-82c1-4226-970f-350cce4c1655 for instance 39badb54-8019-4eaf-b2f6-7409d7e7fb35 on n-h1-846219-10 Jul 20 11:04:33.121830 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ac565cc1-eb41-4207-aaf1-a96fffd08aae req-1f00abf8-89df-45f1-8901-43484d3907f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044888 Jul 20 11:04:33.125553 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1819/3584] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:33.152718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:33.168010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:33.177144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.177847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.178850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.179501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.532205 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c0c5974c-8904-425a-8f96-6ce47adecbc9 tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9e76f227-120f-4e6b-b53b-f7f2e9dbe9d6" status: 202 len: 0 microversion: 2.1 time: 2.433678 Jul 20 11:04:33.532726 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1766/3585] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:04:31 2022] DELETE /compute/v2.1/os-security-groups/9e76f227-120f-4e6b-b53b-f7f2e9dbe9d6 => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:33.537518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:33.538435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:33.564408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.565917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.569008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.573997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.616808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:33.633597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ff11a54-3015-4148-8b8c-9137d7a1994c tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1469 microversion: 2.1 time: 0.501271 Jul 20 11:04:33.635244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1820/3586] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:33 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:33.649455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-973d384a-bb40-4bc5-a6d7-9c64a79d2bf7 req-cbb1b40a-239d-4a86-9bbe-f353150dad07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77652f95-882f-4c86-b7ec-beeda4e2d8d1", "tag": "ff0f0239-a279-4aec-9042-6a6a6793c981"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:33.679715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-973d384a-bb40-4bc5-a6d7-9c64a79d2bf7 req-cbb1b40a-239d-4a86-9bbe-f353150dad07 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:33.681882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-973d384a-bb40-4bc5-a6d7-9c64a79d2bf7 req-cbb1b40a-239d-4a86-9bbe-f353150dad07 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:33.723691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-973d384a-bb40-4bc5-a6d7-9c64a79d2bf7 req-cbb1b40a-239d-4a86-9bbe-f353150dad07 service nova] Creating event network-changed:ff0f0239-a279-4aec-9042-6a6a6793c981 for instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 on n-h1-846219-10 Jul 20 11:04:33.749501 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-973d384a-bb40-4bc5-a6d7-9c64a79d2bf7 req-cbb1b40a-239d-4a86-9bbe-f353150dad07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103628 Jul 20 11:04:33.750608 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1821/3587] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:33.774522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-47dbff6d-b6df-495e-8b2b-5b873ebb8055 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:33.777312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-47dbff6d-b6df-495e-8b2b-5b873ebb8055 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:34.108670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-47dbff6d-b6df-495e-8b2b-5b873ebb8055 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:34.142736 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-47dbff6d-b6df-495e-8b2b-5b873ebb8055 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1216 microversion: 2.1 time: 0.390721 Jul 20 11:04:34.155790 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1822/3588] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:33 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1216 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:34.212121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:34.227335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:34.259569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:34.261761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:34.262906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:34.268625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:34.342190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:04:34.573834 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d046dc2-db65-4994-85e3-b072fd8cc7f1 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 204 len: 0 microversion: 2.1 time: 0.399850 Jul 20 11:04:34.578434 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1823/3589] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:04:34 2022] DELETE /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:04:34.595835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-93988e27-6f39-47b9-8503-c2a3bbccd46d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3fcbb670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:34.661905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:34.675281 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad851c48-095c-4cb5-95e2-8a73651e8ac5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1317 microversion: 2.1 time: 1.141279 Jul 20 11:04:34.676083 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1767/3590] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:33 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:34.690872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:34.697214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:34.710701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:34.712716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:34.713793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:34.715397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.132571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:35.152015 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff1a6968-48d2-4a6a-9529-e9920a06575e tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1490 microversion: 2.1 time: 0.467361 Jul 20 11:04:35.157923 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-93988e27-6f39-47b9-8503-c2a3bbccd46d tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/2a29fc10-1383-42a3-b919-d777e1908c9a" status: 202 len: 0 microversion: 2.1 time: 0.576457 Jul 20 11:04:35.159052 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1824/3591] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:04:34 2022] DELETE /compute/v2.1/os-security-groups/2a29fc10-1383-42a3-b919-d777e1908c9a => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:35.164283 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1768/3592] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:34 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1490 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:35.164439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:35.169373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:35.172615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:35.174724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:35.183907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.185559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.187744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.193361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.207263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.213908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.215577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.216762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.384564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:35.406155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5bb5a88a-7655-462f-9d70-562e7391967e tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1469 microversion: 2.1 time: 0.242594 Jul 20 11:04:35.410656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1825/3593] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:35 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:35.432926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4602332f-bb01-4910-b522-734093c2caee tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] Calling method '.version_select at 0x7f2c3fcbb670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:35.495295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:35.508970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72446e1f-01b0-40de-855f-8c894fe55ad8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1268 microversion: 2.1 time: 0.342120 Jul 20 11:04:35.509569 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1769/3594] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:35 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1268 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:35.527851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6c00bc47-ccf1-404a-b9c8-f8ac089f487e req-2e0f425c-7a97-4e8c-ae17-48f8082d7cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f387b41e-1dab-4efe-9c38-280794c56361", "name": "network-vif-deleted", "tag": "37b7737f-1eb1-4556-a072-315a2246fef9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:35.539243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6c00bc47-ccf1-404a-b9c8-f8ac089f487e req-2e0f425c-7a97-4e8c-ae17-48f8082d7cd7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.540206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6c00bc47-ccf1-404a-b9c8-f8ac089f487e req-2e0f425c-7a97-4e8c-ae17-48f8082d7cd7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.563345 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6c00bc47-ccf1-404a-b9c8-f8ac089f487e req-2e0f425c-7a97-4e8c-ae17-48f8082d7cd7 service nova] Creating event network-vif-deleted:37b7737f-1eb1-4556-a072-315a2246fef9 for instance f387b41e-1dab-4efe-9c38-280794c56361 on n-h1-846219-10 Jul 20 11:04:35.569614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6c00bc47-ccf1-404a-b9c8-f8ac089f487e req-2e0f425c-7a97-4e8c-ae17-48f8082d7cd7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046722 Jul 20 11:04:35.570696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1770/3595] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:35.707464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:35.709495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:35.735693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.736594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:35.737580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:35.738189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:36.213992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:36.293651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:36.363961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:36.384840 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-472d8bf8-0350-455a-a457-2da982e5e763 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1317 microversion: 2.1 time: 0.690654 Jul 20 11:04:36.386142 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1771/3596] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:35 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:36.400714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-923e861c-66e4-403a-8268-5497d42c0aac req-e24770c0-35c9-4677-ab2e-af678eb6df53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c69fc27-d616-4f46-927c-8f2172de06df", "name": "network-vif-deleted", "tag": "82268b50-ef6f-45a2-a08a-761acd3e817a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:36.440490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-923e861c-66e4-403a-8268-5497d42c0aac req-e24770c0-35c9-4677-ab2e-af678eb6df53 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:36.441466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-923e861c-66e4-403a-8268-5497d42c0aac req-e24770c0-35c9-4677-ab2e-af678eb6df53 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:36.470249 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-923e861c-66e4-403a-8268-5497d42c0aac req-e24770c0-35c9-4677-ab2e-af678eb6df53 service nova] Creating event network-vif-deleted:82268b50-ef6f-45a2-a08a-761acd3e817a for instance 5c69fc27-d616-4f46-927c-8f2172de06df on n-h2-846219-10 Jul 20 11:04:36.492428 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-923e861c-66e4-403a-8268-5497d42c0aac req-e24770c0-35c9-4677-ab2e-af678eb6df53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104289 Jul 20 11:04:36.500547 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1772/3597] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:36.506482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:36.519498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:36.533938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:36.536664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:36.544934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:36.548548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:37.464188 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4602332f-bb01-4910-b522-734093c2caee tempest-SecurityGroupRulesNegativeTestJSON-1675211428 tempest-SecurityGroupRulesNegativeTestJSON-1675211428-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/8c828141-b915-4125-9aca-41e26feace02" status: 202 len: 0 microversion: 2.1 time: 2.050420 Jul 20 11:04:37.465627 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1826/3598] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:04:35 2022] DELETE /compute/v2.1/os-security-groups/8c828141-b915-4125-9aca-41e26feace02 => generated 0 bytes in 2054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:04:37.472452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:37.473285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:37.490189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:37.491882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:37.492849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:37.494794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:37.616669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:37.617400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:37.618056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lazy-loading 'fault' on Instance uuid f387b41e-1dab-4efe-9c38-280794c56361 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:04:37.960357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bbb9c8278c423680b2d5f5313e8c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb456ec3887447d984f0803f35bdc20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:37.968774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-539cd891-f073-4449-b252-80595ffcc577 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 200 len: 1307 microversion: 2.1 time: 0.501430 Jul 20 11:04:37.970152 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1827/3599] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:37 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:37.975123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:37.976086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:37.987079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:37.988313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:37.989293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:37.989922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:38.351977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:38.383124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e3a0e69-3488-493f-83cb-cddbb133aabe tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1274 microversion: 2.1 time: 0.408756 Jul 20 11:04:38.396721 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1828/3600] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:37 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1274 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:38.413514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:38.416281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:38.426840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a0ea360267458882dc782fb606c7f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388e2b9c80c476eb61facd15bf729f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:38.466229 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25fb9df0-25ed-439d-9b91-5ba4beecebb7 tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 200 len: 1490 microversion: 2.1 time: 1.963775 Jul 20 11:04:38.490237 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1773/3601] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:36 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 1490 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:38.492833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:38.493993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:38.496199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:38.496922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:38.601319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d679c688-02a9-43dc-8a65-509c8788d802 req-08c7f9b5-802b-4310-9ac8-48f8e03c0348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0", "name": "network-vif-deleted", "tag": "3f95b9a1-49f6-4e90-8bb8-a6fde137e014"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:38.618860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d679c688-02a9-43dc-8a65-509c8788d802 req-08c7f9b5-802b-4310-9ac8-48f8e03c0348 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:38.619337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d679c688-02a9-43dc-8a65-509c8788d802 req-08c7f9b5-802b-4310-9ac8-48f8e03c0348 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:38.652330 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d679c688-02a9-43dc-8a65-509c8788d802 req-08c7f9b5-802b-4310-9ac8-48f8e03c0348 service nova] Creating event network-vif-deleted:3f95b9a1-49f6-4e90-8bb8-a6fde137e014 for instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 on n-h2-846219-10 Jul 20 11:04:38.667462 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d679c688-02a9-43dc-8a65-509c8788d802 req-08c7f9b5-802b-4310-9ac8-48f8e03c0348 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070156 Jul 20 11:04:38.671041 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1774/3602] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:04:38.991258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:38.992097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: f387b41e-1dab-4efe-9c38-280794c56361] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:39.011592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.012026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.013110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.013718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.035338 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] HTTP exception thrown: Instance f387b41e-1dab-4efe-9c38-280794c56361 could not be found. Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Request method failure captured: Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 HTTP/1.1 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-D1U_50ws9fncJUj55BjjUX4mvMv3ovTy0yF8_z6RaQa6sVC3lyjfgtlHwS9UwC5xCHFvBzshsv4_7ZRbU2kO_VYaA2zEGfjStDJJpZzhGSXk-46ue70baL_FLtFbbie8uEmg_fcPJ0_2yEImX5KP_yJKQ6W0bPiE530UKRlgDE0xc Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ccb456ec3887447d984f0803f35bdc20 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MultipleCreateTestJSON-380895134 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ccb456ec3887447d984f0803f35bdc20", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccb456ec3887447d984f0803f35bdc20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccb456ec3887447d984f0803f35bdc20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ccb456ec3887447d984f0803f35bdc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MultipleCreateTestJSON-380895134 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ccb456ec3887447d984f0803f35bdc20 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MultipleCreateTestJSON-380895134 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MultipleCreateTestJSON-380895134-project Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 42bbb9c8278c423680b2d5f5313e8c27 Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MultipleCreateTestJSON-380895134-project Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f387b41e-1dab-4efe-9c38-280794c56361 could not be found. Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f387b41e-1dab-4efe-9c38-280794c56361'} Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f387b41e-1dab-4efe-9c38-280794c56361 could not be found. Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f387b41e-1dab-4efe-9c38-280794c56361 could not be found. Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:39.037514 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f387b41e-1dab-4efe-9c38-280794c56361 could not be found. Jul 20 11:04:39.043615 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.058554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Returning 404 to user: Instance f387b41e-1dab-4efe-9c38-280794c56361 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:39.060007 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60d169c9-8235-4aa0-94cc-8897c1519ca0 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361" status: 404 len: 111 microversion: 2.1 time: 0.073824 Jul 20 11:04:39.066206 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1775/3603] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:38 2022] GET /compute/v2.1/servers/f387b41e-1dab-4efe-9c38-280794c56361 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:04:39.073975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:39.074906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] [instance: 5c69fc27-d616-4f46-927c-8f2172de06df] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:39.084093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.085742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.086799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.087443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.109147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] HTTP exception thrown: Instance 5c69fc27-d616-4f46-927c-8f2172de06df could not be found. Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Request method failure captured: Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df HTTP/1.1 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-D1U_50ws9fncJUj55BjjUX4mvMv3ovTy0yF8_z6RaQa6sVC3lyjfgtlHwS9UwC5xCHFvBzshsv4_7ZRbU2kO_VYaA2zEGfjStDJJpZzhGSXk-46ue70baL_FLtFbbie8uEmg_fcPJ0_2yEImX5KP_yJKQ6W0bPiE530UKRlgDE0xc Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: ccb456ec3887447d984f0803f35bdc20 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-MultipleCreateTestJSON-380895134 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ccb456ec3887447d984f0803f35bdc20", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccb456ec3887447d984f0803f35bdc20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccb456ec3887447d984f0803f35bdc20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ccb456ec3887447d984f0803f35bdc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-MultipleCreateTestJSON-380895134 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: ccb456ec3887447d984f0803f35bdc20 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-MultipleCreateTestJSON-380895134 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-MultipleCreateTestJSON-380895134-project Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 42bbb9c8278c423680b2d5f5313e8c27 Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-MultipleCreateTestJSON-380895134-project Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 5c69fc27-d616-4f46-927c-8f2172de06df could not be found. Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '5c69fc27-d616-4f46-927c-8f2172de06df'} Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c69fc27-d616-4f46-927c-8f2172de06df could not be found. Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c69fc27-d616-4f46-927c-8f2172de06df could not be found. Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:39.112383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c69fc27-d616-4f46-927c-8f2172de06df could not be found. Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] Returning 404 to user: Instance 5c69fc27-d616-4f46-927c-8f2172de06df could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b0d0808a-0836-4fc1-87fe-526765113fc5 tempest-MultipleCreateTestJSON-380895134 tempest-MultipleCreateTestJSON-380895134-project] 10.222.0.79 "GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df" status: 404 len: 111 microversion: 2.1 time: 0.043913 Jul 20 11:04:39.118294 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1776/3604] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:39 2022] GET /compute/v2.1/servers/5c69fc27-d616-4f46-927c-8f2172de06df => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:04:39.410017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:39.411838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:39.419786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.421244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.422505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.423377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.572285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:39.591977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5f2f192-d19a-4705-a7ce-c36d13bbe896 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1317 microversion: 2.1 time: 1.194340 Jul 20 11:04:39.592656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1829/3605] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:38 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1317 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:39.609331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:39.616605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] [instance: c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:39.629691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.630752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.631694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.633267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.665520 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] HTTP exception thrown: Instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 could not be found. Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Request method failure captured: Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 HTTP/1.1 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-C8w8ExPDDrTYTs67ERq_1O00JSuqE8GL2TTkk9KMoihV-fIeISCJXBpHi3NB5zjaAD_Eh-lIWJKlrDkLle1r6LYH6uEw6NpFLX959-iqYtPMTb-91sCQ5BlbGqeDmFbzDZ6fd2tJCmWOczWYP5TUmz6FDV4zUOd-B2wh4I4Up4S6U Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b388e2b9c80c476eb61facd15bf729f1 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueTestJSON-457178833 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b388e2b9c80c476eb61facd15bf729f1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b388e2b9c80c476eb61facd15bf729f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b388e2b9c80c476eb61facd15bf729f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b388e2b9c80c476eb61facd15bf729f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueTestJSON-457178833 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b388e2b9c80c476eb61facd15bf729f1 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueTestJSON-457178833 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueTestJSON-457178833-project Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: c3a0ea360267458882dc782fb606c7f1 Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueTestJSON-457178833-project Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 could not be found. Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0'} Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 could not be found. Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 could not be found. Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:04:39.667572 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 could not be found. Jul 20 11:04:39.673199 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:04:39.677210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] Returning 404 to user: Instance c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:04:39.678415 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-455524b1-134e-4ce3-a4af-4fe6a6ea66bb tempest-ServerRescueTestJSON-457178833 tempest-ServerRescueTestJSON-457178833-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0" status: 404 len: 111 microversion: 2.1 time: 0.084820 Jul 20 11:04:39.682741 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1830/3606] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:39 2022] GET /compute/v2.1/servers/c5fe2a36-7887-4f3b-abf0-3fc23cfcd7a0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:04:39.744203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6a49d8d6-8a2f-412e-98f6-48bb89c273ae req-60bf1659-b0cb-4762-8a77-a9c627fb5272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77652f95-882f-4c86-b7ec-beeda4e2d8d1", "name": "network-vif-plugged", "status": "completed", "tag": "ff0f0239-a279-4aec-9042-6a6a6793c981"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:39.754914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6a49d8d6-8a2f-412e-98f6-48bb89c273ae req-60bf1659-b0cb-4762-8a77-a9c627fb5272 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:39.762956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6a49d8d6-8a2f-412e-98f6-48bb89c273ae req-60bf1659-b0cb-4762-8a77-a9c627fb5272 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:39.799620 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6a49d8d6-8a2f-412e-98f6-48bb89c273ae req-60bf1659-b0cb-4762-8a77-a9c627fb5272 service nova] Creating event network-vif-plugged:ff0f0239-a279-4aec-9042-6a6a6793c981 for instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 on n-h1-846219-10 Jul 20 11:04:39.807798 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6a49d8d6-8a2f-412e-98f6-48bb89c273ae req-60bf1659-b0cb-4762-8a77-a9c627fb5272 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067249 Jul 20 11:04:39.808965 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1831/3607] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:40.618566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:40.620368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:40.634743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:40.635514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:40.636535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:40.637264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:40.756340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:40.769525 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-272750f2-f406-4316-8186-f71af5945ebc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 1.366934 Jul 20 11:04:40.770527 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1777/3608] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:39 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:04:41.333899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:41.343006 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6a0f6d8-554a-48fa-a669-5c3194c86c94 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1317 microversion: 2.1 time: 0.735748 Jul 20 11:04:41.353196 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1832/3609] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:40 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1317 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:41.787113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:41.788506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:41.801458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:41.803295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:41.805540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:41.806942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:41.867077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:41.877652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f53ea97f-938d-41e5-8aa1-c2ee40e6684b req-1d33f7d9-b840-46d4-9d72-a5acc80f9f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9551e7fa-23a0-4481-b8dc-699f20cad7f4", "tag": "330484e6-bbe2-4871-a298-e6b70406be9f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:41.931915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f53ea97f-938d-41e5-8aa1-c2ee40e6684b req-1d33f7d9-b840-46d4-9d72-a5acc80f9f9d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:41.933199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f53ea97f-938d-41e5-8aa1-c2ee40e6684b req-1d33f7d9-b840-46d4-9d72-a5acc80f9f9d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:41.987566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f53ea97f-938d-41e5-8aa1-c2ee40e6684b req-1d33f7d9-b840-46d4-9d72-a5acc80f9f9d service nova] Creating event network-changed:330484e6-bbe2-4871-a298-e6b70406be9f for instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 on n-h2-846219-10 Jul 20 11:04:42.013100 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f53ea97f-938d-41e5-8aa1-c2ee40e6684b req-1d33f7d9-b840-46d4-9d72-a5acc80f9f9d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149199 Jul 20 11:04:42.020242 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1833/3610] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:42.363505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:42.364502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:42.380665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:42.389579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:42.395798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:42.402655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:42.726819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:42.740333 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-287a5dec-e8a8-40f9-be59-ad8d237702fd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 0.956373 Jul 20 11:04:42.743133 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1778/3611] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:41 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:42.823903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:42.943026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:42.961801 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3e7f20a-ccbc-4ef0-bf15-8a56386d92a2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1317 microversion: 2.1 time: 0.603672 Jul 20 11:04:42.973926 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1834/3612] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:42 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:43.762198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:43.763976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:43.773014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:43.773821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:43.775502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:43.776372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:43.988058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:43.990948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:44.002712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:44.005320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:44.009120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:44.013653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:44.128096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:44.754587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:44.770020 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-32bf96f4-373a-4945-a3c0-16c36e6459a1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 1.012892 Jul 20 11:04:44.771662 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1779/3613] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:43 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:44.901925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:44.913336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-78278c0d-6609-4117-8c17-5e45de9115c5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1507 microversion: 2.1 time: 0.934448 Jul 20 11:04:44.922212 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1835/3614] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:43 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1507 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:44.938235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:44.940284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:44.948562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:44.949408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:44.950460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:44.951137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:45.415600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:45.427142 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a6140ed-4608-457e-bda1-ed2f68997625 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1507 microversion: 2.1 time: 0.493121 Jul 20 11:04:45.440047 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1780/3615] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:44 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:45.456406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:45.458666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:45.473094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:45.474112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:45.475143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:45.475858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:45.606718 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f49a6fdf-e5f9-42ed-9169-61166c4d24b9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "PUT /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1079 microversion: 2.1 time: 0.154469 Jul 20 11:04:45.622783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:45.623460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:45.625796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:45.627656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1836/3616] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:04:45 2022] PUT /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1079 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:45.631515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:45.632316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:45.633258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:45.633950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:45.788450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:45.789465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:45.799197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:45.800149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:45.801159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:45.804596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:46.614440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:46.626983 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff5a62b4-8f7f-4e17-8241-4d512af468d7 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1505 microversion: 2.1 time: 1.007933 Jul 20 11:04:46.640099 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1781/3617] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:45 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1505 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:46.959622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-928658480", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:47.065112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:04:47.479689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:47.485012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:47.493294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e51297f-76bf-47e8-89b9-84658e857d8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 1.708801 Jul 20 11:04:47.498916 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1837/3618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:45 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:47.515237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:47.516132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:47.536658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:47.537411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:47.538399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:47.539012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:48.476417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:48.493934 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-041bcc93-2c21-4c61-82a0-6786f6ca031b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1505 microversion: 2.1 time: 0.991281 Jul 20 11:04:48.495638 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1838/3619] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:47 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1505 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:48.552728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:48.554615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:48.602348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:48.602881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:48.603734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:48.605534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:48.804253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:04:48.811549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:04:48.811979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:04:48.812464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:04:48.812877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:04:48.813294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:04:49.012645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:49.067401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.070527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.076274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.079492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.171852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-678262ea-c3b5-4d6b-ab61-5c760cde94a3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "POST /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1/action" status: 202 len: 1111 microversion: 2.1 time: 0.662430 Jul 20 11:04:49.176425 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1839/3620] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:04:48 2022] POST /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1/action => generated 1111 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 11:04:49.203287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:49.204268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:49.229299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.230052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.231012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.236507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.469115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:04:49.469625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:04:49.470952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:04:49.471689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:04:49.473374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:04:49.504167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.507839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.512978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.517195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.607237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:04:49.628075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:04:49.655878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:04:49.661458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:04:49.840376 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5afa4399-71d6-49d6-8c59-027b3b4b4b45 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.198808 Jul 20 11:04:49.843801 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1782/3621] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:04:49.850773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:49.864693 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad05cbd9-ad15-4f39-aaaf-b89677b4e5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 0.686107 Jul 20 11:04:49.865528 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1840/3622] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:49 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:49.876950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:49.883091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:49.885578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1709918069", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:49.907919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.909355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:49.910620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:49.916572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:50.020530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:04:50.976561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:50.988768 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fa0c72cd-f483-4bfd-9a08-8eedeec311cc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 1.121948 Jul 20 11:04:50.992248 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1841/3623] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:49 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:51.007149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce341b25-a0ad-40b5-a29e-5cbf6c144c1c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:51.008243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce341b25-a0ad-40b5-a29e-5cbf6c144c1c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:51.198736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce341b25-a0ad-40b5-a29e-5cbf6c144c1c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:51.206973 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce341b25-a0ad-40b5-a29e-5cbf6c144c1c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1214 microversion: 2.1 time: 0.213395 Jul 20 11:04:51.215038 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1842/3624] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:50 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:51.220673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:51.228320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:51.242374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:51.250108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:51.251250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:51.251870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:51.574650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:04:51.575902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:04:51.577074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:04:51.577604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:04:51.578144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:04:51.598252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:51.598790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:51.605724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:51.606303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:51.628105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Getting quotas for project 168c3b3145174f7b83908c36d6347f42. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:04:51.635557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Getting quotas for user ed728f164a8c48bab486971c6371a145 and project 168c3b3145174f7b83908c36d6347f42. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:04:51.663885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:04:51.674457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:04:51.776330 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44a33307-f04b-49e4-9d07-9da46e61e8d2 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929430 Jul 20 11:04:51.781803 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1783/3625] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:04:51.793054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-545e4537-2a39-4f34-9f3c-583dae6a1801 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:51.796714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-545e4537-2a39-4f34-9f3c-583dae6a1801 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:52.490449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-545e4537-2a39-4f34-9f3c-583dae6a1801 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:52.504553 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-545e4537-2a39-4f34-9f3c-583dae6a1801 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1214 microversion: 2.1 time: 0.719737 Jul 20 11:04:52.505652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1784/3626] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:51 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1214 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:52.510400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:52.511017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:52.520476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:52.521236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:52.522471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:52.523233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:52.868432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:52.880733 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5d07b3fc-540c-4ce2-9e6e-b59f1132dcae tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 1.664281 Jul 20 11:04:52.882389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1843/3627] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:51 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:52.891493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:52.892492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:52.906146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:52.908109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:52.911082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:52.911861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:52.914796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:52.933978 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2981d78a-3968-4d0f-95d5-9663a94ebd4f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.427163 Jul 20 11:04:52.953883 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1785/3628] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:52 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:52.961400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-94d15785-1783-4661-996f-d7398d08de30 req-67294679-987c-40e6-a583-37478e405e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9551e7fa-23a0-4481-b8dc-699f20cad7f4", "name": "network-vif-plugged", "status": "completed", "tag": "330484e6-bbe2-4871-a298-e6b70406be9f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:52.987449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-94d15785-1783-4661-996f-d7398d08de30 req-67294679-987c-40e6-a583-37478e405e29 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:52.987889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-94d15785-1783-4661-996f-d7398d08de30 req-67294679-987c-40e6-a583-37478e405e29 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:53.021829 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-94d15785-1783-4661-996f-d7398d08de30 req-67294679-987c-40e6-a583-37478e405e29 service nova] Creating event network-vif-plugged:330484e6-bbe2-4871-a298-e6b70406be9f for instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 on n-h2-846219-10 Jul 20 11:04:53.035538 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-94d15785-1783-4661-996f-d7398d08de30 req-67294679-987c-40e6-a583-37478e405e29 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078682 Jul 20 11:04:53.040634 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1786/3629] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:53.222341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:53.238316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05e0ccd7-3fdb-4136-8845-2aeb553e38a0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1272 microversion: 2.1 time: 0.354001 Jul 20 11:04:53.240016 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1844/3630] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:52 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:53.523244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:53.524208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:53.538836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:53.539513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:53.540436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:53.541015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:53.764403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:53.786970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffda592f-e586-4e9b-aaf1-c325225ef5ea tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1274 microversion: 2.1 time: 0.268357 Jul 20 11:04:53.794585 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1787/3631] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:53 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1274 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:53.905256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:53.907866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:53.933117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:53.933709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:53.934952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:53.936340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:53.954173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:53.954802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:53.969030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:53.969517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:53.970463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:53.970904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:54.532013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:54.540465 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1b5508a-451f-4d96-b2e9-78a82bee3f81 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.590749 Jul 20 11:04:54.547146 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1788/3632] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:53 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:04:54.552032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:54.557620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:54.566667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:54.567122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:54.567927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:54.568357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:54.585179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:54.602203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2916259b-f434-45f4-9793-2367ae1282c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1316 microversion: 2.1 time: 0.706183 Jul 20 11:04:54.616407 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1845/3633] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:53 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:54.748483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:54.757589 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0b29512-30da-4191-8b5c-c6fee111e666 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1272 microversion: 2.1 time: 0.209303 Jul 20 11:04:54.768123 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1789/3634] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:54 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:54.813111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:54.814149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:54.854041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:54.854516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:54.855350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:54.855797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:55.118852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:55.155981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-300c9cd8-d197-46c9-b7f5-339e94c7e42c tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1272 microversion: 2.1 time: 0.347246 Jul 20 11:04:55.159405 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1846/3635] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:54 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:55.575912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:55.578403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:55.596881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:55.597725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:55.598945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:55.599701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:55.628298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:55.629160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:55.646545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:55.647476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:55.650082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:55.653181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:56.184861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:56.202351 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e20e7d58-485d-4e6e-960c-907e78ecdc50 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.642089 Jul 20 11:04:56.205665 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1790/3636] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:55 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:04:56.211786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:56.212582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:56.223668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:56.224513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:56.227469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:56.228211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:56.251350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:56.266008 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3242d283-dd63-4ff5-96d8-394567de2913 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.646956 Jul 20 11:04:56.269714 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1847/3637] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:55 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:56.279508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:56.282649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:56.305224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:56.307273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:56.308456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:56.308912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:56.509147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:56.532039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c28bd34-ef5b-4e51-b77a-27be755256e8 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1272 microversion: 2.1 time: 0.256424 Jul 20 11:04:56.534448 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1848/3638] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:56 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:56.569346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-608008381", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:56.656765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] validate_networks() for [('27c7b58b-4f85-421a-aaca-e450cd9c7adf', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:04:57.135728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:57.149792 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-abf22d83-3c82-4376-b8e3-c4910fa14de9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.942825 Jul 20 11:04:57.160820 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1791/3639] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:56 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:57.221584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:57.222369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:57.231612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:57.232070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:57.234791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:57.236664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:58.075557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:58.094986 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dcd99488-60da-4873-9e8d-999adcab2367 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.877293 Jul 20 11:04:58.105642 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1792/3640] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:57 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:58.114610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:58.119981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:58.140886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:58.142155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:58.143190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:58.143849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:58.708085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:04:58.708965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:04:58.709700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:04:58.711143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:04:58.712509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:04:58.743444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:58.744198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:58.745433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:58.746017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:58.774849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Getting quotas for project dd30cad7692d421aac0440ee0f4d3d73. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:04:58.785734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Getting quotas for user 4f42fd8232fe4c57873fe233ef39af9c and project dd30cad7692d421aac0440ee0f4d3d73. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:04:58.827443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:04:58.830739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:04:58.901308 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8366b52d-c2ff-4a9c-b2f8-14c81a14b8ff tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336161 Jul 20 11:04:58.912033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1849/3641] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:04:58.918126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:58.920518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:58.931144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:58.932739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:58.934317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:58.935609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:59.474743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:59.500441 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e2f4c48-02f2-4739-bb91-f6a82ae5ae96 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 1.392461 Jul 20 11:04:59.504892 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1793/3642] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:58 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:59.513280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3c94c9b0-b61b-4c74-bca4-d247d38c29df req-b614290e-ac72-4889-87db-68f229a319dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b35049c-be9d-4dbe-9def-b91aded44119", "tag": "ead462fd-6d3c-49aa-9938-5258b5378382"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:04:59.534978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c94c9b0-b61b-4c74-bca4-d247d38c29df req-b614290e-ac72-4889-87db-68f229a319dc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:59.536907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c94c9b0-b61b-4c74-bca4-d247d38c29df req-b614290e-ac72-4889-87db-68f229a319dc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:59.560094 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3c94c9b0-b61b-4c74-bca4-d247d38c29df req-b614290e-ac72-4889-87db-68f229a319dc service nova] Creating event network-changed:ead462fd-6d3c-49aa-9938-5258b5378382 for instance 9b35049c-be9d-4dbe-9def-b91aded44119 on n-h2-846219-10 Jul 20 11:04:59.568524 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3c94c9b0-b61b-4c74-bca4-d247d38c29df req-b614290e-ac72-4889-87db-68f229a319dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061640 Jul 20 11:04:59.569751 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1794/3643] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:04:59.575471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:59.577064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:59.585460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:59.587670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:59.590640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:59.593127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:59.644968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:59.658150 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c3da75a1-7808-483a-b01f-0d8e44106037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.744637 Jul 20 11:04:59.660350 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1850/3644] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:58 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:04:59.680264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:04:59.681091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:04:59.689128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:59.689728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:59.690616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:04:59.691128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:04:59.850315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:04:59.863811 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e48c1f50-4b16-4742-b8ed-a1b0aff9d211 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1220 microversion: 2.1 time: 0.289382 Jul 20 11:04:59.865402 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1795/3645] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:59 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1220 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:00.067582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:00.081928 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e4218da-7b24-4f0a-8a31-4674936a8951 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.420110 Jul 20 11:05:00.095645 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1851/3646] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:04:59 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:00.520715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:00.521335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:00.533145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:00.533490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:00.534496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:00.537624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:00.677832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:00.678479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:00.694900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:00.695425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:00.696220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:00.696657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:01.471344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:01.484594 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b8161818-28e9-41ff-8790-59447d09fb77 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.967342 Jul 20 11:05:01.485965 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1796/3647] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:00 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:01.499431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:01.501044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:01.518910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:01.521593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:01.525330 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-48815486-2e4c-4ca6-8ebf-fe7f82a838ef tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.851203 Jul 20 11:05:01.535003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:01.536940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:01.537410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:01.539602 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1852/3648] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:00 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:01.547505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-fa4f6198-f738-43d6-94f2-a2ea9cf15296 req-28be309d-3672-42a9-9b69-8176e06ead0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5340fed-4d03-4bff-8e61-64dda580dc32", "tag": "988d3305-a284-49bf-a6ae-497fac0321bb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:01.570553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fa4f6198-f738-43d6-94f2-a2ea9cf15296 req-28be309d-3672-42a9-9b69-8176e06ead0e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:01.570983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fa4f6198-f738-43d6-94f2-a2ea9cf15296 req-28be309d-3672-42a9-9b69-8176e06ead0e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:01.595879 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-fa4f6198-f738-43d6-94f2-a2ea9cf15296 req-28be309d-3672-42a9-9b69-8176e06ead0e service nova] Creating event network-changed:988d3305-a284-49bf-a6ae-497fac0321bb for instance f5340fed-4d03-4bff-8e61-64dda580dc32 on n-h1-846219-10 Jul 20 11:05:01.605052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-fa4f6198-f738-43d6-94f2-a2ea9cf15296 req-28be309d-3672-42a9-9b69-8176e06ead0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063654 Jul 20 11:05:01.607106 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1853/3649] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:01.614768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:01.615933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:01.619879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:01.629204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:01.631614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:01.636485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:01.637365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:01.804315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:01.817865 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a267b5dc-c50d-4377-86f7-aea86cb2254b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1274 microversion: 2.1 time: 0.330575 Jul 20 11:05:01.818479 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1797/3650] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:01 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1274 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:02.391512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:02.435032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:02.443117 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0eb398d8-3208-4e78-a8b4-0a5c94e4683f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.833341 Jul 20 11:05:02.444174 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1854/3651] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:01 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:02.502934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:02.504679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:02.528363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:02.536211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:02.539974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:02.546966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:02.547957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:02.553259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:02.553849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:02.572766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:02.574247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:02.576492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:02.578458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:02.623687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:03.146500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:03.195343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:03.200426 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9892ad17-869f-4c58-b303-c09465b3d7e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.658487 Jul 20 11:05:03.210641 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1855/3652] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:02 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:03.210641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:03.215315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:03.217940 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a189066-a686-4f8c-82b0-bb14757f8d70 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.719807 Jul 20 11:05:03.218922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1798/3653] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:02 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:03.246270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:03.248050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:03.250635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:03.251345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:03.370733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:03.390418 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c9458c09-fb23-49d9-b96c-a35081b62d50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1274 microversion: 2.1 time: 0.186249 Jul 20 11:05:03.392506 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1856/3654] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:03 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:03.470467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:03.471619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:03.502461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:03.503227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:03.510729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:03.511486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:04.220513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:04.222183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:04.234574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:04.240382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:04.241537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:04.242151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:04.629175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:04.645223 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-893b476a-5046-438c-b293-aa63cb072080 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 1.181751 Jul 20 11:05:04.645845 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1799/3655] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:03 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:04.662252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:04.663260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:04.677072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:04.678360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:04.679501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:04.680111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:05.070455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:05.093186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9fa653df-6da2-4fa8-96eb-b491ae01cf77 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.878643 Jul 20 11:05:05.094520 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1857/3656] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:04 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:05.102121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:05.103050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:05.112661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:05.115796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:05.117019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:05.118884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:05.119689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:05.129807 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d50cc51-aeb8-47a3-b0c4-84f80b2a7d7a tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.478507 Jul 20 11:05:05.130660 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1800/3657] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:04 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:05.657940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:05.667619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:05.668259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:05.670691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-141ae41a-582e-40f5-985d-f3d1b0ef8a7d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 0.573976 Jul 20 11:05:05.672532 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1858/3658] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:05 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:05.683125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:05.683858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:05.684805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:05.685605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:06.120456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:06.127655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:06.141691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:06.170780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:06.173217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:06.175277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:06.179787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:06.191771 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d85dec8-1298-4f2f-8ba6-3764326b0d02 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.529401 Jul 20 11:05:06.203750 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1801/3659] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:05 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:06.209012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:06.209812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:06.217591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:06.218242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:06.219189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:06.219771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:06.902902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:06.907156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:06.922308 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94cbecd3-793b-4727-b77e-5b20c27beff0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.815595 Jul 20 11:05:06.925347 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1859/3660] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:06 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:06.940916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:06.944160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:06.955220 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5cab17ed-1a8c-4d31-946e-d4777d057c87 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.747697 Jul 20 11:05:06.956316 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1802/3661] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:06 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:06.974715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:06.975353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:06.976336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:06.977611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:07.211536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:07.211754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:07.222158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:07.222966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:07.224941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:07.225956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:08.065047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:08.080778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7978fa89-d79d-41d2-b0db-a32c0ac448a2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 1.153181 Jul 20 11:05:08.090306 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1860/3662] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:06 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:08.096903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-40551a8e-1df3-4cd2-8055-718560bf4e74 req-334b81a1-73dc-46fc-8474-782a29a69fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb24fea-a124-42dd-9106-a0f0b57ca0bc", "tag": "e9bd3b03-8108-4099-898e-57c311501739"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:08.118326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:08.126209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-40551a8e-1df3-4cd2-8055-718560bf4e74 req-334b81a1-73dc-46fc-8474-782a29a69fb4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:08.126507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-40551a8e-1df3-4cd2-8055-718560bf4e74 req-334b81a1-73dc-46fc-8474-782a29a69fb4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:08.131740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a8b37ae-e55d-4db5-9f7a-07600777ac7f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.924999 Jul 20 11:05:08.132540 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1803/3663] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:07 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:08.137418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:08.142146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:08.156506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:08.157210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:08.158129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:08.158711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:08.179249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-40551a8e-1df3-4cd2-8055-718560bf4e74 req-334b81a1-73dc-46fc-8474-782a29a69fb4 service nova] Creating event network-changed:e9bd3b03-8108-4099-898e-57c311501739 for instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc on n-h2-846219-10 Jul 20 11:05:08.193091 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-40551a8e-1df3-4cd2-8055-718560bf4e74 req-334b81a1-73dc-46fc-8474-782a29a69fb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109973 Jul 20 11:05:08.194041 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1861/3664] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:08.199285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:08.199998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:08.229437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:08.229905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:08.230712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:08.231150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:08.677333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:08.687968 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ca05acf1-5d17-4563-a289-3c6182815e7a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.554170 Jul 20 11:05:08.688833 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1804/3665] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:08 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:08.725938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:08.743946 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61650bf4-0c2e-40d5-a77f-5d4ab5162b14 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.546687 Jul 20 11:05:08.745151 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1862/3666] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:08 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:09.100038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:09.101425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:09.113139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.113728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.116720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.117890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.149962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:09.151618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:09.165706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:09.175682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:09.181181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.182202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.186302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.188594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.636301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:09.651438 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-11e9c6d0-07ba-47c6-87ab-48e30475b516 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.505996 Jul 20 11:05:09.660710 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1863/3667] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:09 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:09.674577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0fe21f14-a295-4586-a015-6f2736f9494d req-1ffae3ed-a9a1-408f-9e89-c8f68586b9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b35049c-be9d-4dbe-9def-b91aded44119", "name": "network-vif-plugged", "status": "completed", "tag": "ead462fd-6d3c-49aa-9938-5258b5378382"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:09.694832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:09.707643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-42c0328e-9b06-4040-b293-4c65e87aa3a7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 0.612392 Jul 20 11:05:09.713714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0fe21f14-a295-4586-a015-6f2736f9494d req-1ffae3ed-a9a1-408f-9e89-c8f68586b9f4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.715663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0fe21f14-a295-4586-a015-6f2736f9494d req-1ffae3ed-a9a1-408f-9e89-c8f68586b9f4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.716507 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1805/3668] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:09 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:09.730568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:09.745954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:09.754196 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0fe21f14-a295-4586-a015-6f2736f9494d req-1ffae3ed-a9a1-408f-9e89-c8f68586b9f4 service nova] Creating event network-vif-plugged:ead462fd-6d3c-49aa-9938-5258b5378382 for instance 9b35049c-be9d-4dbe-9def-b91aded44119 on n-h2-846219-10 Jul 20 11:05:09.764911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.765544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.768010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.771734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.773260 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0fe21f14-a295-4586-a015-6f2736f9494d req-1ffae3ed-a9a1-408f-9e89-c8f68586b9f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110312 Jul 20 11:05:09.776840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1864/3669] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:09.790680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:09.797335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:09.837749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.838209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:09.846449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:09.849732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:10.384891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:10.401484 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62735bab-dcc7-41eb-9a2d-f3434bf18c4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 0.679067 Jul 20 11:05:10.402099 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1806/3670] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:09 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:10.476885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:10.499869 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fdf5c2ce-1da2-465c-bd88-b10d4540dab5 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.717432 Jul 20 11:05:10.500836 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1865/3671] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:09 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:10.673730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:10.674659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:10.687268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:10.687986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:10.690998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:10.692713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:10.736414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:10.744286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:10.777227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:10.784331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:10.786976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:10.787772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:11.401821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:11.410876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:11.420516 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe2be772-90f1-40b0-a984-27eb45bc461a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 0.688756 Jul 20 11:05:11.421194 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1866/3672] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:10 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:11.425944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:11.427867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:11.440991 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e68ee54a-9815-46d2-919c-77b2db84fa53 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.770054 Jul 20 11:05:11.452979 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1807/3673] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:10 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:11.462656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:11.463401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:11.464328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:11.466582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:11.521310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:11.531405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:11.561680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:11.581306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:11.587475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:11.588115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:12.689250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:12.737648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9cd09ea4-c1a3-4341-8c11-710b6298f3b6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1314 microversion: 2.1 time: 1.315023 Jul 20 11:05:12.738478 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1867/3674] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:11 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1314 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:12.748529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1ad157b4-24ee-44c6-9820-7160d81eb507 req-629bd348-6ff6-4317-8870-49d355f57515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5340fed-4d03-4bff-8e61-64dda580dc32", "name": "network-vif-plugged", "status": "completed", "tag": "988d3305-a284-49bf-a6ae-497fac0321bb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:12.767508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1ad157b4-24ee-44c6-9820-7160d81eb507 req-629bd348-6ff6-4317-8870-49d355f57515 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:12.770527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1ad157b4-24ee-44c6-9820-7160d81eb507 req-629bd348-6ff6-4317-8870-49d355f57515 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:12.786461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:12.804950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1ad157b4-24ee-44c6-9820-7160d81eb507 req-629bd348-6ff6-4317-8870-49d355f57515 service nova] Creating event network-vif-plugged:988d3305-a284-49bf-a6ae-497fac0321bb for instance f5340fed-4d03-4bff-8e61-64dda580dc32 on n-h1-846219-10 Jul 20 11:05:12.816095 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-609c4fb9-14ac-4d3d-b33d-dae2db9832c1 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 1.299662 Jul 20 11:05:12.817795 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1ad157b4-24ee-44c6-9820-7160d81eb507 req-629bd348-6ff6-4317-8870-49d355f57515 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077053 Jul 20 11:05:12.822307 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1808/3675] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:11 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:12.830018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1868/3676] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:12.837705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:12.839196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:12.840472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:12.841242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:12.865043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:12.875030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:12.878029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:12.878873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:12.880781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:12.884132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:12.885283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:12.887629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:13.398291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:13.400595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:13.411260 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e922209a-0047-4b8b-82c3-5aad2d0ce22f tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.578764 Jul 20 11:05:13.411633 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1869/3677] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:12 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:13.415793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a898f14b-be13-43bc-9fe4-cc0298ffba95 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 0.591793 Jul 20 11:05:13.416577 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1809/3678] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:12 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:13.756685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:13.759620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:13.805150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:13.808432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:13.811345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:13.813323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:13.835623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:13.836275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:13.865248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:13.865710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:13.866515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:13.866958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:14.312985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:14.326311 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2361acd3-fdcc-4fc1-9639-2dbbc7a0af06 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1314 microversion: 2.1 time: 0.493824 Jul 20 11:05:14.327877 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1810/3679] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:13 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:14.332506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:14.345481 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f38481ed-1b48-4827-b252-dfba37e75db5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1502 microversion: 2.1 time: 0.593949 Jul 20 11:05:14.353606 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1870/3680] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:13 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1502 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:14.362372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:14.362881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:14.370107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:14.370567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:14.371522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:14.371973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:14.429932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:14.430566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:14.445133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:14.445790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:14.447592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:05:14.448928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:14.449565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:14.653241 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd6b6e49-f3b8-451d-8f72-f879de75b369 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 204 len: 0 microversion: 2.1 time: 0.292623 Jul 20 11:05:14.656508 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1811/3681] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:05:14 2022] DELETE /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:05:14.683459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:14.688054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:14.701667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:14.704815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:14.706161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:14.706772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:15.117793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:15.150386 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-01299179-d9f0-45aa-aaaf-d572b3a80231 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1516 microversion: 2.1 time: 0.724843 Jul 20 11:05:15.153350 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1871/3682] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:14 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1516 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:15.181670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:15.183015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:15.201263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:15.202479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:15.203664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:15.205750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:15.379328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:15.388537 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e25e031c-0e04-4121-8dec-8cc035aff5b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 0.730461 Jul 20 11:05:15.392762 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1812/3683] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:14 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:15.587637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:15.598264 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f73eaafd-d865-4b37-b016-5cfaa347d918 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 200 len: 1508 microversion: 2.1 time: 0.441844 Jul 20 11:05:15.618545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1076903499", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:15.627726 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1872/3684] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:15 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 1508 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:15.632330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:15.632948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:15.639088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:15.639410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:15.640387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:15.641639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:15.651054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:15.702368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:15.741242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] validate_networks() for [('0764bf2e-3783-4ec1-ab92-a9cc66dd183c', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:05:16.959949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:16.976897 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a05bbff-cfb2-4b0c-96b3-3b9238b461fb tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1464 microversion: 2.1 time: 1.341165 Jul 20 11:05:16.978176 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1873/3685] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:15 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1464 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:16.991528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:16.994192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:17.022160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:17.022624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:17.038062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:17.039661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:18.992441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:19.004604 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c447b0fe-a47d-4c84-a1f8-0814efcb0737 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 2.024662 Jul 20 11:05:19.019319 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1874/3686] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:16 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:19.026561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:19.032050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:19.037925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:19.047611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.051854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.052840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.053829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.574941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:19.589895 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-312d497b-7a64-473e-95d4-def87f5adc24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1316 microversion: 2.1 time: 0.569258 Jul 20 11:05:19.590742 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1875/3687] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:19 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:19.604776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:19.607675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:19.621621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.625908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.626823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.633054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.678004 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 HTTP/1.1 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9b35049c-be9d-4dbe-9def-b91aded44119'} Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:19.682121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:05:19.686279 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:19.693727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:19.695345 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-214dbb5e-c933-4224-90a7-6f75c545553f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 404 len: 111 microversion: 2.1 time: 0.102410 Jul 20 11:05:19.697310 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1876/3688] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:19 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:05:19.714546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29805ef3-4042-45bf-a233-51a576c2b276", "device": "/dev/sdb"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:19.718333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:19.727373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.728311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.729316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.729960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.744474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:05:19.747209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:05:19.751332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:05:19.751754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:05:19.752189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:05:19.802050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.804001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.806854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:19.816013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:19.886098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Getting quotas for project b7c5aa76c0ae494d89540818d2e2b9e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:05:19.906611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Getting quotas for user 01b37285feef4c32bf65656897772be3 and project b7c5aa76c0ae494d89540818d2e2b9e4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:05:19.946466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:05:19.955128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:05:20.072253 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ab552dcc-95ce-4cdf-91f0-9deab5dcb01b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.677982 Jul 20 11:05:20.074763 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1813/3689] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 4681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:05:20.082582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fcb458a9-7686-448f-a826-4a47865c6ab6 req-d3baf65c-d136-49fa-ac46-9ace7eb352dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb24fea-a124-42dd-9106-a0f0b57ca0bc", "name": "network-vif-plugged", "status": "completed", "tag": "e9bd3b03-8108-4099-898e-57c311501739"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:20.098300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fcb458a9-7686-448f-a826-4a47865c6ab6 req-d3baf65c-d136-49fa-ac46-9ace7eb352dd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:20.099158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fcb458a9-7686-448f-a826-4a47865c6ab6 req-d3baf65c-d136-49fa-ac46-9ace7eb352dd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:20.104990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:20.116197 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fcb458a9-7686-448f-a826-4a47865c6ab6 req-d3baf65c-d136-49fa-ac46-9ace7eb352dd service nova] Creating event network-vif-plugged:e9bd3b03-8108-4099-898e-57c311501739 for instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc on n-h2-846219-10 Jul 20 11:05:20.122879 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fcb458a9-7686-448f-a826-4a47865c6ab6 req-d3baf65c-d136-49fa-ac46-9ace7eb352dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045352 Jul 20 11:05:20.149506 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1814/3690] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:20.168823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d91eadd4-4750-4d29-92b3-10d9c5f84664 req-d79183f1-9160-45a8-ac36-935f57a5ca41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b35049c-be9d-4dbe-9def-b91aded44119", "name": "network-vif-deleted", "tag": "ead462fd-6d3c-49aa-9938-5258b5378382"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:20.259614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d91eadd4-4750-4d29-92b3-10d9c5f84664 req-d79183f1-9160-45a8-ac36-935f57a5ca41 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:20.260450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d91eadd4-4750-4d29-92b3-10d9c5f84664 req-d79183f1-9160-45a8-ac36-935f57a5ca41 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:20.298863 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d91eadd4-4750-4d29-92b3-10d9c5f84664 req-d79183f1-9160-45a8-ac36-935f57a5ca41 service nova] Creating event network-vif-deleted:ead462fd-6d3c-49aa-9938-5258b5378382 for instance 9b35049c-be9d-4dbe-9def-b91aded44119 on n-h2-846219-10 Jul 20 11:05:20.306640 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d91eadd4-4750-4d29-92b3-10d9c5f84664 req-d79183f1-9160-45a8-ac36-935f57a5ca41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153625 Jul 20 11:05:20.308712 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1815/3691] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:20.318384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-562351287", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:20.431950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:05:20.437734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bf4e1d49-c747-4bd7-94dc-5c6d8e083979 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "POST /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737542 Jul 20 11:05:20.459139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1877/3692] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:05:19 2022] POST /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:20.477011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:20.489370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:20.503089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:20.509775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:20.510772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:20.511320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.273814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:22.283409 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13948f92-e21f-4c49-968e-a8b79d05dbd2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 1.822425 Jul 20 11:05:22.288051 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1878/3693] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:20 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:22.309111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:22.310526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:22.325979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:22.326762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.327625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:22.328243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.465281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:05:22.467287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:05:22.467946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:05:22.469076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:05:22.470188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:05:22.505208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:22.510243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.513281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:22.515832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.585354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:05:22.598998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:22.607747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:05:22.623494 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65f8e07e-8cb2-4805-9da7-b4c80cff5a37 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1275 microversion: 2.1 time: 0.330345 Jul 20 11:05:22.634697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1879/3694] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:22 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:22.647552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:05:22.651984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:22.655141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:22.657495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:05:22.681251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:22.681897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.688757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:22.691728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:22.805897 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65e7232c-1ddd-4abc-b856-dd7ecc5281f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.494498 Jul 20 11:05:22.812817 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1816/3695] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:05:22.847808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c1ae4c9-5e92-42a6-a511-21f3d131d724 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:22.848471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c1ae4c9-5e92-42a6-a511-21f3d131d724 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:23.135433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c1ae4c9-5e92-42a6-a511-21f3d131d724 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:23.143257 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c1ae4c9-5e92-42a6-a511-21f3d131d724 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1214 microversion: 2.1 time: 0.326654 Jul 20 11:05:23.147583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1817/3696] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:22 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:23.260899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b24d5473-e42e-4889-b88b-091d2d21670b req-bb77f6e4-e551-4ba7-9fa6-dd0823f9a630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77652f95-882f-4c86-b7ec-beeda4e2d8d1", "name": "network-vif-unplugged", "status": "completed", "tag": "ff0f0239-a279-4aec-9042-6a6a6793c981"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:23.291114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b24d5473-e42e-4889-b88b-091d2d21670b req-bb77f6e4-e551-4ba7-9fa6-dd0823f9a630 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:23.292045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b24d5473-e42e-4889-b88b-091d2d21670b req-bb77f6e4-e551-4ba7-9fa6-dd0823f9a630 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:23.318007 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b24d5473-e42e-4889-b88b-091d2d21670b req-bb77f6e4-e551-4ba7-9fa6-dd0823f9a630 service nova] Creating event network-vif-unplugged:ff0f0239-a279-4aec-9042-6a6a6793c981 for instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 on n-h1-846219-10 Jul 20 11:05:23.333092 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b24d5473-e42e-4889-b88b-091d2d21670b req-bb77f6e4-e551-4ba7-9fa6-dd0823f9a630 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076429 Jul 20 11:05:23.360294 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1818/3697] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:05:23.385322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:23.385812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:23.417761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:23.418462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:23.424248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:23.424898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:23.655361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:23.670438 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9971b81b-b259-46bb-aa5c-222408223c5d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1504 microversion: 2.1 time: 1.033068 Jul 20 11:05:23.673547 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1880/3698] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:22 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1504 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:23.697054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:23.700159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:23.718880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:23.719893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:23.720702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:23.721144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.114253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:24.150379 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31bdb2e8-00fb-4a11-a176-d9e712a667b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1281 microversion: 2.1 time: 0.474926 Jul 20 11:05:24.151765 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1881/3699] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:23 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1281 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:24.175591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:24.176319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:24.187119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:24.187688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.188651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:24.189103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.226601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:05:24.302420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:24.316877 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-32de5986-a175-4490-a5a8-c5ce0ca5ccda tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 0.954932 Jul 20 11:05:24.317937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1819/3700] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:23 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:24.332669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:24.335753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:24.355079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:24.360734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.362492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:24.364776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.376797 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0091520f-e3f8-406d-bb4e-5b970b1de23c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 204 len: 0 microversion: 2.1 time: 0.223449 Jul 20 11:05:24.384893 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1882/3701] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:05:24 2022] DELETE /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:05:24.399753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:24.402883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:24.449893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:24.451780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.455798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:24.459049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:24.695763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:24.704503 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7cf16141-0a5d-4a07-a626-9349ed209c3d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1266 microversion: 2.1 time: 0.384200 Jul 20 11:05:24.707944 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1820/3702] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:24 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:25.172948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:25.173575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:25.190427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:25.191031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:25.192025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:25.196488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:26.650962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:26.663847 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94bb042f-8e36-4332-a5f5-5cf4cfa8261b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1510 microversion: 2.1 time: 2.274710 Jul 20 11:05:26.675815 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1883/3703] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:24 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1510 bytes in 2288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:26.689738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:26.691339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:26.710210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:26.710933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:26.711924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:26.713530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:27.623314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:27.695289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35e598e0-9c48-4880-b216-f0a9478a6c5d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 1.015880 Jul 20 11:05:27.698609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1884/3704] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:26 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:27.742284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:27.743367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:27.771791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:27.772580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:27.773908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:27.774671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:27.787254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:27.804887 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e58b0c58-ed91-42cf-bc56-405c20ae4fca tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 2.636740 Jul 20 11:05:27.813592 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1821/3705] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:25 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:27.824425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:27.827900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:27.849373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:27.852013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:27.858893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:27.859769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:27.920005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:27.921260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:27.923122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lazy-loading 'fault' on Instance uuid 2bb24fea-a124-42dd-9106-a0f0b57ca0bc {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:05:28.737760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:28.750324 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f7ee8ea-6089-448c-b982-4b0c26ef39aa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 200 len: 1306 microversion: 2.1 time: 0.934304 Jul 20 11:05:28.750939 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1822/3706] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:27 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 1306 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:28.766858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c11943a4-c6e1-4783-b061-faec881ac500 req-23f3fef1-22d3-4a41-97ab-dab736894abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb24fea-a124-42dd-9106-a0f0b57ca0bc", "name": "network-vif-deleted", "tag": "e9bd3b03-8108-4099-898e-57c311501739"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:28.780474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:28.788546 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-63ffcabd-36c6-4a09-94f7-361004c3354f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1272 microversion: 2.1 time: 1.074016 Jul 20 11:05:28.799830 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1885/3707] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:27 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1272 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:28.810258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c11943a4-c6e1-4783-b061-faec881ac500 req-23f3fef1-22d3-4a41-97ab-dab736894abd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:28.810258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c11943a4-c6e1-4783-b061-faec881ac500 req-23f3fef1-22d3-4a41-97ab-dab736894abd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:28.812786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:28.813624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:28.844347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:28.845911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:28.848511 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c11943a4-c6e1-4783-b061-faec881ac500 req-23f3fef1-22d3-4a41-97ab-dab736894abd service nova] Creating event network-vif-deleted:e9bd3b03-8108-4099-898e-57c311501739 for instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc on n-h2-846219-10 Jul 20 11:05:28.850415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:28.854656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:28.874944 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c11943a4-c6e1-4783-b061-faec881ac500 req-23f3fef1-22d3-4a41-97ab-dab736894abd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113186 Jul 20 11:05:28.879852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1823/3708] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:28.903683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:28.906687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:28.951603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:28.952349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:28.953347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:28.953947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:30.223803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:30.284986 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21d42766-e16e-4c27-93ce-07b901a61b21 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 1.401363 Jul 20 11:05:30.303202 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1824/3709] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:28 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:30.318931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:30.320133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:30.351999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:30.353561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:30.355128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:30.358091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:30.421815 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc HTTP/1.1 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2bb24fea-a124-42dd-9106-a0f0b57ca0bc'} Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:30.424762 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:30.428106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:30.439593 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d41225f2-6040-4028-af28-97d3d2ca24fa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 404 len: 111 microversion: 2.1 time: 0.132703 Jul 20 11:05:30.440469 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1825/3710] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:30 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:05:30.456548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:30.457707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:30.482603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:30.483986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:30.485666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:30.486725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:30.855067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:30.892345 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df279db3-15ba-4b8f-960d-e92e79239f92 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 2.097960 Jul 20 11:05:30.900926 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1886/3711] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:28 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:30.932061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:30.943782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:30.967120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:30.970245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:30.972288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:30.979589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:31.412189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:31.418654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:31.422607 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1d5afe6-606b-43f6-9d49-66e2469b7284 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.508511 Jul 20 11:05:31.433514 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1887/3712] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:30 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:31.462414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:31.463376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:31.495359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:31.497915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:31.500687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:31.501462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:31.668592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:31.681130 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-240ad70f-d61a-4255-8116-7af09b2130da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 1.231624 Jul 20 11:05:31.693168 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1826/3713] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:30 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:31.707309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-01e87ad3-be10-4512-a9a4-475d0ff68b27 req-ddd02f77-321d-46fe-ae06-1ef9e40f2e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:31.722827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-01e87ad3-be10-4512-a9a4-475d0ff68b27 req-ddd02f77-321d-46fe-ae06-1ef9e40f2e28 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:31.723862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-01e87ad3-be10-4512-a9a4-475d0ff68b27 req-ddd02f77-321d-46fe-ae06-1ef9e40f2e28 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:31.755811 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-01e87ad3-be10-4512-a9a4-475d0ff68b27 req-ddd02f77-321d-46fe-ae06-1ef9e40f2e28 service nova] Creating event network-changed:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:05:31.772704 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-01e87ad3-be10-4512-a9a4-475d0ff68b27 req-ddd02f77-321d-46fe-ae06-1ef9e40f2e28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067379 Jul 20 11:05:31.773625 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1827/3714] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:05:31.786077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ac03175-e1de-4f22-bb97-23fce79a5827 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ac03175-e1de-4f22-bb97-23fce79a5827 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 163 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": 12345, "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 12345 Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:05:31.807902 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 20 11:05:31.813135 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:31.814925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ac03175-e1de-4f22-bb97-23fce79a5827 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:31.816160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2ac03175-e1de-4f22-bb97-23fce79a5827 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.039710 Jul 20 11:05:31.827558 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1828/3715] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:31 2022] POST /compute/v2.1/servers => generated 127 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:05:31.836558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:31.837606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:31.851828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:31.852827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:31.853855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:31.854521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:32.554240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:33.143359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:33.393476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:33.408690 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7295d434-d839-47e8-9b30-b7d667795e8d tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 1.964334 Jul 20 11:05:33.411303 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1888/3716] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:31 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:33.426330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:33.427594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:33.438795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:33.439658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:33.440730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:33.441318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:33.797643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:33.814874 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c2a2639-137e-4906-80a4-66735efb3970 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.985510 Jul 20 11:05:33.818044 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1829/3717] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:31 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:33.987842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:34.003930 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c0d7546c-c0b2-4295-a821-11eab3d92387 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 0.584192 Jul 20 11:05:34.005163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1889/3718] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:33 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:34.026027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:34.034187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:34.053315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:34.054519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:34.059201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:34.060391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:34.079925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-521947551", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "a539ddc0-7dab-4c9a-91fe-b9f2c4322e19"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:34.172823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] validate_networks() for [('a539ddc0-7dab-4c9a-91fe-b9f2c4322e19', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:05:34.942790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:34.971971 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28983f1d-8a02-45d4-b37c-26baaf39a2f8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.959304 Jul 20 11:05:34.972679 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1890/3719] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:34 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:34.996274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:35.002175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:35.037761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.038322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.043609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.044664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.723768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:35.737270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cc69ebb8-f4a9-4a6a-8a13-43dc75c70d27 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.763403 Jul 20 11:05:35.752910 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1891/3720] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:34 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:35.782902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-29d82dce-7c03-4b82-89f0-b880a7859ff7 req-c6c1d5f2-434c-4a54-9e3a-87d8d5ea116c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77652f95-882f-4c86-b7ec-beeda4e2d8d1", "name": "network-vif-plugged", "status": "completed", "tag": "ff0f0239-a279-4aec-9042-6a6a6793c981"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:35.807851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-29d82dce-7c03-4b82-89f0-b880a7859ff7 req-c6c1d5f2-434c-4a54-9e3a-87d8d5ea116c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.808695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-29d82dce-7c03-4b82-89f0-b880a7859ff7 req-c6c1d5f2-434c-4a54-9e3a-87d8d5ea116c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.842519 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-29d82dce-7c03-4b82-89f0-b880a7859ff7 req-c6c1d5f2-434c-4a54-9e3a-87d8d5ea116c service nova] Creating event network-vif-plugged:ff0f0239-a279-4aec-9042-6a6a6793c981 for instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 on n-h1-846219-10 Jul 20 11:05:35.848745 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-29d82dce-7c03-4b82-89f0-b880a7859ff7 req-c6c1d5f2-434c-4a54-9e3a-87d8d5ea116c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088228 Jul 20 11:05:35.849861 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1892/3721] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:35.856764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:35.868252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:35.875830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.876660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.880070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:05:35.881711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:05:35.882406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:05:35.883052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:05:35.883696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:05:35.897788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.902438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.909986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.911836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.913373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:35.914083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:35.989794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Getting quotas for project 041b323d3dc84dc6bf8d3d195570de77. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:05:36.011933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Getting quotas for user 9ecfde6197a546efb78f381be42a9f10 and project 041b323d3dc84dc6bf8d3d195570de77. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:05:36.037244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:05:36.046986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:05:36.194080 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8bea7b5-1c8d-49f6-b25b-2adaea8868cb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368576 Jul 20 11:05:36.199761 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1830/3722] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:05:36.235756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5e34e58c-bc56-44fb-bcb7-ec1b8904d27f req-6070823d-ccb7-48a7-983d-75e483ae114c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688e2be6-67cd-49e5-bda0-5d5a2ed8343d", "tag": "528d0009-0440-449c-ac5f-9ec27f3a696c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:36.264317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e34e58c-bc56-44fb-bcb7-ec1b8904d27f req-6070823d-ccb7-48a7-983d-75e483ae114c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:36.266165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5e34e58c-bc56-44fb-bcb7-ec1b8904d27f req-6070823d-ccb7-48a7-983d-75e483ae114c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:36.311697 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5e34e58c-bc56-44fb-bcb7-ec1b8904d27f req-6070823d-ccb7-48a7-983d-75e483ae114c service nova] Creating event network-changed:528d0009-0440-449c-ac5f-9ec27f3a696c for instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d on n-h1-846219-10 Jul 20 11:05:36.322198 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5e34e58c-bc56-44fb-bcb7-ec1b8904d27f req-6070823d-ccb7-48a7-983d-75e483ae114c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120006 Jul 20 11:05:36.323578 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1831/3723] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:36.335023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:36.336369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:36.353981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:36.354710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:36.355786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:36.359401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:36.507741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:36.519584 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58190036-58e8-4d4a-9612-6541f5720371 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 0.668242 Jul 20 11:05:36.520764 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1893/3724] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:35 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:36.527625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:36.536128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:36.548145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:36.550521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:36.554712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:36.555544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:36.987009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:37.019394 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44547e89-0dd5-4f75-b695-52eb189f2870 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.496748 Jul 20 11:05:37.020218 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1894/3725] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:36 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:37.038161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dc0a0a5a-67e5-4126-8627-5ff2b662b322 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:37.039403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dc0a0a5a-67e5-4126-8627-5ff2b662b322 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:37.113079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:37.124029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97c877d9-95c2-4650-beea-9931a476b715 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 0.799023 Jul 20 11:05:37.129881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1832/3726] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:36 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:37.168164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dc0a0a5a-67e5-4126-8627-5ff2b662b322 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:37.185369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dc0a0a5a-67e5-4126-8627-5ff2b662b322 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1227 microversion: 2.1 time: 0.163059 Jul 20 11:05:37.201323 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1895/3727] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:37 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1227 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:37.551960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:37.552596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:37.575857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:37.576307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:37.586528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:37.586995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:37.938202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:37.959825 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-faba8138-b952-45f7-9bb0-c297e7387dbd tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 0.420535 Jul 20 11:05:37.974532 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1833/3728] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:37 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:38.049540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:38.051040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:38.062635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:38.066573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:38.068189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:38.068844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:38.146359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:38.148381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:38.168214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:38.189989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:38.217476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:38.219901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:38.722378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:38.737206 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-70cb5e23-697a-4261-a624-003363510aad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.694305 Jul 20 11:05:38.738054 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1896/3729] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:38 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:38.791880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:38.810423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:38.882389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:38.884542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:38.885883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:38.886684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:39.150903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:39.151620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:39.166665 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3d3fa7c2-3163-4d10-94e2-62b0eba31717 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 1.025193 Jul 20 11:05:39.167674 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1834/3730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:38 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:39.179081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:39.182450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:39.212456 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f6aab127-40a4-4a26-99ce-afca592b1dfc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1297 microversion: 2.1 time: 0.472869 Jul 20 11:05:39.215189 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1897/3731] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:38 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1297 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:39.218404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:39.219018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:39.219986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:39.220572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:39.757871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:39.763388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:39.789429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:39.790247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:39.796167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:39.796964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.084977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:40.100588 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe683ea0-a87d-4750-a8d4-c189523388c8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 0.931602 Jul 20 11:05:40.104291 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1835/3732] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:39 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:40.188465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:40.193428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:40.211634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:40.212092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.212904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:40.213345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.322631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:40.361435 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a87b615a-5ebb-4e1e-8047-d5584b13dd80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.609268 Jul 20 11:05:40.363676 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1898/3733] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:39 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:40.373326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f85fd4ed-c452-4c52-bdca-6057a7e8e10d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-975029846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1716a033-c952-4fcd-a7c3-73a0b59af5f2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:40.517358 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f85fd4ed-c452-4c52-bdca-6057a7e8e10d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Block Device 1716a033-c952-4fcd-a7c3-73a0b59af5f2 is not bootable. Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f85fd4ed-c452-4c52-bdca-6057a7e8e10d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 357 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-975029846", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "1716a033-c952-4fcd-a7c3-73a0b59af5f2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: exception: Block Device 1716a033-c952-4fcd-a7c3-73a0b59af5f2 is not bootable. Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-975029846', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '1716a033-c952-4fcd-a7c3-73a0b59af5f2'}], 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 1716a033-c952-4fcd-a7c3-73a0b59af5f2 is not bootable. Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:40.524631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 1716a033-c952-4fcd-a7c3-73a0b59af5f2 is not bootable. Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 1716a033-c952-4fcd-a7c3-73a0b59af5f2 is not bootable. Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f85fd4ed-c452-4c52-bdca-6057a7e8e10d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Block Device 1716a033-c952-4fcd-a7c3-73a0b59af5f2 is not bootable. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:40.528105 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f85fd4ed-c452-4c52-bdca-6057a7e8e10d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.161432 Jul 20 11:05:40.531330 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1899/3734] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:05:40.541203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:40.544070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:40.570421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:40.573180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.583379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:40.584367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.754874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:40.772328 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-35170e26-1077-475a-8582-602dc95e4876 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1285 microversion: 2.1 time: 0.240009 Jul 20 11:05:40.772932 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1900/3735] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:40 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:40.797002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:40.799678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:40.815270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:40.816090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.817496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:40.818246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:40.829747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:40.838470 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df2ddd83-4f33-4342-a804-0c951e1942eb tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 0.656954 Jul 20 11:05:40.844373 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1836/3736] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:40 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:41.121479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:41.123829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:41.140273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.141972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.145307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.151977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.189639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:41.201828 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7f3bf4d5-29df-458e-96e9-6233cba73baa tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.423177 Jul 20 11:05:41.203100 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1901/3737] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:40 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:41.250075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:41.250868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:41.268472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.273181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.274577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.275386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.526425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:41.542137 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-591f7774-2cdb-4b8c-9fe3-d5b12c77e5f4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 0.424772 Jul 20 11:05:41.547654 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1837/3738] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:41 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:41.552828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:41.561865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:41.594134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.594916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.601223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.612742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.666023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:41.683236 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aeb4882d-669a-49ad-9fe2-29fb0c713d6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.445186 Jul 20 11:05:41.685058 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1902/3739] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:41 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:41.690800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-cbe12705-930d-4fa1-8f3b-cfa819820f1d req-cdd6de6f-017a-47b0-ae8b-8a534153bc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "name": "network-vif-plugged", "status": "completed", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:41.703816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-cbe12705-930d-4fa1-8f3b-cfa819820f1d req-cdd6de6f-017a-47b0-ae8b-8a534153bc12 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.704701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-cbe12705-930d-4fa1-8f3b-cfa819820f1d req-cdd6de6f-017a-47b0-ae8b-8a534153bc12 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.716582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:41.745022 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-cbe12705-930d-4fa1-8f3b-cfa819820f1d req-cdd6de6f-017a-47b0-ae8b-8a534153bc12 service nova] Creating event network-vif-plugged:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:05:41.760042 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-cbe12705-930d-4fa1-8f3b-cfa819820f1d req-cdd6de6f-017a-47b0-ae8b-8a534153bc12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073069 Jul 20 11:05:41.760675 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1903/3740] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:41.800476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:41.803409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:41.829050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.831155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:41.836312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:41.836987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:42.108552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:42.137188 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0414689-c151-4cd1-88ca-8b5366833c76 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1285 microversion: 2.1 time: 0.348968 Jul 20 11:05:42.141644 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1904/3741] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:41 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:42.161927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:42.163763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:42.183979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:42.184688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:42.187352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:42.189688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:42.229543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:42.271840 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-858a94b8-1752-4a42-91e9-6a91d5ec342f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.722108 Jul 20 11:05:42.292566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1838/3742] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:41 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:42.573275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:42.574943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:42.598685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:42.609724 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f7fd3479-3483-4919-89f7-da16fbb25e35 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1522 microversion: 2.1 time: 0.466357 Jul 20 11:05:42.616895 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1905/3743] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:42 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:42.623101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:42.623917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:42.624825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:42.626215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:42.890210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:42.911514 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-326c6e98-04b5-4791-a20e-e6949c53f455 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1323 microversion: 2.1 time: 0.347302 Jul 20 11:05:42.912636 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1839/3744] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:42 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1323 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:43.156327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:43.158473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:43.190406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:43.194878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:43.197178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:43.199750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:43.302008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:43.302815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:43.318758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:43.319736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:43.322929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:43.323575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:43.357072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:43.367255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3cfc4316-5656-4a2a-9b34-0c44c4898391 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1285 microversion: 2.1 time: 0.215657 Jul 20 11:05:43.379665 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1906/3745] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:43 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:43.635210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:43.635832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:43.662176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:43.662672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:43.665277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:43.665733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:43.673858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:43.683896 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44c8ad42-fcdf-443a-a8c8-68ca1a17a474 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.386112 Jul 20 11:05:43.690482 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1840/3746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:43 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:43.933036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:43.934011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:43.978706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:43.997660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:44.000003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:44.011808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:44.018078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:44.656671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:44.665768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:44.684331 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad9e5340-56d8-4c5a-aa60-3806aa1bce4e tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1507 microversion: 2.1 time: 1.059829 Jul 20 11:05:44.692023 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1907/3747] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:43 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1507 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:44.706544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:44.707424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:44.723083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:44.734785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:44.736117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:44.739502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:45.226917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:45.239923 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f66862f5-405b-4810-ab9d-b3f258249510 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1518 microversion: 2.1 time: 1.312390 Jul 20 11:05:45.247768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1841/3748] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:43 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1518 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:45.253380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:45.259536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:45.271976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:45.281227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:45.282319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:45.282471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:45.283080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:45.303101 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-46325090-a3c6-43f9-a372-94cc01722204 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 0.609621 Jul 20 11:05:45.304728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1908/3749] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:44 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:45.338855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:45.339871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:45.363788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:45.365933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:45.369916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:45.371056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:45.952951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:46.023956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:46.129233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:46.143317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-70c84958-aebe-4fe4-aa87-1996da3f2e2f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.834942 Jul 20 11:05:46.143926 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1909/3750] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:45 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:46.158804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec6ba4dd-2613-4253-b495-846c83531966 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187869068", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "478de60b-94fe-4326-bea5-987154e218b6", "destination_type": "local"}, {"source_type": "volume", "uuid": "bd85e4cf-8032-43bf-8e7f-06c516c55934", "destination_type": "invalid"}], "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec6ba4dd-2613-4253-b495-846c83531966 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 494 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-187869068", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "478de60b-94fe-4326-bea5-987154e218b6", "destination_type": "local"}, {"source_type": "volume", "uuid": "bd85e4cf-8032-43bf-8e7f-06c516c55934", "destination_type": "invalid"}], "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-187869068', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '478de60b-94fe-4326-bea5-987154e218b6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'bd85e4cf-8032-43bf-8e7f-06c516c55934', 'destination_type': 'invalid'}], 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'invalid' Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:46.179709 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec6ba4dd-2613-4253-b495-846c83531966 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:46.183367 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec6ba4dd-2613-4253-b495-846c83531966 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.037374 Jul 20 11:05:46.187507 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1910/3751] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:46 2022] POST /compute/v2.1/servers => generated 155 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:05:46.208296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:46.209667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:46.233400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.234122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.237548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.238242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.242193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:46.252666 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23b76012-dd84-45d7-9e5f-20753f97532d tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 200 len: 1507 microversion: 2.1 time: 1.003228 Jul 20 11:05:46.253255 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1842/3752] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:45 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 1507 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:46.290464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4e7eb149-50ce-4c56-8327-20bb07706e87 req-078a8593-8ab8-4a86-8dff-f451c4cd3946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688e2be6-67cd-49e5-bda0-5d5a2ed8343d", "name": "network-vif-plugged", "status": "completed", "tag": "528d0009-0440-449c-ac5f-9ec27f3a696c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:46.313104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lazy-loading 'flavor' on Instance uuid cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:05:46.341387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4e7eb149-50ce-4c56-8327-20bb07706e87 req-078a8593-8ab8-4a86-8dff-f451c4cd3946 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.342089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4e7eb149-50ce-4c56-8327-20bb07706e87 req-078a8593-8ab8-4a86-8dff-f451c4cd3946 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.382372 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4e7eb149-50ce-4c56-8327-20bb07706e87 req-078a8593-8ab8-4a86-8dff-f451c4cd3946 service nova] Creating event network-vif-plugged:528d0009-0440-449c-ac5f-9ec27f3a696c for instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d on n-h1-846219-10 Jul 20 11:05:46.391313 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4e7eb149-50ce-4c56-8327-20bb07706e87 req-078a8593-8ab8-4a86-8dff-f451c4cd3946 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119925 Jul 20 11:05:46.393299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1843/3753] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:46.409507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:46.410424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:46.426173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.428057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.429311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.432585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.507249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ac7f355-b77a-47d6-b603-57e6d29dbefc tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action" status: 200 len: 32 microversion: 2.1 time: 0.312815 Jul 20 11:05:46.510193 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1911/3754] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:05:46 2022] POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:05:46.525024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:46.537337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:46.553164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.555201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.556830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.557492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.600600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:05:46.756664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe5374d3-0733-47ee-8074-c42534988dfe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 204 len: 0 microversion: 2.1 time: 0.243786 Jul 20 11:05:46.758265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1912/3755] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:05:46 2022] DELETE /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:05:46.766568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:46.767952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:46.777294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.779457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:46.780513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:46.781175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:47.171143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:48.995481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:49.007490 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab73bc17-28c7-40c9-be8d-da31cd6f7fbb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 2.247587 Jul 20 11:05:49.013272 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1913/3756] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:46 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 2254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:49.028848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:49.040721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80886da6-64b7-4771-a62b-e64d6f6aaa79 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 2.645767 Jul 20 11:05:49.044454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:49.045564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:49.047661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1844/3757] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:46 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:49.070442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-427130021", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "6c740025-ac3c-4e30-9c2d-99c8f1333193"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:49.090070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:49.090598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:49.091550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:49.091918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:49.264213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] validate_networks() for [('6c740025-ac3c-4e30-9c2d-99c8f1333193', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:05:49.743557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:49.752789 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-313df20d-5ee1-439c-964d-02c36814f873 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.736544 Jul 20 11:05:49.756831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1914/3758] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:49 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:49.771641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:49.772643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:49.783967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:49.789443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:49.790546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:49.792236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:49.795415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:50.488974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:50.507789 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31045333-8292-49f0-9cca-ecdca84add91 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1314 microversion: 2.1 time: 0.748978 Jul 20 11:05:50.509803 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1915/3759] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:49 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:50.517309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b49950cc-65c7-43d8-bdbe-2141bde8156b req-d8de8969-d5b5-42ae-9dd2-51d2b8c877c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861b09fa-f28b-4f3f-956a-a6f3d6caddf6", "tag": "9a11a5b8-4a63-4cce-b0c1-cbadd088f373"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:50.570683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b49950cc-65c7-43d8-bdbe-2141bde8156b req-d8de8969-d5b5-42ae-9dd2-51d2b8c877c9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:50.574123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b49950cc-65c7-43d8-bdbe-2141bde8156b req-d8de8969-d5b5-42ae-9dd2-51d2b8c877c9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:50.638370 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b49950cc-65c7-43d8-bdbe-2141bde8156b req-d8de8969-d5b5-42ae-9dd2-51d2b8c877c9 service nova] Creating event network-changed:9a11a5b8-4a63-4cce-b0c1-cbadd088f373 for instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 on n-h2-846219-10 Jul 20 11:05:50.658902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b49950cc-65c7-43d8-bdbe-2141bde8156b req-d8de8969-d5b5-42ae-9dd2-51d2b8c877c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144171 Jul 20 11:05:50.660769 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1916/3760] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:50.676281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:50.679440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:50.693678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:50.696065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:50.717492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:50.722727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:50.895585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:05:50.896067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:05:50.896483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:05:50.897531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:05:50.897958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:05:50.954247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:50.956378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:50.961031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:50.964575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:51.132391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Getting quotas for project f9662a26e6ec4789adac8707d0b279ee. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:05:51.280227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Getting quotas for user 013e6cb7f7a34317ab8e2ef7c4b9dc53 and project f9662a26e6ec4789adac8707d0b279ee. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:05:51.337854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:05:51.351936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:05:51.515186 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3f3a829-3d47-496e-b22c-fe10e8e305f9 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.449508 Jul 20 11:05:51.532234 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1845/3761] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:05:51.536309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:51.543261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:51.583731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:51.585690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:51.591272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:51.591863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:51.884472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:51.901517 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19474ffe-a6dc-4d6f-881f-fd26c9eba0ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.232078 Jul 20 11:05:51.902432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1917/3762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:50 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:51.913170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:51.913800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:51.962980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:51.971625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:51.973531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:51.982464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:52.383212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:52.412011 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6fc2d35-de6f-426a-9ebd-5d59219d73fc tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 0.880755 Jul 20 11:05:52.435369 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1846/3763] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:51 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:52.443711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:52.448957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:52.495765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:52.497535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:52.498672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:52.501305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.053171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:53.068195 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-45c3d1bb-be24-4ec2-a40c-ebb7d2b05ac3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1501 microversion: 2.1 time: 0.626809 Jul 20 11:05:53.069088 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1847/3764] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:52 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1501 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:53.115426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:53.116309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:53.143067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.146497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.150120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.151400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.172090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:53.196534 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bd4552b8-6076-4673-9afd-dae91d82caed tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 1.290640 Jul 20 11:05:53.201513 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1918/3765] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:51 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:53.225271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e221b76-9355-4643-9940-11a84c1f9097 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-356116723", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e221b76-9355-4643-9940-11a84c1f9097 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 491 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-356116723", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-356116723', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 20 11:05:53.241052 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 20 11:05:53.254886 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:53.271287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e221b76-9355-4643-9940-11a84c1f9097 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:53.275752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9e221b76-9355-4643-9940-11a84c1f9097 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.070237 Jul 20 11:05:53.278460 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1919/3766] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:53 2022] POST /compute/v2.1/servers => generated 624 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:05:53.298192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a8c40e2b-7dd8-4e65-9299-a1af7eb00eb6 req-c7eb5b90-c166-48e2-9449-a557c7f0f482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77652f95-882f-4c86-b7ec-beeda4e2d8d1", "name": "network-vif-deleted", "tag": "ff0f0239-a279-4aec-9042-6a6a6793c981"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:53.323886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a8c40e2b-7dd8-4e65-9299-a1af7eb00eb6 req-c7eb5b90-c166-48e2-9449-a557c7f0f482 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.325294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a8c40e2b-7dd8-4e65-9299-a1af7eb00eb6 req-c7eb5b90-c166-48e2-9449-a557c7f0f482 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.349076 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a8c40e2b-7dd8-4e65-9299-a1af7eb00eb6 req-c7eb5b90-c166-48e2-9449-a557c7f0f482 service nova] Creating event network-vif-deleted:ff0f0239-a279-4aec-9042-6a6a6793c981 for instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 on n-h1-846219-10 Jul 20 11:05:53.363124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a8c40e2b-7dd8-4e65-9299-a1af7eb00eb6 req-c7eb5b90-c166-48e2-9449-a557c7f0f482 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081335 Jul 20 11:05:53.367567 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1920/3767] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:53.393727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:53.398491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:53.421764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.423491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.428727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.429931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.855048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:53.877523 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ebc4aa9b-518b-4012-8482-54d22652f060 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1213 microversion: 2.1 time: 0.776107 Jul 20 11:05:53.888054 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1848/3768] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:53 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1213 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:53.898016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:53.901280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:53.919557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.920375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:53.921176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:53.922304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:54.414012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:54.431153 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7726180f-bc3b-48d1-959d-f9f887efc873 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.053916 Jul 20 11:05:54.432218 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1921/3769] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:53 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:54.459941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:54.460801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:54.469442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:54.470278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:54.471768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:54.472545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:55.355331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:55.374572 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83e8cce8-612a-4354-b6bc-8048010a0c55 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 1.487016 Jul 20 11:05:55.391214 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1849/3770] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:53 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:55.391214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:55.391214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:55.403981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:55.404437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:55.405230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:55.405662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:55.768950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:55.782912 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-48685afa-08a3-43be-9427-4bbb84163e01 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 1.333523 Jul 20 11:05:55.798033 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1922/3771] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:54 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:55.826681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:55.827534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:55.859469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:55.864180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:55.866090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:55.866540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:56.318938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:56.332387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db58fd6a-59c2-4211-80ca-cf1241bb006b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1275 microversion: 2.1 time: 0.533037 Jul 20 11:05:56.351964 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1923/3772] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:55 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1275 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:56.421567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:56.422131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:56.452021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:56.455572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:56.460324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:56.463026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:56.674212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:05:56.730236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:56.745406 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2087f694-21e7-4794-9755-6257b86cf5f2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.366964 Jul 20 11:05:56.749516 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1850/3773] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:55 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:56.802406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:56.804518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:56.813378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:56.814277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:56.815334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:56.815987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:57.550092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:57.564346 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9023c316-6c2a-4003-83cd-f054b79411cf tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 1.156351 Jul 20 11:05:57.568435 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1924/3774] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:56 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:57.580461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:57.588577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2653d43f-5ac2-451d-8fbc-4d30a8bf86e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2653d43f-5ac2-451d-8fbc-4d30a8bf86e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 416 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:57.592012 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:05:57.595454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:05:57.598838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b27601d-89dd-415f-acb6-ecbecc376c1b tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.799183 Jul 20 11:05:57.609156 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1851/3775] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:56 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:57.617652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:57.618427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2653d43f-5ac2-451d-8fbc-4d30a8bf86e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:57.619530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:57.620251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2653d43f-5ac2-451d-8fbc-4d30a8bf86e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.049813 Jul 20 11:05:57.621934 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1925/3776] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:57 2022] POST /compute/v2.1/servers => generated 619 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:05:57.631478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:57.633012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:57.634145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:57.634605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:57.635447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:57.635889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:57.661649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:57.662133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:57.663120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:57.663747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:58.264176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:58.299289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e04d8630-d2a2-45e7-847d-38fb1824cfa5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.666701 Jul 20 11:05:58.304964 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1926/3777] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:57 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:05:58.331608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70597f0a-0006-4414-ac1c-40034fb754c0"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:58.342350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:58.357549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:58.360014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:58.364492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:58.369443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:58.370231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:58.379494 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-54fdec14-53e4-4760-9d23-0c0b7f0c4f0b tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.776456 Jul 20 11:05:58.387629 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1852/3778] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:57 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:58.401202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:58.402078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:58.420459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:58.421172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:58.422240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:58.422900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:58.760823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:58.773798 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a5e3658c-d2af-4154-951e-d5e8b863c0ef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.384652 Jul 20 11:05:58.775138 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1853/3779] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:58 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:58.783670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:58.786859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:58.804298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:58.810558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:58.812893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:58.815843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:59.001105 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b358847a-a6fc-4187-8708-7548139ef39f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693524 Jul 20 11:05:59.003210 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1927/3780] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:05:58 2022] POST /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:05:59.008952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:59.010133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:59.021210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:59.022005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:59.026062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:59.029409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:59.221111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:59.259652 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5c0da25-bad1-4618-a09f-ff00ea50d8bd tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 0.483101 Jul 20 11:05:59.267422 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1854/3781] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:58 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:59.288247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6509a50-473a-4dc6-b55a-a8e71f79ba49 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1028335400", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": -1, "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:05:59.321294 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f6509a50-473a-4dc6-b55a-a8e71f79ba49 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Flavor -1 could not be found. Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6509a50-473a-4dc6-b55a-a8e71f79ba49 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 206 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1028335400", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": -1, "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: exception: Flavor -1 could not be found. Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1028335400', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': -1, 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:59.335033 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6509a50-473a-4dc6-b55a-a8e71f79ba49 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:05:59.339150 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6509a50-473a-4dc6-b55a-a8e71f79ba49 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.067632 Jul 20 11:05:59.343047 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1855/3782] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:05:59 2022] POST /compute/v2.1/servers => generated 73 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:05:59.362255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:59.363312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:59.411550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:59.413267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:59.416342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:59.419915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:59.782258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:05:59.807704 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-06a85be8-f54e-428d-be0a-ba2f5c709848 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.802533 Jul 20 11:05:59.815385 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1928/3783] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:59 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:05:59.832804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:05:59.834399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:05:59.858633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:59.873652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:05:59.875484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:05:59.876570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.313236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:00.336144 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad8b8279-d2ff-4c40-a742-8ba87e060b50 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.993703 Jul 20 11:06:00.363861 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1856/3784] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:59 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:00.385728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:00.401532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:00.405300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:00.409092 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cd6beafb-a25f-499a-9034-7d3b2076b4fe tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.591520 Jul 20 11:06:00.434593 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1929/3785] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:05:59 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:00.452454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:00.454018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:00.454963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.456708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:00.457971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.466438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:00.492598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:00.493818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.503523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:00.505941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.537830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:00.812692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:00.830854 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1a3bc62-7978-4925-9aea-45c282fb2db4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.394330 Jul 20 11:06:00.835372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:00.860829 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1930/3786] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:00 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:00.872786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:00.873675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:00.881694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:00.882710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.883948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:00.884592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:00.888805 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77e743e3-3070-48de-97fd-4cc0a1431e3b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 0.522029 Jul 20 11:06:00.919203 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1857/3787] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:00 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:01.042657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b4aa474-8d1b-4236-b76c-d293637135ce tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203813303", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b4aa474-8d1b-4236-b76c-d293637135ce tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 173 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1203813303", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1203813303', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi -1 Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:06:01.046587 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:01.051907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b4aa474-8d1b-4236-b76c-d293637135ce tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:01.052801 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b4aa474-8d1b-4236-b76c-d293637135ce tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.014470 Jul 20 11:06:01.052801 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1858/3788] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:01 2022] POST /compute/v2.1/servers => generated 145 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 11:06:01.064284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:01.081367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:01.082994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:01.114962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.119445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.123018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.124094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.242668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:01.280433 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-598df1b1-5cf5-4208-9476-11470e4cb829 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.410680 Jul 20 11:06:01.304929 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1931/3789] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:00 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:01.312179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-19a51022-9411-46b3-abf9-72778adc413a req-df56afc8-ec0b-4b70-814b-add5051323aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861b09fa-f28b-4f3f-956a-a6f3d6caddf6", "name": "network-vif-plugged", "status": "completed", "tag": "9a11a5b8-4a63-4cce-b0c1-cbadd088f373"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:01.318316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:01.341529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-19a51022-9411-46b3-abf9-72778adc413a req-df56afc8-ec0b-4b70-814b-add5051323aa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.347136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-19a51022-9411-46b3-abf9-72778adc413a req-df56afc8-ec0b-4b70-814b-add5051323aa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.429567 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-19a51022-9411-46b3-abf9-72778adc413a req-df56afc8-ec0b-4b70-814b-add5051323aa service nova] Creating event network-vif-plugged:9a11a5b8-4a63-4cce-b0c1-cbadd088f373 for instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 on n-h2-846219-10 Jul 20 11:06:01.474747 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-19a51022-9411-46b3-abf9-72778adc413a req-df56afc8-ec0b-4b70-814b-add5051323aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186669 Jul 20 11:06:01.483598 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1932/3790] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:01.516499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:01.520947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:01.545099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.545562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.547332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.547797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.610156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:01.625844 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a547962-9adc-4955-a302-fb864bf8bf23 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.562411 Jul 20 11:06:01.628575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1859/3791] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:01 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:01.646370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:01.647151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:01.659652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.660344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.664793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.665497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.916698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:01.934925 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92d55603-3ea2-4bf9-ba0f-c1892dcb6256 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.444974 Jul 20 11:06:01.938905 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1933/3792] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:01 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:01.954439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:01.957709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:01.987008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.987501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:01.988296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:01.988737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:02.053878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:02.065981 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78a525ea-7789-4cff-8bab-5ab9c649ad83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.423703 Jul 20 11:06:02.093180 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1860/3793] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:01 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:02.142789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63a44ab0-00d5-4ac9-97bd-2a86421457cf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-93225894", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:02.149185 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-63a44ab0-00d5-4ac9-97bd-2a86421457cf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63a44ab0-00d5-4ac9-97bd-2a86421457cf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 214 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-93225894", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-93225894', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:02.151375 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 20 11:06:02.155494 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:02.157629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63a44ab0-00d5-4ac9-97bd-2a86421457cf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:02.159008 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-63a44ab0-00d5-4ac9-97bd-2a86421457cf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.021496 Jul 20 11:06:02.163162 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1861/3794] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:02 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:06:02.169928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:02.170896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:02.182250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:02.183043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:02.184674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:02.186005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:02.284832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:02.310754 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-671772bf-68de-4e6a-bdc1-a4723670d816 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1327 microversion: 2.1 time: 0.362937 Jul 20 11:06:02.326195 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1934/3795] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:01 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:02.333160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:02.333822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:02.347825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:02.352235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:02.352985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:02.353953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:02.985906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:02.997276 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1fa77568-be43-4896-944f-963e41ea63be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.832766 Jul 20 11:06:02.998106 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1862/3796] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:02 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:03.010310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:03.053395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-85edb2f9-2228-4743-acfa-43fae09ab148 req-651c3caa-a7fb-497d-9222-734bbb5a227e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e36fcb3-168e-41a5-90ef-59b817ebe544", "tag": "343e7f07-2b08-4000-a623-532b7ad05edd"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:03.061913 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d6cf93cd-4328-4621-9fda-880a8560bf87 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.734324 Jul 20 11:06:03.070073 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1935/3797] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:02 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:03.098017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:03.102130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-85edb2f9-2228-4743-acfa-43fae09ab148 req-651c3caa-a7fb-497d-9222-734bbb5a227e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:03.104076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:03.111119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-85edb2f9-2228-4743-acfa-43fae09ab148 req-651c3caa-a7fb-497d-9222-734bbb5a227e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:03.128441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:03.143938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:03.176747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:03.177523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:03.192422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-85edb2f9-2228-4743-acfa-43fae09ab148 req-651c3caa-a7fb-497d-9222-734bbb5a227e service nova] Creating event network-changed:343e7f07-2b08-4000-a623-532b7ad05edd for instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 on n-h2-846219-10 Jul 20 11:06:03.222579 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-85edb2f9-2228-4743-acfa-43fae09ab148 req-651c3caa-a7fb-497d-9222-734bbb5a227e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218118 Jul 20 11:06:03.226925 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1863/3798] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:03.248134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:03.249956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:03.266390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:03.272011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:03.273121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:03.273718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:04.481522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:04.535029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-333945f8-8ed3-4ce6-8a85-5a04dfa65a09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.302793 Jul 20 11:06:04.536375 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1864/3799] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:03 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:04.564863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:04.567556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:04.609732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:04.612361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:04.618247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:04.619623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:04.646746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:04.662766 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd986d52-8d30-439c-bbc6-8c26e37fd979 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 1.589568 Jul 20 11:06:04.663526 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1936/3800] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:03 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:04.674046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:04.678776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:04.698078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:04.701314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:04.704957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:04.708200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:05.283300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:05.327098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:05.334553 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02dec0db-5fa0-450a-957a-b25fb4032990 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1527 microversion: 2.1 time: 0.785807 Jul 20 11:06:05.339207 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1865/3801] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:04 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1527 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:05.360982 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bcbbcda6-9298-4407-a7c5-003b6c1b2dae tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.690047 Jul 20 11:06:05.363117 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1937/3802] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:04 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:05.373569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-105545a9-48d3-4b40-87f9-975805ecfa8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-58372561", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "key_name": "tempest-key-1623462560", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:05.396725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:05.398853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:05.424062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:05.429127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:05.434516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:05.437289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:05.514398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-105545a9-48d3-4b40-87f9-975805ecfa8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] validate_networks() for [('27c7b58b-4f85-421a-aaca-e450cd9c7adf', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:06:06.372955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-105545a9-48d3-4b40-87f9-975805ecfa8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Invalid key_name provided. Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-105545a9-48d3-4b40-87f9-975805ecfa8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 245 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-58372561", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "key_name": "tempest-key-1623462560", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid key_name provided. Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-58372561', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'key_name': 'tempest-key-1623462560', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1623462560 not found for user 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:06.387571 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 20 11:06:06.390865 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:06.403798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-105545a9-48d3-4b40-87f9-975805ecfa8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid key_name provided. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:06.405265 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-105545a9-48d3-4b40-87f9-975805ecfa8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.063377 Jul 20 11:06:06.410832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1866/3803] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:05 2022] POST /compute/v2.1/servers => generated 70 bytes in 1071 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 20 11:06:06.416222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:06.417118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:06.427840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:06.432102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:06.435560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:06.439751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:06.441924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:06.484543 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-939928fd-c427-4c6a-8465-0a4868332a52 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1527 microversion: 2.1 time: 1.119053 Jul 20 11:06:06.485581 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1938/3804] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:05 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1527 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:06.525278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:06.525896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:06.542894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:06.545288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:06.546363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:06.547050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.015399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:07.059675 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85b707c9-1368-445d-b600-d044a2a24ac8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.641959 Jul 20 11:06:07.062193 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1867/3805] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:06 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:07.086707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:07.088542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:07.106114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:07.117022 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e48005ba-282c-4063-addd-3f85552757e0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.629634 Jul 20 11:06:07.118200 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1939/3806] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:06 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:07.133199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.133787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.138736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.141501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.317417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:07.318303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:07.332676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.333132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.333934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.338302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.382295 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] HTTP exception thrown: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Request method failure captured: Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 HTTP/1.1 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-F88UiIIcHK6Am29TkrUlG8UF1zwFOIxFKvai3tZNI0ppdTIjm-kO3-hPmV4LQW1OFxANY-Om3GlFkrJBqZN23Qq5PImWLMSs_5ilDmvVX0rn1g5CFFu-cF-SsR-ObankPAk1lcr7AF2sNq0tdilJGI2-KVzxEVmV2F55fb5m5pd8k Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 129513ef0a314dc98274560e16d9a646 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-382996277 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_129513ef0a314dc98274560e16d9a646", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/129513ef0a314dc98274560e16d9a646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/129513ef0a314dc98274560e16d9a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/129513ef0a314dc98274560e16d9a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-382996277 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 129513ef0a314dc98274560e16d9a646 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-382996277 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestMultiTenantJSON-382996277-project Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8ba9c34823a94c8294a1418644ed1464 Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-382996277-project Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '861b09fa-f28b-4f3f-956a-a6f3d6caddf6'} Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:07.387423 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Returning 404 to user: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:07.391114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-992745ec-7463-4a03-af27-b78c8974c37b tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] 10.222.0.79 "DELETE /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 404 len: 111 microversion: 2.1 time: 0.269562 Jul 20 11:06:07.393512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1940/3807] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:07 2022] DELETE /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 111 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:07.407394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:07.408033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:07.426664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.432118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.433350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.434034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.606865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:07.620511 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b9d1605c-b72b-4438-a5b9-dae7b78bef09 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.553255 Jul 20 11:06:07.621742 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1868/3808] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:07 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:07.641043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:07.644424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:07.663002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.664180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.665435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.666169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.874510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:07.890873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:07.901385 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce6bfcd3-621c-494e-997a-d097a008d42b tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1527 microversion: 2.1 time: 0.503660 Jul 20 11:06:07.912749 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1941/3809] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:07 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1527 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:07.925079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Action: 'update', calling method: >, body: {"server": {"name": "861b09fa-f28b-4f3f-956a-a6f3d6caddf6_new"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:07.930358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:07.951327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.952744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:07.954658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:07.959914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.025142 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] HTTP exception thrown: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Request method failure captured: Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 HTTP/1.1 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 64 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-F88UiIIcHK6Am29TkrUlG8UF1zwFOIxFKvai3tZNI0ppdTIjm-kO3-hPmV4LQW1OFxANY-Om3GlFkrJBqZN23Qq5PImWLMSs_5ilDmvVX0rn1g5CFFu-cF-SsR-ObankPAk1lcr7AF2sNq0tdilJGI2-KVzxEVmV2F55fb5m5pd8k Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 129513ef0a314dc98274560e16d9a646 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-382996277 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_129513ef0a314dc98274560e16d9a646", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/129513ef0a314dc98274560e16d9a646"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/129513ef0a314dc98274560e16d9a646"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/129513ef0a314dc98274560e16d9a646"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-382996277 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 129513ef0a314dc98274560e16d9a646 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-382996277 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestMultiTenantJSON-382996277-project Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8ba9c34823a94c8294a1418644ed1464 Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-382996277-project Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "861b09fa-f28b-4f3f-956a-a6f3d6caddf6_new"}} Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '861b09fa-f28b-4f3f-956a-a6f3d6caddf6', 'body': {'server': {'name': '861b09fa-f28b-4f3f-956a-a6f3d6caddf6_new'}}} Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 11:06:08.029872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:08.033432 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:08.034259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] Returning 404 to user: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:08.034695 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12243b30-aa3d-455c-be39-6bba8012f913 tempest-ServersNegativeTestMultiTenantJSON-382996277 tempest-ServersNegativeTestMultiTenantJSON-382996277-project] 10.222.0.79 "PUT /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 404 len: 111 microversion: 2.1 time: 0.118003 Jul 20 11:06:08.042610 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1942/3810] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:06:07 2022] PUT /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:08.052985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:08.053506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:08.059444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:08.080581 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9637b863-a1fd-4c50-bb28-a688b303d8d6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.442327 Jul 20 11:06:08.081492 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1869/3811] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:07 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:08.084716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.086942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.092652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.093401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.096421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:08.099638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:08.126541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.127869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.132893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.135515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.191700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:06:08.363974 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-84374c3f-bcb9-4e43-a123-46508c1a2d36 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "DELETE /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 204 len: 0 microversion: 2.1 time: 0.313343 Jul 20 11:06:08.364943 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1943/3812] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:08 2022] DELETE /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:06:08.370308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:08.372077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:08.379073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.379073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.380008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.381066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:08.821765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:08.838208 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96f203c1-7152-4d44-97e5-2d14b7f7b980 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.755615 Jul 20 11:06:08.853083 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1870/3813] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:08 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:08.860303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1dfa9c28-7d38-4d6a-8d24-8057ccaaa221 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-729856904", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:08.965513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:08.980456 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3b46273-87c1-4e2f-a76a-90a4d01f8967 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.613914 Jul 20 11:06:08.981855 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1944/3814] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:08 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:08.987155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:08.988085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:08.996949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:08.998089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.000333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.001584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.220054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.security_group_api [None req-1dfa9c28-7d38-4d6a-8d24-8057ccaaa221 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Neutron security group does_not_exist not found {{(pid=125886) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 20 11:06:09.220643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1dfa9c28-7d38-4d6a-8d24-8057ccaaa221 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1dfa9c28-7d38-4d6a-8d24-8057ccaaa221 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 257 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-729856904", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-729856904', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 20 11:06:09.230367 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:09.234396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1dfa9c28-7d38-4d6a-8d24-8057ccaaa221 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:09.237534 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1dfa9c28-7d38-4d6a-8d24-8057ccaaa221 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.379659 Jul 20 11:06:09.241606 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1871/3815] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:08 2022] POST /compute/v2.1/servers => generated 106 bytes in 387 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:06:09.276138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:09.278131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:09.312793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.315015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.316723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.318041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.339243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:09.350192 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33cfc765-a3d6-4cd2-aff4-5e9b6c5feafb tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1533 microversion: 2.1 time: 0.366710 Jul 20 11:06:09.361683 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1945/3816] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:08 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1533 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:09.796491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:09.825719 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a13edcfa-fcff-4d1c-8e93-4d020e3ec007 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.579439 Jul 20 11:06:09.829066 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1872/3817] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:09 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:09.857215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:09.857952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:09.879756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.880218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.881019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.881460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.882574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:09.883589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:09.895578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.896806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:09.897841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:09.898656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.280649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:10.298954 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-193ccd81-4e01-4c9f-95ed-a8e7e484c553 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.424148 Jul 20 11:06:10.321809 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1873/3818] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:09 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:10.332130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:10.332522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:10.332955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:10.341662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.342389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.343469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.343978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.345228 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-041d6ad5-31e2-4de6-84e0-057ed5e311b2 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.492865 Jul 20 11:06:10.361122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1946/3819] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:09 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:10.376726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-22f3a277-8b5a-4538-8452-7bc9e4013785 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:10.377231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-22f3a277-8b5a-4538-8452-7bc9e4013785 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 11a7fcc7-3ac5-4533-a58a-f3a2a2033795] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:10.387495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-22f3a277-8b5a-4538-8452-7bc9e4013785 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 11a7fcc7-3ac5-4533-a58a-f3a2a2033795 could not be found. Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-22f3a277-8b5a-4538-8452-7bc9e4013785 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/11a7fcc7-3ac5-4533-a58a-f3a2a2033795 HTTP/1.1 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 11a7fcc7-3ac5-4533-a58a-f3a2a2033795 could not be found. Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '11a7fcc7-3ac5-4533-a58a-f3a2a2033795'} Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a7fcc7-3ac5-4533-a58a-f3a2a2033795 could not be found. Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a7fcc7-3ac5-4533-a58a-f3a2a2033795 could not be found. Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:10.397300 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a7fcc7-3ac5-4533-a58a-f3a2a2033795 could not be found. Jul 20 11:06:10.400973 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:10.403255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-22f3a277-8b5a-4538-8452-7bc9e4013785 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 11a7fcc7-3ac5-4533-a58a-f3a2a2033795 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:10.404845 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-22f3a277-8b5a-4538-8452-7bc9e4013785 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "DELETE /compute/v2.1/servers/11a7fcc7-3ac5-4533-a58a-f3a2a2033795" status: 404 len: 111 microversion: 2.1 time: 0.037158 Jul 20 11:06:10.406367 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1947/3820] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:10 2022] DELETE /compute/v2.1/servers/11a7fcc7-3ac5-4533-a58a-f3a2a2033795 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:10.427446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:10.428801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:10.440405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.441256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.442653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.443616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.654980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecfde6197a546efb78f381be42a9f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b323d3dc84dc6bf8d3d195570de77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:10.669140 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ece4de4-6ecf-44c3-9b12-838aadfffe40 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 200 len: 1491 microversion: 2.1 time: 0.261234 Jul 20 11:06:10.671611 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1948/3821] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:10 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 1491 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:10.691042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:10.696008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:10.709998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.712987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.714048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.720104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:10.724598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.729504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a70616bf-978f-42ea-887a-7e804782a4d1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.408234 Jul 20 11:06:10.734413 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1874/3822] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:10 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:10.741526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4d7356af-c8e8-422c-9727-04e5b019a978 req-35a6250b-e2ee-4d56-92d5-27f4aecf68e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e36fcb3-168e-41a5-90ef-59b817ebe544", "name": "network-vif-plugged", "status": "completed", "tag": "343e7f07-2b08-4000-a623-532b7ad05edd"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:10.790978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4d7356af-c8e8-422c-9727-04e5b019a978 req-35a6250b-e2ee-4d56-92d5-27f4aecf68e2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.801130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4d7356af-c8e8-422c-9727-04e5b019a978 req-35a6250b-e2ee-4d56-92d5-27f4aecf68e2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.869530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4d7356af-c8e8-422c-9727-04e5b019a978 req-35a6250b-e2ee-4d56-92d5-27f4aecf68e2 service nova] Creating event network-vif-plugged:343e7f07-2b08-4000-a623-532b7ad05edd for instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 on n-h2-846219-10 Jul 20 11:06:10.884926 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4d7356af-c8e8-422c-9727-04e5b019a978 req-35a6250b-e2ee-4d56-92d5-27f4aecf68e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149230 Jul 20 11:06:10.890603 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1875/3823] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:10.900711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3c7c6288-d363-4e7b-bac6-5e3025d053be req-f337844f-8e24-41be-be4a-f22c33808dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861b09fa-f28b-4f3f-956a-a6f3d6caddf6", "name": "network-vif-deleted", "tag": "9a11a5b8-4a63-4cce-b0c1-cbadd088f373"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:10.941500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c7c6288-d363-4e7b-bac6-5e3025d053be req-f337844f-8e24-41be-be4a-f22c33808dcd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:10.941945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c7c6288-d363-4e7b-bac6-5e3025d053be req-f337844f-8e24-41be-be4a-f22c33808dcd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:10.978921 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3c7c6288-d363-4e7b-bac6-5e3025d053be req-f337844f-8e24-41be-be4a-f22c33808dcd service nova] Creating event network-vif-deleted:9a11a5b8-4a63-4cce-b0c1-cbadd088f373 for instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 on n-h2-846219-10 Jul 20 11:06:11.000383 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3c7c6288-d363-4e7b-bac6-5e3025d053be req-f337844f-8e24-41be-be4a-f22c33808dcd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107858 Jul 20 11:06:11.003713 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1876/3824] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:11.305873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:11.316674 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed5eba1f-61a4-4930-ac79-97707f21fc47 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.638488 Jul 20 11:06:11.317539 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1949/3825] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:10 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:11.329378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:11.332904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:11.337125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:11.338616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:11.348547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:11.349145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:11.349785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:11.350600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:11.350745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:11.351475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:11.352096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:11.352696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:11.582192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:11.598523 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e454f2f3-9aaa-4719-b735-435955798d7a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.264702 Jul 20 11:06:11.600776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1950/3826] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:11 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:11.618942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-252b518b-02f6-4aa7-a969-02c1b162fa89 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:11.621945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-252b518b-02f6-4aa7-a969-02c1b162fa89 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Failed to fetch instance by id 9223372036854775808 {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 11:06:11.625073 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-252b518b-02f6-4aa7-a969-02c1b162fa89 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-252b518b-02f6-4aa7-a969-02c1b162fa89 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9223372036854775808 could not be found. Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9223372036854775808'} Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:11.628885 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:11.632611 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:11.632611 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:11.632611 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:11.632611 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 20 11:06:11.632611 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:11.637783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-252b518b-02f6-4aa7-a969-02c1b162fa89 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:11.639359 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-252b518b-02f6-4aa7-a969-02c1b162fa89 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.026750 Jul 20 11:06:11.640460 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1951/3827] 10.222.0.79 () {58 vars in 1187 bytes} [Wed Jul 20 11:06:11 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:06:11.649285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:11.649915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:11.658012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:11.658475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:11.659320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:11.659763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:11.925843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:11.978756 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61c56c26-208c-4c2d-97be-df6967e928e6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.333790 Jul 20 11:06:11.981404 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1952/3828] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:11 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:11.995108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:11.995985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] [instance: 861b09fa-f28b-4f3f-956a-a6f3d6caddf6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:12.018780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.020556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.024319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.024868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.070698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] HTTP exception thrown: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Request method failure captured: Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 HTTP/1.1 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Frx346_8u162XaQC93dJzFGAaYQ_g0xspp6_aYoCIReWZk3ka96FC9gYiVx1Zbk5eZ0a-YgfHpRZxlIZ1pR7E-21hJ4Ac2drk4rnRgJzPzyyWVguuj8N2fapOYcYPM7U7PnlSfOh_HqKoN1HufTgUzbNZeSxyY6O1Wt51_Ho5RFB0 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 041b323d3dc84dc6bf8d3d195570de77 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1951516112 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_041b323d3dc84dc6bf8d3d195570de77", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/041b323d3dc84dc6bf8d3d195570de77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/041b323d3dc84dc6bf8d3d195570de77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/041b323d3dc84dc6bf8d3d195570de77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1951516112 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 041b323d3dc84dc6bf8d3d195570de77 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1951516112 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1951516112-project Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9ecfde6197a546efb78f381be42a9f10 Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1951516112-project Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '861b09fa-f28b-4f3f-956a-a6f3d6caddf6'} Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:12.074716 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. Jul 20 11:06:12.078805 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.083765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] Returning 404 to user: Instance 861b09fa-f28b-4f3f-956a-a6f3d6caddf6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:12.084767 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-924f6b31-ce1d-4197-a3f1-46e0f45bd810 tempest-ServersNegativeTestMultiTenantJSON-1951516112 tempest-ServersNegativeTestMultiTenantJSON-1951516112-project] 10.222.0.79 "GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6" status: 404 len: 111 microversion: 2.1 time: 0.098103 Jul 20 11:06:12.085942 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1953/3829] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:11 2022] GET /compute/v2.1/servers/861b09fa-f28b-4f3f-956a-a6f3d6caddf6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:12.101100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:12.102411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:12.111535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.112339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.113573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.114176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.198587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:12.219492 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-734a9aac-94f3-4784-b04c-1ed29fdba2cf tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1317 microversion: 2.1 time: 0.896295 Jul 20 11:06:12.234738 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1877/3830] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:11 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:12.253980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:12.255114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:12.289229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.290352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.295414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.296205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.727753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:12.754966 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4934356e-9dd5-45e0-8219-4f6d593ef279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.516571 Jul 20 11:06:12.771217 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1878/3831] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:12 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:12.805818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-acbbdf33-5055-48f3-b25f-67a6288104db tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:12.806685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-acbbdf33-5055-48f3-b25f-67a6288104db tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Failed to fetch instance by id -1 {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 20 11:06:12.807492 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-acbbdf33-5055-48f3-b25f-67a6288104db tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance -1 could not be found. Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-acbbdf33-5055-48f3-b25f-67a6288104db tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance -1 could not be found. Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '-1'} Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:12.812672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:12.816967 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:12.816967 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:12.816967 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 20 11:06:12.816967 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:12.819119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-acbbdf33-5055-48f3-b25f-67a6288104db tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance -1 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:12.823207 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-acbbdf33-5055-48f3-b25f-67a6288104db tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.045735 Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1879/3832] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 11:06:12 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:12.861726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:12.864450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:12.873477 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-15f94a16-eb99-490d-9e48-a89243b77cbf tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1524 microversion: 2.1 time: 0.785576 Jul 20 11:06:12.880615 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1954/3833] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:12 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1524 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:13.247562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:13.248713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:13.274567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:13.281330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:13.282389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:13.282940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:13.586356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:13.598098 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-794bf8db-ba9b-48bc-ba95-b84bc62b22d5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.768024 Jul 20 11:06:13.599187 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1880/3834] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:12 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:13.616923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:13.628106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:13.634897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:13.635525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:13.642486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:13.643096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:13.648267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:13.675368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:13.684584 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0696eb1e-17a0-4818-90cb-dc9a73d76ca0 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1508 microversion: 2.1 time: 0.442098 Jul 20 11:06:13.696009 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1955/3835] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:13 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1508 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:13.712065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:13.713509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:13.731565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:13.739298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:13.740323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:13.740876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:13.992398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:14.012149 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a6ff39f-c0c1-4d74-b047-62c97b320f34 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.398434 Jul 20 11:06:14.023550 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1881/3836] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:13 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:14.023550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:14.023550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:14.043673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.044281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.045175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.045716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.154052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:14.180741 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f77780c9-1068-4c00-a267-c376c7440a70 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1508 microversion: 2.1 time: 0.472419 Jul 20 11:06:14.181335 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1956/3837] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:13 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1508 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:14.203343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-388201c9-9981-440f-8b67-72531d3b68bc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:14.228911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-388201c9-9981-440f-8b67-72531d3b68bc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 6ebc2c36-2975-40ee-8e92-a9c38b43839d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:14.248434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-388201c9-9981-440f-8b67-72531d3b68bc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 6ebc2c36-2975-40ee-8e92-a9c38b43839d could not be found. Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-388201c9-9981-440f-8b67-72531d3b68bc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/6ebc2c36-2975-40ee-8e92-a9c38b43839d/action HTTP/1.1 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 19 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: {"forceDelete": {}} Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 6ebc2c36-2975-40ee-8e92-a9c38b43839d could not be found. Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6ebc2c36-2975-40ee-8e92-a9c38b43839d', 'body': {'forceDelete': {}}} Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ebc2c36-2975-40ee-8e92-a9c38b43839d could not be found. Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ebc2c36-2975-40ee-8e92-a9c38b43839d could not be found. Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:14.265271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ebc2c36-2975-40ee-8e92-a9c38b43839d could not be found. Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-388201c9-9981-440f-8b67-72531d3b68bc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 6ebc2c36-2975-40ee-8e92-a9c38b43839d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-388201c9-9981-440f-8b67-72531d3b68bc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/6ebc2c36-2975-40ee-8e92-a9c38b43839d/action" status: 404 len: 111 microversion: 2.1 time: 0.068793 Jul 20 11:06:14.273582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1957/3838] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:14 2022] POST /compute/v2.1/servers/6ebc2c36-2975-40ee-8e92-a9c38b43839d/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:14.278041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:14.279301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:14.297193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.297899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.298849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.306096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.360525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:14.368423 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1bd2c3e8-4a0d-47fa-bc60-f1d0e432f7b1 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1504 microversion: 2.1 time: 0.353407 Jul 20 11:06:14.369015 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1882/3839] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:14 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1504 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:14.385257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:14.388948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:14.411114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:14.415193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.415894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.416866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.425595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.454356 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-24af78f4-a6a0-41d2-afca-73c1ad1bfd08 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "PUT /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1080 microversion: 2.1 time: 0.185801 Jul 20 11:06:14.462255 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1958/3840] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:06:14 2022] PUT /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1080 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:14.467988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e7cc98b-dfff-4e2e-909f-2034f25630a8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'create', calling method: .version_select at 0x7f2c3e990040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-651217157", "description": "tempest-description-430809609"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:14.740522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:14.759676 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fb664872-10d1-4f4a-84e7-b6082d0e3c87 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.379336 Jul 20 11:06:14.760289 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1883/3841] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:14 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:14.765347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:14.770219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:14.793818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.794540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.795576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:14.796183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:14.990734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e7cc98b-dfff-4e2e-909f-2034f25630a8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.527123 Jul 20 11:06:14.997681 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1959/3842] 10.222.0.79 () {60 vars in 1179 bytes} [Wed Jul 20 11:06:14 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:14.997681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:14.997681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:15.010861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:15.012176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:15.013017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:15.013466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:15.131459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:15.140445 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9412c05a-edcf-4b5f-8bd6-022f86b92ef5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1506 microversion: 2.1 time: 0.378920 Jul 20 11:06:15.144118 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1884/3843] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:14 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:15.154753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-651217157"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:15.155339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:15.172218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:15.172672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:15.176123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:15.176576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:15.463660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:15.481930 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19ae4c69-b2be-455a-a156-9c71bfdddd6b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.488803 Jul 20 11:06:15.482557 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1960/3844] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:14 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:15.509498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:15.510133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:15.520129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:15.521053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:15.522214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:15.524416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:15.569405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:15.755596 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.network.security_group_api [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Adding security group 596dcc97-1dd5-487d-833a-e20dc820154f to port 563fd253-8097-4b59-9631-b3fb00162e50 Jul 20 11:06:15.930891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:15.955619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5dad757-a83d-4e34-8602-2781cefcf504 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1506 microversion: 2.1 time: 0.452748 Jul 20 11:06:15.957418 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1961/3845] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:15 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:15.972784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-891a1fbe-ca8a-4193-b75d-3a9119f45bfc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:15.979470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-891a1fbe-ca8a-4193-b75d-3a9119f45bfc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: bab1010f-df48-4d73-b088-01efea881ffd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:15.986929 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-891a1fbe-ca8a-4193-b75d-3a9119f45bfc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance bab1010f-df48-4d73-b088-01efea881ffd could not be found. Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-891a1fbe-ca8a-4193-b75d-3a9119f45bfc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/bab1010f-df48-4d73-b088-01efea881ffd/action HTTP/1.1 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 39 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: {"os-getConsoleOutput": {"length": 10}} Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance bab1010f-df48-4d73-b088-01efea881ffd could not be found. Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'bab1010f-df48-4d73-b088-01efea881ffd', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab1010f-df48-4d73-b088-01efea881ffd could not be found. Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab1010f-df48-4d73-b088-01efea881ffd could not be found. Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:16.001459 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:16.005111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:16.005111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:16.005111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:16.005111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:16.005111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab1010f-df48-4d73-b088-01efea881ffd could not be found. Jul 20 11:06:16.005111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:16.010836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-891a1fbe-ca8a-4193-b75d-3a9119f45bfc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance bab1010f-df48-4d73-b088-01efea881ffd could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:16.016770 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-891a1fbe-ca8a-4193-b75d-3a9119f45bfc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/bab1010f-df48-4d73-b088-01efea881ffd/action" status: 404 len: 111 microversion: 2.1 time: 0.057847 Jul 20 11:06:16.032081 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1962/3846] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:15 2022] POST /compute/v2.1/servers/bab1010f-df48-4d73-b088-01efea881ffd/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:16.037440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:16.039472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:16.048511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:16.049204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:16.050822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:16.051606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.071401 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aaf0decd-5a79-4ceb-b946-794fe331b80a tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action" status: 202 len: 0 microversion: 2.1 time: 1.925954 Jul 20 11:06:17.071839 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1885/3847] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:15 2022] POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action => generated 0 bytes in 1927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:06:17.079157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:17.081332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:17.100191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.100668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.101485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.101937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.240116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bbd28c83-7af8-4f2c-b03f-3ee5416ee156 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "PUT /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1082 microversion: 2.1 time: 0.167145 Jul 20 11:06:17.249955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1886/3848] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:06:17 2022] PUT /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1082 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:17.258097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-651217157"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:17.258655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:17.276968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.277986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.278784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.279876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.461447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:17.476262 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a67f289a-ab57-44b5-96d5-be02f58528c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.442558 Jul 20 11:06:17.477188 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1963/3849] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:16 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:17.493426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bca1da5b-c1d7-4727-b70f-5bb3aa56ef08 req-87958f73-5922-4d31-9f27-0bc6403deb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:17.514834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bca1da5b-c1d7-4727-b70f-5bb3aa56ef08 req-87958f73-5922-4d31-9f27-0bc6403deb46 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.515951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bca1da5b-c1d7-4727-b70f-5bb3aa56ef08 req-87958f73-5922-4d31-9f27-0bc6403deb46 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.552314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bca1da5b-c1d7-4727-b70f-5bb3aa56ef08 req-87958f73-5922-4d31-9f27-0bc6403deb46 service nova] Creating event network-changed:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:06:17.559732 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bca1da5b-c1d7-4727-b70f-5bb3aa56ef08 req-87958f73-5922-4d31-9f27-0bc6403deb46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081100 Jul 20 11:06:17.560584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1964/3850] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:17.583057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:17.590503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:17.610848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.612378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.613459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:17.614064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:17.635543 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.network.security_group_api [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Removing security group 596dcc97-1dd5-487d-833a-e20dc820154f from port 563fd253-8097-4b59-9631-b3fb00162e50 Jul 20 11:06:18.285627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:18.296354 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff58e4a7-c808-4bbf-89c0-074b7c890cf5 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1508 microversion: 2.1 time: 0.729007 Jul 20 11:06:18.310696 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1965/3851] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:17 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1508 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:18.320775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:18.321425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:18.337598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:18.339725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:18.340088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:18.341480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:18.341974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:18.452600 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-28e54cbb-2ffe-4f7e-865d-a777fda2275f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action" status: 202 len: 0 microversion: 2.1 time: 1.201448 Jul 20 11:06:18.458117 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1887/3852] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:17 2022] POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action => generated 0 bytes in 1207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:06:18.463205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:18.463842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:18.485088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:18.485654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:18.486620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:18.487196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:18.935944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:18.951768 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eaff0e7f-6fa1-4ba6-b044-0f2934abb3b8 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1508 microversion: 2.1 time: 0.485883 Jul 20 11:06:18.964252 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1888/3853] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:18 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:18.976172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:18.993781 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27dd3487-db0c-4772-97ca-2356174ddbb9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.681624 Jul 20 11:06:18.997732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-394c1aaf-6a0f-4807-a19b-6705779de96e tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'create', calling method: .version_select at 0x7f2c3e544ee0>, body: {"pool": null} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:19.000353 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1966/3854] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:18 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:19.017197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:19.017677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:19.039742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:19.040204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:19.041190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:19.041640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:19.114378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:06:19.312980 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-01bb598f-cd60-46ad-a9a2-d9d6fd696ca1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 204 len: 0 microversion: 2.1 time: 0.310938 Jul 20 11:06:19.319639 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1967/3855] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:19 2022] DELETE /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:06:19.334469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:19.335930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:19.352159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:19.352826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:19.357685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:19.359809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:19.425346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:06:19.603534 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7585052-e301-4b06-b7fa-0198d71a93b2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 204 len: 0 microversion: 2.1 time: 0.281977 Jul 20 11:06:19.613001 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1968/3856] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:19 2022] DELETE /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:06:19.629258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad2df9c4-b8ce-4a09-9a42-8e5e11f1b4af tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:19.629258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad2df9c4-b8ce-4a09-9a42-8e5e11f1b4af tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: c172bc16-dc9d-4f0e-9667-b0cd80a4c49f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:19.647035 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ad2df9c4-b8ce-4a09-9a42-8e5e11f1b4af tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance c172bc16-dc9d-4f0e-9667-b0cd80a4c49f could not be found. Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad2df9c4-b8ce-4a09-9a42-8e5e11f1b4af tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/c172bc16-dc9d-4f0e-9667-b0cd80a4c49f HTTP/1.1 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance c172bc16-dc9d-4f0e-9667-b0cd80a4c49f could not be found. Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'c172bc16-dc9d-4f0e-9667-b0cd80a4c49f'} Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c172bc16-dc9d-4f0e-9667-b0cd80a4c49f could not be found. Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c172bc16-dc9d-4f0e-9667-b0cd80a4c49f could not be found. Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:19.653108 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c172bc16-dc9d-4f0e-9667-b0cd80a4c49f could not be found. Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad2df9c4-b8ce-4a09-9a42-8e5e11f1b4af tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance c172bc16-dc9d-4f0e-9667-b0cd80a4c49f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad2df9c4-b8ce-4a09-9a42-8e5e11f1b4af tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/c172bc16-dc9d-4f0e-9667-b0cd80a4c49f" status: 404 len: 111 microversion: 2.1 time: 0.040282 Jul 20 11:06:19.663392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1969/3857] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:19 2022] GET /compute/v2.1/servers/c172bc16-dc9d-4f0e-9667-b0cd80a4c49f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:19.676989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:19.677913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:19.690548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:19.691054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:19.691803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:19.692248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:20.086395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:20.104185 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5878148a-cc63-480a-bb53-c864de4b0c17 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1553 microversion: 2.1 time: 0.446558 Jul 20 11:06:20.115601 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1970/3858] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:19 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1553 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:20.129814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:20.130135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:20.147484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:20.148232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:20.149195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:20.152736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:20.242144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:06:20.343451 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Instance is already in deleting state, ignoring this request Jul 20 11:06:20.344311 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5fa5fa8a-bc20-4a7e-b2ee-60c36c847562 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 204 len: 0 microversion: 2.1 time: 0.227620 Jul 20 11:06:20.344905 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1971/3859] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:20 2022] DELETE /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:06:20.352758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4c2d35b1-cebe-46be-abdd-97551273a499 req-14789561-bd96-425f-a13f-8a4a7e07a1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:20.375781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4c2d35b1-cebe-46be-abdd-97551273a499 req-14789561-bd96-425f-a13f-8a4a7e07a1af service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:20.376497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4c2d35b1-cebe-46be-abdd-97551273a499 req-14789561-bd96-425f-a13f-8a4a7e07a1af service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:20.403463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4c2d35b1-cebe-46be-abdd-97551273a499 req-14789561-bd96-425f-a13f-8a4a7e07a1af service nova] Creating event network-changed:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:06:20.425313 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4c2d35b1-cebe-46be-abdd-97551273a499 req-14789561-bd96-425f-a13f-8a4a7e07a1af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078967 Jul 20 11:06:20.430795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1972/3860] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:20.436334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:20.437038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:20.468261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:20.468723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:20.469515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:20.469955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:21.657974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:21.677048 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5c3b089c-8e06-4197-b480-131151cd7f48 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.244911 Jul 20 11:06:21.678805 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1973/3861] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:20 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:21.701768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:21.702852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:21.712332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:21.713083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:21.714284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:21.716206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:22.805495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:22.833860 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b16537f-b1b0-4488-a248-9a43c19500fc tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1514 microversion: 2.1 time: 1.152737 Jul 20 11:06:22.836113 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1974/3862] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:21 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1514 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:22.864524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:22.868270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:22.907943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:22.909329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:22.913719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:22.918069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:23.342024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:23.352251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca679ba5-6740-489e-998f-0937e01567fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1553 microversion: 2.1 time: 0.510562 Jul 20 11:06:23.360146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1975/3863] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:22 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1553 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:23.370040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:23.372840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:23.389204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:23.389924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:23.390956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:23.404070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:23.911748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:23.917213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:23.934538 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2be6551-8199-41ec-94ce-6d3e5ea70aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.567689 Jul 20 11:06:23.951315 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1976/3864] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:23 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:23.980203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:23.983591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:24.008366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.010279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.011676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.012138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.500797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013e6cb7f7a34317ab8e2ef7c4b9dc53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9662a26e6ec4789adac8707d0b279ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:24.513644 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-baff6ae1-463f-4e16-bb40-892d5a5c9379 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 200 len: 1514 microversion: 2.1 time: 0.560692 Jul 20 11:06:24.516512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1977/3865] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:23 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 1514 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:24.539666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da10ca11-00c2-4bbd-88df-57192d2b1d32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1735020934", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da10ca11-00c2-4bbd-88df-57192d2b1d32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 238 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1735020934", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1735020934', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:06:24.553386 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da10ca11-00c2-4bbd-88df-57192d2b1d32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:24.557078 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da10ca11-00c2-4bbd-88df-57192d2b1d32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036893 Jul 20 11:06:24.561608 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1978/3866] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:06:24.595844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:24.597307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:24.623910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.624363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.625430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.628617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.756380 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-394c1aaf-6a0f-4807-a19b-6705779de96e tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.789820 Jul 20 11:06:24.756995 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1889/3867] 10.222.0.79 () {60 vars in 1169 bytes} [Wed Jul 20 11:06:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:24.790293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:24.802539 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-117cc99c-b958-425f-8d44-fb386b640d05 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1511 microversion: 2.1 time: 0.235571 Jul 20 11:06:24.804133 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1979/3868] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:24 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:24.804874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:24.805795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:24.826383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.218"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:24.828402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:24.836699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.837470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.838578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.840070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.842141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.843947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.845063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:24.845655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:24.878936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Acquired lock "refresh_cache-cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 11:06:26.299554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:26.315788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1ed8c0a-8d28-4d00-a376-f107d8214a3a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.557552 Jul 20 11:06:26.316396 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1890/3869] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:24 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:26.334579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-41c67eb2-e3ed-4d06-9a3f-a5ca5bad374e req-27d41783-4ad9-4c17-b5b3-c99a83303341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e36fcb3-168e-41a5-90ef-59b817ebe544", "name": "network-vif-deleted", "tag": "343e7f07-2b08-4000-a623-532b7ad05edd"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:26.364915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-41c67eb2-e3ed-4d06-9a3f-a5ca5bad374e req-27d41783-4ad9-4c17-b5b3-c99a83303341 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.365743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-41c67eb2-e3ed-4d06-9a3f-a5ca5bad374e req-27d41783-4ad9-4c17-b5b3-c99a83303341 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:26.396807 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-41c67eb2-e3ed-4d06-9a3f-a5ca5bad374e req-27d41783-4ad9-4c17-b5b3-c99a83303341 service nova] Creating event network-vif-deleted:343e7f07-2b08-4000-a623-532b7ad05edd for instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 on n-h2-846219-10 Jul 20 11:06:26.405970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-41c67eb2-e3ed-4d06-9a3f-a5ca5bad374e req-27d41783-4ad9-4c17-b5b3-c99a83303341 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085206 Jul 20 11:06:26.410777 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1891/3870] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:26.426928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:26.427946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 8e36fcb3-168e-41a5-90ef-59b817ebe544] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:26.441996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.444689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:26.449506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.451690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:26.489254 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] HTTP exception thrown: Instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 could not be found. Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Request method failure captured: Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 HTTP/1.1 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-DzX19Qz9-sN9wh-dX3gejiS4eVuzP2Bb8TO25xPSJgppwMt0OvEw4pJ_mBXW5A9nlbGlBy8iN-1A4joZnaS2e6k-InnpZ8_WQzjOPUh7ju-foDUVKrs0Oa4N7CuaHWNrI1s6JnPGA8uy8wC7VckmmnK9gPgq9Guz-9kXaybQOdsYo Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9662a26e6ec4789adac8707d0b279ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 013e6cb7f7a34317ab8e2ef7c4b9dc53 Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 could not be found. Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '8e36fcb3-168e-41a5-90ef-59b817ebe544'} Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 could not be found. Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 could not be found. Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:26.498089 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 could not be found. Jul 20 11:06:26.502639 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:26.506524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Returning 404 to user: Instance 8e36fcb3-168e-41a5-90ef-59b817ebe544 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:26.511001 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f561a4fe-f659-41b8-a201-da748f7dd1c3 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544" status: 404 len: 111 microversion: 2.1 time: 0.098465 Jul 20 11:06:26.517394 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1892/3871] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:26 2022] GET /compute/v2.1/servers/8e36fcb3-168e-41a5-90ef-59b817ebe544 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:26.533496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:26.537958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:26.556172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.557290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:26.559993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.561405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:26.811767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:26.828682 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11af6f8c-6979-4b7a-b779-be7a1248580e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1345 microversion: 2.1 time: 0.308465 Jul 20 11:06:26.835024 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1893/3872] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:26 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1345 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:26.858923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:26.860704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:26.889403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.890260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:26.893313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:26.898176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:27.493914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:27.517624 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84b2c2fa-d42d-490f-9233-a2d93c6977b6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.672350 Jul 20 11:06:27.518308 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1894/3873] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:26 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:27.561941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:27.562456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:27.587015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:27.587559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:27.595199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:27.595662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:27.664138 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] HTTP exception thrown: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Request method failure captured: Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 HTTP/1.1 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-DzX19Qz9-sN9wh-dX3gejiS4eVuzP2Bb8TO25xPSJgppwMt0OvEw4pJ_mBXW5A9nlbGlBy8iN-1A4joZnaS2e6k-InnpZ8_WQzjOPUh7ju-foDUVKrs0Oa4N7CuaHWNrI1s6JnPGA8uy8wC7VckmmnK9gPgq9Guz-9kXaybQOdsYo Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9662a26e6ec4789adac8707d0b279ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 013e6cb7f7a34317ab8e2ef7c4b9dc53 Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '77652f95-882f-4c86-b7ec-beeda4e2d8d1'} Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:27.669853 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.674056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Returning 404 to user: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:27.678076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86338bd9-f1a1-4a64-ae2c-396761261a8c tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 404 len: 111 microversion: 2.1 time: 0.127947 Jul 20 11:06:27.684367 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1895/3874] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:27 2022] DELETE /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:27.706533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c474639-03f3-4219-a047-5891a7e5a976 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-534747279", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c474639-03f3-4219-a047-5891a7e5a976 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 234 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-534747279", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-534747279', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:27.727052 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.731487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c474639-03f3-4219-a047-5891a7e5a976 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:27.751981 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c474639-03f3-4219-a047-5891a7e5a976 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.066834 Jul 20 11:06:27.752625 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1896/3875] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:27 2022] POST /compute/v2.1/servers => generated 133 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:06:27.773614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:27.781795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 77652f95-882f-4c86-b7ec-beeda4e2d8d1] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:27.807227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:27.813059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:27.814103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:27.814561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:27.843341 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] HTTP exception thrown: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Request method failure captured: Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 HTTP/1.1 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-DzX19Qz9-sN9wh-dX3gejiS4eVuzP2Bb8TO25xPSJgppwMt0OvEw4pJ_mBXW5A9nlbGlBy8iN-1A4joZnaS2e6k-InnpZ8_WQzjOPUh7ju-foDUVKrs0Oa4N7CuaHWNrI1s6JnPGA8uy8wC7VckmmnK9gPgq9Guz-9kXaybQOdsYo Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9662a26e6ec4789adac8707d0b279ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 013e6cb7f7a34317ab8e2ef7c4b9dc53 Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '77652f95-882f-4c86-b7ec-beeda4e2d8d1'} Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:27.851408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Returning 404 to user: Instance 77652f95-882f-4c86-b7ec-beeda4e2d8d1 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:27.856283 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d66c7345-23ac-4086-9126-70c3d687d4ce tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1" status: 404 len: 111 microversion: 2.1 time: 0.092033 Jul 20 11:06:27.870311 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1897/3876] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:27 2022] GET /compute/v2.1/servers/77652f95-882f-4c86-b7ec-beeda4e2d8d1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:27.876555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:27.877179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:27.895207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:27.895714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:27.896502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:27.896940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:28.284880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:28.297220 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c7a1730-978f-41e1-b42c-73923a57c051 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.424525 Jul 20 11:06:28.303640 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1898/3877] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:27 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:28.315760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:28.316554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:28.339187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:28.348830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:28.350395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:28.353914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:28.577902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:28.592216 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a33dd8bf-6ed6-4a47-9289-f7cc84862fd4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1345 microversion: 2.1 time: 0.282566 Jul 20 11:06:28.593439 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1899/3878] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:28 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:28.604424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:28.605519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:28.644247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:28.644737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:28.659202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:28.662014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:28.711202 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] HTTP exception thrown: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Request method failure captured: Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 HTTP/1.1 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-DzX19Qz9-sN9wh-dX3gejiS4eVuzP2Bb8TO25xPSJgppwMt0OvEw4pJ_mBXW5A9nlbGlBy8iN-1A4joZnaS2e6k-InnpZ8_WQzjOPUh7ju-foDUVKrs0Oa4N7CuaHWNrI1s6JnPGA8uy8wC7VckmmnK9gPgq9Guz-9kXaybQOdsYo Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9662a26e6ec4789adac8707d0b279ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 013e6cb7f7a34317ab8e2ef7c4b9dc53 Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '34f4a07e-6bfa-44fd-8ff6-0186a36a1366'} Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:28.719317 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:28.723567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:28.725090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Returning 404 to user: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:28.726116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5ad9fb99-9341-481b-bf16-7b90be97e146 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 404 len: 111 microversion: 2.1 time: 0.131539 Jul 20 11:06:28.726904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1900/3879] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:28 2022] DELETE /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:28.749700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:28.750635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:28.765072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:28.771826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:28.772842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:28.775150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:29.347852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:29.356732 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c6a4c84-8e6d-406e-b5cd-6d2edfac3829 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.628585 Jul 20 11:06:29.364569 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1901/3880] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:28 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:29.369417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-006fce5f-58a5-4050-b929-bab36c1b0e5b req-5e1dca33-881d-405a-9595-495fc4f4faf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688e2be6-67cd-49e5-bda0-5d5a2ed8343d", "name": "network-vif-deleted", "tag": "528d0009-0440-449c-ac5f-9ec27f3a696c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:29.393699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-006fce5f-58a5-4050-b929-bab36c1b0e5b req-5e1dca33-881d-405a-9595-495fc4f4faf2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:29.394457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-006fce5f-58a5-4050-b929-bab36c1b0e5b req-5e1dca33-881d-405a-9595-495fc4f4faf2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:29.416665 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-006fce5f-58a5-4050-b929-bab36c1b0e5b req-5e1dca33-881d-405a-9595-495fc4f4faf2 service nova] Creating event network-vif-deleted:528d0009-0440-449c-ac5f-9ec27f3a696c for instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d on n-h1-846219-10 Jul 20 11:06:29.432960 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-006fce5f-58a5-4050-b929-bab36c1b0e5b req-5e1dca33-881d-405a-9595-495fc4f4faf2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066888 Jul 20 11:06:29.434175 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1902/3881] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:29.439960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:29.442922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] [instance: 34f4a07e-6bfa-44fd-8ff6-0186a36a1366] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:29.460718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:29.463096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:29.464224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:29.465691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:29.504984 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] HTTP exception thrown: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Request method failure captured: Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 HTTP/1.1 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-DzX19Qz9-sN9wh-dX3gejiS4eVuzP2Bb8TO25xPSJgppwMt0OvEw4pJ_mBXW5A9nlbGlBy8iN-1A4joZnaS2e6k-InnpZ8_WQzjOPUh7ju-foDUVKrs0Oa4N7CuaHWNrI1s6JnPGA8uy8wC7VckmmnK9gPgq9Guz-9kXaybQOdsYo Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f9662a26e6ec4789adac8707d0b279ee", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f9662a26e6ec4789adac8707d0b279ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f9662a26e6ec4789adac8707d0b279ee Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1061719160 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 013e6cb7f7a34317ab8e2ef7c4b9dc53 Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiskConfigTestJSON-1061719160-project Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '34f4a07e-6bfa-44fd-8ff6-0186a36a1366'} Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:29.506859 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] Returning 404 to user: Instance 34f4a07e-6bfa-44fd-8ff6-0186a36a1366 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-baa03c25-a2e4-4a4f-81b7-755f2f35b2c2 tempest-ServerDiskConfigTestJSON-1061719160 tempest-ServerDiskConfigTestJSON-1061719160-project] 10.222.0.79 "GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366" status: 404 len: 111 microversion: 2.1 time: 0.075420 Jul 20 11:06:29.515565 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1903/3882] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:29 2022] GET /compute/v2.1/servers/34f4a07e-6bfa-44fd-8ff6-0186a36a1366 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:29.522899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3a86ae4-dcd0-47f5-b6e0-9d7d61d73419 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:29.524716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3a86ae4-dcd0-47f5-b6e0-9d7d61d73419 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 71b037c7-707f-450a-bf93-1f7c1c40ea2f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:29.546529 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c3a86ae4-dcd0-47f5-b6e0-9d7d61d73419 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 71b037c7-707f-450a-bf93-1f7c1c40ea2f could not be found. Jul 20 11:06:29.549597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Building network info cache for instance {{(pid=125885) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3a86ae4-dcd0-47f5-b6e0-9d7d61d73419 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/71b037c7-707f-450a-bf93-1f7c1c40ea2f/action HTTP/1.1 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 13 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: {"pause": {}} Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 71b037c7-707f-450a-bf93-1f7c1c40ea2f could not be found. Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '71b037c7-707f-450a-bf93-1f7c1c40ea2f', 'body': {'pause': {}}} Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b037c7-707f-450a-bf93-1f7c1c40ea2f could not be found. Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b037c7-707f-450a-bf93-1f7c1c40ea2f could not be found. Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:29.552456 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b037c7-707f-450a-bf93-1f7c1c40ea2f could not be found. Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3a86ae4-dcd0-47f5-b6e0-9d7d61d73419 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 71b037c7-707f-450a-bf93-1f7c1c40ea2f could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3a86ae4-dcd0-47f5-b6e0-9d7d61d73419 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/71b037c7-707f-450a-bf93-1f7c1c40ea2f/action" status: 404 len: 111 microversion: 2.1 time: 0.037772 Jul 20 11:06:29.567083 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1904/3883] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:29 2022] POST /compute/v2.1/servers/71b037c7-707f-450a-bf93-1f7c1c40ea2f/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:29.571869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:29.572714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:29.595702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:29.596386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:29.604180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:29.604837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:29.672057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:31.474882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:31.485904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d3c112bd-61a6-4834-a12a-68c1935f6744 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.919455 Jul 20 11:06:31.489192 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1905/3884] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:29 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:31.510108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:31.512325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:31.522770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:31.524752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:31.526193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:31.527552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:31.850596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:31.890724 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-28e2589e-5365-418c-be69-9568d378110a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1345 microversion: 2.1 time: 0.387588 Jul 20 11:06:31.893141 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1906/3885] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:31 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1345 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:31.934163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a9c44111-2764-4687-a794-eb2ec0edf143 req-b566b323-57b1-44d0-ad89-a97301255254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:31.955268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9c44111-2764-4687-a794-eb2ec0edf143 req-b566b323-57b1-44d0-ad89-a97301255254 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:31.957140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9c44111-2764-4687-a794-eb2ec0edf143 req-b566b323-57b1-44d0-ad89-a97301255254 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:31.973699 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a9c44111-2764-4687-a794-eb2ec0edf143 req-b566b323-57b1-44d0-ad89-a97301255254 service nova] Creating event network-changed:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:06:31.980264 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a9c44111-2764-4687-a794-eb2ec0edf143 req-b566b323-57b1-44d0-ad89-a97301255254 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080461 Jul 20 11:06:31.982902 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1907/3886] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:31.991778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:31.993049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:32.002365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:32.003276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:32.004348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:32.006338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:32.892234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:32.904640 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0af70c8-e6ac-4602-9083-5d1a08d34fcc tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.919796 Jul 20 11:06:32.905738 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1908/3887] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:31 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:32.925341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:32.926430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:32.935588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:32.939026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:32.940700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:32.941374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.098760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Updating instance_info_cache with network_info: [{"id": "563fd253-8097-4b59-9631-b3fb00162e50", "address": "fa:16:3e:f7:c4:20", "network": {"id": "0764bf2e-3783-4ec1-ab92-a9cc66dd183c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-198016631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b7c5aa76c0ae494d89540818d2e2b9e4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap563fd253-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 11:06:33.118381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Releasing lock "refresh_cache-cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" {{(pid=125885) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 11:06:33.119805 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f692b0fb-fed1-4d3d-bbae-35f967a7a1b4 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action" status: 202 len: 0 microversion: 2.1 time: 8.313876 Jul 20 11:06:33.121109 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1980/3888] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:24 2022] POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action => generated 0 bytes in 8316 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 11:06:33.135649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:33.136486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:33.145095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:33.151157 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-945397f8-38ef-4dad-9800-3ee602414b96 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1345 microversion: 2.1 time: 0.231704 Jul 20 11:06:33.151815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1909/3889] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:32 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1345 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:33.162715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:33.163461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.164419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:33.165639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.167063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.218"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:33.313831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a793f6ce-72af-4226-b2b6-2981cbe06979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.190132 Jul 20 11:06:33.316530 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1981/3890] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:33 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:06:33.331833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:33.333654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:33.351547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:33.354019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.355111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:33.356799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.530338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:33.541581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:33.542939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.543988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:33.544599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:33.806899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:33.818568 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d88f9ba3-b653-4d19-9e9c-d4498821a4e7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1509 microversion: 2.1 time: 0.497798 Jul 20 11:06:33.819759 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1982/3891] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:33 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:34.168078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:34.168841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:34.185934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:34.186403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:34.187240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:34.190467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:34.645381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:34.655270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-700ce36b-70eb-48c9-a29f-c39e16a9ce4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 200 len: 1345 microversion: 2.1 time: 0.491443 Jul 20 11:06:34.656747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1983/3892] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:34 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 1345 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:34.838764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:34.840698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:34.859873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:34.860806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:34.862052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:34.862941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:34.874869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Acquired lock "refresh_cache-cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 11:06:36.163084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:36.180960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bbd6d7ac-2db1-40ed-ad13-f90b24099a54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1489 microversion: 2.1 time: 1.348007 Jul 20 11:06:36.181810 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1984/3893] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:34 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1489 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:36.196175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:36.202308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:36.225829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.226654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.234045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.234907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.286918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d HTTP/1.1 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '688e2be6-67cd-49e5-bda0-5d5a2ed8343d'} Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:36.293541 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.301808 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.312841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:36.316570 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-75eaffa0-91ee-472e-996f-6bb4920e3692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 404 len: 111 microversion: 2.1 time: 0.133640 Jul 20 11:06:36.317618 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1985/3894] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:36 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:36.329160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:36.330049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:36.346417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.347216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.348229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.351775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.403162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'pause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state paused Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 13 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: {"pause": {}} Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot 'pause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state paused Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'pause': {}}} Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state paused. Cannot pause while the instance is in this state. Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state paused Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.405238 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:36.409742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:36.409742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:36.409742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:36.409742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state paused Jul 20 11:06:36.409742 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.416374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'pause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state paused {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:36.428384 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d447c844-6a56-44d1-82a3-0be89111290d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 143 microversion: 2.1 time: 0.109479 Jul 20 11:06:36.429536 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1986/3895] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:36 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 143 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:06:36.437621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:36.438443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:36.461123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.461783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.462726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.463368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.607955 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-83d8772f-addb-4251-b478-2102f63fafd0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.173640 Jul 20 11:06:36.609238 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1987/3896] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:36 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:06:36.626027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:36.627307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:36.634976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.635746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.637624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.638224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.660262 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d/os-volume_attachments HTTP/1.1 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': '688e2be6-67cd-49e5-bda0-5d5a2ed8343d'} Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:36.663645 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:36.668517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:36.674705 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aea14e53-86db-4fda-8a50-25a21060965b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062887 Jul 20 11:06:36.676201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1988/3897] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:06:36 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:36.681738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:36.682827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:36.715127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.716222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:36.717325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:36.718004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:37.608740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:37.620461 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28a6026f-641f-40b2-929f-ebe2467d8ef4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1496 microversion: 2.1 time: 0.942850 Jul 20 11:06:37.622570 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1989/3898] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:36 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1496 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:37.640842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1598500002", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:37.737616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:06:39.795550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Building network info cache for instance {{(pid=125886) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 20 11:06:40.467448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:06:40.468449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:06:40.469111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:06:40.469680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:06:40.470265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:06:40.485231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:40.485908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:40.492427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:40.493113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:40.540092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:06:40.569720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:06:40.613107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:06:40.619210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:06:40.748525 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e51f2e2-93ea-42b4-b8ee-1ae6fab34bcc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.124314 Jul 20 11:06:40.753921 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1990/3899] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:06:40.773364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:40.779028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:40.805960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:40.810918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:40.814120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:40.814767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:41.354132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:41.377636 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8e4f95a-83bc-46c7-976f-1114201909c3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.614598 Jul 20 11:06:41.378728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1991/3900] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:40 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:41.403864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-43fa3162-5ade-4a26-b4ca-7d6bf640eb80 req-fc7bdfb2-1ba0-4e15-828f-29fe74809a4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:41.457626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-43fa3162-5ade-4a26-b4ca-7d6bf640eb80 req-fc7bdfb2-1ba0-4e15-828f-29fe74809a4a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:41.467691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-43fa3162-5ade-4a26-b4ca-7d6bf640eb80 req-fc7bdfb2-1ba0-4e15-828f-29fe74809a4a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:41.513203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-43fa3162-5ade-4a26-b4ca-7d6bf640eb80 req-fc7bdfb2-1ba0-4e15-828f-29fe74809a4a service nova] Creating event network-changed:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:06:41.521667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-43fa3162-5ade-4a26-b4ca-7d6bf640eb80 req-fc7bdfb2-1ba0-4e15-828f-29fe74809a4a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141423 Jul 20 11:06:41.524994 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1992/3901] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:41.548410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3fdb6c8a-bf83-4fa0-8371-3cfa1c25d5b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:41.551863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3fdb6c8a-bf83-4fa0-8371-3cfa1c25d5b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:41.765570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3fdb6c8a-bf83-4fa0-8371-3cfa1c25d5b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:41.775742 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3fdb6c8a-bf83-4fa0-8371-3cfa1c25d5b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 200 len: 1215 microversion: 2.1 time: 0.249325 Jul 20 11:06:41.781931 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1993/3902] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:41 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 1215 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:41.812071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:41.814876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:41.852529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:41.855856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:41.865593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:41.866443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.061601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Updating instance_info_cache with network_info: [{"id": "563fd253-8097-4b59-9631-b3fb00162e50", "address": "fa:16:3e:f7:c4:20", "network": {"id": "0764bf2e-3783-4ec1-ab92-a9cc66dd183c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-198016631-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b7c5aa76c0ae494d89540818d2e2b9e4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap563fd253-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 11:06:42.083037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Releasing lock "refresh_cache-cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" {{(pid=125886) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 11:06:42.085256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-662bed74-d00f-4e3f-8a7a-0959d9415c3c tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action" status: 202 len: 0 microversion: 2.1 time: 8.927321 Jul 20 11:06:42.086191 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1910/3903] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:33 2022] POST /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db/action => generated 0 bytes in 8934 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 20 11:06:42.102685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:42.103213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:42.123623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.124085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.124880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.140543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.278940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:06:42.327281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:42.346826 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed8fef8d-5cae-43da-95f7-26ffa933b52b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.563369 Jul 20 11:06:42.351009 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1994/3904] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:41 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:42.364768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b2118da-0ef8-4151-ab5d-43bcf12315a8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '.version_select at 0x7f2c3e9feca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:42.423160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77361cdf-c8eb-4dd1-ac2d-07e1d66637e4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 204 len: 0 microversion: 2.1 time: 0.335227 Jul 20 11:06:42.424054 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1911/3905] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:42 2022] DELETE /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:06:42.440221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:42.444648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:42.459067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.459561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.464629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.465529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.521176 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc/action HTTP/1.1 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 28 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: {"reboot": {"type": "SOFT"}} Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2bb24fea-a124-42dd-9106-a0f0b57ca0bc', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:42.525822 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:42.529466 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:42.538258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:42.552541 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04724491-de28-405b-b883-9ff2d19bedc7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc/action" status: 404 len: 111 microversion: 2.1 time: 0.125291 Jul 20 11:06:42.553737 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1912/3906] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:42 2022] POST /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc/action => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:42.570132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:42.572272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:42.588041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.589221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.591142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.593155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.772350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:42.785240 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a5107978-d209-4171-b2c3-2f95bedcf61e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 200 len: 1273 microversion: 2.1 time: 0.229559 Jul 20 11:06:42.787679 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1913/3907] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:42 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:42.793924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:42.795105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:42.815637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.816460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:42.818263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:42.818877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:43.072966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:43.101030 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-287ff1b3-8d23-42f7-946c-54c311e77fb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.302141 Jul 20 11:06:43.105660 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1914/3908] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:42 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:43.126242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:43.127094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:43.143562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:43.146220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:43.147219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:43.149636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:43.643303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:43.659864 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-32d03f04-8845-4cb5-a212-e70367810a31 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.539836 Jul 20 11:06:43.660475 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1915/3909] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:43 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:43.681014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47b9080d-6bcf-41ce-8596-836f2e2aee32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:43.681919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-47b9080d-6bcf-41ce-8596-836f2e2aee32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: c6250e3f-6817-4f35-8924-1232a12a07b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:43.698765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-47b9080d-6bcf-41ce-8596-836f2e2aee32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance c6250e3f-6817-4f35-8924-1232a12a07b5 could not be found. Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47b9080d-6bcf-41ce-8596-836f2e2aee32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/c6250e3f-6817-4f35-8924-1232a12a07b5/action HTTP/1.1 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 28 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: {"reboot": {"type": "SOFT"}} Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c6250e3f-6817-4f35-8924-1232a12a07b5 could not be found. Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c6250e3f-6817-4f35-8924-1232a12a07b5', 'body': {'reboot': {'type': 'SOFT'}}} Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6250e3f-6817-4f35-8924-1232a12a07b5 could not be found. Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6250e3f-6817-4f35-8924-1232a12a07b5 could not be found. Jul 20 11:06:43.700383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6250e3f-6817-4f35-8924-1232a12a07b5 could not be found. Jul 20 11:06:43.704153 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:43.706312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47b9080d-6bcf-41ce-8596-836f2e2aee32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance c6250e3f-6817-4f35-8924-1232a12a07b5 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:43.707812 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-47b9080d-6bcf-41ce-8596-836f2e2aee32 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/c6250e3f-6817-4f35-8924-1232a12a07b5/action" status: 404 len: 111 microversion: 2.1 time: 0.030936 Jul 20 11:06:43.708932 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1916/3910] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:43 2022] POST /compute/v2.1/servers/c6250e3f-6817-4f35-8924-1232a12a07b5/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:43.717613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:43.718247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:43.740498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:43.740962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:43.741762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:43.742209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:44.647503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:44.664413 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4209280f-c80f-4ec0-b7c8-c5a61c33d02e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.951097 Jul 20 11:06:44.678155 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1917/3911] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:43 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:44.678155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:44.678155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:44.680762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:44.694505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:44.694728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:44.695742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:44.696524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:44.876609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:44.884691 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0ee55a2-fbb6-4ea0-8d07-14e3c6cbef65 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 200 len: 1217 microversion: 2.1 time: 0.218639 Jul 20 11:06:44.896026 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1918/3912] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:44 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:44.901584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:44.902587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:44.912689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:44.916590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:44.921920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:44.922684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:45.324912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:45.343993 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f88e1cb5-890e-4ab9-b7e2-876876b816ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.446333 Jul 20 11:06:45.344642 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1919/3913] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:44 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:45.362905 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b2118da-0ef8-4151-ab5d-43bcf12315a8 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/f97076ea-6339-4992-a418-665075d2c848" status: 202 len: 0 microversion: 2.1 time: 3.004691 Jul 20 11:06:45.368758 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1995/3914] 10.222.0.79 () {58 vars in 1262 bytes} [Wed Jul 20 11:06:42 2022] DELETE /compute/v2.1/os-floating-ips/f97076ea-6339-4992-a418-665075d2c848 => generated 0 bytes in 3012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:06:45.375806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:45.377543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:45.398354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0eb0fdec-abdc-4f03-89ee-eb6f788952aa tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '.version_select at 0x7f2c3e99af70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:45.400430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:45.406665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:45.407682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:45.408222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:45.454739 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc/action HTTP/1.1 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 65 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2bb24fea-a124-42dd-9106-a0f0b57ca0bc', 'body': {'rebuild': {'imageRef': '478de60b-94fe-4326-bea5-987154e218b6'}}} Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 11:06:45.459534 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:45.463105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:45.470147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1ee61bd4-ac8b-4cd2-879d-ed8c1d200157 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc/action" status: 404 len: 111 microversion: 2.1 time: 0.107908 Jul 20 11:06:45.478440 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1920/3915] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:45 2022] POST /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:45.488886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:45.501915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:45.522041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:45.525916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:45.527598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:45.529706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.010224 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0eb0fdec-abdc-4f03-89ee-eb6f788952aa tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/596dcc97-1dd5-487d-833a-e20dc820154f" status: 202 len: 0 microversion: 2.1 time: 0.635482 Jul 20 11:06:46.011930 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1996/3916] 10.222.0.79 () {58 vars in 1271 bytes} [Wed Jul 20 11:06:45 2022] DELETE /compute/v2.1/os-security-groups/596dcc97-1dd5-487d-833a-e20dc820154f => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:06:46.021493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:46.024341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:46.044854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.045356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.049109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.049582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.106895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:46.117143 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44d79d79-b6c4-4a13-92ea-99c637a4deb5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.637521 Jul 20 11:06:46.133191 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1921/3917] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:45 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:46.154145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:46.154968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:46.185168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:46.186624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.187817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.188082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:46.189513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.189967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.207667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f48a295f-87f0-4716-a2be-c02fc0559107 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 200 len: 1217 microversion: 2.1 time: 0.194326 Jul 20 11:06:46.208277 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1997/3918] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:46 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:46.227962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:46.228606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:46.238109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.238569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.240096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.241710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:06:46.247016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.249567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:46.413109 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d0a367c-1754-420b-aa10-940738373a62 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 204 len: 0 microversion: 2.1 time: 0.278101 Jul 20 11:06:46.415499 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1922/3919] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:06:46 2022] DELETE /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:06:46.429475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:46.430684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:46.439024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.439788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:46.441008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:46.444135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:47.468661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:47.481379 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9117150-26c7-4a57-a34d-4326344ee981 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.268956 Jul 20 11:06:47.483075 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1998/3920] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:46 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:47.498685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:47.499654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:47.517243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:47.519075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:47.522193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:47.522888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:47.680891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:47.697363 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6435bc4-7f88-420b-9815-d55e161ee86f tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1510 microversion: 2.1 time: 1.271027 Jul 20 11:06:47.699978 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1923/3921] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:46 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1510 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:47.719616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fe7d29f-81bb-4adb-a2a1-164e2ebc10f7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:47.721193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7fe7d29f-81bb-4adb-a2a1-164e2ebc10f7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: dfd0a383-c74f-436b-8791-e949b58c1807] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:47.726456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:47.736501 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af9748b4-3509-4614-8c56-6c28cdd9d0e1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 200 len: 1219 microversion: 2.1 time: 0.251651 Jul 20 11:06:47.738057 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-7fe7d29f-81bb-4adb-a2a1-164e2ebc10f7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance dfd0a383-c74f-436b-8791-e949b58c1807 could not be found. Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fe7d29f-81bb-4adb-a2a1-164e2ebc10f7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/dfd0a383-c74f-436b-8791-e949b58c1807/action HTTP/1.1 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 65 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance dfd0a383-c74f-436b-8791-e949b58c1807 could not be found. Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'dfd0a383-c74f-436b-8791-e949b58c1807', 'body': {'rebuild': {'imageRef': '478de60b-94fe-4326-bea5-987154e218b6'}}} Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd0a383-c74f-436b-8791-e949b58c1807 could not be found. Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 20 11:06:47.743075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd0a383-c74f-436b-8791-e949b58c1807 could not be found. Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd0a383-c74f-436b-8791-e949b58c1807 could not be found. Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:47.748210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fe7d29f-81bb-4adb-a2a1-164e2ebc10f7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance dfd0a383-c74f-436b-8791-e949b58c1807 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:47.751241 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 1999/3922] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:47 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:47.752002 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7fe7d29f-81bb-4adb-a2a1-164e2ebc10f7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/dfd0a383-c74f-436b-8791-e949b58c1807/action" status: 404 len: 111 microversion: 2.1 time: 0.048965 Jul 20 11:06:47.753889 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1924/3923] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:47 2022] POST /compute/v2.1/servers/dfd0a383-c74f-436b-8791-e949b58c1807/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:47.769950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:47.771034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:47.782980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:47.783839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:47.792624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:47.793417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:48.127578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:48.143520 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b2abbc8-859d-4d70-a730-68d08b761d88 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.377261 Jul 20 11:06:48.146849 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2000/3924] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:47 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:48.168200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:48.168936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:48.185767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:48.186979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:48.187940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:48.188500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:48.717493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:48.718295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:48.728324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:48.734140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:48.738870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:48.739911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:48.742264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:48.926757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:48.940272 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a9f5c62-454b-406c-9613-c07305ea61a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.777687 Jul 20 11:06:48.949050 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1925/3925] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:48 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:48.954243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:48.954874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:48.989465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:48.989953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:48.990748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:48.991755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:49.039261 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 HTTP/1.1 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '8fcdf99c-c6a8-4266-a50e-c20592085b19'} Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:49.043936 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:06:49.051359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.052994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:49.054023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-27763da0-b77e-4bd6-a1cb-99409ff1541b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 404 len: 111 microversion: 2.1 time: 0.103992 Jul 20 11:06:49.065682 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1926/3926] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:48 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:49.074703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd590c29-3cd2-416c-ad0f-0f70c308b430 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:49.077026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd590c29-3cd2-416c-ad0f-0f70c308b430 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 4d1b9b03-b64f-4f9f-970a-b66071f369d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:49.091789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-fd590c29-3cd2-416c-ad0f-0f70c308b430 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 4d1b9b03-b64f-4f9f-970a-b66071f369d5 could not be found. Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd590c29-3cd2-416c-ad0f-0f70c308b430 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/4d1b9b03-b64f-4f9f-970a-b66071f369d5/action HTTP/1.1 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 15 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: {"restore": {}} Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 4d1b9b03-b64f-4f9f-970a-b66071f369d5 could not be found. Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '4d1b9b03-b64f-4f9f-970a-b66071f369d5', 'body': {'restore': {}}} Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1b9b03-b64f-4f9f-970a-b66071f369d5 could not be found. Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1b9b03-b64f-4f9f-970a-b66071f369d5 could not be found. Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:49.094026 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:49.098340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:49.098340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:49.098340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1b9b03-b64f-4f9f-970a-b66071f369d5 could not be found. Jul 20 11:06:49.098340 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:49.099504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd590c29-3cd2-416c-ad0f-0f70c308b430 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 4d1b9b03-b64f-4f9f-970a-b66071f369d5 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:49.100525 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd590c29-3cd2-416c-ad0f-0f70c308b430 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/4d1b9b03-b64f-4f9f-970a-b66071f369d5/action" status: 404 len: 111 microversion: 2.1 time: 0.033570 Jul 20 11:06:49.107262 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1927/3927] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:49 2022] POST /compute/v2.1/servers/4d1b9b03-b64f-4f9f-970a-b66071f369d5/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:49.112852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:49.122448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:49.134419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:49.134872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:49.136313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:49.136894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:49.474893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b37285feef4c32bf65656897772be3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c5aa76c0ae494d89540818d2e2b9e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:49.483893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5fc05cee-0a48-4b42-be5a-f41bbf0dc632 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 200 len: 1510 microversion: 2.1 time: 0.771019 Jul 20 11:06:49.484472 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2001/3928] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:48 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 1510 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:49.500284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-243188796", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:49.568105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:06:49.735510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:49.744169 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16b833fb-478f-4619-b96c-b00a9cd86df6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.635551 Jul 20 11:06:49.763375 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1928/3929] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:49 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:49.786989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:49.788046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:49.798165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:49.798896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:49.800000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:49.800592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:50.493670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:50.505456 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-353ad028-17af-481e-a34b-bd1d3b9363e8 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.740822 Jul 20 11:06:50.519892 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1929/3930] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:49 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:50.520873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:06:51.030672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-afd0e974-f5c7-408d-a30a-df66caf549f3 req-8e028986-955c-4dc7-8b0e-fccbec4d57d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db", "name": "network-vif-deleted", "tag": "563fd253-8097-4b59-9631-b3fb00162e50"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:51.078753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-afd0e974-f5c7-408d-a30a-df66caf549f3 req-8e028986-955c-4dc7-8b0e-fccbec4d57d3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.079764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-afd0e974-f5c7-408d-a30a-df66caf549f3 req-8e028986-955c-4dc7-8b0e-fccbec4d57d3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.103326 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-afd0e974-f5c7-408d-a30a-df66caf549f3 req-8e028986-955c-4dc7-8b0e-fccbec4d57d3 service nova] Creating event network-vif-deleted:563fd253-8097-4b59-9631-b3fb00162e50 for instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db on n-h2-846219-10 Jul 20 11:06:51.110435 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-afd0e974-f5c7-408d-a30a-df66caf549f3 req-8e028986-955c-4dc7-8b0e-fccbec4d57d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.588983 Jul 20 11:06:51.111707 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1930/3931] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:51.117358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dae7f96b-2cfd-465f-b0b6-85c02f33206c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Action: 'create', calling method: .version_select at 0x7f2c3f6df0d0>, body: {"keypair": {"name": "tempest-keypair-505905735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgWBADzpxFmXeYIBXgjIz2FxdihrK3FCObAkT05KHt2ud1RV82Cp+LkjQm7EI5mBMu62yz3eLOJLP508RgDaDG2zSEJOcykajnFrwMvPn4HL9hxGMqL+LagHojbhqVtWA=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:51.137980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dae7f96b-2cfd-465f-b0b6-85c02f33206c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Getting quotas for project e46390237efb4949bda0460063e81c63. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:06:51.146372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dae7f96b-2cfd-465f-b0b6-85c02f33206c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Getting quotas for user 1dd04112c4ef4700a7eef39d840d3ad2 and project e46390237efb4949bda0460063e81c63. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:06:51.146496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:06:51.146993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:06:51.147694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:06:51.148282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:06:51.148911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:06:51.173015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.173559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.174710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.175196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.185608 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dae7f96b-2cfd-465f-b0b6-85c02f33206c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.072412 Jul 20 11:06:51.186992 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1931/3932] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 11:06:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 11:06:51.194058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:51.195013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] [instance: cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:51.208865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.209711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.210656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.217153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.227071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:06:51.244218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:06:51.251894 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] HTTP exception thrown: Instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db could not be found. Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Request method failure captured: Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db HTTP/1.1 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-FqqHq9VCWKUfV-ML4sAopI6eTSeqUB3uSPDKG8IvxNAdpNNxyJCc69UHvxAOpZhuQtGjGPnkztFqO9SDQm-b8pCz2OocZWc321W_xhZvvxL11WQSAqn4K7TONRY5WOIJ2NkyrSxzF7LBa1aQ0TR2IH6DjnJaBBVLm01JDO17auoho Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b7c5aa76c0ae494d89540818d2e2b9e4 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-557176594 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b7c5aa76c0ae494d89540818d2e2b9e4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b7c5aa76c0ae494d89540818d2e2b9e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b7c5aa76c0ae494d89540818d2e2b9e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b7c5aa76c0ae494d89540818d2e2b9e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-557176594 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b7c5aa76c0ae494d89540818d2e2b9e4 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-557176594 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerRescueTestJSONUnderV235-557176594-project Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 01b37285feef4c32bf65656897772be3 Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-557176594-project Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db could not be found. Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db'} Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db could not be found. Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db could not be found. Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.255892 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db could not be found. Jul 20 11:06:51.259722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.273330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:06:51.285668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] Returning 404 to user: Instance cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:51.285933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:06:51.287110 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-63ad7dd5-440d-4524-86e1-715915d25cc0 tempest-ServerRescueTestJSONUnderV235-557176594 tempest-ServerRescueTestJSONUnderV235-557176594-project] 10.222.0.79 "GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db" status: 404 len: 111 microversion: 2.1 time: 0.098895 Jul 20 11:06:51.293193 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1932/3933] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:51 2022] GET /compute/v2.1/servers/cf8322ba-1a8d-49e7-9bd6-e3afacf5d3db => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:51.299822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:51.304775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:51.332715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.333168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.337827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.341555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.425730 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'restore' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 15 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: {"restore": {}} Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'restore' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'restore': {}}} Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state active. Cannot restore while the instance is in this state. Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:51.434107 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:51.437721 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:51.437721 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:51.437721 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:51.437721 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:51.437721 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:51.439380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'restore' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:51.440418 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c901a0ba-0e2a-4d4a-b2ad-1f84cf960aac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 145 microversion: 2.1 time: 0.145521 Jul 20 11:06:51.441004 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1933/3934] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:51 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 145 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:06:51.463233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:51.468257 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1f204e92-6b6c-4694-8e58-59c07d73d11e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.971722 Jul 20 11:06:51.470139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2002/3935] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:06:51.478734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:51.484917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:51.491435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:51.505865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.508781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.515514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:51.516256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:51.792421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:51.801954 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1214 microversion: 2.1 time: 0.325540 Jul 20 11:06:51.804099 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2003/3936] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:51 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1214 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:52.157730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:52.158946 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002102 Jul 20 11:06:52.160539 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2004/3937] 10.222.0.79 () {56 vars in 885 bytes} [Wed Jul 20 11:06:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 11:06:52.166664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:52.169063 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002902 Jul 20 11:06:52.170008 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2005/3938] 10.222.0.79 () {54 vars in 1034 bytes} [Wed Jul 20 11:06:52 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 20 11:06:52.176897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:52.178408 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002373 Jul 20 11:06:52.179293 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2006/3939] 10.222.0.79 () {54 vars in 1040 bytes} [Wed Jul 20 11:06:52 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:06:52.188306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:52.189715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9bd0fe36-e13a-479f-a24e-04ac36275b93 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001965 Jul 20 11:06:52.190218 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2007/3940] 10.222.0.79 () {56 vars in 885 bytes} [Wed Jul 20 11:06:52 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 20 11:06:52.234716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:52.251584 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5459ea25-1648-4de4-9c55-ba300fbf2d6d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.789481 Jul 20 11:06:52.254181 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1934/3941] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:51 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:52.275186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:52.276670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:52.295432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:52.298916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:52.299940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:52.303479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:52.820949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:52.822364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:52.834561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:52.835806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:52.837571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:52.838220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:53.271843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:53.282469 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-08b9f23c-43c8-4922-8d5d-b1b44f022a51 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1266 microversion: 2.1 time: 0.464692 Jul 20 11:06:53.284134 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1935/3942] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:52 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:53.430830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:53.441125 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d3fe41d-8074-4c17-a91a-43ee1f8bd0e3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.170285 Jul 20 11:06:53.450800 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2008/3943] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:52 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:53.468943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad654a87-7ece-46d6-a72f-4fd1a1259179 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:53.470246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad654a87-7ece-46d6-a72f-4fd1a1259179 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 1ba6a523-1b33-4c71-a055-4c3baa37beb5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:53.485049 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-ad654a87-7ece-46d6-a72f-4fd1a1259179 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 1ba6a523-1b33-4c71-a055-4c3baa37beb5 could not be found. Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad654a87-7ece-46d6-a72f-4fd1a1259179 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/1ba6a523-1b33-4c71-a055-4c3baa37beb5/action HTTP/1.1 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 14 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: {"resume": {}} Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 1ba6a523-1b33-4c71-a055-4c3baa37beb5 could not be found. Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '1ba6a523-1b33-4c71-a055-4c3baa37beb5', 'body': {'resume': {}}} Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba6a523-1b33-4c71-a055-4c3baa37beb5 could not be found. Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba6a523-1b33-4c71-a055-4c3baa37beb5 could not be found. Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:53.508679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:53.513624 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:53.513624 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:53.513624 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba6a523-1b33-4c71-a055-4c3baa37beb5 could not be found. Jul 20 11:06:53.513624 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:53.514154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad654a87-7ece-46d6-a72f-4fd1a1259179 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 1ba6a523-1b33-4c71-a055-4c3baa37beb5 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:53.515248 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad654a87-7ece-46d6-a72f-4fd1a1259179 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/1ba6a523-1b33-4c71-a055-4c3baa37beb5/action" status: 404 len: 111 microversion: 2.1 time: 0.054527 Jul 20 11:06:53.520218 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1936/3944] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:53 2022] POST /compute/v2.1/servers/1ba6a523-1b33-4c71-a055-4c3baa37beb5/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:06:53.529904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:53.530932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:53.538509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:53.545158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:53.546442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:53.547121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:54.303275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:54.308076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:54.329161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:54.329981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:54.331895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:54.332588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:54.562619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:54.587836 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f8b47e7-0c3a-423a-9abf-c98e5885c09c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1272 microversion: 2.1 time: 0.287391 Jul 20 11:06:54.589984 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1937/3945] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:54 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:54.639535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:54.658558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-312c0caa-8181-4207-96fa-33cc923d6830 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.133781 Jul 20 11:06:54.663392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2009/3946] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:53 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:54.683230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:54.684310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:54.701713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:54.703100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:54.704832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:54.708642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:55.606823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:55.607724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:55.621202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:55.625876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:55.628200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:55.630834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:55.722979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:55.733657 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8bdf282f-3ad5-46e6-ba04-3d11599aba19 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.056784 Jul 20 11:06:55.741827 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1938/3947] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:54 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:55.754843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:55.756663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:55.769474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:55.772143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:55.773096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:55.775036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:55.844400 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'resume' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 14 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: {"resume": {}} Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'resume' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'resume': {}}} Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state active. Cannot resume while the instance is in this state. Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:55.846274 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:55.850573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:55.850573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:06:55.850573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:06:55.850573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:06:55.850573 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:06:55.865601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'resume' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:55.866926 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c65a3842-cb94-4bf4-b38c-eb6823093b1e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 144 microversion: 2.1 time: 0.118790 Jul 20 11:06:55.871675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1939/3948] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:06:55 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 144 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 11:06:55.881938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:55.884431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:55.907269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:55.908014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:55.909928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:55.910600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:56.580081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:56.589590 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3a0a9088-bc61-4ff4-92cd-b6d4ccd2f747 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1314 microversion: 2.1 time: 0.986942 Jul 20 11:06:56.595661 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2010/3949] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:55 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:56.720816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:56.740251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19e95324-d717-43f0-b0d8-f0e21dfa94c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.864081 Jul 20 11:06:56.742082 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1940/3950] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:55 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:56.761681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:56.762746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:56.771570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:56.772255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:56.773224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:56.773821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:57.613560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:57.614568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:57.628190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:57.628573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:57.634192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:57.634665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:57.966230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:57.974159 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f07fdc3-aefb-46f4-9dd7-2f998aaf5868 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.217494 Jul 20 11:06:57.984951 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2011/3951] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:56 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:58.082873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a78ad74f-983a-413b-8bcb-a44228290f86 req-6fd6f174-e1b7-4970-ae99-5e92a8e06672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab54db46-9076-4a17-b1e6-1c05fbe4b9a8", "tag": "ce259d0c-50af-4fc4-9c01-8105e836652c"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:58.102608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a78ad74f-983a-413b-8bcb-a44228290f86 req-6fd6f174-e1b7-4970-ae99-5e92a8e06672 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:58.103682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a78ad74f-983a-413b-8bcb-a44228290f86 req-6fd6f174-e1b7-4970-ae99-5e92a8e06672 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:58.124597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a78ad74f-983a-413b-8bcb-a44228290f86 req-6fd6f174-e1b7-4970-ae99-5e92a8e06672 service nova] Creating event network-changed:ce259d0c-50af-4fc4-9c01-8105e836652c for instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 on n-h2-846219-10 Jul 20 11:06:58.131722 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a78ad74f-983a-413b-8bcb-a44228290f86 req-6fd6f174-e1b7-4970-ae99-5e92a8e06672 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054795 Jul 20 11:06:58.154870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2012/3952] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:06:58.246741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd94da41-8b16-41b3-ac29-81cfbe90753a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd94da41-8b16-41b3-ac29-81cfbe90753a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 160 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": "", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27c7b58b-4f85-421a-aaca-e450cd9c7adf"}]}} Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'server': {'name': '', 'imageRef': '478de60b-94fe-4326-bea5-987154e218b6', 'flavorRef': '452', 'networks': [{'uuid': '27c7b58b-4f85-421a-aaca-e450cd9c7adf'}]}}} Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '' Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:06:58.249576 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 11:06:58.254946 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:06:58.259953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd94da41-8b16-41b3-ac29-81cfbe90753a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:06:58.274232 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cd94da41-8b16-41b3-ac29-81cfbe90753a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019958 Jul 20 11:06:58.276173 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2013/3953] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:06:58 2022] POST /compute/v2.1/servers => generated 108 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:06:58.283251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:58.289299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:58.317992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:58.320417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:58.323500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:58.328206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:59.144657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:59.180715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-090a05bf-6590-429a-b03a-2fdf0fcc0b71 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1314 microversion: 2.1 time: 1.573008 Jul 20 11:06:59.191071 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1941/3954] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:57 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1314 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:06:59.599495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:06:59.614938 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e449f07c-c061-44a0-b947-258cff14206e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.335461 Jul 20 11:06:59.628692 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2014/3955] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:58 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:06:59.643840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:06:59.643840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:06:59.661586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:59.668152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:59.679829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:06:59.680325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:06:59.961968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2140305530", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "6534a450-3b34-4bea-b3a9-1cc6b89b48d5"}, {"port": "4f9eba37-5782-42b9-a580-d8aef484de11", "tag": "port-1"}, {"port": "6248f3fa-d9ae-4cf6-a449-7652d080210f", "tag": "port-2"}, {"uuid": "ab1e3860-bc7b-405a-80dd-06a702e5fa2b", "tag": "net-1"}, {"uuid": "ab1e3860-bc7b-405a-80dd-06a702e5fa2b"}, {"uuid": "935238eb-5921-48f5-8b03-166469f3bdef", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "935238eb-5921-48f5-8b03-166469f3bdef", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f4f1cef9-6347-4b04-a4d8-f0f47b0e4580", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7e4a067b-c0e9-4b94-b8ce-62fc54d4afc4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3df90533-4e8d-467a-b6a1-f682942a9436", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1819989288"}], "key_name": "tempest-keypair-505905735", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:00.372444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] validate_networks() for [('6534a450-3b34-4bea-b3a9-1cc6b89b48d5', None, None, None, None, None), (None, None, '4f9eba37-5782-42b9-a580-d8aef484de11', None, None, None), (None, None, '6248f3fa-d9ae-4cf6-a449-7652d080210f', None, None, None), ('ab1e3860-bc7b-405a-80dd-06a702e5fa2b', None, None, None, None, None), ('ab1e3860-bc7b-405a-80dd-06a702e5fa2b', None, None, None, None, None), ('935238eb-5921-48f5-8b03-166469f3bdef', '10.2.2.100', None, None, None, None), ('935238eb-5921-48f5-8b03-166469f3bdef', '10.2.2.200', None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:07:00.526945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:00.542634 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b34a34c7-27c9-41fb-beb7-424d7db49b5a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.906988 Jul 20 11:07:00.547621 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1942/3956] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:06:59 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:00.565861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:00.567099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:00.574959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:00.575819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:00.576815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:00.577461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:01.082255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:01.167068 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-805dd444-4a47-4ee6-aa12-6ba371f2751c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1314 microversion: 2.1 time: 0.537606 Jul 20 11:07:01.167864 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1943/3957] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:00 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:01.170417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:01.187826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99f07ee2-1eef-4eeb-a300-4a1288661c54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:01.188715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99f07ee2-1eef-4eeb-a300-4a1288661c54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 1c8945ff-8ec8-4211-8b62-9720b3dc67ac] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:01.203389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:01.212313 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-99f07ee2-1eef-4eeb-a300-4a1288661c54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 1c8945ff-8ec8-4211-8b62-9720b3dc67ac could not be found. Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99f07ee2-1eef-4eeb-a300-4a1288661c54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/1c8945ff-8ec8-4211-8b62-9720b3dc67ac/action HTTP/1.1 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 14 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: {"shelve": {}} Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 1c8945ff-8ec8-4211-8b62-9720b3dc67ac could not be found. Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '1c8945ff-8ec8-4211-8b62-9720b3dc67ac', 'body': {'shelve': {}}} Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8945ff-8ec8-4211-8b62-9720b3dc67ac could not be found. Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8945ff-8ec8-4211-8b62-9720b3dc67ac could not be found. Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:07:01.215149 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:07:01.219727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:07:01.219727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:07:01.219727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8945ff-8ec8-4211-8b62-9720b3dc67ac could not be found. Jul 20 11:07:01.219727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:01.222816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99f07ee2-1eef-4eeb-a300-4a1288661c54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 1c8945ff-8ec8-4211-8b62-9720b3dc67ac could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:07:01.224254 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99f07ee2-1eef-4eeb-a300-4a1288661c54 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/1c8945ff-8ec8-4211-8b62-9720b3dc67ac/action" status: 404 len: 111 microversion: 2.1 time: 0.054630 Jul 20 11:07:01.232142 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1944/3958] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:07:01 2022] POST /compute/v2.1/servers/1c8945ff-8ec8-4211-8b62-9720b3dc67ac/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:07:01.243238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:01.245472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:01.254864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:01.255792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:01.256840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:01.257437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:01.306997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:01.796998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=16 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:02.630125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:02.644727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9dbe35f9-b808-4118-8283-76881fa4cf8a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.407317 Jul 20 11:07:02.646335 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1945/3959] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:01 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:02.653194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:02.659925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:02.676329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:02.680685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:02.681835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:02.683245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:03.618847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:03.630546 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9705b94d-a29a-4369-a4dc-9e654d0a087e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1314 microversion: 2.1 time: 0.982407 Jul 20 11:07:03.655476 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1946/3960] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:02 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1314 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:03.660130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:03.660770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:03.688521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:03.689172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:03.692507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:03.693142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:04.694867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:04.721894 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c50fdd7-b2ff-4652-8ca6-ba32cac89c76 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.056759 Jul 20 11:07:04.723067 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1947/3961] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:03 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:04.734101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:04.734484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:04.762034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:04.769638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:04.770636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:04.771253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:05.305193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:05.317759 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c9e06dfe-4dbf-4337-9542-723499335f1b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1314 microversion: 2.1 time: 0.591152 Jul 20 11:07:05.320637 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1948/3962] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:04 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:05.333700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:05.334260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:05.349981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:05.350977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:05.352023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:05.352698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:05.405705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lazy-loading 'flavor' on Instance uuid 9551e7fa-23a0-4481-b8dc-699f20cad7f4 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:07:05.964226 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d0c7d91-829e-4074-a793-475cf911fa61 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.640787 Jul 20 11:07:05.973265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1949/3963] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:07:05 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:07:06.269034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a87889d1-fd1f-4a73-8cfe-03ebdb87120d req-8bea7623-cdf5-41bd-8c0e-4840387dc921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab54db46-9076-4a17-b1e6-1c05fbe4b9a8", "name": "network-vif-plugged", "status": "completed", "tag": "ce259d0c-50af-4fc4-9c01-8105e836652c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:06.296338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a87889d1-fd1f-4a73-8cfe-03ebdb87120d req-8bea7623-cdf5-41bd-8c0e-4840387dc921 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:06.296861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a87889d1-fd1f-4a73-8cfe-03ebdb87120d req-8bea7623-cdf5-41bd-8c0e-4840387dc921 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:06.313700 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a87889d1-fd1f-4a73-8cfe-03ebdb87120d req-8bea7623-cdf5-41bd-8c0e-4840387dc921 service nova] Creating event network-vif-plugged:ce259d0c-50af-4fc4-9c01-8105e836652c for instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 on n-h2-846219-10 Jul 20 11:07:06.322246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a87889d1-fd1f-4a73-8cfe-03ebdb87120d req-8bea7623-cdf5-41bd-8c0e-4840387dc921 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346546 Jul 20 11:07:06.324483 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1950/3964] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:06.345526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:06.360459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:06.393065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:06.395246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:06.396094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:06.397127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:07.108724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:07.131906 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f075fb57-8f60-4abf-869e-0f365d334d6c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 0.806048 Jul 20 11:07:07.132994 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1951/3965] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:06 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:07.165576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:07.166587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:07.209888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:07.210314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:07.211105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:07.211577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:07.830351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:07.844832 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3ea115bd-2586-488c-9242-5968b585bf6a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1314 microversion: 2.1 time: 0.710563 Jul 20 11:07:07.851534 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1952/3966] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:07 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:08.153884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:08.178155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:08.195658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:08.196389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:08.197266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:08.198862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:08.839916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:08.853043 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b4665784-d7b7-4a5f-b6f9-ad0dc525c1b0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 0.706607 Jul 20 11:07:08.854498 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1953/3967] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:08 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:07:08.868962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:08.870194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:08.885233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:08.885971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:08.887024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:08.887672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:09.384275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:09.395880 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-796ae85d-f527-4c24-a3c8-96dd3f2ac61b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1501 microversion: 2.1 time: 0.533823 Jul 20 11:07:09.395880 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1954/3968] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:08 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1501 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:09.410558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:09.411399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:09.419138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:09.419787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:09.420860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:09.421478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:09.603087 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6ae8f0a-4b67-4252-83ff-c84a0de279b8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8/action" status: 202 len: 0 microversion: 2.1 time: 0.196871 Jul 20 11:07:09.614529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=59 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:09.615090 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1955/3969] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:07:09 2022] POST /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:07:09.671721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:09.673015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:09.716947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:09.719334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:09.720517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:09.721106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:10.387858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:10.405494 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e59be9b-9189-4d0a-a515-932b8ad84eb4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1506 microversion: 2.1 time: 0.780155 Jul 20 11:07:10.405494 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1956/3970] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:09 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:10.423163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:10.423837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:10.444333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:10.444796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:10.448268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:10.448785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:11.058009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:07:11.059004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:07:11.059148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:07:11.059551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:07:11.060076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:07:11.073765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:11.080617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:11.081075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:11.087562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:11.088148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:11.090472 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0b85e71d-ed44-4236-b846-05b915287ad4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 0.690129 Jul 20 11:07:11.092362 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1957/3971] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:10 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:11.138475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Getting quotas for project e46390237efb4949bda0460063e81c63. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:07:11.145010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Getting quotas for user 1dd04112c4ef4700a7eef39d840d3ad2 and project e46390237efb4949bda0460063e81c63. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:07:11.456968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:07:11.459917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f4f1cef9-6347-4b04-a4d8-f0f47b0e4580',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7e4a067b-c0e9-4b94-b8ce-62fc54d4afc4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3df90533-4e8d-467a-b6a1-f682942a9436',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:07:11.680215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-508a685a-e63e-4705-bf93-282fe24ca530 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'create', calling method: .version_select at 0x7f2c3f6df4c0>, body: {"keypair": {"name": "tempest-keypair-1475532711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE89idFZ47VzYnjrJnld7Ht3cvMEDNwvW6NXkFMWZeDdxoVQWrwaBRKsELXGSQo0yWw9zZHhMuikyL+iu54lKzCdfMeV3MG4/PidzQRfoPN75aVKA87PI7YUyZ9fampAqA=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:11.743077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-508a685a-e63e-4705-bf93-282fe24ca530 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:07:11.756064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:11.774739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-508a685a-e63e-4705-bf93-282fe24ca530 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for user 85fdcf2c53c648548248e606e639b974 and project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:07:11.888873 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-508a685a-e63e-4705-bf93-282fe24ca530 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.795284 Jul 20 11:07:11.896918 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1958/3972] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:07:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:11.918117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:11.918774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:11.944590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:11.946509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:11.948265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:11.949245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:12.258800 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-88a9dcd3-af17-4e11-91fa-a74a803bcef2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 12.297672 Jul 20 11:07:12.260876 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2015/3973] 10.222.0.79 () {62 vars in 1188 bytes} [Wed Jul 20 11:06:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 12304 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 20 11:07:12.292938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:12.309163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:12.350406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:12.353050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:12.354106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:12.354573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:13.066251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:13.075289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:13.076346 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-128b8833-207f-4a6f-8ed6-f26c387e33fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1486 microversion: 2.1 time: 1.174373 Jul 20 11:07:13.077769 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1959/3974] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:11 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1486 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:13.084003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7129239-6785-4851-b849-3486c5b1ab00 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:13.084737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7129239-6785-4851-b849-3486c5b1ab00 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:13.106310 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6bd6c592-d814-4616-b710-40f3d63198cd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 0.843568 Jul 20 11:07:13.106768 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2016/3975] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:12 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:13.127303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:13.128118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:13.140045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:13.140816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:13.146420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:13.147862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:13.234233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7129239-6785-4851-b849-3486c5b1ab00 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:13.238204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:07:13.249551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7129239-6785-4851-b849-3486c5b1ab00 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:13.252803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7129239-6785-4851-b849-3486c5b1ab00 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:13.256367 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7129239-6785-4851-b849-3486c5b1ab00 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1285 microversion: 2.32 time: 0.177409 Jul 20 11:07:13.260350 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1960/3976] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:13 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:13.519838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3440608-cd54-40c9-bef5-6af3df389d79 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 204 len: 0 microversion: 2.1 time: 0.397233 Jul 20 11:07:13.521373 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2017/3977] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:07:13 2022] DELETE /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:07:13.531503 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:07:13.531665 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:07:13.544711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:13.546512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:13.578498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:13.582170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:13.583206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:13.587096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:14.127897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:14.128624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:14.153182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:14.153539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:14.157337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:14.164836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:14.165364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:14.177086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:14.188030 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98caf993-60ae-4768-aad7-fc0038f77c4d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1492 microversion: 2.1 time: 0.661114 Jul 20 11:07:14.191004 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1961/3978] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:13 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1492 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:07:14.286627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c2b2d82-f29a-4163-8a35-155a6eb91ecc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:14.287829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1c2b2d82-f29a-4163-8a35-155a6eb91ecc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:14.617293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c2b2d82-f29a-4163-8a35-155a6eb91ecc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:14.634373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c2b2d82-f29a-4163-8a35-155a6eb91ecc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:14.642131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c2b2d82-f29a-4163-8a35-155a6eb91ecc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:14.643937 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c2b2d82-f29a-4163-8a35-155a6eb91ecc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1285 microversion: 2.32 time: 0.369508 Jul 20 11:07:14.649399 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1962/3979] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:14 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1285 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:15.208841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:15.209637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:15.232181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:15.233815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:15.234903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:15.235596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:15.976125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:15.990047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a61a91b-b939-40c3-8f3c-9d33066f0cda tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1492 microversion: 2.1 time: 0.785568 Jul 20 11:07:15.997758 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1963/3980] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:15 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1492 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:07:16.005000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:16.016357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:16.033646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:16.039430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:16.046877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:16.048585 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2edb7663-3ccc-4aff-9aaa-1e468bcf8bd1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 1.925570 Jul 20 11:07:16.050300 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2018/3981] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:14 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:07:16.053044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:16.055474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:16.192281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:16.207250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:16.232016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:16.233234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09d3ea9f-73ab-4813-8fcf-ebd90c7a6c1e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1593 microversion: 2.32 time: 0.234175 Jul 20 11:07:16.233806 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1964/3982] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:15 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1593 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:17.010674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:17.012540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:17.030395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.031651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:17.032607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.033396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:17.069628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:17.070621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:17.092347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.093031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:17.095222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.096014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:17.501874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:17.517981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c05e50b4-285f-4ae3-a058-423bed4be620 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 200 len: 1450 microversion: 2.1 time: 0.511281 Jul 20 11:07:17.519469 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2019/3983] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:17 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 1450 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:17.526666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:17.527881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:17.556054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.556528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:17.557501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.557949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:17.870998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:17.891108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:17.898344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:17.913797 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b57069f-de8a-40b8-9163-41a27ff36368 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1593 microversion: 2.32 time: 0.392775 Jul 20 11:07:17.918041 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2020/3984] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:17 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1593 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:17.934199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b9cc0fe4-8200-4325-a8d8-946ca6ef954d req-17579062-54e2-47de-a80d-691e0d01f590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab54db46-9076-4a17-b1e6-1c05fbe4b9a8", "name": "network-vif-deleted", "tag": "ce259d0c-50af-4fc4-9c01-8105e836652c"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:17.976791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b9cc0fe4-8200-4325-a8d8-946ca6ef954d req-17579062-54e2-47de-a80d-691e0d01f590 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:17.977502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b9cc0fe4-8200-4325-a8d8-946ca6ef954d req-17579062-54e2-47de-a80d-691e0d01f590 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:18.004193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:18.006847 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b9cc0fe4-8200-4325-a8d8-946ca6ef954d req-17579062-54e2-47de-a80d-691e0d01f590 service nova] Creating event network-vif-deleted:ce259d0c-50af-4fc4-9c01-8105e836652c for instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 on n-h2-846219-10 Jul 20 11:07:18.019397 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b9cc0fe4-8200-4325-a8d8-946ca6ef954d req-17579062-54e2-47de-a80d-691e0d01f590 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098740 Jul 20 11:07:18.022926 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2021/3985] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:18.026802 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-863d7c5f-8139-459b-a049-5b6865384933 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1531 microversion: 2.1 time: 0.962263 Jul 20 11:07:18.035203 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1965/3986] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:17 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1531 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:07:18.552641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:18.555843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:18.614096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:18.615699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:18.620784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:18.622018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:18.647775 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 HTTP/1.1 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ab54db46-9076-4a17-b1e6-1c05fbe4b9a8'} Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:07:18.653398 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:07:18.657794 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:07:18.660174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:07:18.661260 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49199772-4ce5-4b61-a363-003c74015274 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 404 len: 111 microversion: 2.1 time: 0.129051 Jul 20 11:07:18.672214 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2022/3987] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:18 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:07:18.938478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:18.939471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:18.975675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1128328701", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:18.981167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:18.982158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:18.987027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:18.987836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:18.992672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:19.116806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:07:20.264364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:20.281278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:20.287404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:20.290750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94f3956e-f047-4a15-9081-d9232bf63697 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1661 microversion: 2.32 time: 1.356807 Jul 20 11:07:20.295081 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1966/3988] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:18 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1661 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:20.314368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:20.315846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:20.349478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:20.351606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:20.352882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:20.353107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:21.113501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:07:21.113959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:07:21.114387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:07:21.114802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:07:21.115554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:07:21.138326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:21.141462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:21.141922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:21.142730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:21.143190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:21.223325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:07:21.256339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:07:21.306120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:07:21.314604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:07:21.391955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:21.405927 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec8b81ab-329e-4ba6-b73f-313eff983db7 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.106973 Jul 20 11:07:21.407011 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1967/3989] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:20 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:21.426812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1891007372", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eec87b6d-7d5e-44a0-b831-62582b4dcc3f"}], "security_groups": [{"name": "tempest-securitygroup--444186482"}], "key_name": "tempest-keypair-1475532711", "user_data": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:21.449700 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d64636d-04b9-4f41-a3d1-a5475fb46aac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477993 Jul 20 11:07:21.450988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2023/3990] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:07:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:07:21.472969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:21.473974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:21.489210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:21.491868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:21.492985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:21.495793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:21.926436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] validate_networks() for [('eec87b6d-7d5e-44a0-b831-62582b4dcc3f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:07:22.240440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:22.258309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:22.260953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:22.262705 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28fdf922-d514-4df9-aacd-b5a3cbc2db50 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1661 microversion: 2.32 time: 0.810378 Jul 20 11:07:22.265985 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2024/3991] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:21 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1661 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:22.274852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33b8f055-0afe-44d7-9c63-3e436c776990 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:22.283405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33b8f055-0afe-44d7-9c63-3e436c776990 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:22.514012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-33b8f055-0afe-44d7-9c63-3e436c776990 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:22.523852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33b8f055-0afe-44d7-9c63-3e436c776990 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1215 microversion: 2.1 time: 0.252701 Jul 20 11:07:22.537072 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2025/3992] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:22 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:22.543096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:22.556606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:22.579770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:22.587937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:22.589422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:22.590003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:23.705007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:23.722398 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1215a8f7-6833-4767-b1dd-c986132e9eb3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.183700 Jul 20 11:07:23.723022 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2026/3993] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:22 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:23.764487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:23.769848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:23.804860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:23.810039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:23.814064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:23.818047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:24.164670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:07:24.165048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:07:24.165191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:07:24.166634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:07:24.167359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:07:24.188274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:24.191636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:24.192974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:24.199339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:24.261876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:07:24.269760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for user 85fdcf2c53c648548248e606e639b974 and project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:07:24.288532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:07:24.291578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:07:24.362641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:24.382632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:24.384737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:24.387339 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69976e93-a608-46d6-a861-4a902f0f5fe5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1708 microversion: 2.32 time: 0.657478 Jul 20 11:07:24.403571 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2027/3994] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:23 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1708 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:24.409614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9e17a1f-c263-45c5-9c49-7dd9da13d196 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.000909 Jul 20 11:07:24.419946 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1968/3995] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:07:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 3012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:07:24.427578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:24.429695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a71f8cba-2ed9-4eea-9509-4a1b7e0cae1f req-1cf90832-dc45-4e9f-a3ed-9e9847201316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9551e7fa-23a0-4481-b8dc-699f20cad7f4", "name": "network-vif-plugged", "status": "completed", "tag": "330484e6-bbe2-4871-a298-e6b70406be9f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:24.434277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:24.465810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:24.466348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a71f8cba-2ed9-4eea-9509-4a1b7e0cae1f req-1cf90832-dc45-4e9f-a3ed-9e9847201316 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:24.466826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a71f8cba-2ed9-4eea-9509-4a1b7e0cae1f req-1cf90832-dc45-4e9f-a3ed-9e9847201316 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:24.468248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:24.469954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:24.470741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:24.514314 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a71f8cba-2ed9-4eea-9509-4a1b7e0cae1f req-1cf90832-dc45-4e9f-a3ed-9e9847201316 service nova] Creating event network-vif-plugged:330484e6-bbe2-4871-a298-e6b70406be9f for instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 on n-h2-846219-10 Jul 20 11:07:24.520214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a71f8cba-2ed9-4eea-9509-4a1b7e0cae1f req-1cf90832-dc45-4e9f-a3ed-9e9847201316 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098684 Jul 20 11:07:24.522664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1969/3996] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:24.530973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-079d569b-092c-4302-b331-319311c1f191 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:24.531886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-079d569b-092c-4302-b331-319311c1f191 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:24.986388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-079d569b-092c-4302-b331-319311c1f191 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:24.996985 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-079d569b-092c-4302-b331-319311c1f191 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1239 microversion: 2.1 time: 0.470954 Jul 20 11:07:25.001037 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1970/3997] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:24 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1239 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:25.020572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:25.021746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:25.034496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:25.035898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:25.040220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:25.041067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:25.575409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:25.586834 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-636168d5-611f-499a-9af3-59b3716a7491 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1273 microversion: 2.1 time: 1.181917 Jul 20 11:07:25.608158 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2028/3998] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:24 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1273 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:25.617787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:25.630468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:25.656738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:25.657292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:25.658216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:25.658685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:27.417469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:27.433425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:27.436885 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7dbf01ac-9378-42af-bca4-842b541967ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 2.433169 Jul 20 11:07:27.438405 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1971/3999] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:25 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 2437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:27.457724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:27.458698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:27.471616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:27.473152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:27.476985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:27.478936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:27.527908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:27.540171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:27.544102 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf49d706-c6d0-4001-b99a-4ee9e5c5708d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1755 microversion: 2.32 time: 1.933541 Jul 20 11:07:27.546391 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2029/4000] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:25 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1755 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:27.566616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:27.569323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:27.582159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:27.583079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:27.585031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:27.585845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:27.930285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:27.949137 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52aea084-8302-41a2-9e38-95768ec3ecac tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1297 microversion: 2.1 time: 0.508858 Jul 20 11:07:27.949739 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1972/4001] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:27 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1297 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:28.409130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:28.431568 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5d078305-398b-4f5c-9ac9-953f338900ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 0.879644 Jul 20 11:07:28.438646 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2030/4002] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:27 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:28.456439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:28.457324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:28.475691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:28.476140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:28.479922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:28.482546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:28.568740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:28.569766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:28.595045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:28.610212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:28.611354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:28.616107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:29.654409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:29.665128 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dda24aed-61b6-4be9-a363-9003c028798e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.214660 Jul 20 11:07:29.695918 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1973/4003] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:28 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:29.712316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:29.735413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:29.762263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:29.763369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:29.764189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:29.764629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:30.316098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:30.340005 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-319f571b-b3f2-48b5-b4b1-2a8d9144a7ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1297 microversion: 2.1 time: 0.634920 Jul 20 11:07:30.340852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1974/4004] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:29 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1297 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:30.372964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:30.374686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:30.405596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:30.407361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:30.408504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:30.408931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:30.739401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:30.784790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:30.788149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:30.789807 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55bd9eab-5d6a-4404-8004-15471260e2f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1755 microversion: 2.32 time: 2.227605 Jul 20 11:07:30.790929 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2031/4005] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:28 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1755 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:07:30.824754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:30.826377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:30.856283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:30.867563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:30.877930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:30.882786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:31.169846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:31.467732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:31.482781 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b06665ea-29fe-4565-8d27-07311b91abe7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 1.134429 Jul 20 11:07:31.486286 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1975/4006] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:30 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:31.501201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:31.504083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:31.534558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:31.548084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:31.549332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:31.549518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:31.841758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:31.861033 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d56d66d3-dfeb-4b1e-b584-bb1b661d90e0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1297 microversion: 2.1 time: 0.372643 Jul 20 11:07:31.876474 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1976/4007] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:31 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1297 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:31.882635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:31.883535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:31.892276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:31.892999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:31.894282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:31.895599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:32.230086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:32.264474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c1aee31-da1a-43a1-b009-8d1ffe35b952 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.461490 Jul 20 11:07:32.270171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2032/4008] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:30 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:32.295889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2f592107-b8e8-449e-bdbb-034361cdea63 req-8a849e40-7e44-4845-802b-bb8aeb8a28f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2", "tag": "65fbc3b6-20f1-40ce-8bff-dad234a55c64"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:32.361568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2f592107-b8e8-449e-bdbb-034361cdea63 req-8a849e40-7e44-4845-802b-bb8aeb8a28f9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:32.362009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2f592107-b8e8-449e-bdbb-034361cdea63 req-8a849e40-7e44-4845-802b-bb8aeb8a28f9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:32.464774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2f592107-b8e8-449e-bdbb-034361cdea63 req-8a849e40-7e44-4845-802b-bb8aeb8a28f9 service nova] Creating event network-changed:65fbc3b6-20f1-40ce-8bff-dad234a55c64 for instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 on n-h2-846219-10 Jul 20 11:07:32.483627 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2f592107-b8e8-449e-bdbb-034361cdea63 req-8a849e40-7e44-4845-802b-bb8aeb8a28f9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209548 Jul 20 11:07:32.494422 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2033/4009] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:32.539110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:32.542296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:32.548738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=14 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:32.590901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:32.604820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:32.617811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:32.623744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:32.768183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:33.343475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:33.357906 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6c8e8307-9581-4ac1-8fa6-0360f80f95e0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 0.852668 Jul 20 11:07:33.368654 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2034/4010] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:32 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:33.373637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:33.374553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:33.384616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:33.385395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:33.386420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:33.387092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:34.249447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:34.414566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:34.443597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:34.446388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:34.447715 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9c4e13ed-8fb9-4fc4-9e85-36d559b968f5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1802 microversion: 2.32 time: 2.569874 Jul 20 11:07:34.455216 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1977/4011] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:31 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1802 bytes in 2578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:34.474803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:34.475471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:34.505385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:34.505881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:34.506709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:34.507163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:34.984032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:34.994618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=16 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:35.001186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-754c73c0-9e51-42f7-bbc6-d3e6f24f9c65 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1364 microversion: 2.1 time: 1.631706 Jul 20 11:07:35.004162 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2035/4012] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:33 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1364 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:35.033648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:35.035538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:35.073954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:35.074428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:35.075519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:35.075973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:35.527134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:35.553254 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25f8efde-8068-4e29-a5a3-f0ccb09753ec tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.091421 Jul 20 11:07:35.554498 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1978/4013] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:34 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:35.562943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:35.563847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:35.572887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:35.573664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:35.574654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:35.575324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:35.756897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lazy-loading 'services' on Instance uuid f5340fed-4d03-4bff-8e61-64dda580dc32 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:07:35.883114 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc09e155-167c-4baa-81f5-cb6ad68b890f tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32/os-volume_attachments/29805ef3-4042-45bf-a233-51a576c2b276" status: 202 len: 0 microversion: 2.1 time: 0.323922 Jul 20 11:07:35.889337 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1979/4014] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:07:35 2022] DELETE /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32/os-volume_attachments/29805ef3-4042-45bf-a233-51a576c2b276 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:07:35.902362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:35.903583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:35.925318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:35.928851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:35.933110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:35.933785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:36.458160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:36.471347 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57673f8e-0712-474e-a11e-e67927c7d310 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 1.451375 Jul 20 11:07:36.471953 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2036/4015] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:35 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:36.560957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:36.561864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:36.620785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:36.626545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:36.631629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:36.632226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:37.905984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:37.942972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:37.960614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:37.973608 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2ee13d43-a41f-4b48-b331-5c13632bac4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1849 microversion: 2.32 time: 2.082102 Jul 20 11:07:37.976224 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1980/4016] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:35 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1849 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:38.000345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:38.013678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:38.050822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:38.057067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:38.066171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:38.067000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:38.199407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:38.592894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:38.602684 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad869a87-7f06-460d-a080-d761eafdb239 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1364 microversion: 2.1 time: 2.087126 Jul 20 11:07:38.608549 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2037/4017] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:36 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1364 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:39.275821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1320189238", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "7630a96e-0ca7-4a41-aed2-59295df5337b"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:39.467285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] validate_networks() for [('7630a96e-0ca7-4a41-aed2-59295df5337b', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:07:39.471538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:39.492138 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f8c16c6-d42d-475b-83f1-a227adc0f05e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.514509 Jul 20 11:07:39.495299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1981/4018] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:37 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:39.518164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:39.518969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:39.557793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:39.559579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:39.568034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:39.568865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:40.698562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:40.743048 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b85e7967-4ba3-4ed7-8f76-8630a3e236d2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 1.241730 Jul 20 11:07:40.746203 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1982/4019] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:39 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:40.768003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:40.774006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:40.829599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:40.830609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:40.834947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:40.845475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:41.921286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:41.931085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:41.953531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:41.954685 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef6da151-d95d-4801-8ede-ee0ade89db8d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1849 microversion: 2.32 time: 1.207152 Jul 20 11:07:41.972141 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1983/4020] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:40 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1849 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:41.978541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0be7c352-7d36-44ff-9b15-8fa8bc52c88e req-a5e74b2d-c5cf-42fe-8093-4a09f02dd35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "0298200c-fbfd-493c-a9ca-617cb89c0f7c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:41.987533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:42.007991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0be7c352-7d36-44ff-9b15-8fa8bc52c88e req-a5e74b2d-c5cf-42fe-8093-4a09f02dd35d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:42.015860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0be7c352-7d36-44ff-9b15-8fa8bc52c88e req-a5e74b2d-c5cf-42fe-8093-4a09f02dd35d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:42.058619 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0be7c352-7d36-44ff-9b15-8fa8bc52c88e req-a5e74b2d-c5cf-42fe-8093-4a09f02dd35d service nova] Creating event network-changed:0298200c-fbfd-493c-a9ca-617cb89c0f7c for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:42.086031 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0be7c352-7d36-44ff-9b15-8fa8bc52c88e req-a5e74b2d-c5cf-42fe-8093-4a09f02dd35d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112103 Jul 20 11:07:42.089979 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1984/4021] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:42.123898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:42.135051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:42.147350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:42.147877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:42.148674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:42.149117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:42.728304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:42.738519 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-90489f51-5380-439e-b0e5-0bc31d9c3c5d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1364 microversion: 2.1 time: 0.647221 Jul 20 11:07:42.739124 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1985/4022] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:42 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1364 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:42.757025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:07:42.757575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:07:42.757914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:07:42.758330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:07:42.758745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:07:42.779388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:42.779852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:42.780666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:42.781109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:42.825911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Getting quotas for project df64e9c6ca0e41d8bb372cbeae5f97ea. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:07:42.872690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Getting quotas for user fa33792e96b249b99f470557b97dc0c7 and project df64e9c6ca0e41d8bb372cbeae5f97ea. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:07:42.894808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:07:42.897734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:07:43.033212 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bd3102d3-f49c-4233-973b-fa4d3f49d45e tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.421178 Jul 20 11:07:43.042975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2038/4023] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 11:07:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4433 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:07:43.048982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:43.049901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:43.059945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.060775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:43.061911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.062552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:43.256114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a859bd3b-ae91-474f-935f-8c08ddafba4b req-bd85918a-9c8b-419b-a218-ba805f589371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:43.279040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a859bd3b-ae91-474f-935f-8c08ddafba4b req-bd85918a-9c8b-419b-a218-ba805f589371 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.279885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a859bd3b-ae91-474f-935f-8c08ddafba4b req-bd85918a-9c8b-419b-a218-ba805f589371 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:43.321587 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a859bd3b-ae91-474f-935f-8c08ddafba4b req-bd85918a-9c8b-419b-a218-ba805f589371 service nova] Creating event network-changed:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:07:43.336942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a859bd3b-ae91-474f-935f-8c08ddafba4b req-bd85918a-9c8b-419b-a218-ba805f589371 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.586638 Jul 20 11:07:43.344207 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1986/4024] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:43.351968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:43.356937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:43.369934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.379990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:43.381247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.383009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:43.822894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:43.835089 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a0cfe43-c23e-4e4a-a30d-88be5bda8892 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 0.790340 Jul 20 11:07:43.845119 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2039/4025] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:43 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:43.850808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:43.851804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:43.879942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.880682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:43.881567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:43.882225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:44.528747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:44.538651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b92860b1-4a1a-4464-97b7-8d224bf8ff0c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 1.193036 Jul 20 11:07:44.551558 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1987/4026] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:43 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:44.557931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:44.558784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:44.565895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:44.566857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:44.567592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:44.568184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:44.740129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:44.753946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:44.759730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:44.763029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-612efaac-795b-4b67-b14b-7534d7cee832 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1266 microversion: 2.26 time: 0.210005 Jul 20 11:07:44.767644 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1988/4027] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:44 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:44.782551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:44.784300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:44.801242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:44.803946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:44.805092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:44.808291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:45.184859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:45.201433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:45.203103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:45.216808 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d61f6c7-c200-44b4-b660-ae336a906146 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1870 microversion: 2.32 time: 1.370103 Jul 20 11:07:45.229624 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2040/4028] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:43 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1870 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:45.243856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-aa717de4-7f3a-4f4f-be06-8a19bce79a64 req-86b0c776-95f1-4b0d-8d6d-55c48ae03fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "4f9eba37-5782-42b9-a580-d8aef484de11"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:45.269943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aa717de4-7f3a-4f4f-be06-8a19bce79a64 req-86b0c776-95f1-4b0d-8d6d-55c48ae03fc0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:45.272371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-aa717de4-7f3a-4f4f-be06-8a19bce79a64 req-86b0c776-95f1-4b0d-8d6d-55c48ae03fc0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:45.308180 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-aa717de4-7f3a-4f4f-be06-8a19bce79a64 req-86b0c776-95f1-4b0d-8d6d-55c48ae03fc0 service nova] Creating event network-changed:4f9eba37-5782-42b9-a580-d8aef484de11 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:45.325376 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-aa717de4-7f3a-4f4f-be06-8a19bce79a64 req-86b0c776-95f1-4b0d-8d6d-55c48ae03fc0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092270 Jul 20 11:07:45.333432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2041/4029] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:45.339920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:45.348184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:45.357829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:45.362438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:45.363718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:45.364512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:45.760446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:45.771346 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09c5fb21-53e4-4f15-9de0-15e929703231 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1364 microversion: 2.1 time: 1.001745 Jul 20 11:07:45.778027 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1989/4030] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:44 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1364 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:45.787136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:45.796484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:45.835496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:45.836338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:45.838885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:45.840743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:48.125895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:48.141789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ddcf621d-9668-4fb9-bbe0-a5e032df3a87 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 2.359960 Jul 20 11:07:48.143935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1990/4031] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:45 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:48.153712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:48.169655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:48.169655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:48.172998 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-902dcee6-f741-4f9e-8e18-19baf65c59f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 2.836931 Jul 20 11:07:48.173843 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2042/4032] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:45 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 2839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:48.191436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1556ca7d-f478-4eb1-9dd4-97833ab2ed07 req-3d0268f2-df18-4f15-81a9-5eb9b72b9e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2", "name": "network-vif-plugged", "status": "completed", "tag": "65fbc3b6-20f1-40ce-8bff-dad234a55c64"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:48.205288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:48.205785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:48.214257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:48.215752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:48.230940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1556ca7d-f478-4eb1-9dd4-97833ab2ed07 req-3d0268f2-df18-4f15-81a9-5eb9b72b9e98 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:48.231453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1556ca7d-f478-4eb1-9dd4-97833ab2ed07 req-3d0268f2-df18-4f15-81a9-5eb9b72b9e98 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:48.282542 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1556ca7d-f478-4eb1-9dd4-97833ab2ed07 req-3d0268f2-df18-4f15-81a9-5eb9b72b9e98 service nova] Creating event network-vif-plugged:65fbc3b6-20f1-40ce-8bff-dad234a55c64 for instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 on n-h2-846219-10 Jul 20 11:07:48.311074 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1556ca7d-f478-4eb1-9dd4-97833ab2ed07 req-3d0268f2-df18-4f15-81a9-5eb9b72b9e98 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129804 Jul 20 11:07:48.314729 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2043/4033] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:48.354809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:48.356807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:48.380965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:48.389351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:48.393267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:48.394212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:49.195802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:49.217551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:49.220855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:49.226457 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-453ee726-4ad8-4685-97a8-4d28da72ca46 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1320 microversion: 2.26 time: 1.080865 Jul 20 11:07:49.227566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1991/4034] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:48 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1320 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:49.245118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:49.247037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:49.267151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:49.268098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:49.269152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:49.276275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:49.312962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:49.328279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:49.329838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:49.331034 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fb9d967b-1dc7-43fa-ad9c-17a2baa90dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.013967 Jul 20 11:07:49.337479 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2044/4035] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:48 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:49.348413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d420ebcf-c633-410f-b3bd-91c0c19719a1 req-1e25021f-ab77-4a53-b536-808df5fc1c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "6248f3fa-d9ae-4cf6-a449-7652d080210f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:49.371148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:49.376362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d420ebcf-c633-410f-b3bd-91c0c19719a1 req-1e25021f-ab77-4a53-b536-808df5fc1c6e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:49.376838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d420ebcf-c633-410f-b3bd-91c0c19719a1 req-1e25021f-ab77-4a53-b536-808df5fc1c6e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:49.410983 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d420ebcf-c633-410f-b3bd-91c0c19719a1 req-1e25021f-ab77-4a53-b536-808df5fc1c6e service nova] Creating event network-changed:6248f3fa-d9ae-4cf6-a449-7652d080210f for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:49.422506 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d420ebcf-c633-410f-b3bd-91c0c19719a1 req-1e25021f-ab77-4a53-b536-808df5fc1c6e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083674 Jul 20 11:07:49.426877 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2045/4036] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:49.462885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:49.463897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:49.483951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:49.485827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:49.486717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:49.487360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:50.158931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:50.170500 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5599d51-845c-4761-a244-13bc48091588 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1315 microversion: 2.1 time: 0.742013 Jul 20 11:07:50.171961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2046/4037] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:49 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:50.182189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:50.183149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:50.204778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:50.209314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:50.210707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:50.215714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:50.309696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:50.366093 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ac918322-841b-41dc-95bc-f23953d48be8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1364 microversion: 2.1 time: 1.135770 Jul 20 11:07:50.367375 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1992/4038] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:49 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1364 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:50.373953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:50.375065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:50.383285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:50.384690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:50.387796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:50.388533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:51.580534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:51.597527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:51.602946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:51.606968 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-984f5114-9c8b-4966-9137-7ed6f8dc9392 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 1.236750 Jul 20 11:07:51.610638 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1993/4039] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:50 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:51.622500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:51.624719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:51.646185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:51.654090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:51.656482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:51.659462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:51.770132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:51.781655 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59540c9c-772b-41fc-80a3-de8fbadd8a24 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1526 microversion: 2.1 time: 1.608419 Jul 20 11:07:51.783119 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2047/4040] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:50 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1526 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:51.789450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6dda4e0c-7c54-43c1-823a-69c54693ec2d req-a13d2d69-54c9-48b9-a21e-a489bf4afbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-plugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:51.794767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:07:51.813224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6dda4e0c-7c54-43c1-823a-69c54693ec2d req-a13d2d69-54c9-48b9-a21e-a489bf4afbbb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:51.813975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6dda4e0c-7c54-43c1-823a-69c54693ec2d req-a13d2d69-54c9-48b9-a21e-a489bf4afbbb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:51.827994 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6dda4e0c-7c54-43c1-823a-69c54693ec2d req-a13d2d69-54c9-48b9-a21e-a489bf4afbbb service nova] Creating event network-vif-plugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:07:51.835715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6dda4e0c-7c54-43c1-823a-69c54693ec2d req-a13d2d69-54c9-48b9-a21e-a489bf4afbbb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049642 Jul 20 11:07:51.836860 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2048/4041] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:51.846068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:51.848711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:51.864364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:51.866479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:51.870543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:51.871283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:52.094985 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e453113f-9294-4b54-816b-5a48f0de9723 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 204 len: 0 microversion: 2.1 time: 0.482666 Jul 20 11:07:52.096391 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1994/4042] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:07:51 2022] DELETE /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:07:52.105015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:52.112159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:52.136509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:52.137012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:52.140029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:52.141344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:52.806702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:52.888564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:53.366356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:53.379580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f2277f48-bc7a-4511-8eb1-f41318aed0f6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1503 microversion: 2.1 time: 1.281690 Jul 20 11:07:53.380185 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1995/4043] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:52 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1503 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:53.390056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:53.392793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:53.404447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.408825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:53.410314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.412571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:53.464149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:53.490709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:53.503983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:53.505236 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cd3f9118-0669-4977-b6c6-3b01bb736973 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.665425 Jul 20 11:07:53.505833 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2049/4044] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:51 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:53.510480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-fde2cd4d-2dbb-46e2-90c0-f73e917cefa8 req-56428246-c8df-4928-a649-915bfedefdfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "06f51a83-1a03-4238-a830-39f5693112ee"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:53.573720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fde2cd4d-2dbb-46e2-90c0-f73e917cefa8 req-56428246-c8df-4928-a649-915bfedefdfe service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.574084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fde2cd4d-2dbb-46e2-90c0-f73e917cefa8 req-56428246-c8df-4928-a649-915bfedefdfe service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:53.587659 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-fde2cd4d-2dbb-46e2-90c0-f73e917cefa8 req-56428246-c8df-4928-a649-915bfedefdfe service nova] Creating event network-changed:06f51a83-1a03-4238-a830-39f5693112ee for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:53.593556 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-fde2cd4d-2dbb-46e2-90c0-f73e917cefa8 req-56428246-c8df-4928-a649-915bfedefdfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086526 Jul 20 11:07:53.594714 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2050/4045] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:53.601466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:53.602396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:53.612274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.612901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:53.613923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.615366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:53.918720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:53.945318 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e23f7947-8950-4bd9-8c54-ecc66efa4da9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1364 microversion: 2.1 time: 0.563248 Jul 20 11:07:53.947868 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1996/4046] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:53 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1364 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:53.955581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:53.960334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:53.974662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.975477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:53.976430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:53.977177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:54.033854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:54.326803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:54.357121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:54.361298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:54.365452 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d1312db-1432-4be6-bd60-be60ed6b8dfe tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 0.416097 Jul 20 11:07:54.384807 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1997/4047] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:53 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:54.390790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:54.396568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:54.414136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:54.414832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:54.419740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:54.422444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:54.627718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed728f164a8c48bab486971c6371a145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '168c3b3145174f7b83908c36d6347f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:54.641506 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43f60c9e-f3cd-46cf-8b20-b7d9702c7fdd tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 200 len: 1470 microversion: 2.1 time: 1.045154 Jul 20 11:07:54.651902 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2051/4048] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:53 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 1470 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:54.658128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:54.658839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:54.666670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:54.667444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:54.668404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:54.669006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:54.709687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lazy-loading 'flavor' on Instance uuid 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:07:54.845585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:07:55.204877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8f8fbb4b-65b3-41f5-86d1-f003459d2dde tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2/action" status: 202 len: 0 microversion: 2.1 time: 0.549436 Jul 20 11:07:55.205162 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2052/4049] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:07:54 2022] POST /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:07:55.224921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:55.225782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:55.240580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:55.241150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:55.246392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:55.246900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:55.412833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:55.424958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f1bfba5-a1d9-4c67-9b2f-ab3b9399fca3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1508 microversion: 2.1 time: 1.038696 Jul 20 11:07:55.425564 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1998/4050] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:54 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1508 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:55.430007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-55653096-89d0-4521-aa05-895a09911fe1 req-633b4fb1-ff65-4462-8adc-3f0ab7869e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2703c4f-c286-4d2c-859a-48fed58223d5", "tag": "544db7e3-48c1-4d25-a838-0693a66b38eb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:55.455367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-55653096-89d0-4521-aa05-895a09911fe1 req-633b4fb1-ff65-4462-8adc-3f0ab7869e93 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:55.456108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-55653096-89d0-4521-aa05-895a09911fe1 req-633b4fb1-ff65-4462-8adc-3f0ab7869e93 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:55.478843 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-55653096-89d0-4521-aa05-895a09911fe1 req-633b4fb1-ff65-4462-8adc-3f0ab7869e93 service nova] Creating event network-changed:544db7e3-48c1-4d25-a838-0693a66b38eb for instance c2703c4f-c286-4d2c-859a-48fed58223d5 on n-h2-846219-10 Jul 20 11:07:55.496402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-55653096-89d0-4521-aa05-895a09911fe1 req-633b4fb1-ff65-4462-8adc-3f0ab7869e93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069591 Jul 20 11:07:55.497093 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 1999/4051] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:55.510596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:55.511338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:55.527927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:55.528385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:55.529168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:55.529610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:56.827919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:56.845718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:56.849241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:56.854529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e04384a-47ca-4f83-97b0-99a626a2c89f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.633884 Jul 20 11:07:56.855100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:56.859547 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2053/4052] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:55 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:56.870279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:56.870899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:56.875387 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e68f8067-6a44-4e8f-be60-ae776b191de3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1551 microversion: 2.1 time: 1.376732 Jul 20 11:07:56.875942 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2000/4053] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:55 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1551 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:56.887602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:56.890436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:56.892413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:56.894491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:56.914859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:56.916906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:56.952488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:56.955732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:56.961136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:56.963787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.287428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:57.289363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:57.299980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:57.301509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:57.303098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e49d8e3-fa80-42f5-9e66-7bd94a4427aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.440349 Jul 20 11:07:57.303628 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-406942b7-d0ae-47aa-a909-6341d30536de tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 0.426541 Jul 20 11:07:57.303941 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2054/4054] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:56 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:57.303941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-725cb6c2-34e9-49d4-9f84-3442a84c1cf3 req-5c10a53f-5e05-451a-94cd-d981d5e40355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "084c15f7-7ed1-4084-802d-d9cce3f7f535"}, {"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "1de386d0-c8be-401e-8561-0735b8431467"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:57.326353 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2001/4055] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:56 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:57.326877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-725cb6c2-34e9-49d4-9f84-3442a84c1cf3 req-5c10a53f-5e05-451a-94cd-d981d5e40355 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.327501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-725cb6c2-34e9-49d4-9f84-3442a84c1cf3 req-5c10a53f-5e05-451a-94cd-d981d5e40355 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.333642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:57.335428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] [instance: f5340fed-4d03-4bff-8e61-64dda580dc32] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:57.342357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.343032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.344003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.344598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.344720 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-725cb6c2-34e9-49d4-9f84-3442a84c1cf3 req-5c10a53f-5e05-451a-94cd-d981d5e40355 service nova] Creating event network-changed:084c15f7-7ed1-4084-802d-d9cce3f7f535 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:57.345197 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-725cb6c2-34e9-49d4-9f84-3442a84c1cf3 req-5c10a53f-5e05-451a-94cd-d981d5e40355 service nova] Creating event network-changed:1de386d0-c8be-401e-8561-0735b8431467 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:57.351378 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-725cb6c2-34e9-49d4-9f84-3442a84c1cf3 req-5c10a53f-5e05-451a-94cd-d981d5e40355 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045928 Jul 20 11:07:57.352367 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2055/4056] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:57.359987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:57.360686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:57.364071 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] HTTP exception thrown: Instance f5340fed-4d03-4bff-8e61-64dda580dc32 could not be found. Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Request method failure captured: Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 HTTP/1.1 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-FNdJrBfqk87VNk__CdkzlxATSIrBqQBSSQUrBjgxu6qpHBvuuPFkjWgw4lOY13QHrZPojDTD7DEGcFb7-AHCtUWCez8cUQZsP68zzv-XKVAC0w5wrBdWtlIz71i4qnXAe-IN5pmKFTStbfEdK6JZmo_KGoxqv9pqd6rCdPzy2dmd4 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 168c3b3145174f7b83908c36d6347f42 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesBackupsTest-85363671 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_168c3b3145174f7b83908c36d6347f42", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/168c3b3145174f7b83908c36d6347f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/168c3b3145174f7b83908c36d6347f42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/168c3b3145174f7b83908c36d6347f42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesBackupsTest-85363671 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 168c3b3145174f7b83908c36d6347f42 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesBackupsTest-85363671 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesBackupsTest-85363671-project Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ed728f164a8c48bab486971c6371a145 Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesBackupsTest-85363671-project Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f5340fed-4d03-4bff-8e61-64dda580dc32 could not be found. Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f5340fed-4d03-4bff-8e61-64dda580dc32'} Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5340fed-4d03-4bff-8e61-64dda580dc32 could not be found. Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5340fed-4d03-4bff-8e61-64dda580dc32 could not be found. Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:57.366088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:07:57.371722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:07:57.371722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:07:57.371722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:07:57.371722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:07:57.371722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5340fed-4d03-4bff-8e61-64dda580dc32 could not be found. Jul 20 11:07:57.371722 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:07:57.372555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.372555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.372555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.372555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.373555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] Returning 404 to user: Instance f5340fed-4d03-4bff-8e61-64dda580dc32 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:07:57.374749 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3751154f-62fb-447f-bb7d-ce657750a758 tempest-VolumesBackupsTest-85363671 tempest-VolumesBackupsTest-85363671-project] 10.222.0.79 "GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32" status: 404 len: 111 microversion: 2.1 time: 0.046886 Jul 20 11:07:57.376065 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2002/4057] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:57 2022] GET /compute/v2.1/servers/f5340fed-4d03-4bff-8e61-64dda580dc32 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:07:57.385259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:57.386188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:57.393613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.395218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.396172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.396767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.582435 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-281aff9b-8e7a-46f1-90fd-dff0d3c54560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203105 Jul 20 11:07:57.583528 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2003/4058] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:07:57 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:57.593295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-50d17252-5b8e-48ce-9db9-795311740811 req-39fa59d4-3d7e-4d0a-b98a-4453b59f0c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9551e7fa-23a0-4481-b8dc-699f20cad7f4", "name": "network-vif-unplugged", "status": "completed", "tag": "330484e6-bbe2-4871-a298-e6b70406be9f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:57.616227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-50d17252-5b8e-48ce-9db9-795311740811 req-39fa59d4-3d7e-4d0a-b98a-4453b59f0c27 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.617004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-50d17252-5b8e-48ce-9db9-795311740811 req-39fa59d4-3d7e-4d0a-b98a-4453b59f0c27 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.656371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:57.666543 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-50d17252-5b8e-48ce-9db9-795311740811 req-39fa59d4-3d7e-4d0a-b98a-4453b59f0c27 service nova] Creating event network-vif-unplugged:330484e6-bbe2-4871-a298-e6b70406be9f for instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 on n-h2-846219-10 Jul 20 11:07:57.668453 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9c92bc22-2938-4d88-8b5a-1a3475009306 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1508 microversion: 2.1 time: 0.313832 Jul 20 11:07:57.669970 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2056/4059] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:57 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1508 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:57.686882 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-50d17252-5b8e-48ce-9db9-795311740811 req-39fa59d4-3d7e-4d0a-b98a-4453b59f0c27 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101952 Jul 20 11:07:57.688219 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2004/4060] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:07:57.874936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:57.876440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:57.898984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.901421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:57.904464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:57.905650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:58.323278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:58.324681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:58.334810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:58.336285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:58.337711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:58.338382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:58.787944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:58.804227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:58.809693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:58.811206 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c45eec67-1fbf-4d82-8147-d32fdbf884c1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 0.940546 Jul 20 11:07:58.812429 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2057/4061] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:57 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:58.818909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:58.819724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:58.829495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:58.830054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:58.831376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:58.832101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:58.849132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:58.861963 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2737d56-5342-4b48-8677-104379ff0be0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.544545 Jul 20 11:07:58.875443 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2005/4062] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:58 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:58.887248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:58.888391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:58.904255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:58.904949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:58.906270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:58.906550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:59.209687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:59.220229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:59.221912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:59.223262 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5c088a53-c585-4ec4-b883-128ffc403b65 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 0.409648 Jul 20 11:07:59.224205 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2058/4063] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:58 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:07:59.252138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:07:59.261025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-26114bf7-63df-4863-a0fb-d37ccd1a3bac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1508 microversion: 2.1 time: 0.384377 Jul 20 11:07:59.261629 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2006/4064] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:58 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:07:59.456811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8aff0be9-fcd3-4e92-aa32-f409b8f6615a req-1dc8a6c0-5bee-4693-826d-bed2e62d2e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5340fed-4d03-4bff-8e61-64dda580dc32", "name": "network-vif-deleted", "tag": "988d3305-a284-49bf-a6ae-497fac0321bb"}, {"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "67f4832e-193e-46ee-97a7-ca0940d4e922"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:07:59.493568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8aff0be9-fcd3-4e92-aa32-f409b8f6615a req-1dc8a6c0-5bee-4693-826d-bed2e62d2e7f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:59.495316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8aff0be9-fcd3-4e92-aa32-f409b8f6615a req-1dc8a6c0-5bee-4693-826d-bed2e62d2e7f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:59.512337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8aff0be9-fcd3-4e92-aa32-f409b8f6615a req-1dc8a6c0-5bee-4693-826d-bed2e62d2e7f service nova] Creating event network-vif-deleted:988d3305-a284-49bf-a6ae-497fac0321bb for instance f5340fed-4d03-4bff-8e61-64dda580dc32 on n-h1-846219-10 Jul 20 11:07:59.513317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8aff0be9-fcd3-4e92-aa32-f409b8f6615a req-1dc8a6c0-5bee-4693-826d-bed2e62d2e7f service nova] Creating event network-changed:67f4832e-193e-46ee-97a7-ca0940d4e922 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:07:59.525746 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8aff0be9-fcd3-4e92-aa32-f409b8f6615a req-1dc8a6c0-5bee-4693-826d-bed2e62d2e7f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072710 Jul 20 11:07:59.527747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2059/4065] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:07:59.838417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:59.839040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:59.864712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:59.865194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:59.865971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:59.866414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:59.883542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:07:59.884901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:07:59.901031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:59.901524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:07:59.902356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:07:59.920819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:00.526425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:00.540096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:00.552897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:00.554428 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-504e98f3-2b1c-4dec-b645-ad9a82142c4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 0.720495 Jul 20 11:08:00.556619 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2007/4066] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:07:59 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:00.576125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:00.592848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:00.595358 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2764f98-7643-47b5-9723-218d074df6b3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.714853 Jul 20 11:08:00.596900 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2060/4067] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:07:59 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:00.598071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:00.616914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:00.622353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:00.625216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:00.627425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:00.635458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:00.637291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:00.654949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:00.655867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:00.660135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:00.661946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:01.214796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:01.223881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:01.229803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:01.233855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:01.235003 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5412ef42-7672-4475-983f-33c40ab465ab tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1511 microversion: 2.1 time: 0.633088 Jul 20 11:08:01.235643 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2061/4068] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:00 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1511 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:01.238511 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e87e532c-fd36-4ad1-95c8-4e1e2a148293 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 0.680627 Jul 20 11:08:01.252253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:01.252883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:01.254327 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2008/4069] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:00 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:01.287352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:01.288959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:01.289969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:01.294454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:01.576313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:01.576953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:01.587332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:01.587897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:01.595335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:01.596343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:01.801997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:01.818439 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e603d565-fb74-4b5e-ae1d-c8b878ee4bc3 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1451 microversion: 2.1 time: 0.567479 Jul 20 11:08:01.834765 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2062/4070] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:01 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1451 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:01.846477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:01.848287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:01.867618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:01.872241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:01.873627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:01.878581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.406247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:02.426507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:02.430481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:02.436589 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-71011b20-99f7-46ed-8dc7-c66e774b654c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 0.863596 Jul 20 11:08:02.437562 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2009/4071] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:01 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:02.456199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-10b6a045-19b4-4269-9954-ba473279d77e req-1a3f1ed1-8ea7-4972-949a-c94e563c2c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:02.495648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-10b6a045-19b4-4269-9954-ba473279d77e req-1a3f1ed1-8ea7-4972-949a-c94e563c2c6a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.500330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-10b6a045-19b4-4269-9954-ba473279d77e req-1a3f1ed1-8ea7-4972-949a-c94e563c2c6a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.537721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-10b6a045-19b4-4269-9954-ba473279d77e req-1a3f1ed1-8ea7-4972-949a-c94e563c2c6a service nova] Creating event network-changed:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:08:02.562064 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-10b6a045-19b4-4269-9954-ba473279d77e req-1a3f1ed1-8ea7-4972-949a-c94e563c2c6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119564 Jul 20 11:08:02.563867 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2010/4072] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:02.599743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:02.601744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:02.612444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.613208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.614257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.615192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.625915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:02.635619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2559c299-0c2e-4f47-a3af-465e5876be7c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.799464 Jul 20 11:08:02.636228 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2063/4073] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:01 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:02.658502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:02.661144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:02.683913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.686922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.690398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.694320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.707114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lazy-loading 'flavor' on Instance uuid 9551e7fa-23a0-4481-b8dc-699f20cad7f4 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:02.757738 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'shelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state shelved_offloaded Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 14 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: {"shelve": {}} Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'shelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state shelved_offloaded Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'shelve': {}}} Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 20 11:08:02.770819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state shelved_offloaded Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state shelved_offloaded Jul 20 11:08:02.775383 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:02.782504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'shelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state shelved_offloaded {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:02.783832 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0e84588-738b-4f91-9910-7f9161ef183c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 155 microversion: 2.1 time: 0.218538 Jul 20 11:08:02.791964 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2011/4074] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:02 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 155 bytes in 227 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:08:02.801804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:02.802776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:02.817337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.822471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:02.823807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:02.827242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:03.308919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:03.343669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:03.351511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:03.358785 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-be8268cd-5314-469c-9e9c-304a79228afd tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 0.721457 Jul 20 11:08:03.361158 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2064/4075] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:02 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:03.462486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:03.463521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:03.480829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:03.485625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:03.488371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:03.489712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:03.545850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b905ed73-92da-453c-957e-f79b5724a786 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.734023 Jul 20 11:08:03.551583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2012/4076] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:02 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:08:03.565489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:03.573103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:03.601283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:03.601751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:03.606231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:03.606759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:04.247591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:04.266084 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-46d01266-2b87-4ff8-b996-db49dfc4bddb tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1459 microversion: 2.1 time: 0.709797 Jul 20 11:08:04.275302 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2013/4077] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:03 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1459 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:04.280819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:04.285662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:04.309267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:04.309509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:04.316373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:04.316794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:04.672395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:04.696542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:04.706873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:04.711027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-554e6fe4-1d3f-4d21-b55b-0bccb5fb5dd9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.257792 Jul 20 11:08:04.717569 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2065/4078] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:03 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:04.737041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:04.740105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:04.772675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:04.777047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:04.778135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:04.780534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:06.122604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:06.146570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eb687cbc-a2c9-48ba-8f4d-8b404896d6ee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 1.869832 Jul 20 11:08:06.168295 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2014/4079] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:04 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:06.190110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c5f2f86d-f0cc-4d7b-90e3-a7e15233c314 req-f07d081e-c1de-4730-a964-3955fff241db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2703c4f-c286-4d2c-859a-48fed58223d5", "name": "network-vif-plugged", "status": "completed", "tag": "544db7e3-48c1-4d25-a838-0693a66b38eb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:06.230431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c5f2f86d-f0cc-4d7b-90e3-a7e15233c314 req-f07d081e-c1de-4730-a964-3955fff241db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:06.230896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c5f2f86d-f0cc-4d7b-90e3-a7e15233c314 req-f07d081e-c1de-4730-a964-3955fff241db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:06.272518 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c5f2f86d-f0cc-4d7b-90e3-a7e15233c314 req-f07d081e-c1de-4730-a964-3955fff241db service nova] Creating event network-vif-plugged:544db7e3-48c1-4d25-a838-0693a66b38eb for instance c2703c4f-c286-4d2c-859a-48fed58223d5 on n-h2-846219-10 Jul 20 11:08:06.286865 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c5f2f86d-f0cc-4d7b-90e3-a7e15233c314 req-f07d081e-c1de-4730-a964-3955fff241db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113367 Jul 20 11:08:06.287610 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2015/4080] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:06.300615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:06.306335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:06.329528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:06.330288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:06.331297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:06.331900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:06.437326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:06.446787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:06.454656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:06.456139 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-edc198dd-25b1-4fd5-ba31-2b736044e434 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 1.735853 Jul 20 11:08:06.456854 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2066/4081] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:04 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:06.466318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:06.470507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:06.486666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:06.488137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:06.491419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:06.493266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:07.032019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:07.034931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:07.050660 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9becee3f-545d-464e-af0b-52fc260b6979 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.760969 Jul 20 11:08:07.072676 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2016/4082] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:06 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:07.174236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:07.174854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:07.198839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:07.199577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:07.200815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:07.201671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:07.615940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:07.634988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:07.641187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:07.644484 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-365fc9c2-e70d-4810-bb35-cb1dfa1a6f12 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.181943 Jul 20 11:08:07.645895 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2067/4083] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:06 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:07.654701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:07.655609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:07.663280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:07.673413 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-49f47bf3-d47c-4e8e-9dc3-bb6dade78a7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.503044 Jul 20 11:08:07.674269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:07.675644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:07.678082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:07.679376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:07.692728 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2017/4084] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:07 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:08.090183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:08.091910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:08.108133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:08.109808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:08.110851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:08.111532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:08.153230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:08.171998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:08.191620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:08.192982 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51dc4344-dab2-4de2-b565-19c20841bbed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1362 microversion: 2.26 time: 0.544451 Jul 20 11:08:08.193589 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2068/4085] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:07 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:08.664413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:08.665096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:08.685431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:08.685887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:08.691968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:08.692436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:08.799005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:08.835496 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cd09d37c-bb03-426c-8ee3-23e44cfd17f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.753250 Jul 20 11:08:08.838947 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2018/4086] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:08 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:08.888417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:08.891766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:08.926158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:08.926852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:08.941087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:08.942066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:09.549789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:09.574358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4459dc83-06e5-4407-b638-6dc38c3517ab tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.715147 Jul 20 11:08:09.584774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2019/4087] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:08 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:09.600546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:09.603261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:09.636981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:09.637450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:09.638269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:09.638719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:09.752784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:09.795784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:09.802866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:09.812122 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9384e1fe-03c7-4a7a-bfb5-bbc4714ef57c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.149129 Jul 20 11:08:09.813697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2069/4088] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:08 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:09.858487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:09.859120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:09.886937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:09.887892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:09.888916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:09.891785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:10.898213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:10.911356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:10.913267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:10.921568 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-edfc2336-1c0a-4b39-b3fe-6cf9ffed38ca tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1545 microversion: 2.26 time: 1.334443 Jul 20 11:08:10.928623 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2020/4089] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:09 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1545 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:10.934821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:10.943354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:10.959699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:10.963573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:10.964833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:10.965701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:11.202522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:11.218733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:11.226177 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-37991782-623e-433a-9d71-d670169f1f90 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 1.373207 Jul 20 11:08:11.231702 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2070/4090] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:09 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:11.254959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:11.266092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:11.293177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:11.294311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:11.306298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:11.308077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:11.842241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:11.858450 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-75f2cab8-49a5-4511-995a-709dbddf0315 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.928311 Jul 20 11:08:11.861093 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2021/4091] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:10 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:11.877115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3eea2b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:11.893577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:11.900525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:11.901998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:11.928943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:11.952333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:11.957784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:11.970403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.047862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:12.056043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.091394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:12.094747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.170596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:12.209492 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cd0a7fba-f21c-4e06-8867-8b86d215734d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1760598718" status: 201 len: 0 microversion: 2.26 time: 0.344801 Jul 20 11:08:12.218019 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2022/4092] 10.222.0.79 () {62 vars in 1379 bytes} [Wed Jul 20 11:08:11 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1760598718 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 11:08:12.225401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02ab43d6-0fa5-4c7d-9228-9cf1123e4fef tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3f69b040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:12.232881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:12.236483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02ab43d6-0fa5-4c7d-9228-9cf1123e4fef tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:12.237327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02ab43d6-0fa5-4c7d-9228-9cf1123e4fef tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.253930 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02ab43d6-0fa5-4c7d-9228-9cf1123e4fef tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1760598718" status: 204 len: 0 microversion: 2.26 time: 0.034013 Jul 20 11:08:12.258175 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2023/4093] 10.222.0.79 () {60 vars in 1360 bytes} [Wed Jul 20 11:08:12 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1760598718 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:12.265417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:12.266180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:12.273499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:12.274372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.275557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:12.276326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.853035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:12.882614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:12.888083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:12.896927 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e115c0d9-a6b2-4504-a7bf-a6e14fa9db30 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1891 microversion: 2.32 time: 1.662081 Jul 20 11:08:12.904309 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2071/4094] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:11 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1891 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:12.934099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3e88a820>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:12.955384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:12.971305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:12.978811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:13.005969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.009720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.012683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.013416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.099640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.100222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.201529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:13.248402 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af88ba42-458c-472b-9e36-5f1685ddb450 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 204 len: 0 microversion: 2.26 time: 0.342431 Jul 20 11:08:13.249320 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2072/4095] 10.222.0.79 () {60 vars in 1294 bytes} [Wed Jul 20 11:08:12 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:13.254711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:13.256248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:13.269638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.275827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.276895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.277505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.473687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:13.578899 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72be78d9-5e5e-432b-b3d2-223b26c2af22 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 1.318539 Jul 20 11:08:13.601266 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2024/4096] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:12 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:13.614076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e3363ac-60bf-465c-bf4a-84e8f0754ba9 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3ee3e4c0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:13.654573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e3363ac-60bf-465c-bf4a-84e8f0754ba9 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.655040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e3363ac-60bf-465c-bf4a-84e8f0754ba9 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.717803 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e3363ac-60bf-465c-bf4a-84e8f0754ba9 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 200 len: 12 microversion: 2.26 time: 0.122421 Jul 20 11:08:13.726541 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2025/4097] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 11:08:13 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 12 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:13.743227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3eeeed30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:13.771872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.776806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.777937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:13.795937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.797594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.799478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.801649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.802156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:13.824391 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ab40b32-dfe0-4169-8ca3-37cdcdabf572 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.573841 Jul 20 11:08:13.836265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2073/4098] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:13 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:13.912465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.912925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.922680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:13.924560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:13.942190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.943237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.944225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.946420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:13.953284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:13.953791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.048770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:14.104510 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c196128-4274-4b94-b576-ed44bc2cd6cc tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1267958132" status: 201 len: 0 microversion: 2.26 time: 0.368638 Jul 20 11:08:14.105244 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2026/4099] 10.222.0.79 () {62 vars in 1379 bytes} [Wed Jul 20 11:08:13 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1267958132 => generated 0 bytes in 373 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 11:08:14.120001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b3e4befd-4f8b-4b2c-b3bb-f6f96b6c6925 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3f69ba60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:14.179582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3e4befd-4f8b-4b2c-b3bb-f6f96b6c6925 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.184673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3e4befd-4f8b-4b2c-b3bb-f6f96b6c6925 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.248825 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b3e4befd-4f8b-4b2c-b3bb-f6f96b6c6925 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 200 len: 36 microversion: 2.26 time: 0.135622 Jul 20 11:08:14.253361 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2027/4100] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 11:08:14 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 36 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:14.291792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3ee3e700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:14.307279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.311204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.311633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:14.337554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.338226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.341229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.342139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.411679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.412153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.477481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:14.527269 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3c865c6-5ae6-42b4-ba9a-6596d70997df tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1267958132" status: 204 len: 0 microversion: 2.26 time: 0.262048 Jul 20 11:08:14.528307 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2028/4101] 10.222.0.79 () {60 vars in 1363 bytes} [Wed Jul 20 11:08:14 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1267958132 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:14.542271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-947de937-b531-4920-a0e4-a3b7fed9015a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3e74b9d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:14.565504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-947de937-b531-4920-a0e4-a3b7fed9015a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.565896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-947de937-b531-4920-a0e4-a3b7fed9015a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.589275 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-947de937-b531-4920-a0e4-a3b7fed9015a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 200 len: 12 microversion: 2.26 time: 0.056391 Jul 20 11:08:14.591243 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2029/4102] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 11:08:14 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:14.600411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3f1dcaf0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:14.608988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.609446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.609937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:14.622057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.622661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.629247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.629995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.674879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.675994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.678420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:14.694863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:14.716764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf238d64-10a6-429f-9679-6fa70aabb8ed tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 204 len: 0 microversion: 2.26 time: 0.120729 Jul 20 11:08:14.726130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2030/4103] 10.222.0.79 () {60 vars in 1294 bytes} [Wed Jul 20 11:08:14 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:14.734277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:14.734914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:14.748456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.749125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:14.750025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:14.750503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.019120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:15.032278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:15.045414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:15.047075 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0a1277c-dce8-4d43-a125-c49263c7af60 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.128646 Jul 20 11:08:15.048316 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2074/4104] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:13 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:15.064164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3e91c9d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:15.081961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.089874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.090892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:15.103352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.110250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.111444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.115235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.186929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.187792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.217433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.222406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.270941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:15.315819 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-072208b0-5351-433c-b032-98f87d78706f tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1323730609" status: 201 len: 0 microversion: 2.26 time: 0.265396 Jul 20 11:08:15.317788 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2075/4105] 10.222.0.79 () {62 vars in 1379 bytes} [Wed Jul 20 11:08:15 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1323730609 => generated 0 bytes in 269 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 11:08:15.334868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:15.340176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:15.356213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.357235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.358795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.359490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.441369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:15.450773 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e522e07-e1b6-406b-9946-fefe4aff311f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.722602 Jul 20 11:08:15.465696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2031/4106] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:14 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:15.471699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3f1dc550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:15.481875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.483133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.483897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:15.491698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.492538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.493647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.494334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.556330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.557110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.582995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.583941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.663303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:15.713856 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d85a0cca-2ce4-49d8-8f9a-cadda9edccb6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1436757212" status: 201 len: 0 microversion: 2.26 time: 0.246739 Jul 20 11:08:15.719709 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2032/4107] 10.222.0.79 () {62 vars in 1379 bytes} [Wed Jul 20 11:08:15 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1436757212 => generated 0 bytes in 253 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 11:08:15.738002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3ee3ed30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:15.760818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.761490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.762647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:15.778487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.778952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.783914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.784464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.807538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:15.820134 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-685faab0-4fcb-4988-97f6-e43fb3c31d53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.494221 Jul 20 11:08:15.820844 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2076/4108] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:15 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:15.854534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.855124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.887467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:15.926263 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3c33eec0-0914-42b8-aa9c-b27830c816ee tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 204 len: 0 microversion: 2.26 time: 0.200160 Jul 20 11:08:15.932641 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2033/4109] 10.222.0.79 () {60 vars in 1294 bytes} [Wed Jul 20 11:08:15 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:15.940566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-039c1b1c-f3d3-449e-a7a7-f8866c9b1d81 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3e8df8b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:15.958279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-039c1b1c-f3d3-449e-a7a7-f8866c9b1d81 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:15.959043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-039c1b1c-f3d3-449e-a7a7-f8866c9b1d81 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:15.981385 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-039c1b1c-f3d3-449e-a7a7-f8866c9b1d81 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 200 len: 12 microversion: 2.26 time: 0.047098 Jul 20 11:08:15.987996 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2077/4110] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 11:08:15 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:16.000948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3ee97af0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:16.032212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.032773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.033296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:16.057115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.059065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.059965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.060424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.072595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:16.073865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:16.086088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.088134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.089862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.090646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.173590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.176926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.235837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:16.307029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2724eae9-437c-41a4-b1ee-17fb63d0e010 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 204 len: 0 microversion: 2.26 time: 0.313524 Jul 20 11:08:16.320145 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2034/4111] 10.222.0.79 () {60 vars in 1294 bytes} [Wed Jul 20 11:08:15 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:16.343425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3e74be50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:16.386662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.387470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.388011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:16.407462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.408064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.408848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.409247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.472196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.472196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.499406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.500697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.536851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:16.570139 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f435a0e-69f6-40bc-98e0-41c5e0dbebad tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-6297872" status: 201 len: 0 microversion: 2.26 time: 0.245522 Jul 20 11:08:16.574080 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2035/4112] 10.222.0.79 () {62 vars in 1370 bytes} [Wed Jul 20 11:08:16 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-6297872 => generated 0 bytes in 253 msecs (HTTP/1.1 201) 10 headers in 483 bytes (1 switches on core 0) Jul 20 11:08:16.610409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:16.611970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:16.673960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.674803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:16.675959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:16.676423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.613857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:17.630261 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3373bcac-0dd3-4581-aa4e-f2a2c73f6671 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 1.034069 Jul 20 11:08:17.633937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2036/4113] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:16 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:17.661074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3fdc83a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:17.692215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.692678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.700875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:17.718597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.719059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.722719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.723218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.782458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:17.788435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.788901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.801090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:17.802613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:17.818554 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b690ee32-7f6f-41dd-99a8-20346a48f14f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.754802 Jul 20 11:08:17.834264 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2078/4114] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:16 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:17.839056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.839779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.839907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:17.840507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:17.878565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.879017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.883841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:17.889755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:17.937249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:17.987539 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19d47c68-c324-46b0-9689-f1386599e443 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1826688166" status: 201 len: 0 microversion: 2.26 time: 0.347272 Jul 20 11:08:17.992556 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2037/4115] 10.222.0.79 () {62 vars in 1379 bytes} [Wed Jul 20 11:08:17 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags/tempest-tag-1826688166 => generated 0 bytes in 356 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 20 11:08:18.002926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Action: 'update_all', calling method: .version_select at 0x7f2c3fa36820>, body: {"tags": ["tempest-tag-346524912", "tempest-tag-811957185"]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:18.029028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.034332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.036265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:18.053551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.054356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.055824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.057313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.110607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.110607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.138744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:18.208735 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66bfc72d-98bd-4d5e-a646-f5bb036f238a tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 200 len: 60 microversion: 2.26 time: 0.202788 Jul 20 11:08:18.215438 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2038/4116] 10.222.0.79 () {62 vars in 1311 bytes} [Wed Jul 20 11:08:17 2022] PUT /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 60 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:18.222714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-107cf179-8d74-4e6b-81c3-7db290f4cdd6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3f698700>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:18.242258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-107cf179-8d74-4e6b-81c3-7db290f4cdd6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.249863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-107cf179-8d74-4e6b-81c3-7db290f4cdd6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.280672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=86,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:18.295379 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-107cf179-8d74-4e6b-81c3-7db290f4cdd6 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 200 len: 60 microversion: 2.26 time: 0.076705 Jul 20 11:08:18.302028 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2039/4117] 10.222.0.79 () {60 vars in 1291 bytes} [Wed Jul 20 11:08:18 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 60 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:18.314457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '.version_select at 0x7f2c3ee3ea60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:18.349852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.350318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.356066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:18.386692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.391502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.397370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.397870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.486471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.494280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.550092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lazy-loading 'flavor' on Instance uuid c2703c4f-c286-4d2c-859a-48fed58223d5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:18.629750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5dd33f4a-0458-4520-bf5f-8c5f38f87828 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags" status: 204 len: 0 microversion: 2.26 time: 0.324773 Jul 20 11:08:18.642734 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2040/4118] 10.222.0.79 () {60 vars in 1294 bytes} [Wed Jul 20 11:08:18 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5/tags => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:18.666176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:18.667622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:18.691820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.692469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:18.693424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:18.693990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:19.010615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:19.028022 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ee1c3527-c7f7-4269-a3cc-217dbf834ac4 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 1.190571 Jul 20 11:08:19.029390 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2079/4119] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:17 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:19.039823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:19.043465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:19.058885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:19.062103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:19.063114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:19.063804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:19.123120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:08:19.376830 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f2317c3-1ed6-4ee8-8fab-1d447f1be7e3 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 204 len: 0 microversion: 2.26 time: 0.345361 Jul 20 11:08:19.383593 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2080/4120] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:08:19 2022] DELETE /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:08:19.400233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:19.400908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:19.419611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:19.421316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:19.423208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:19.423836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:19.491611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:19.504864 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1aa8c71f-c57d-4bf8-9031-1f68d5d8d47d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.853903 Jul 20 11:08:19.516852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2041/4121] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:18 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:19.533000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:19.535885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:19.560036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:19.560849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:19.561889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:19.562723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:20.090785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.110337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.119482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.121119 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b9eec1b-de26-4ae0-ad87-9f62cf35f15b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.731718 Jul 20 11:08:20.130844 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2081/4122] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:19 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:20.137911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:20.138896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:20.144137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:20.192885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.198820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:20.200541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:20.201405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:20.201815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:20.221055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.222600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.223890 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9012348-b4d2-423e-8a6f-2711aa02180b tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1551 microversion: 2.26 time: 0.705884 Jul 20 11:08:20.224683 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2042/4123] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:19 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1551 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:20.524242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:20.525343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:20.537987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:20.540458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:20.543990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:20.544568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:20.900771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:20.916963 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5a585a1c-009b-47bf-93d9-86e903678137 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1509 microversion: 2.1 time: 0.783770 Jul 20 11:08:20.921053 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2082/4124] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:20 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1509 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:21.155374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:21.166607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:21.213182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:21.213644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:21.214445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:21.214893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:21.335877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:21.367625 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86a1287d-e44f-40c4-adfe-e4a6151694c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.838086 Jul 20 11:08:21.377389 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2043/4125] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:20 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:21.420626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:21.425909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:21.451595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:21.456377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:21.459947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:21.462175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:21.952896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:21.968692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:21.973236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:21.982189 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5541420-d466-4038-baaa-65d7fd2e1bc5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.835845 Jul 20 11:08:21.993495 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2083/4126] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:21 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:21.999440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:22.000392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:22.026653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:22.027600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:22.028752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:22.029490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:22.033145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:22.401492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:22.413634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:22.419263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:22.420924 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-924a3bd8-ff66-4108-9ff9-b17e847ba907 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1551 microversion: 2.26 time: 1.042147 Jul 20 11:08:22.424192 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2044/4127] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:21 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1551 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:22.442276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:22.444631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:22.465337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:22.466208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:22.468378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:22.469001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:22.639726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:22.650918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-635c7454-9d16-4ac4-9bef-c7330d5609fa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1530 microversion: 2.1 time: 0.655207 Jul 20 11:08:22.660192 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2084/4128] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:21 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1530 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:22.685539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-34de41d3-9975-461c-80a9-bfc49990fed2 req-2c18cf7f-9432-4f05-9dd0-5275576f82ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2703c4f-c286-4d2c-859a-48fed58223d5", "name": "network-vif-deleted", "tag": "544db7e3-48c1-4d25-a838-0693a66b38eb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:22.711694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-34de41d3-9975-461c-80a9-bfc49990fed2 req-2c18cf7f-9432-4f05-9dd0-5275576f82ac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:22.714568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-34de41d3-9975-461c-80a9-bfc49990fed2 req-2c18cf7f-9432-4f05-9dd0-5275576f82ac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:22.760468 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-34de41d3-9975-461c-80a9-bfc49990fed2 req-2c18cf7f-9432-4f05-9dd0-5275576f82ac service nova] Creating event network-vif-deleted:544db7e3-48c1-4d25-a838-0693a66b38eb for instance c2703c4f-c286-4d2c-859a-48fed58223d5 on n-h2-846219-10 Jul 20 11:08:22.772729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-34de41d3-9975-461c-80a9-bfc49990fed2 req-2c18cf7f-9432-4f05-9dd0-5275576f82ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090816 Jul 20 11:08:22.776963 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2085/4129] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:08:23.018080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:23.018913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:23.036385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:23.039493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:23.043684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:23.044257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:23.116229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.128081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e9eb8436-2007-4ddc-a62c-f0420a07c536 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.702424 Jul 20 11:08:23.147584 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2045/4130] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:22 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:23.443017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:23.449335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:23.466712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:23.472400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:23.473511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:23.474175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:23.613026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.623419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.633673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa33792e96b249b99f470557b97dc0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df64e9c6ca0e41d8bb372cbeae5f97ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.635206 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cff45097-eaca-4b95-a869-ad80ac3a483d tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 200 len: 1509 microversion: 2.26 time: 0.196244 Jul 20 11:08:23.642995 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2046/4131] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:23 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:23.676475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:23.677450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:23.692464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:23.693226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:23.694187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:23.694783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:23.948725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.982838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.993161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:23.998737 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-10643863-7a84-457d-9c78-f5d1982985a1 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.985294 Jul 20 11:08:23.999923 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2086/4132] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:23 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:24.093885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:24.120209 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e5380c1-acfe-4a4a-97f7-27c111b5ec6c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1530 microversion: 2.1 time: 0.447466 Jul 20 11:08:24.123199 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2047/4133] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:23 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1530 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:24.147850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:24.148534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:24.157645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:24.162299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:24.166006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:24.166464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:24.531547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:24.573978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8cb56cdb-c767-4c11-bfa0-9025fff728bd tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.426451 Jul 20 11:08:24.575428 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2087/4134] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:24 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:24.659859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:24.660879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] [instance: c2703c4f-c286-4d2c-859a-48fed58223d5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:24.679746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:24.691988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:24.693887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:24.694562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:24.749983 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] HTTP exception thrown: Instance c2703c4f-c286-4d2c-859a-48fed58223d5 could not be found. Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Request method failure captured: Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 HTTP/1.1 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-H4PoEHWfmZRm1udbiv0-KDVfj3x11Gthkj-w0U25OWg6bUmr8XXEKq-4fbB9qVhexbVp6tfCDYe2JAl8jQYamX7wpLlFtdSZA4p5ufbxp0eRstcxqp9nhSA94Gepej_Zx87iG0T8pFkG0cvDCUuRb3siSLvn1d8EJFhRp5jo2j140 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.26 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: df64e9c6ca0e41d8bb372cbeae5f97ea Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerTagsTestJSON-1687778444 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_df64e9c6ca0e41d8bb372cbeae5f97ea", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/df64e9c6ca0e41d8bb372cbeae5f97ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/df64e9c6ca0e41d8bb372cbeae5f97ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/df64e9c6ca0e41d8bb372cbeae5f97ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerTagsTestJSON-1687778444 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: df64e9c6ca0e41d8bb372cbeae5f97ea Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerTagsTestJSON-1687778444 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerTagsTestJSON-1687778444-project Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: fa33792e96b249b99f470557b97dc0c7 Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerTagsTestJSON-1687778444-project Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c2703c4f-c286-4d2c-859a-48fed58223d5 could not be found. Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c2703c4f-c286-4d2c-859a-48fed58223d5'} Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2703c4f-c286-4d2c-859a-48fed58223d5 could not be found. Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2703c4f-c286-4d2c-859a-48fed58223d5 could not be found. Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:24.752680 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2703c4f-c286-4d2c-859a-48fed58223d5 could not be found. Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:24.756808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] Returning 404 to user: Instance c2703c4f-c286-4d2c-859a-48fed58223d5 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:24.757416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2519b350-9ba9-48a6-8a59-3891de655627 tempest-ServerTagsTestJSON-1687778444 tempest-ServerTagsTestJSON-1687778444-project] 10.222.0.79 "GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5" status: 404 len: 111 microversion: 2.26 time: 0.106279 Jul 20 11:08:24.761401 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2048/4135] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:24 2022] GET /compute/v2.1/servers/c2703c4f-c286-4d2c-859a-48fed58223d5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:08:25.021889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:25.022524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:25.032110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:25.032859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:25.033833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:25.034438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:25.140184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:25.140838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:25.151669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:25.153904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:25.154904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:25.156336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:25.542186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:25.550500 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72a1989f-b1e3-460f-b838-93b3de1d8fcd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.415365 Jul 20 11:08:25.559450 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2049/4136] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:25 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:25.593741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:25.594374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:25.601759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:25.602217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:25.603108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:25.603456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:26.484858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:26.499152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:26.500798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:26.501980 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50f0a2fd-497f-464e-bf46-fee9e0125c10 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.487182 Jul 20 11:08:26.514030 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2088/4137] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:25 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:26.569063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:26.569687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:26.606094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:26.606567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:26.607437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:26.607886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:27.067434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:27.087912 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e42ebe5-c380-44f3-9d45-04d2bce8ff83 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 1.488341 Jul 20 11:08:27.088910 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2050/4138] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:25 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:27.203614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:27.222439 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7d2157e-2d97-4a35-9cd8-64d8b7a92443 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.657376 Jul 20 11:08:27.223759 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2089/4139] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:26 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:27.405774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6f77620e-a72f-4e40-b6fe-eec64dbeb353 req-1074b35d-483e-482b-9cc8-1e748f3d95d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2", "name": "network-vif-plugged", "status": "completed", "tag": "65fbc3b6-20f1-40ce-8bff-dad234a55c64"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:27.431287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6f77620e-a72f-4e40-b6fe-eec64dbeb353 req-1074b35d-483e-482b-9cc8-1e748f3d95d9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:27.432004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6f77620e-a72f-4e40-b6fe-eec64dbeb353 req-1074b35d-483e-482b-9cc8-1e748f3d95d9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:27.457396 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6f77620e-a72f-4e40-b6fe-eec64dbeb353 req-1074b35d-483e-482b-9cc8-1e748f3d95d9 service nova] Creating event network-vif-plugged:65fbc3b6-20f1-40ce-8bff-dad234a55c64 for instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 on n-h2-846219-10 Jul 20 11:08:27.465403 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6f77620e-a72f-4e40-b6fe-eec64dbeb353 req-1074b35d-483e-482b-9cc8-1e748f3d95d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063220 Jul 20 11:08:27.466293 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2051/4140] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:27.525555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:27.526560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:27.546635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:27.547836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:27.552024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:27.552618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:28.111210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:28.123364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:28.221724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:28.251156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:28.253565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:28.262545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:28.328178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:28.375514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:28.377053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:28.389533 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e52938d2-e5f2-4d49-af19-8c71ee26c8c5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.864248 Jul 20 11:08:28.390544 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2090/4141] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:27 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:28.414129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:28.415262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:28.428359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:28.437141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:28.442820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:28.443537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:29.325653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:29.330830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:29.341869 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ddc07af7-7bfc-4ecd-99f8-3f286dc75c90 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.950014 Jul 20 11:08:29.342115 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a4f962e-23b8-40a7-aa8b-4a3fc920819f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 1.240394 Jul 20 11:08:29.351289 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2052/4142] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:28 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:29.351539 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2091/4143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:28 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:29.413193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:29.413838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:29.423924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:29.424397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:29.425245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:29.425695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:30.046724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:30.065866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:30.088044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:30.089459 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-801445d7-c078-4215-b5c5-0b7a346154d3 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.680226 Jul 20 11:08:30.090073 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2053/4144] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:29 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:30.361617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:30.362249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:30.366863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:30.368668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:30.385755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:30.386216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:30.387027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:30.390796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:30.391333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:30.392134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:30.392576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:30.407237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:30.900685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:30.909086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0d317aa-ab97-491c-8a02-7072b1852215 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.552178 Jul 20 11:08:30.924183 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2054/4145] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:30 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:30.929689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-86a711c7-1b73-4529-a7ba-80e8c42388b9 req-20a91804-66c5-4e01-87cc-eb6bada588f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9551e7fa-23a0-4481-b8dc-699f20cad7f4", "name": "network-vif-plugged", "status": "completed", "tag": "330484e6-bbe2-4871-a298-e6b70406be9f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:30.949830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-86a711c7-1b73-4529-a7ba-80e8c42388b9 req-20a91804-66c5-4e01-87cc-eb6bada588f8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:30.957286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-86a711c7-1b73-4529-a7ba-80e8c42388b9 req-20a91804-66c5-4e01-87cc-eb6bada588f8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:30.971899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:30.990005 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-86a711c7-1b73-4529-a7ba-80e8c42388b9 req-20a91804-66c5-4e01-87cc-eb6bada588f8 service nova] Creating event network-vif-plugged:330484e6-bbe2-4871-a298-e6b70406be9f for instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 on n-h2-846219-10 Jul 20 11:08:31.012321 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-86a711c7-1b73-4529-a7ba-80e8c42388b9 req-20a91804-66c5-4e01-87cc-eb6bada588f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086082 Jul 20 11:08:31.019503 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2055/4146] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:31.023052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d08df7f5-6a2e-4b7b-9a63-98b347bde66d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.654866 Jul 20 11:08:31.034413 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2092/4147] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:30 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:31.112224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:31.113069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:31.136772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:31.141430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:31.142391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:31.142856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:31.792611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:31.836421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:31.845355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:31.851282 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b3cc62aa-735f-42bd-9e50-50fc5dc18bb5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.744184 Jul 20 11:08:31.856068 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2056/4148] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:31 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:31.943323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:31.943323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:31.959107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:31.960236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:31.962361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:31.963707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:32.051438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:32.052216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:32.070266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:32.075832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:32.076833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:32.080436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:32.464766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:32.480884 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3c018639-1082-48ea-8956-39c1018eb96c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.542612 Jul 20 11:08:32.492854 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2093/4149] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:31 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:32.603740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:32.619632 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5129be44-a39b-4ec6-ac05-8acc76de2497 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.567412 Jul 20 11:08:32.633770 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2057/4150] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:32 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:32.875880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:32.876686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:32.888723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:32.891103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:32.894351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:32.895839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:33.208906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:33.209536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:33.240412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:33.240868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:33.241649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:33.244166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:33.249771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:33.363639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:33.407574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:33.409345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:33.410556 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9a92492-0721-4559-ae5c-24770f281573 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.539940 Jul 20 11:08:33.411127 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2094/4151] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:32 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:33.500792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:33.503820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:33.517541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:33.520450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:33.521427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:33.522110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:33.602720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:33.616241 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9832b2d0-22b7-4c41-b664-ccd44e691a0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.408682 Jul 20 11:08:33.618619 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2058/4152] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:33 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:33.636750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:33.637747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:33.654999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:33.661075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:33.662270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:33.666015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.194480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:34.220492 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5475f266-a4b4-4603-8a60-4915083a5e7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.723642 Jul 20 11:08:34.237253 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2095/4153] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:33 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:34.245057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:34.246035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:34.255066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.255955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.256951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.258324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.262248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:34.273620 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5baa9013-d7ff-49bb-90ec-65da1d96369f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.641844 Jul 20 11:08:34.287038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2059/4154] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:33 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:34.326267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:34.326920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:34.390775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.392935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.393812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.399921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.557044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:34.565991 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b83e71cd-5ca5-445d-8330-0cad28241e51 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1517 microversion: 2.1 time: 0.326119 Jul 20 11:08:34.566586 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2096/4155] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:34 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:34.601075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:34.602281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:34.619247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.620246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.622803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.623685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.846307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:34.855018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8e13cc7-98db-49df-b083-20eabb5e2fd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.553112 Jul 20 11:08:34.864788 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2060/4156] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:34 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:34.873263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-583557645"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:34.874546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:34.905341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.908928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:34.914973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:34.918066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:35.021612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:35.032701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:35.034202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:35.040753 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-953dda59-322c-472a-93fa-b06c3cb13ec0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.452057 Jul 20 11:08:35.041668 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2097/4157] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:34 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:35.238269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:35.239111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:35.249745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:35.258902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:35.265433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:35.266769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:35.659700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:35.676191 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79e13dfc-2a3b-4a3f-a1e9-4c71a6f706aa tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.438511 Jul 20 11:08:35.691525 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2098/4158] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:35 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:35.708856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:35.709661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:35.738050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:35.739624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:35.742644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:35.744561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.078601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:36.090834 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-283ab9a5-5bc0-4c87-9d48-a163a654cdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.397224 Jul 20 11:08:36.092171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2099/4159] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:35 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:36.097095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:36.098005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:36.107094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.107845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.108794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.109387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.170143 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-059d3d8e-1109-400a-b27f-b20c19ba93e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 1.302540 Jul 20 11:08:36.182995 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2061/4160] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:34 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 11:08:36.216735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:36.218917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:36.262521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.264851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.267701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.269789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.510214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:36.526344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:36.531735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:36.535096 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-01fe3835-1507-4166-911c-7dc8c9b11587 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.441662 Jul 20 11:08:36.537018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2100/4161] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:36 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:36.632313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:36.643440 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66306574-36a5-4565-a7df-05ac57a290ad tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.454809 Jul 20 11:08:36.644414 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2062/4162] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:36 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:36.665898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:36.666891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:36.679396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.682615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.683999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.686462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.699302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:36.700082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:36.702244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:36.715959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.720042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.722927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:36.725179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:36.741515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:37.521280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:37.537360 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fb6dc49f-8867-4f9d-9256-95e49d014f0d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.843960 Jul 20 11:08:37.537964 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2063/4163] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:36 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:37.556369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:37.564663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:37.565982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:37.571961 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9943ea1d-102c-42ba-86c0-9d1160f1da73 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.910864 Jul 20 11:08:37.573441 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2101/4164] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:36 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:37.597156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f04b9b0c-eecc-4a36-a0f1-a42d25c137e5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:37.599304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:37.600052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:37.606573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:37.607462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:37.633379 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f04b9b0c-eecc-4a36-a0f1-a42d25c137e5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d has no mapping to a cell. Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f04b9b0c-eecc-4a36-a0f1-a42d25c137e5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d/action HTTP/1.1 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 15 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: {"os-stop": {}} Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d has no mapping to a cell. Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d', 'body': {'os-stop': {}}} Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d has no mapping to a cell. Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:37.667949 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d has no mapping to a cell. Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d has no mapping to a cell. Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f04b9b0c-eecc-4a36-a0f1-a42d25c137e5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d has no mapping to a cell. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f04b9b0c-eecc-4a36-a0f1-a42d25c137e5 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d/action" status: 404 len: 117 microversion: 2.1 time: 0.082781 Jul 20 11:08:37.673954 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2102/4165] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:37 2022] POST /compute/v2.1/servers/31cb577c-4ceb-48d2-bfb9-5ac7aa339f7d/action => generated 117 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:08:37.684839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:37.688228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:37.734683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:37.736292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:37.739430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:37.741266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:38.347735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:38.363871 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ecf3758-9b71-43b4-9a90-6c9e10e4d708 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.682760 Jul 20 11:08:38.375568 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2103/4166] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:37 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:38.377681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:38.384019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:38.385742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:38.391066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:38.400032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:38.401743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:38.403032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:38.405164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:38.405387 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef0ba2ea-bf4d-4288-afcf-273b1a3e4f25 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.842406 Jul 20 11:08:38.407493 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2064/4167] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:37 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:38.407819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:38.554110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:38.555307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:38.593385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:38.595884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:38.603268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:38.603734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:39.379704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:39.396603 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-acc2b482-983a-47c9-b07f-72fc83089b85 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.018388 Jul 20 11:08:39.397697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2104/4168] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:38 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:39.420480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a81bbc69-6312-4882-94a5-e33dfe395846 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:39.421801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a81bbc69-6312-4882-94a5-e33dfe395846 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 5c84e84c-b3c1-4735-965d-269b891cdba8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:39.445306 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a81bbc69-6312-4882-94a5-e33dfe395846 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 5c84e84c-b3c1-4735-965d-269b891cdba8 could not be found. Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a81bbc69-6312-4882-94a5-e33dfe395846 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/5c84e84c-b3c1-4735-965d-269b891cdba8/action HTTP/1.1 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 15 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: {"suspend": {}} Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 5c84e84c-b3c1-4735-965d-269b891cdba8 could not be found. Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5c84e84c-b3c1-4735-965d-269b891cdba8', 'body': {'suspend': {}}} Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c84e84c-b3c1-4735-965d-269b891cdba8 could not be found. Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c84e84c-b3c1-4735-965d-269b891cdba8 could not be found. Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:39.449297 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:39.464765 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:39.464765 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:39.464765 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c84e84c-b3c1-4735-965d-269b891cdba8 could not be found. Jul 20 11:08:39.464765 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:39.468508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a81bbc69-6312-4882-94a5-e33dfe395846 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 5c84e84c-b3c1-4735-965d-269b891cdba8 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:39.469929 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a81bbc69-6312-4882-94a5-e33dfe395846 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/5c84e84c-b3c1-4735-965d-269b891cdba8/action" status: 404 len: 111 microversion: 2.1 time: 0.053663 Jul 20 11:08:39.471228 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2105/4169] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:39 2022] POST /compute/v2.1/servers/5c84e84c-b3c1-4735-965d-269b891cdba8/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:08:39.481213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:39.482372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:39.505345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:39.507469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:39.519531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:39.520144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:40.269399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:40.295793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7306453a-6836-48c7-8fd8-6b03b11db56d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 1.745355 Jul 20 11:08:40.296417 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2065/4170] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:38 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:40.314637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:40.333493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:40.334132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:40.335864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:40.343008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:40.345337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3e1f9a61-d09f-4052-88b5-8a43a16c0390 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.872563 Jul 20 11:08:40.363633 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2106/4171] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:39 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:40.376135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:40.376607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:40.377486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:40.377938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:40.737450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:40.765779 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8369e65d-dd8c-4894-95bd-df99a829379d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.456071 Jul 20 11:08:40.769441 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2066/4172] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:40 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:40.792698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:40.793571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:40.808192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:40.808813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:40.810123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:40.810792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:40.992574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-69429f02-1177-4e03-9bf1-8f6d42882e51 req-b95e3092-e2d2-4e42-ba9f-7c825ee7edfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-plugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:41.027400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-69429f02-1177-4e03-9bf1-8f6d42882e51 req-b95e3092-e2d2-4e42-ba9f-7c825ee7edfd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.029210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-69429f02-1177-4e03-9bf1-8f6d42882e51 req-b95e3092-e2d2-4e42-ba9f-7c825ee7edfd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:41.069120 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-69429f02-1177-4e03-9bf1-8f6d42882e51 req-b95e3092-e2d2-4e42-ba9f-7c825ee7edfd service nova] Creating event network-vif-plugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:08:41.084153 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-69429f02-1177-4e03-9bf1-8f6d42882e51 req-b95e3092-e2d2-4e42-ba9f-7c825ee7edfd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097400 Jul 20 11:08:41.090589 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2067/4173] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:41.165117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:41.190281 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-26f2fd90-0e97-4b8c-82d0-0f5126ff402a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.399340 Jul 20 11:08:41.191480 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2107/4174] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:40 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:41.214400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:41.215551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:41.249075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.250201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:41.252765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.255405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:41.315838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:41.316702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:41.338958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.343368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:41.345576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.354453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:41.395082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lazy-loading 'flavor' on Instance uuid 9551e7fa-23a0-4481-b8dc-699f20cad7f4 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:41.625166 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-966dee03-c932-4a38-9a8e-bc0232828974 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.419637 Jul 20 11:08:41.633522 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2068/4175] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:41 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:08:41.645994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:41.646882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:41.674214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.674831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:41.676627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:41.678499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:42.518794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:42.532231 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4fda829e-3a13-4427-93b8-45ecbc03741e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 1.219076 Jul 20 11:08:42.546603 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2108/4176] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:41 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:42.560843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:42.561470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:42.615380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:42.618019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:42.619107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:42.620263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:42.657286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:42.672615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:42.682921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:42.688553 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48836d16-35b5-4806-90af-76136222a7b9 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.051295 Jul 20 11:08:42.690277 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2069/4177] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:41 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:43.049197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:43.062477 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-53bb603d-9dc2-42f3-8c70-6a42567a630a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1495 microversion: 2.1 time: 0.514631 Jul 20 11:08:43.078154 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2109/4178] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:42 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1495 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:43.088716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:43.094780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:43.147005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:43.148658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:43.150835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:43.156721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:43.232998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lazy-loading 'flavor' on Instance uuid 9551e7fa-23a0-4481-b8dc-699f20cad7f4 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:08:43.274429 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'suspend' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state suspended Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 15 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: {"suspend": {}} Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'suspend' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state suspended Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'suspend': {}}} Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 20 11:08:43.276931 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state suspended Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state suspended Jul 20 11:08:43.281727 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:43.288088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'suspend' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state suspended {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:43.292021 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-feb311b0-8034-48aa-a6cd-1686c169c14b tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 148 microversion: 2.1 time: 0.216333 Jul 20 11:08:43.294496 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2070/4179] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:43 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 148 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:08:43.305661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:43.307778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:43.331838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:43.332302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:43.333365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:43.333811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:43.471831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:43.513013 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ede69214-93e0-485c-b679-90ca6ea41fb1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.213107 Jul 20 11:08:43.517002 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2071/4180] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:43 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:08:43.534620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:43.538338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:43.561282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:43.562659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:43.563505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:43.563953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:43.654484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a87265af-4f79-4896-9504-67eca2972046 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Action: 'create', calling method: .version_select at 0x7f2c3e941f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-454626121", "metadata": {"Type": "work"}}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:44.310071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:44.338354 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-27581af4-ae68-4a2c-91a2-808b62b31e9d tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1501 microversion: 2.1 time: 0.817990 Jul 20 11:08:44.347505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2072/4181] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:43 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1501 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:44.394681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:44.395470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:44.411752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a87265af-4f79-4896-9504-67eca2972046 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.253631 Jul 20 11:08:44.412748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2110/4182] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 11:08:43 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1255 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 20 11:08:44.418072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:44.418999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:44.438877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:44.440029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:44.442541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:44.443775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:44.446526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:44.448787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:44.449316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:44.449891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:45.486112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:45.503672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:45.517927 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e30f95d8-aff2-41ba-8348-093ea0950cc6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 1.166341 Jul 20 11:08:45.519308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:45.521050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:45.522254 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e1b5483-7398-4e1b-bbfe-cc797ddeaf86 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.108367 Jul 20 11:08:45.522810 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2111/4183] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:44 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:45.524766 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2073/4184] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:44 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:45.543378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79c51775-2b2c-4803-829c-c9ce98b2714d tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3fe470d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:45.550337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:45.555445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:45.571116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:45.571116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:45.576912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:45.579146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:45.656660 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79c51775-2b2c-4803-829c-c9ce98b2714d tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 352 microversion: 2.1 time: 0.130592 Jul 20 11:08:45.657336 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2074/4185] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:45 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:45.981657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:45.991489 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-95f373f3-a365-4f69-94e4-d3e5c8e79445 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1501 microversion: 2.1 time: 0.456325 Jul 20 11:08:45.998130 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2112/4186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:45 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1501 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:46.535542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:46.542441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:46.543894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:46.544819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:46.569167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:46.573801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:46.577859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:46.579045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:46.579798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:46.583831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:46.591542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:46.592361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:47.688347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:47.704155 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-727ec0ff-2392-46af-878b-1d9be7b06be2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 1.172811 Jul 20 11:08:47.707461 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2075/4187] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:46 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:47.719196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f782c9e-4b61-47c4-b542-ffc6dd40f470 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3f871f70>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:47.873332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:47.886707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:47.906845 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f782c9e-4b61-47c4-b542-ffc6dd40f470 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 353 microversion: 2.1 time: 0.197005 Jul 20 11:08:47.922473 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2076/4188] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:47 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:47.932392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:47.935249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:47.944234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:47.952401 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2724698d-a0f1-4e13-a8e7-f95ceacc159b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.413008 Jul 20 11:08:47.956394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:47.956968 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2113/4189] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:46 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:08:47.960804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:47.964217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:47.969769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:47.978369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33d831cd-80c5-4fe3-9253-0182fd036c97 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3e8761f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:48.187559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33d831cd-80c5-4fe3-9253-0182fd036c97 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 353 microversion: 2.1 time: 0.228768 Jul 20 11:08:48.188024 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2114/4190] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:47 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 353 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:48.201484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e6fdc8ae-8198-4a71-b443-9bc3187a91cf tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3e843dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:48.391907 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e6fdc8ae-8198-4a71-b443-9bc3187a91cf tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 202 len: 0 microversion: 2.1 time: 0.195006 Jul 20 11:08:48.398550 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2115/4191] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:08:48 2022] DELETE /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:08:48.410807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5470ffda-ed45-4040-bdcb-8c1d5cf96af9 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3e86c940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:48.482159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:48.491550 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2896e608-8b3e-4f0f-824a-dc055aa7982c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.567559 Jul 20 11:08:48.504648 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2077/4192] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:47 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:48.512605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:48.513681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:48.528918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:48.532411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:48.533521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:48.535466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:48.592586 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5470ffda-ed45-4040-bdcb-8c1d5cf96af9 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 352 microversion: 2.1 time: 0.192639 Jul 20 11:08:48.593543 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2116/4193] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:48 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 352 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:48.723720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:48.724718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:48.738682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:48.747723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:48.748964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:48.756375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.084746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:49.094535 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5b7e37bd-0c70-41cf-af13-c8dc31c0a092 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.374669 Jul 20 11:08:49.103987 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2117/4194] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:48 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:49.113112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:49.123642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:49.137805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:49.142732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.143913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:49.147201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.187091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:49.197520 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f786c34-3daf-4650-8d7b-a4bb049887c4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.688942 Jul 20 11:08:49.209485 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2078/4195] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:48 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:49.228042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc4b41ab-b388-46d5-a322-9c95e0eb3a8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:49.233644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bc4b41ab-b388-46d5-a322-9c95e0eb3a8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: e9ca0eec-4839-460a-8354-9319fbb326cf] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:49.240382 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-bc4b41ab-b388-46d5-a322-9c95e0eb3a8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance e9ca0eec-4839-460a-8354-9319fbb326cf could not be found. Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc4b41ab-b388-46d5-a322-9c95e0eb3a8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/e9ca0eec-4839-460a-8354-9319fbb326cf/action HTTP/1.1 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 15 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: {"unpause": {}} Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e9ca0eec-4839-460a-8354-9319fbb326cf could not be found. Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e9ca0eec-4839-460a-8354-9319fbb326cf', 'body': {'unpause': {}}} Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ca0eec-4839-460a-8354-9319fbb326cf could not be found. Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ca0eec-4839-460a-8354-9319fbb326cf could not be found. Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:49.255408 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:49.260669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:49.260669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:49.260669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ca0eec-4839-460a-8354-9319fbb326cf could not be found. Jul 20 11:08:49.260669 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:49.265656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc4b41ab-b388-46d5-a322-9c95e0eb3a8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance e9ca0eec-4839-460a-8354-9319fbb326cf could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:49.266886 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc4b41ab-b388-46d5-a322-9c95e0eb3a8e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/e9ca0eec-4839-460a-8354-9319fbb326cf/action" status: 404 len: 111 microversion: 2.1 time: 0.042946 Jul 20 11:08:49.267760 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2079/4196] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:49 2022] POST /compute/v2.1/servers/e9ca0eec-4839-460a-8354-9319fbb326cf/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:08:49.284150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:49.310044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:49.345896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:49.346996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.348112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:49.354854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.744478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:49.753555 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b0da1575-e14f-4226-b039-05179f64baf0 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.473228 Jul 20 11:08:49.763539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:49.775585 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2080/4197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:49 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:49.781227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c1f3d4e-8791-40b0-9c87-f6982f687136 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3f4a2a60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:49.784526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:49.786995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:49.798340 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-26f2ca24-9c51-4614-ba81-b640fd5f6bc7 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.692862 Jul 20 11:08:49.799671 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2118/4198] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:49 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:49.814953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:49.816324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:49.824118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:49.824909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.826029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:49.826826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:49.931031 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c1f3d4e-8791-40b0-9c87-f6982f687136 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 352 microversion: 2.1 time: 0.153483 Jul 20 11:08:49.932018 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2081/4199] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:49 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:50.013267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:50.024967 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a01caed-e91a-48a6-b0dc-a8549511bdf6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.223981 Jul 20 11:08:50.026139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2119/4200] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:49 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:50.044879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:50.045592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:50.056692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.059267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.060420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.061144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.121885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:50.122507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:50.142016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.142499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.146430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.146962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.193174 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'unpause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 15 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: {"unpause": {}} Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'unpause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'unpause': {}}} Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state active. Cannot unpause while the instance is in this state. Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:50.198221 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:50.202523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:50.202523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:50.202523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:50.202523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:50.202523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:50.205897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'unpause' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:50.208418 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c213e9d2-f193-42e7-9fc8-6fd5d5b4c42f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 145 microversion: 2.1 time: 0.169483 Jul 20 11:08:50.211548 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2082/4201] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:50 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 145 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:08:50.225679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:50.228116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:50.250130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.252476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.254941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.255871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.511575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:50.529814 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36473618-c615-4a33-849d-e77e485a84e7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.413103 Jul 20 11:08:50.551326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2120/4202] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:50 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:50.759204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:50.769802 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-043d721e-339b-493a-9b88-9dca860e48ea tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.553986 Jul 20 11:08:50.775933 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2083/4203] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:50 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:50.790736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:50.791392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:50.793541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=70 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:50.818085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:50.818624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:50.826573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.833860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.834713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.835153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.859238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.859715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:50.860512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:50.860982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:51.750737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:51.783917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:51.785472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:51.786673 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0c60dca7-7867-42e4-beba-db6f7612d4ef tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.972775 Jul 20 11:08:51.803352 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2084/4204] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:50 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:51.809435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8b73f8d3-54cd-4d00-b707-fe60bc1c39be tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3f4d8b80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:51.922743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8b73f8d3-54cd-4d00-b707-fe60bc1c39be tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 352 microversion: 2.1 time: 0.118094 Jul 20 11:08:51.923673 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2085/4205] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:51 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:51.929137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:51.930453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:51.942639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:51.948058 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:51.949386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:51.950030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:51.955364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:51.974450 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-545d3ee9-6ed1-4d94-abaa-5efc6536178f tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.188925 Jul 20 11:08:51.984943 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2121/4206] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:50 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:51.998638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1086c74-17bf-4f58-b8b4-329de020bf63 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:52.003133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1086c74-17bf-4f58-b8b4-329de020bf63 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:52.020505 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a1086c74-17bf-4f58-b8b4-329de020bf63 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f could not be found. Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1086c74-17bf-4f58-b8b4-329de020bf63 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/1aa7194d-f0ef-4a4a-94a0-e712224cbc2f/action HTTP/1.1 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 18 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: {"unshelve": null} Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f could not be found. Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1aa7194d-f0ef-4a4a-94a0-e712224cbc2f', 'body': {'unshelve': None}} Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f could not be found. Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f could not be found. Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:52.022312 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f could not be found. Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:52.026298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1086c74-17bf-4f58-b8b4-329de020bf63 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 1aa7194d-f0ef-4a4a-94a0-e712224cbc2f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:52.033981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1086c74-17bf-4f58-b8b4-329de020bf63 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/1aa7194d-f0ef-4a4a-94a0-e712224cbc2f/action" status: 404 len: 111 microversion: 2.1 time: 0.037771 Jul 20 11:08:52.036567 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2122/4207] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:51 2022] POST /compute/v2.1/servers/1aa7194d-f0ef-4a4a-94a0-e712224cbc2f/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:08:52.058559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:52.069264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:52.099550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:52.101720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:52.105864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:52.106532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:52.774662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:52.792209 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5dca0862-6838-4249-9318-44f3f5757d32 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.866796 Jul 20 11:08:52.794348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2086/4208] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:51 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:52.808253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:52.818506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:52.836419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:52.837000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:52.837703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:52.838160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:52.839521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:52.850940 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1897d84a-f96c-4080-bc71-df13f67dc9f6 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.807932 Jul 20 11:08:52.864552 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2123/4209] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:52 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:52.891026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:52.891918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:52.915035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:52.932586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:52.935903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:52.938260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:53.426777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:53.463860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:53.472747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:53.477814 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5be3c8bf-e8c8-4fe2-988b-83d128e03570 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.669822 Jul 20 11:08:53.487830 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2087/4210] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:52 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:53.505261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f855bb2-56ee-4779-a3cb-68e9bc4511b3 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3f30f5e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:53.615420 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f855bb2-56ee-4779-a3cb-68e9bc4511b3 tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 200 len: 352 microversion: 2.1 time: 0.125590 Jul 20 11:08:53.616022 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2088/4211] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:53 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:53.721580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:53.739968 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43ab0afd-d186-4ce4-96e1-c09def7afdef tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.851773 Jul 20 11:08:53.745277 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2124/4212] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:52 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:53.758384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:53.759986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:53.785640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:53.786360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:53.789325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:53.789796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:53.811150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:53.811814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:53.826479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:53.830038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:53.833723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:53.839859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:53.858958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:53.876366 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Cannot 'unshelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action HTTP/1.1 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 18 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: {"unshelve": null} Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'unshelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'unshelve': None}} Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 in vm_state active. Cannot unshelve while the instance is in this state. Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:08:53.877993 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active Jul 20 11:08:53.883434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:53.894225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 409 to user: Cannot 'unshelve' instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 while it is in vm_state active {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:53.901583 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5965db2-a67a-4db7-98d6-e341d2954af1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action" status: 409 len: 146 microversion: 2.1 time: 0.142121 Jul 20 11:08:53.906922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2089/4213] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:08:53 2022] POST /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4/action => generated 146 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:08:53.939756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:53.942485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:53.980821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:53.984055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:53.985952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:53.990161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:54.833814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:54.849332 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af1d1240-08c9-402f-8863-7dd179f452cd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 1.041273 Jul 20 11:08:54.850394 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2125/4214] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:53 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:08:54.884964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:54.886230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:54.920203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:54.923128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:54.924173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:54.930867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:54.989802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:55.024723 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b24b937-0566-44e2-a217-24f6030f0999 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 1.101986 Jul 20 11:08:55.041561 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2090/4215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:53 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:55.053341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-329245c2-d33b-4261-90d8-52674a6645ea tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Calling method '.version_select at 0x7f2c3edc01f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:55.139497 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-329245c2-d33b-4261-90d8-52674a6645ea tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] HTTP exception thrown: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-329245c2-d33b-4261-90d8-52674a6645ea tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Request method failure captured: Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c HTTP/1.1 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-I7Qu2EVNWjKiA51uQvBJYo5D0a3P4rF3P0A1Ya8jX7R6QJBi3x8pP22aTL6wcs429VL4eQchocZs-PTsH1Gtz3KxN6PJsp6o8SINYJlkwUmz3Pp9CyyVSWz3nNbKmjw_HqZ-s2QTI2FhMLrUM3zBssDWrDdwak6PEbfrbpaVPLx8s Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: a300e6391d294ca691f13e36b32c8847 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesGetTestJSON-1193703853 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a300e6391d294ca691f13e36b32c8847", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a300e6391d294ca691f13e36b32c8847"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a300e6391d294ca691f13e36b32c8847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a300e6391d294ca691f13e36b32c8847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesGetTestJSON-1193703853 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: a300e6391d294ca691f13e36b32c8847 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesGetTestJSON-1193703853 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesGetTestJSON-1193703853-project Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: f362f45315974e1aa0b32e1e8340be71 Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesGetTestJSON-1193703853-project Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: exception: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '135219cc-696a-4db7-8942-55b3da1ce72c'} Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. (HTTP 404) (Request-ID: req-c625f5b2-4fa1-4cda-ac19-16a868d7f25d) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:08:55.143379 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. Jul 20 11:08:55.148197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.154600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-329245c2-d33b-4261-90d8-52674a6645ea tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] Returning 404 to user: Volume 135219cc-696a-4db7-8942-55b3da1ce72c could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:55.156209 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-329245c2-d33b-4261-90d8-52674a6645ea tempest-VolumesGetTestJSON-1193703853 tempest-VolumesGetTestJSON-1193703853-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c" status: 404 len: 109 microversion: 2.1 time: 0.111686 Jul 20 11:08:55.157372 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2091/4216] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:08:55 2022] GET /compute/v2.1/os-volumes/135219cc-696a-4db7-8942-55b3da1ce72c => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:08:55.177225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:55.181640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:55.200638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:55.201494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:55.202564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:55.203306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:55.808704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:55.830729 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07d074c1-a1bd-43e7-a3b2-0eb279c157a4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.671992 Jul 20 11:08:55.839113 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2092/4217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:55 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:55.858945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:55.875134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24393a74-889f-4769-afbf-516ba0d781be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298712563_updated"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:55.877762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:55.879403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-24393a74-889f-4769-afbf-516ba0d781be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 362483a1-7933-47c8-a3ef-b2d5392c1e13] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:55.895556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:55.897145 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-157e9d41-6d60-41ec-a4fe-74ed8aef056c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.034044 Jul 20 11:08:55.900729 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-24393a74-889f-4769-afbf-516ba0d781be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 362483a1-7933-47c8-a3ef-b2d5392c1e13 could not be found. Jul 20 11:08:55.901934 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2126/4218] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:54 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24393a74-889f-4769-afbf-516ba0d781be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/servers/362483a1-7933-47c8-a3ef-b2d5392c1e13 HTTP/1.1 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 80 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-298712563_updated"}} Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 362483a1-7933-47c8-a3ef-b2d5392c1e13 could not be found. Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '362483a1-7933-47c8-a3ef-b2d5392c1e13', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-298712563_updated'}}} Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362483a1-7933-47c8-a3ef-b2d5392c1e13 could not be found. Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 20 11:08:55.904717 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362483a1-7933-47c8-a3ef-b2d5392c1e13 could not be found. Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362483a1-7933-47c8-a3ef-b2d5392c1e13 could not be found. Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24393a74-889f-4769-afbf-516ba0d781be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 362483a1-7933-47c8-a3ef-b2d5392c1e13 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-24393a74-889f-4769-afbf-516ba0d781be tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "PUT /compute/v2.1/servers/362483a1-7933-47c8-a3ef-b2d5392c1e13" status: 404 len: 111 microversion: 2.1 time: 0.050873 Jul 20 11:08:55.914251 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2093/4219] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:08:55 2022] PUT /compute/v2.1/servers/362483a1-7933-47c8-a3ef-b2d5392c1e13 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:08:55.922519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:55.927051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:55.935068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:55.935591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:55.945833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:55.946183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:55.946692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:55.947994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:55.950276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:55.950865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:55.951419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:55.951854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:56.508474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:56.514039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:56.524272 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81f3b889-cb32-4ef7-9e6b-7a683f8ffe37 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.599910 Jul 20 11:08:56.530866 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2094/4220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:55 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:56.534668 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8276964c-257f-439f-985a-c97737d13560 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1525 microversion: 2.1 time: 0.631164 Jul 20 11:08:56.537870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2127/4221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:55 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1525 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:56.559942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:56.560932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:56.585585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:56.586464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:56.590396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:56.591551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:56.922087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:56.925238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:56.938644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:56.940469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:56.941664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:56.944195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.055020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:57.065762 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-722f2819-f403-4d28-9d79-5f2aa3ba9279 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.511678 Jul 20 11:08:57.071305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2095/4222] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:56 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:57.088085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5ed0aa7-2ff1-4a16-9569-41fbbcf8ea5c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5ed0aa7-2ff1-4a16-9569-41fbbcf8ea5c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: request: PUT /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 HTTP/1.1 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 280 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.091551 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 20 11:08:57.095542 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:08:57.098113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5ed0aa7-2ff1-4a16-9569-41fbbcf8ea5c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:57.100636 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5ed0aa7-2ff1-4a16-9569-41fbbcf8ea5c tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "PUT /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 400 len: 619 microversion: 2.1 time: 0.016630 Jul 20 11:08:57.115392 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2096/4223] 10.222.0.79 () {60 vars in 1256 bytes} [Wed Jul 20 11:08:57 2022] PUT /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 11:08:57.140681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:57.141750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:57.166451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.169368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.170351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.171099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.499162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:57.526666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:57.534629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:57.539234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3b8dce17-c619-4c27-b536-112de5331104 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.621922 Jul 20 11:08:57.565568 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2128/4224] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:56 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:57.565568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3523b467-4bc7-4707-939d-ea9bb8b86f0a req-3c42a763-df43-4a7b-a687-5075e1cd1a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "0298200c-fbfd-493c-a9ca-617cb89c0f7c"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:57.582120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3523b467-4bc7-4707-939d-ea9bb8b86f0a req-3c42a763-df43-4a7b-a687-5075e1cd1a4d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.582708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3523b467-4bc7-4707-939d-ea9bb8b86f0a req-3c42a763-df43-4a7b-a687-5075e1cd1a4d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.631331 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3523b467-4bc7-4707-939d-ea9bb8b86f0a req-3c42a763-df43-4a7b-a687-5075e1cd1a4d service nova] Creating event network-vif-plugged:0298200c-fbfd-493c-a9ca-617cb89c0f7c for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:08:57.642309 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3523b467-4bc7-4707-939d-ea9bb8b86f0a req-3c42a763-df43-4a7b-a687-5075e1cd1a4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085816 Jul 20 11:08:57.653589 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2129/4225] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:08:57.664294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:57.670411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:57.671120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:57.672328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:08:57.682016 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b5cc7151-4de7-41cd-8c3d-8a47682b90f4 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.558916 Jul 20 11:08:57.684305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2097/4226] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:57 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:57.711398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:57.712113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:57.718333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.723791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.725356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.726085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.730992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.731830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:57.732661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:57.733262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:58.216741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:58.244406 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-80b191d6-8234-45e8-a5b5-92672e04e68a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1507 microversion: 2.1 time: 0.589224 Jul 20 11:08:58.252786 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2130/4227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:57 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1507 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:58.373578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:58.405006 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbe5121f-dcde-4330-aa76-5cf25b9d2644 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.705836 Jul 20 11:08:58.407947 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2098/4228] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:57 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:58.428224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e01d05c5-fd63-451b-b18e-7af8aa44a0ac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e01d05c5-fd63-451b-b18e-7af8aa44a0ac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: request: PUT /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 HTTP/1.1 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 24 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: {"server": {"name": ""}} Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4', 'body': {'server': {'name': ''}}} Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '' Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:08:58.432723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 20 11:08:58.437816 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:08:58.439514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e01d05c5-fd63-451b-b18e-7af8aa44a0ac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:08:58.441703 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e01d05c5-fd63-451b-b18e-7af8aa44a0ac tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "PUT /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 400 len: 108 microversion: 2.1 time: 0.019197 Jul 20 11:08:58.446353 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2131/4229] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:08:58 2022] PUT /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:08:58.455287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:58.456133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:58.468794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:58.471297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:58.474469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:58.476555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:58.573818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:58.574804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:58.622650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:58.623341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:58.628342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:58.630391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:59.124779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:59.152349 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b221d574-d44b-4ef4-8960-d820115905a9 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1504 microversion: 2.1 time: 0.703669 Jul 20 11:08:59.153608 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2099/4230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:58 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1504 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:08:59.268961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:08:59.269651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:08:59.294806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:59.308228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:59.309377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:59.309986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:59.393900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:59.406651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:59.425917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:59.452392 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f6fa95cd-5065-4a5f-ba6c-07d2dbdf1627 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.883227 Jul 20 11:08:59.465950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2132/4231] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:08:58 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:08:59.689534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b6156fdf-2483-40ec-b44f-763973e36e6c req-f0b1f777-b5c3-45bd-8c74-cad98fd644e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "1de386d0-c8be-401e-8561-0735b8431467"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "06f51a83-1a03-4238-a830-39f5693112ee"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:08:59.709602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b6156fdf-2483-40ec-b44f-763973e36e6c req-f0b1f777-b5c3-45bd-8c74-cad98fd644e2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:08:59.710779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b6156fdf-2483-40ec-b44f-763973e36e6c req-f0b1f777-b5c3-45bd-8c74-cad98fd644e2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:08:59.778635 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b6156fdf-2483-40ec-b44f-763973e36e6c req-f0b1f777-b5c3-45bd-8c74-cad98fd644e2 service nova] Creating event network-vif-plugged:1de386d0-c8be-401e-8561-0735b8431467 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:08:59.779557 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b6156fdf-2483-40ec-b44f-763973e36e6c req-f0b1f777-b5c3-45bd-8c74-cad98fd644e2 service nova] Creating event network-vif-plugged:06f51a83-1a03-4238-a830-39f5693112ee for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:08:59.798182 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b6156fdf-2483-40ec-b44f-763973e36e6c req-f0b1f777-b5c3-45bd-8c74-cad98fd644e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110616 Jul 20 11:08:59.805605 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2133/4232] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:08:59.826394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:08:59.849740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4bf5822c-cef1-41d2-9a8d-4f16e24b7958 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1507 microversion: 2.1 time: 0.585654 Jul 20 11:08:59.856696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2100/4233] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:08:59 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1507 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:00.476537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:00.477935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:00.485427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:00.486196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:00.487206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:00.487812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:00.873392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:00.874206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:00.896599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:00.902362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:00.908461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:00.910040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:01.122495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:01.149443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:01.168170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:01.171499 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3354f615-4e83-4eb8-9f82-ef5860a98567 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.701434 Jul 20 11:09:01.175795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2134/4234] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:09:00 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:09:01.477349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:01.492535 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0d47445-fc15-4d0e-8ad1-a88064b6028e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1507 microversion: 2.1 time: 0.619494 Jul 20 11:09:01.498265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2101/4235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:00 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1507 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:01.994979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "67f4832e-193e-46ee-97a7-ca0940d4e922"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "6248f3fa-d9ae-4cf6-a449-7652d080210f"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "084c15f7-7ed1-4084-802d-d9cce3f7f535"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:02.023625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:02.027535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:02.072752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] Creating event network-vif-plugged:67f4832e-193e-46ee-97a7-ca0940d4e922 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:09:02.076836 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] Creating event network-vif-plugged:6248f3fa-d9ae-4cf6-a449-7652d080210f for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:09:02.077605 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] Creating event network-vif-plugged:084c15f7-7ed1-4084-802d-d9cce3f7f535 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:09:02.094822 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7a8b778e-d7dd-4de0-9eb1-91a2710c75d7 req-6ae63334-55b8-48ee-aea7-64194d47fc95 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.104059 Jul 20 11:09:02.102217 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2135/4236] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:02.195784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:02.196506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:02.227510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:02.227992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:02.228801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:02.229246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:02.517283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:02.518011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:02.532496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:02.532971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:02.533719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:02.534160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:03.019401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:03.029431 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6166b5d3-4fb5-461c-963f-5adacf12a5fb tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 200 len: 1450 microversion: 2.1 time: 0.516316 Jul 20 11:09:03.034509 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2136/4237] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:02 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 1450 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:09:03.050588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:03.052638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:03.070806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:03.079354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:03.092896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:03.097242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:03.164321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:09:03.180671 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Working on deleting snapshot fc0a60aa-e7b9-4829-9a3d-5aa48a4e2093 from shelved instance... Jul 20 11:09:03.219904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:03.230038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:03.246782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:03.252029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e3489e9c-5a1e-4447-baca-0083e974a89e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.057883 Jul 20 11:09:03.254970 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2102/4238] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:09:02 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:09:04.272916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:04.274477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:04.293745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:04.299037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:04.302098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:04.306534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:04.894878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Doing local delete in cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=125885) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 11:09:04.896971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:04.898860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:04.900118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 11:09:04.908273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] deallocate_for_instance() {{(pid=125885) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 11:09:05.174253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:05.188066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:05.189515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:05.190688 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffa45e7a-d511-4b43-b7d5-7ee2a52305ed tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 0.922009 Jul 20 11:09:05.221164 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2103/4239] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:09:04 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:09:05.226405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-67780c0c-1a7e-4baf-94ae-f44cc8605ada req-aa57012e-ac84-414c-b8e0-6ccc8f0e9a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-plugged", "status": "completed", "tag": "4f9eba37-5782-42b9-a580-d8aef484de11"}, {"server_uuid": "5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2", "name": "network-vif-unplugged", "status": "completed", "tag": "65fbc3b6-20f1-40ce-8bff-dad234a55c64"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:05.283409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-67780c0c-1a7e-4baf-94ae-f44cc8605ada req-aa57012e-ac84-414c-b8e0-6ccc8f0e9a3b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:05.284063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-67780c0c-1a7e-4baf-94ae-f44cc8605ada req-aa57012e-ac84-414c-b8e0-6ccc8f0e9a3b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:05.352607 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-67780c0c-1a7e-4baf-94ae-f44cc8605ada req-aa57012e-ac84-414c-b8e0-6ccc8f0e9a3b service nova] Creating event network-vif-plugged:4f9eba37-5782-42b9-a580-d8aef484de11 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:09:05.353068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.server_external_events [req-67780c0c-1a7e-4baf-94ae-f44cc8605ada req-aa57012e-ac84-414c-b8e0-6ccc8f0e9a3b service nova] Unable to find a host for instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2. Dropping event network-vif-unplugged {{(pid=125886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 11:09:05.400693 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-67780c0c-1a7e-4baf-94ae-f44cc8605ada req-aa57012e-ac84-414c-b8e0-6ccc8f0e9a3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.177905 Jul 20 11:09:05.401332 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2104/4240] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 179 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 11:09:06.211569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:06.212476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:06.221825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:06.227920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:06.229023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:06.229632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:07.392047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:07.404377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:07.406020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:07.410885 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-57486c8d-5f34-4794-8655-8d7c9c1a79b6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1879 microversion: 2.32 time: 1.201068 Jul 20 11:09:07.413073 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2105/4241] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:09:06 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1879 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:09:08.166642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Updating instance_info_cache with network_info: [] {{(pid=125885) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 11:09:08.222942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ff720e4f-b3d0-485b-a2b9-5db87695fc8d req-968a49ca-3321-4d04-9e9f-2501ccf0c85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2", "name": "network-vif-deleted", "tag": "65fbc3b6-20f1-40ce-8bff-dad234a55c64"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:08.254030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=72 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:08.256053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ff720e4f-b3d0-485b-a2b9-5db87695fc8d req-968a49ca-3321-4d04-9e9f-2501ccf0c85e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:08.256502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ff720e4f-b3d0-485b-a2b9-5db87695fc8d req-968a49ca-3321-4d04-9e9f-2501ccf0c85e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:08.306005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.server_external_events [req-ff720e4f-b3d0-485b-a2b9-5db87695fc8d req-968a49ca-3321-4d04-9e9f-2501ccf0c85e service nova] Unable to find a host for instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2. Dropping event network-vif-deleted {{(pid=125886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 11:09:08.310184 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ff720e4f-b3d0-485b-a2b9-5db87695fc8d req-968a49ca-3321-4d04-9e9f-2501ccf0c85e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091031 Jul 20 11:09:08.316110 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2106/4242] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 11:09:08.442079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:08.446109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:08.470673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:08.472080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:08.473111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:08.476856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:09.529463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2faa5df0-45ca-4747-89e6-f8fd9c7708ec tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 204 len: 0 microversion: 2.1 time: 6.482514 Jul 20 11:09:09.532351 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2137/4243] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:09:03 2022] DELETE /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 0 bytes in 6486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:09:09.544397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:09.547799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:09.571395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:09.572911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:09.575238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:09.577813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:09.630823 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 HTTP/1.1 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2'} Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:09.637810 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:09:09.642792 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:09:09.647159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:09:09.649293 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-950c3258-c680-43e2-8e2e-83b51007e20a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 404 len: 111 microversion: 2.1 time: 0.112572 Jul 20 11:09:09.652144 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2138/4244] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:09 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:09:09.888542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1588804991", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:10.005546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:09:10.480310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:10.511379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:10.521758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:10.531422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d33c129-2299-4538-9d6b-e1a50d6cf814 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2832 microversion: 2.32 time: 2.099159 Jul 20 11:09:10.534623 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2107/4245] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:09:08 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2832 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:09:10.652525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:10.656916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:10.712633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:10.713252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:10.722854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:10.725521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.564489 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8b8a9875-03e2-4da2-b980-b2f3849adadb tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.999468 Jul 20 11:09:11.565422 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2108/4246] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 11:09:10 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57/os-interface => generated 1831 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:09:11.579163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:11.579808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:11.605808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:11.612110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.613170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:11.613894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.665439 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc HTTP/1.1 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2bb24fea-a124-42dd-9106-a0f0b57ca0bc'} Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:09:11.672017 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:09:11.676627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6d83678-c18c-495c-a672-6f3802aac768 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 404 len: 111 microversion: 2.1 time: 0.107478 Jul 20 11:09:11.683628 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2109/4247] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:09:11 2022] DELETE /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:09:11.703018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:11.711046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 2bb24fea-a124-42dd-9106-a0f0b57ca0bc] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:11.756241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:11.756739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.757544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:11.757993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.808528 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc HTTP/1.1 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2bb24fea-a124-42dd-9106-a0f0b57ca0bc'} Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:11.820840 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. Jul 20 11:09:11.825702 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:11.829329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 2bb24fea-a124-42dd-9106-a0f0b57ca0bc could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:09:11.830377 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a96f79f1-df94-4127-b546-c7909e6a6c9e tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc" status: 404 len: 111 microversion: 2.1 time: 0.145870 Jul 20 11:09:11.836098 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2110/4248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:11 2022] GET /compute/v2.1/servers/2bb24fea-a124-42dd-9106-a0f0b57ca0bc => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:09:11.844923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:11.845606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:11.865086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:11.866330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.870347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:11.871030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:11.981318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:09:12.198284 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-241ab329-7913-41ef-8ca4-199a0a95c69a tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 204 len: 0 microversion: 2.1 time: 0.357362 Jul 20 11:09:12.202101 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2111/4249] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:09:11 2022] DELETE /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:09:12.221104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:12.223775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:12.249652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:12.251512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:12.252655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:12.255518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:13.412282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:13.423641 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7752b4b-7284-4d3a-92f3-1de7f9d50334 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 1.220235 Jul 20 11:09:13.434530 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2112/4250] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:12 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:13.434530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:13.434530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:13.459133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:13.461666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:13.464100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:13.468324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:13.485361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:09:13.485930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:09:13.486710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:09:13.487614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:09:13.488238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:09:13.502848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:13.503481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:13.504238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:13.504686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:13.534183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:13.585769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:09:13.616918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:09:13.662049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:09:13.669576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:09:13.799057 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73a7e36c-0d15-4ece-a2c6-2ddea393fc16 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.909438 Jul 20 11:09:13.804537 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2139/4251] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:09:13.814823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89e3dd23-8865-4f14-8713-e826cdd6d9cf tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:13.820431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89e3dd23-8865-4f14-8713-e826cdd6d9cf tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:14.081786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89e3dd23-8865-4f14-8713-e826cdd6d9cf tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:14.091374 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89e3dd23-8865-4f14-8713-e826cdd6d9cf tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1215 microversion: 2.1 time: 0.282527 Jul 20 11:09:14.102175 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2140/4252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:13 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:14.444078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:14.444867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:14.477123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:14.477586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:14.478390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:14.478836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:14.591841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:14.609222 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0cfd857-7fdb-4222-8f38-79c0a244439b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.180727 Jul 20 11:09:14.613572 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2113/4253] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:13 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:14.882167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:14.903549 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-187f40ba-d4c5-45f0-ab58-69a7a83670e1 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1510 microversion: 2.1 time: 0.465173 Jul 20 11:09:14.905472 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2141/4254] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:14 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:09:15.110346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:15.111652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:15.127918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:15.130725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:15.132134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:15.132753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:15.353640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:15.364979 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-941a3b1b-fd18-498a-924d-03e0c7753af8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1211 microversion: 2.1 time: 0.258515 Jul 20 11:09:15.377808 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2114/4255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:15 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1211 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:15.637319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:15.638276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:15.660264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:15.661726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:15.664434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:15.665086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:15.925161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:15.925816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:15.949327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:15.953384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:15.956963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:15.962726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:16.418184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f42fd8232fe4c57873fe233ef39af9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd30cad7692d421aac0440ee0f4d3d73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:16.426439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:16.437195 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97a8b8af-4c68-48fb-ae6d-da5c661a9319 tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 200 len: 1468 microversion: 2.1 time: 0.517776 Jul 20 11:09:16.449035 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2115/4256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:15 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 1468 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:16.464252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2f28af21-428a-4d1a-a8ae-cbbfc119656c req-93a7746e-250c-4b33-a0df-c11f1f69cb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9551e7fa-23a0-4481-b8dc-699f20cad7f4", "name": "network-vif-deleted", "tag": "330484e6-bbe2-4871-a298-e6b70406be9f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:16.476818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2f28af21-428a-4d1a-a8ae-cbbfc119656c req-93a7746e-250c-4b33-a0df-c11f1f69cb27 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:16.477794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2f28af21-428a-4d1a-a8ae-cbbfc119656c req-93a7746e-250c-4b33-a0df-c11f1f69cb27 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:16.494950 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2f28af21-428a-4d1a-a8ae-cbbfc119656c req-93a7746e-250c-4b33-a0df-c11f1f69cb27 service nova] Creating event network-vif-deleted:330484e6-bbe2-4871-a298-e6b70406be9f for instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 on n-h2-846219-10 Jul 20 11:09:16.500688 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2f28af21-428a-4d1a-a8ae-cbbfc119656c req-93a7746e-250c-4b33-a0df-c11f1f69cb27 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048387 Jul 20 11:09:16.502105 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2116/4257] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:16.526384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:16.539131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:16.557267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:16.557742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:16.558541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:16.558986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:16.571844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:16.582410 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b1088cae-12d1-4921-aff4-6124af9812a2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.949497 Jul 20 11:09:16.586963 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2142/4258] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:15 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:16.604141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1899823878"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:16.615651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:16.634848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:16.635502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:16.636465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:16.637151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:16.899046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:16.923667 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ba50f6d6-4a6d-4f01-9f15-2f02c42ca417 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1273 microversion: 2.1 time: 0.416359 Jul 20 11:09:16.926787 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2117/4259] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:16 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1273 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:17.124802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e27f94a3-06e8-49e5-a8bc-6f91d3ee1872 req-0a2169b9-03c8-47e3-8bdd-aa4b7627074a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-unplugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:17.144642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e27f94a3-06e8-49e5-a8bc-6f91d3ee1872 req-0a2169b9-03c8-47e3-8bdd-aa4b7627074a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:17.145592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e27f94a3-06e8-49e5-a8bc-6f91d3ee1872 req-0a2169b9-03c8-47e3-8bdd-aa4b7627074a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:17.192621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e27f94a3-06e8-49e5-a8bc-6f91d3ee1872 req-0a2169b9-03c8-47e3-8bdd-aa4b7627074a service nova] Creating event network-vif-unplugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:09:17.200268 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e27f94a3-06e8-49e5-a8bc-6f91d3ee1872 req-0a2169b9-03c8-47e3-8bdd-aa4b7627074a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081158 Jul 20 11:09:17.201713 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2118/4260] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:17.408778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6320af44-39d9-476a-8b27-a4a1f991aec4 req-8d97202c-d11a-4c4a-bebb-62ce91f0c8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "tag": "0298200c-fbfd-493c-a9ca-617cb89c0f7c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:17.459295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6320af44-39d9-476a-8b27-a4a1f991aec4 req-8d97202c-d11a-4c4a-bebb-62ce91f0c8e5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:17.462279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6320af44-39d9-476a-8b27-a4a1f991aec4 req-8d97202c-d11a-4c4a-bebb-62ce91f0c8e5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:17.498288 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6320af44-39d9-476a-8b27-a4a1f991aec4 req-8d97202c-d11a-4c4a-bebb-62ce91f0c8e5 service nova] Creating event network-changed:0298200c-fbfd-493c-a9ca-617cb89c0f7c for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:09:17.516505 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6320af44-39d9-476a-8b27-a4a1f991aec4 req-8d97202c-d11a-4c4a-bebb-62ce91f0c8e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113096 Jul 20 11:09:17.522948 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2119/4261] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:17.534407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:17.541299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] [instance: 9551e7fa-23a0-4481-b8dc-699f20cad7f4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:17.560369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:17.562507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:17.564969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:17.565650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:17.604929 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] HTTP exception thrown: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 could not be found. Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Request method failure captured: Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 HTTP/1.1 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-E98pSEAKRdtd6z_5VPjdOSs-9HQg4NEdBbjdhOoGhYSIeuCH9wtUcS5phyPCE75AYf1SPaMoMMXAeYLOYkkaDtel4uWkmylC2wcEYOq2_gAsD-1iqsKbYviJm59AoIXDu1B4D4el_sH9-lhvqQxphi0xm3xFrbtfqkq7MI-8ECeTs Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_dd30cad7692d421aac0440ee0f4d3d73", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/dd30cad7692d421aac0440ee0f4d3d73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: dd30cad7692d421aac0440ee0f4d3d73 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2058198462 Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4f42fd8232fe4c57873fe233ef39af9c Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersNegativeTestJSON-2058198462-project Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 could not be found. Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9551e7fa-23a0-4481-b8dc-699f20cad7f4'} Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 could not be found. Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 could not be found. Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:09:17.606963 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 could not be found. Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] Returning 404 to user: Instance 9551e7fa-23a0-4481-b8dc-699f20cad7f4 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:09:17.611093 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85dc61c2-47d2-41a6-b3a3-875b7e23dcdf tempest-ServersNegativeTestJSON-2058198462 tempest-ServersNegativeTestJSON-2058198462-project] 10.222.0.79 "GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4" status: 404 len: 111 microversion: 2.1 time: 0.078400 Jul 20 11:09:17.614216 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2120/4262] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:17 2022] GET /compute/v2.1/servers/9551e7fa-23a0-4481-b8dc-699f20cad7f4 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:09:17.944594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:17.946438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:17.958678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:17.959131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:17.960186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:17.960633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:18.128496 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-115d7212-190a-48ab-9657-c59775d91c44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 1.529706 Jul 20 11:09:18.141564 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2143/4263] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:09:16 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 20 11:09:18.269608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:18.283053 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2d1dd2a3-d70f-4bdc-89aa-fb2d914b3424 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1273 microversion: 2.1 time: 0.339010 Jul 20 11:09:18.283919 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2121/4264] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:17 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:19.302709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:19.304020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:19.317857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:19.323999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:19.325054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:19.327531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:19.625950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:19.635552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e5b6014-74fd-488c-aca8-036a649237fe tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1273 microversion: 2.1 time: 0.338141 Jul 20 11:09:19.646585 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2144/4265] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:19 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:20.654549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:20.656135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:20.674758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:20.675238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:20.676094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:20.676540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:21.092415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:21.110590 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-54ac538e-b9a2-4944-9866-b92eb29d431a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 0.458275 Jul 20 11:09:21.114208 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2122/4266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:20 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:22.132046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:22.133277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:22.142813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:22.148487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:22.149493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:22.160332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:22.166098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:23.096767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:23.102708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a9e3ad89-117e-49c7-9292-89bf4710dd06 req-9068a22a-82a8-4ba6-8d72-4edc160b9c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b59476-aba2-4c63-a3e1-d8681d6edd92", "tag": "9ac17a42-7529-48fa-b730-7e8377272ab6"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:23.123517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9e3ad89-117e-49c7-9292-89bf4710dd06 req-9068a22a-82a8-4ba6-8d72-4edc160b9c94 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:23.124311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9e3ad89-117e-49c7-9292-89bf4710dd06 req-9068a22a-82a8-4ba6-8d72-4edc160b9c94 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:23.157808 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a9e3ad89-117e-49c7-9292-89bf4710dd06 req-9068a22a-82a8-4ba6-8d72-4edc160b9c94 service nova] Creating event network-changed:9ac17a42-7529-48fa-b730-7e8377272ab6 for instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 on n-h2-846219-10 Jul 20 11:09:23.171012 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea47c887-f817-46bc-a093-b889b0b74e46 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 1.043647 Jul 20 11:09:23.181803 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a9e3ad89-117e-49c7-9292-89bf4710dd06 req-9068a22a-82a8-4ba6-8d72-4edc160b9c94 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083293 Jul 20 11:09:23.189702 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2145/4267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:22 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:23.197941 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2123/4268] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:23.675840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-924d7c97-2856-49bb-a4ea-cbaa5dbced36 req-1a683fba-7c5e-494c-898e-816830971eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-plugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:23.681441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:23.711845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-924d7c97-2856-49bb-a4ea-cbaa5dbced36 req-1a683fba-7c5e-494c-898e-816830971eb0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:23.712313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-924d7c97-2856-49bb-a4ea-cbaa5dbced36 req-1a683fba-7c5e-494c-898e-816830971eb0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:23.737828 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-924d7c97-2856-49bb-a4ea-cbaa5dbced36 req-1a683fba-7c5e-494c-898e-816830971eb0 service nova] Creating event network-vif-plugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:09:23.751353 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-924d7c97-2856-49bb-a4ea-cbaa5dbced36 req-1a683fba-7c5e-494c-898e-816830971eb0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079764 Jul 20 11:09:23.752359 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2146/4269] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:24.190167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:24.190877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:24.208432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:24.218124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:24.222491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:24.224273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:24.962209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:24.977398 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eaa0b849-e6f7-407b-b13b-9ee43dc5a460 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 0.792335 Jul 20 11:09:24.985600 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2124/4270] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:24 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:26.003334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:26.004602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:26.008930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:26.036833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:26.038882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:26.040708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:26.043610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:28.089056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:28.109759 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fc6e4fda-c78d-4b68-8d88-46afceaa9c7f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 2.110770 Jul 20 11:09:28.113410 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2147/4271] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:25 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:29.131688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:29.133576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:29.165963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:29.166814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:29.179038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:29.183593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:30.106767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:30.120776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2f91ac72-ae7d-490b-9cec-d94db664aab7 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 0.992044 Jul 20 11:09:30.121945 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2125/4272] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:29 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:31.144289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:31.145338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:31.166866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:31.167935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:31.171161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:31.172631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:31.280825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9c4eb74c-5145-49c9-8fad-16438893f222 req-286032c4-9907-4cf9-9b0f-5b9f805231fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b59476-aba2-4c63-a3e1-d8681d6edd92", "name": "network-vif-plugged", "status": "completed", "tag": "9ac17a42-7529-48fa-b730-7e8377272ab6"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:31.298794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9c4eb74c-5145-49c9-8fad-16438893f222 req-286032c4-9907-4cf9-9b0f-5b9f805231fa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:31.301731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9c4eb74c-5145-49c9-8fad-16438893f222 req-286032c4-9907-4cf9-9b0f-5b9f805231fa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:31.316692 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9c4eb74c-5145-49c9-8fad-16438893f222 req-286032c4-9907-4cf9-9b0f-5b9f805231fa service nova] Creating event network-vif-plugged:9ac17a42-7529-48fa-b730-7e8377272ab6 for instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 on n-h2-846219-10 Jul 20 11:09:31.324822 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9c4eb74c-5145-49c9-8fad-16438893f222 req-286032c4-9907-4cf9-9b0f-5b9f805231fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054421 Jul 20 11:09:31.325869 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2126/4273] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:09:32.156284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:32.217025 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c92248c4-9235-4684-8a83-409e9530bea6 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 1.037109 Jul 20 11:09:32.232136 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2148/4274] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:31 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:33.244983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:33.246456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:33.262564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:33.265342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:33.268792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:33.272029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:33.714661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:33.730869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-00a807da-0e2b-42f1-a901-910bf0f1e3c5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1315 microversion: 2.1 time: 0.484632 Jul 20 11:09:33.732006 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2127/4275] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:33 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:34.749248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:34.750425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:34.776361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:34.777204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:34.782842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:34.784394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:34.870945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d807b874-27a6-4c9f-a60f-5d5418da1718 tempest-ExtensionsTest-496031588 tempest-ExtensionsTest-496031588-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:34.873460 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d807b874-27a6-4c9f-a60f-5d5418da1718 tempest-ExtensionsTest-496031588 tempest-ExtensionsTest-496031588-project] 10.222.0.79 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.387987 Jul 20 11:09:34.882041 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2149/4276] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 11:09:34 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:34.912919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-335957ec-31d8-480a-8f18-61226aa50032 tempest-ExtensionsTest-496031588 tempest-ExtensionsTest-496031588-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:34.918337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-335957ec-31d8-480a-8f18-61226aa50032 tempest-ExtensionsTest-496031588 tempest-ExtensionsTest-496031588-project] 10.222.0.79 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.034667 Jul 20 11:09:34.924402 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2150/4277] 10.222.0.79 () {58 vars in 1133 bytes} [Wed Jul 20 11:09:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:09:35.644646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:35.667310 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8053bc55-d9c6-4c00-9f6b-8e2d5c16194a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1503 microversion: 2.1 time: 0.921908 Jul 20 11:09:35.676542 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2128/4278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:34 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1503 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:09:35.707970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b868be02-1c66-4b22-9e6c-842341b6919c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:35.727922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b868be02-1c66-4b22-9e6c-842341b6919c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:35.747686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b868be02-1c66-4b22-9e6c-842341b6919c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:35.831479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b868be02-1c66-4b22-9e6c-842341b6919c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Going to try to stop instance {{(pid=125885) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:09:35.970326 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b868be02-1c66-4b22-9e6c-842341b6919c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92/action" status: 202 len: 0 microversion: 2.1 time: 0.277176 Jul 20 11:09:35.974136 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2151/4279] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:09:35 2022] POST /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:09:35.982145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:35.982963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:35.996400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:35.998034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:36.001456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:36.002075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:36.262094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:36.272800 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65123c45-12ea-45b6-8894-4562f75f8351 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.295654 Jul 20 11:09:36.273799 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2129/4280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:35 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:37.294791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:37.296152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:37.317030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:37.323274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:37.325692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:37.328602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:38.310295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:38.319021 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5828eee5-8ce8-4836-a054-5213916d0593 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 1.031096 Jul 20 11:09:38.334570 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2152/4281] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:37 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:39.347302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:39.348618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:39.355595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:39.357676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:39.358669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:39.359890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:39.360571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:39.751918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:39.782748 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99a07891-114a-477f-89c2-b5130a673b9b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.445896 Jul 20 11:09:39.796922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2130/4282] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:39 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:40.813422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:40.814280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:40.844791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:40.848143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:40.849164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:40.850330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:41.665725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:41.680967 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d9fa315-b150-437f-8406-ee24375f8d5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.876240 Jul 20 11:09:41.685509 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2153/4283] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:40 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:42.704126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:42.704759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:42.718485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:42.718946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:42.727770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:42.728238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:43.021753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:43.033025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a918c2bd-e324-4399-a086-102d194c4e4e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.332616 Jul 20 11:09:43.042851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2131/4284] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:42 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:44.050498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:44.051879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:44.080657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:44.081258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:44.082173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:44.082728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:44.176534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:44.793244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:44.809995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-05eb3861-debb-4b66-a1c4-a22bbbf31b4f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.758974 Jul 20 11:09:44.811603 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2154/4285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:44 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:45.836036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:45.838562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:45.862263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:45.887348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:45.916280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:45.917168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:46.604090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:46.611008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=78 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:46.613788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c2d5d5e0-8ed3-4f99-8a13-6bc780fb771a tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.785670 Jul 20 11:09:46.631998 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2132/4286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:45 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:49.131262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:49.132064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:49.151319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:49.151803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:49.155084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:49.155820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:49.637550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:49.662618 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2771dc16-2cba-43a8-9c7d-171701f42ea8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 2.013589 Jul 20 11:09:49.674338 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2155/4287] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:47 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:50.683563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:50.684353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:50.705126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:50.710131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:50.711138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:50.711872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:51.046366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:51.047781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:51.057307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:51.058224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:51.059333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:51.060175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:51.087027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:51.101976 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-409d52b5-85c2-46ec-a580-14c170ee1349 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.424226 Jul 20 11:09:51.104642 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2133/4288] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:50 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:51.316895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:51.329831 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0ebad72-8aaf-47a0-bf25-9c3eb5d76497 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.285715 Jul 20 11:09:51.343618 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2156/4289] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:51 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:51.347230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-442858076"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:51.348619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:51.376999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:51.377458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:51.378238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:51.378676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:52.007844 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-42d0a00a-b643-4350-b5b5-34255e56cff0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.663005 Jul 20 11:09:52.010571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2134/4290] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:09:51 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 20 11:09:52.023416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:52.024146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:52.038388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:52.038842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:52.039676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:52.040119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:52.123125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:52.124122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:52.136483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:52.139123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:52.141602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:52.144610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:52.352470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:52.371829 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49376338-62f4-42b9-b2df-4fbbf4cf1878 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.348961 Jul 20 11:09:52.377273 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2157/4291] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:52 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:52.540291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:52.549533 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b6283163-3910-49d3-98cb-7d373746eda0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.431162 Jul 20 11:09:52.558467 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2135/4292] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:52 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:09:53.394738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:53.395541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:53.407034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=22 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:09:53.415831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:53.416567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:53.417539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:53.418163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:53.577510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:53.586794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:53.618243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:53.623710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:53.631082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:53.631082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:53.867129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:53.885059 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0acdf1d-5349-4fc5-af23-dae07958aa3f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.495488 Jul 20 11:09:53.898570 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2158/4293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:53 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:53.995885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:54.007347 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7377cfca-0421-4fb2-817c-2a0d38899bff tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.436581 Jul 20 11:09:54.017166 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2136/4294] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:53 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:54.411333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4bb45cf-95ad-4a3e-954d-64fa53ff5aa3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'create', calling method: .version_select at 0x7f2c3e8499d0>, body: {"keypair": {"name": "tempest-keypair-834688256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFb/eDj2XjkXf/9K1ym+5glHdr9GXMrnAwerEqTc9vSXv7iPf2NXjdxw2HUxACAi13JH+0vh6yOtq1ruBBj7uwgEQhnDztd69W43DUvmj67YKuOR9gtOyqYAZr+GYLeyiw=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:54.436176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-a4bb45cf-95ad-4a3e-954d-64fa53ff5aa3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for project 08962304189a4134a48f4fc532a13400. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:09:54.451859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-a4bb45cf-95ad-4a3e-954d-64fa53ff5aa3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for user 10d795e205ec46efa3393368a9567374 and project 08962304189a4134a48f4fc532a13400. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:09:54.498117 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4bb45cf-95ad-4a3e-954d-64fa53ff5aa3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.599519 Jul 20 11:09:54.498760 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2159/4295] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 11:09:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 601 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 11:09:54.906380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:54.907200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:54.931115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:54.931784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:54.933654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:54.934850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:55.029575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:55.032164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:55.053100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:55.064482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:55.068439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:55.071148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:55.196553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:55.212060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-20129ffd-4863-489e-a3ff-7c6d7013794a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1687 microversion: 2.1 time: 0.312350 Jul 20 11:09:55.223848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2137/4296] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:54 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1687 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:55.397488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:55.408952 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e02b88b1-c501-473f-b1ba-8dcfdd14fff3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.388167 Jul 20 11:09:55.415190 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2160/4297] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:55 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:55.618613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-24267c9e-1d29-471b-9ec7-3d9bad70a64d req-eeb3211c-33d9-4771-b926-eef6576e0de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-unplugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:09:55.639030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-24267c9e-1d29-471b-9ec7-3d9bad70a64d req-eeb3211c-33d9-4771-b926-eef6576e0de8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:55.641063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-24267c9e-1d29-471b-9ec7-3d9bad70a64d req-eeb3211c-33d9-4771-b926-eef6576e0de8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:55.705736 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-24267c9e-1d29-471b-9ec7-3d9bad70a64d req-eeb3211c-33d9-4771-b926-eef6576e0de8 service nova] Creating event network-vif-unplugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:09:55.738243 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-24267c9e-1d29-471b-9ec7-3d9bad70a64d req-eeb3211c-33d9-4771-b926-eef6576e0de8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124457 Jul 20 11:09:55.740997 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2138/4298] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:09:56.233735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:56.234799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:56.249944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:56.251377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:56.254030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:56.255010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:56.434441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:56.435197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:56.462653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:56.465355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:56.470109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:56.475766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:56.992742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:57.017790 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f1900bd3-f739-411f-9d03-b316738fcc43 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1687 microversion: 2.1 time: 0.790593 Jul 20 11:09:57.020242 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2161/4299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:56 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1687 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:57.220174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:57.237073 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-75acba80-ae63-4782-a09d-b97d4ade45e8 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.808449 Jul 20 11:09:57.237988 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2139/4300] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:56 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:58.037750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:58.039308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:58.057822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:58.058496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:58.062431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:58.063079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:58.260360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:58.261610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:58.296734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:58.300025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:58.307588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:58.322567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:59.465372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:59.483510 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dc24e465-263a-46ee-81b7-847f3bdaa39b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 1.230933 Jul 20 11:09:59.492707 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2140/4301] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:58 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:09:59.514678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:09:59.523692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:09:59.554286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:59.556276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:59.561312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:09:59.564015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:09:59.648782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:09:59.667058 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce974a79-929c-4fd8-85e2-a65648ee30b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.631094 Jul 20 11:09:59.669331 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2162/4302] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:09:58 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:00.094791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-821078384", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e46291c9-18b9-4313-bd7d-5fe3e547a263"}], "security_groups": [{"name": "tempest-securitygroup--412965703"}], "key_name": "tempest-keypair-834688256", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:00.373990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:00.404109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:00.405807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:00.407194 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84fc7367-9173-4885-8954-30202ade4f59 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2950 microversion: 2.32 time: 0.910789 Jul 20 11:10:00.415762 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2141/4303] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:09:59 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2950 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:00.440461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:00.442189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:00.461002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:00.465098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:00.466688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:00.468029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:00.520701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] validate_networks() for [('e46291c9-18b9-4313-bd7d-5fe3e547a263', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:10:00.937949 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f9fb260-06f5-4e61-96d1-86a1f4ea029e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.503480 Jul 20 11:10:00.939982 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2142/4304] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 11:10:00 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57/os-interface => generated 1831 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:00.947955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:00.950353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:00.974780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:00.978640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:00.980043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:00.980671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:01.733639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:01.750437 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0e3aae3-db43-4cff-8775-eb9bcf14f6f9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.809125 Jul 20 11:10:01.755270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2143/4305] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:00 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:01.781993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:01.784333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:01.819380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:01.823559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:01.824770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:01.828391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:02.537594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:02.556502 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c0459d2-719b-4554-99bd-3ac906fca6e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.795841 Jul 20 11:10:02.583895 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2144/4306] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:01 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:02.598505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a9c980ea-5bad-428c-89e7-c7c25fbb485b req-9826487d-8973-49e0-a929-a08ed98dbf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-plugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:02.620372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9c980ea-5bad-428c-89e7-c7c25fbb485b req-9826487d-8973-49e0-a929-a08ed98dbf3d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:02.621460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9c980ea-5bad-428c-89e7-c7c25fbb485b req-9826487d-8973-49e0-a929-a08ed98dbf3d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:02.651892 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a9c980ea-5bad-428c-89e7-c7c25fbb485b req-9826487d-8973-49e0-a929-a08ed98dbf3d service nova] Creating event network-vif-plugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:10:02.661942 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a9c980ea-5bad-428c-89e7-c7c25fbb485b req-9826487d-8973-49e0-a929-a08ed98dbf3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076163 Jul 20 11:10:02.670259 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2145/4307] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:02.743291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:10:02.744349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:10:02.745014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:10:02.745600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:10:02.746193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:10:02.775390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:02.776811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:02.786275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:02.804805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:02.805652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:02.807647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:02.811542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:02.811783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:02.816759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:02.819153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:02.884991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for project 08962304189a4134a48f4fc532a13400. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:10:02.893151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for user 10d795e205ec46efa3393368a9567374 and project 08962304189a4134a48f4fc532a13400. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:10:02.928931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:10:02.931729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:10:03.001069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2a518663-c31b-4a0f-8b5d-c9f55d7404bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.911040 Jul 20 11:10:03.007676 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2163/4308] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 11:10:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2918 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:10:03.018390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb52819e-81a2-42d7-b8b1-3415296e57c3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:03.021730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb52819e-81a2-42d7-b8b1-3415296e57c3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:03.175496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb52819e-81a2-42d7-b8b1-3415296e57c3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:03.188726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb52819e-81a2-42d7-b8b1-3415296e57c3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:03.197480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb52819e-81a2-42d7-b8b1-3415296e57c3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:03.198834 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb52819e-81a2-42d7-b8b1-3415296e57c3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1280 microversion: 2.20 time: 0.184639 Jul 20 11:10:03.210646 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2164/4309] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:03 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:10:03.304678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:03.318832 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-834e3506-91d8-4bd4-8e13-f2d41e320d3b tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.548226 Jul 20 11:10:03.323942 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2146/4310] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:02 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:03.581325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:03.582128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:03.601844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:03.604726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:03.607001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:03.610726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:04.080175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:04.094245 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1fbdfa4-ee86-4b3a-864d-b12538644f3e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.517083 Jul 20 11:10:04.117603 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2165/4311] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:03 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:04.222426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:04.223397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:04.250089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:04.250557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:04.251428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:04.251867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:04.350799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:04.353609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:04.370607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:04.376962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:04.378298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:04.378824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:04.445864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:04.464105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:04.466646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:04.468082 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d9af9fa-742f-4f21-a2cb-db0379fe4716 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1284 microversion: 2.20 time: 0.251320 Jul 20 11:10:04.470016 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2147/4312] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:04 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:04.711743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:04.728327 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1c6bfb0d-1260-4a4a-837b-df108a43f037 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.389541 Jul 20 11:10:04.730519 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2166/4313] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:04 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:05.119399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:05.120276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:05.153419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:05.165470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:05.179627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:05.180617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:05.489239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:05.490618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:05.504571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:05.507796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:05.512157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:05.513990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:05.690629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:05.716737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:05.721223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:05.724960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad35c36e-3f9f-4502-b009-a37b465783e2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1338 microversion: 2.20 time: 0.239877 Jul 20 11:10:05.727604 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2167/4314] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:05 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1338 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:05.756106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:05.757696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:05.767098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:05.768989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:05.771352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:05.773489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:05.775102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:05.780307 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5291a52-b94b-4d5b-8e99-3afbe68b3cea tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.665912 Jul 20 11:10:05.780987 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2148/4315] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:05 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:06.619900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:06.630460 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c21d65d6-199b-4762-8dfe-385448a0ecee tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1513 microversion: 2.1 time: 0.881994 Jul 20 11:10:06.635374 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2168/4316] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:05 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1513 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:06.756303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:06.756877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:06.787029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:06.788087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:06.788677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:06.799959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:06.801038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:06.816635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:06.817092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:06.818420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:06.818861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:06.828259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:08.185105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:08.195394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:08.206229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:08.218293 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0dd9a75c-0748-4533-9dd7-1017ceb72531 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.422772 Jul 20 11:10:08.223674 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2169/4317] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:06 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:08.226319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:08.230282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:08.234785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:08.235030 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0cfd567b-d0e7-41fa-8624-9ae2f3538ff5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 1.492097 Jul 20 11:10:08.239709 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2149/4318] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:06 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:10:08.240223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:08.258238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:08.258998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:08.260092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:08.260731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:08.816052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:08.829548 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30bc1282-166e-4bc5-acb9-cf47f1181a02 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1490 microversion: 2.1 time: 0.600260 Jul 20 11:10:08.830698 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2170/4319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:08 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1490 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:08.853652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:08.854171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:08.888250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:08.888715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:08.889514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:08.889952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:08.950048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:10:09.122825 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74d67036-a59c-469c-bc63-b6219e06f751 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 204 len: 0 microversion: 2.1 time: 0.272670 Jul 20 11:10:09.124869 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2150/4320] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:08 2022] DELETE /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:10:09.136946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:09.137577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:09.181072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:09.181546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:09.182364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:09.182807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:09.257762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:09.259404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:09.290103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:09.296444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:09.303736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:09.305849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:09.792011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:09.825839 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30b427a9-bb01-42e3-983d-9a6dc3215fdd tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1496 microversion: 2.1 time: 0.695690 Jul 20 11:10:09.834265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2171/4321] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:09 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1496 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:09.844233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:09.859210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:09.883336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:09.885897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:09.890950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:09.891840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:10.095315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:10.104711 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f57f957-dc55-4a96-890c-ee1bf160292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.852766 Jul 20 11:10:10.113757 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2151/4322] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:09 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:10.234179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:10.254932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:10.274120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:10.276184 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a5f8889-a4ae-44b6-8255-36224f8d13e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 0.439612 Jul 20 11:10:10.283410 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2172/4323] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:09 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:10.577941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3d4ff00b-140b-42c7-a938-2582f4209359 req-d5578d5d-21ae-44e2-bf02-d03cae13a1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:10.582625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:10.613150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3d4ff00b-140b-42c7-a938-2582f4209359 req-d5578d5d-21ae-44e2-bf02-d03cae13a1ec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:10.626025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3d4ff00b-140b-42c7-a938-2582f4209359 req-d5578d5d-21ae-44e2-bf02-d03cae13a1ec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:10.657929 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3d4ff00b-140b-42c7-a938-2582f4209359 req-d5578d5d-21ae-44e2-bf02-d03cae13a1ec service nova] Creating event network-changed:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:10:10.685553 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3d4ff00b-140b-42c7-a938-2582f4209359 req-d5578d5d-21ae-44e2-bf02-d03cae13a1ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111141 Jul 20 11:10:10.698877 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2152/4324] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:10.853443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:10.854154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:10.867284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:10.877057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:10.889403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:10.890179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:10.964498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:11.146981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:11.147996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:11.160496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:11.187743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:11.192627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:11.193415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:11.572108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:11.592502 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc97d5d8-bd80-4b9d-bd6c-908b5911259f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1496 microversion: 2.1 time: 0.745652 Jul 20 11:10:11.593252 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2173/4325] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:10 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1496 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:11.637960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:11.638635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:11.671200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:11.679979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:11.680930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:11.681388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:12.175666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:12.190726 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e3c9eb8-39b1-4445-ac21-fee4a2c045f3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.061729 Jul 20 11:10:12.191758 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2153/4326] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:11 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:12.358255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:12.383995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:12.392018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:12.395089 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7e3a551-a99e-464b-93c3-493eb38c66d2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 0.800848 Jul 20 11:10:12.399853 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2174/4327] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:11 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:12.610502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:12.611130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:12.624963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:12.625425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:12.626674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:12.627116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:12.796427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-017e5c95-45f5-4560-a22c-03983592db59 req-fdb49ab2-2985-4383-b441-756dab495153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b59476-aba2-4c63-a3e1-d8681d6edd92", "name": "network-vif-deleted", "tag": "9ac17a42-7529-48fa-b730-7e8377272ab6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:12.801512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:12.822183 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e8c976d-3d29-4f2e-9a48-d12275ef65ea tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 200 len: 1454 microversion: 2.1 time: 0.216116 Jul 20 11:10:12.826471 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2154/4328] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:12 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:12.838648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-017e5c95-45f5-4560-a22c-03983592db59 req-fdb49ab2-2985-4383-b441-756dab495153 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:12.839440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-017e5c95-45f5-4560-a22c-03983592db59 req-fdb49ab2-2985-4383-b441-756dab495153 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:12.856760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-017e5c95-45f5-4560-a22c-03983592db59 req-fdb49ab2-2985-4383-b441-756dab495153 service nova] Creating event network-vif-deleted:9ac17a42-7529-48fa-b730-7e8377272ab6 for instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 on n-h2-846219-10 Jul 20 11:10:12.869699 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-017e5c95-45f5-4560-a22c-03983592db59 req-fdb49ab2-2985-4383-b441-756dab495153 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076892 Jul 20 11:10:12.873984 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2175/4329] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:10:13.209537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:13.210198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:13.232558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:13.235747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:13.237778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:13.238804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:13.415470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:13.418383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=12 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:13.425934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:13.428295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:13.450839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:13.452534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:13.453576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:13.454242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:14.097553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:14.124449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3c2f3296-d6d0-4ce8-a9a3-d1d54da9caa0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.919560 Jul 20 11:10:14.130037 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2155/4330] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:13 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:14.157994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:14.158702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:14.195593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:14.196445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:14.197833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:14.198435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:14.220718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:14.228462 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 HTTP/1.1 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f6b59476-aba2-4c63-a3e1-d8681d6edd92'} Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:14.230777 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:14.235882 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:14.237024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:14.237541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:14.238593 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76dfd905-c205-46cb-94d1-2b3933b783ba tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 404 len: 111 microversion: 2.1 time: 0.106424 Jul 20 11:10:14.239412 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2156/4331] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:14 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:14.240513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:14.262368 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-444541e3-3a9e-4b31-a0f4-9770869f2a5a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 0.843946 Jul 20 11:10:14.274474 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2176/4332] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:13 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:14.506351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-347205460", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "aee48918-6e36-4370-8c8c-9b84b9f82c2d"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:14.678027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] validate_networks() for [('aee48918-6e36-4370-8c8c-9b84b9f82c2d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:10:15.147887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:15.149081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:15.168004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:15.168792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:15.178878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:15.179850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:15.853906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:15.867424 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f67877b0-4ca5-40fe-a342-fee3641174eb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.721686 Jul 20 11:10:15.874791 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2177/4333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:15 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:15.900280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:15.905649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:15.931441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:15.933226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:15.937363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:15.939297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:16.231543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:10:16.232670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:10:16.233380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:10:16.234037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:10:16.236117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:10:16.258708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:16.261755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:16.263506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:16.276265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:16.358023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:10:16.384842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Getting quotas for user 2c3eeb31db074ffb8b820b11f793fe4a and project 79fb963135ff4e3086b956c7ea23c766. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:10:16.437124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:10:16.439714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:10:16.455141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:16.485313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:16.489203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:16.492948 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0db1f44c-352d-474c-a225-1dd3b610ef09 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 0.616398 Jul 20 11:10:16.498647 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2178/4334] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:15 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:16.700090 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-260f56be-834b-425f-a96c-d75888ab6762 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.200221 Jul 20 11:10:16.700753 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2157/4335] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:10:16.712891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9802bd6-04a8-4731-9b6a-6e316b67c5a1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:16.713529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9802bd6-04a8-4731-9b6a-6e316b67c5a1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:16.863636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9802bd6-04a8-4731-9b6a-6e316b67c5a1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:16.876009 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9802bd6-04a8-4731-9b6a-6e316b67c5a1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1214 microversion: 2.1 time: 0.168914 Jul 20 11:10:16.882135 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2179/4336] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:16 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:16.892248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:16.893992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:16.914731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:16.918346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:16.920943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:16.924351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:17.502146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:17.518068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:17.519657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:17.557844 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58862c85-fb8a-42a9-b3f3-c22ee6382491 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.659848 Jul 20 11:10:17.561648 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2158/4337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:16 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:17.563511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:17.570331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:17.577232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:17.579308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:17.794705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-243f89e5-f749-438a-9ef0-7b24fee81b9f req-edc48c0c-5ebd-414e-aa37-7fad0c122878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "name": "network-vif-plugged", "status": "completed", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:17.830484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-243f89e5-f749-438a-9ef0-7b24fee81b9f req-edc48c0c-5ebd-414e-aa37-7fad0c122878 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:17.831525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-243f89e5-f749-438a-9ef0-7b24fee81b9f req-edc48c0c-5ebd-414e-aa37-7fad0c122878 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:17.902986 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-243f89e5-f749-438a-9ef0-7b24fee81b9f req-edc48c0c-5ebd-414e-aa37-7fad0c122878 service nova] Creating event network-vif-plugged:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:10:17.940498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-243f89e5-f749-438a-9ef0-7b24fee81b9f req-edc48c0c-5ebd-414e-aa37-7fad0c122878 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144699 Jul 20 11:10:17.947854 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2159/4338] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:10:17.976359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:17.984540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:18.037353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:18.039301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:18.043297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:18.044979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:18.199903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:18.209973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:18.219008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:18.230116 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89e69c04-ec51-4a0f-b4d7-51028c3ab3e4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 0.710605 Jul 20 11:10:18.243199 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2180/4339] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:17 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:18.304909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:18.331106 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bed245c2-616a-4718-92e2-0777ae7a2b5c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1218 microversion: 2.1 time: 0.366035 Jul 20 11:10:18.334842 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2160/4340] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:17 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1218 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:18.601166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:18.602495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:18.620518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:18.628349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:18.629620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:18.630321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:19.266537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:19.271060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:19.309781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:19.310712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:19.314150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:19.315732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:19.616816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:19.636931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8fac92c5-4071-4326-b1ae-aa97e10bd990 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.040650 Jul 20 11:10:19.641973 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2181/4341] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:18 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:19.651754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:19.655638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:19.673979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:19.674768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:19.678071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:19.678852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:20.035002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:20.044552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d912bd63-c6d3-4c97-bb4b-24e5f5ddbb8e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1272 microversion: 2.1 time: 0.401053 Jul 20 11:10:20.050498 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2182/4342] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:19 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:20.139090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:20.172849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:20.184189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:20.191350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a1fa50c-23e6-496b-b0a4-10b8ffa929ab tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1405 microversion: 2.20 time: 0.934844 Jul 20 11:10:20.212373 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2161/4343] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:19 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1405 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:10:20.663517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:20.668520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:20.686392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:20.687056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:20.688011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:20.688677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:21.096994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:21.099023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:21.146711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:21.153453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:21.158666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:21.159747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:21.432070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:21.447293 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5ad69492-33ec-4acb-8cad-17cab80730c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.791810 Jul 20 11:10:21.448973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:21.452465 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2183/4344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:20 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:21.466379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:21.470219 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7015d76-9e3f-489e-a5b0-3d802eedafad tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1272 microversion: 2.1 time: 0.384889 Jul 20 11:10:21.471242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:21.488065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:21.489128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:21.490270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:21.492253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:21.494920 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2162/4345] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:21 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1272 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:22.211314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:22.227371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:22.233098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:22.234747 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-02b4f101-eb7f-49de-9e2c-ffc450ef1ff6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1596 microversion: 2.20 time: 0.780774 Jul 20 11:10:22.235576 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2184/4346] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:10:21 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1596 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:10:22.257751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:22.258308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:22.272745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:22.273203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:22.277051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:22.277506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:22.468996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:22.469951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:22.491748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:22.492268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:22.493108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:22.495562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:22.762205 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e9d443d7-ebce-4117-b408-c66ffaafb3e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.510030 Jul 20 11:10:22.764232 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2163/4347] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 11:10:22 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-interface => generated 284 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:10:22.769208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:22.770884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:22.799420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:22.801037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:22.803814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:22.805534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:22.926082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:22.938956 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0a62184-51cd-40a4-b3e5-4427d25da4cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.474875 Jul 20 11:10:22.939609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2185/4348] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:22 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:23.501163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:23.515129 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-313789f1-06a9-4cc9-b932-ab6c8d7c1cf5 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1314 microversion: 2.1 time: 0.749520 Jul 20 11:10:23.524859 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2164/4349] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:22 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1314 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:23.702483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d1a59080-4090-495f-a70f-86ccf88081c5 req-45a93eca-6f66-4add-a87c-54153a1b8b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11861070-524a-4985-aa2a-2424d03c15f9", "tag": "afc18747-d991-4fe8-9e53-71f218268e22"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:23.726434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:23.733981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d1a59080-4090-495f-a70f-86ccf88081c5 req-45a93eca-6f66-4add-a87c-54153a1b8b4d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:23.734957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d1a59080-4090-495f-a70f-86ccf88081c5 req-45a93eca-6f66-4add-a87c-54153a1b8b4d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:23.793430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d1a59080-4090-495f-a70f-86ccf88081c5 req-45a93eca-6f66-4add-a87c-54153a1b8b4d service nova] Creating event network-changed:afc18747-d991-4fe8-9e53-71f218268e22 for instance 11861070-524a-4985-aa2a-2424d03c15f9 on n-h2-846219-10 Jul 20 11:10:23.821171 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d1a59080-4090-495f-a70f-86ccf88081c5 req-45a93eca-6f66-4add-a87c-54153a1b8b4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122820 Jul 20 11:10:23.826705 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2186/4350] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:23.966726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:23.970042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:23.985458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:23.988678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:23.991340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:23.995774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:24.546120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:24.546851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:24.566199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:24.574019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:24.574916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:24.577271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:25.758550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:25.772203 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e7d0e872-9cfe-42c3-b396-6fd5b7944413 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.810195 Jul 20 11:10:25.773413 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2165/4351] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:23 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:26.002837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:26.016626 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1cec6f31-1f4f-4e95-b40b-93fd8e565625 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1314 microversion: 2.1 time: 1.473654 Jul 20 11:10:26.018192 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2187/4352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:24 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1314 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:26.611865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a571c7b0-b8e6-41fd-b7c5-151a34d78b10 req-af2d8399-38cb-43db-b4b1-11e9969236d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:26.621932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:26.636087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:26.669049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a571c7b0-b8e6-41fd-b7c5-151a34d78b10 req-af2d8399-38cb-43db-b4b1-11e9969236d0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:26.670117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a571c7b0-b8e6-41fd-b7c5-151a34d78b10 req-af2d8399-38cb-43db-b4b1-11e9969236d0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:26.698104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a571c7b0-b8e6-41fd-b7c5-151a34d78b10 req-af2d8399-38cb-43db-b4b1-11e9969236d0 service nova] Creating event network-changed:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:10:26.717473 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a571c7b0-b8e6-41fd-b7c5-151a34d78b10 req-af2d8399-38cb-43db-b4b1-11e9969236d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107760 Jul 20 11:10:26.731793 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2166/4353] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:26.800011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:26.800644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:26.819998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:26.820577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:26.821526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:26.821947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:26.881563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:27.035962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:27.036674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:27.049004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:27.049386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:27.050174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:27.055578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:28.214023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:28.225036 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21892578-5ba3-4d1d-9854-81a1b1e1d857 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1314 microversion: 2.1 time: 1.193169 Jul 20 11:10:28.237693 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2167/4354] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:27 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:28.243522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:28.252437 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c3e13e9-b2e8-4511-85c2-e36febfb4c8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 1.456262 Jul 20 11:10:28.252958 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2188/4355] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:26 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:29.244920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:29.246255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:29.266589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:29.271022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:29.272399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:29.273886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:29.276995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:29.277455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:29.291835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:29.292415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:29.300392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:29.302082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:29.377791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:29.923744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:29.941039 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d6e057d-5cdb-4cbf-bc83-00427ad33b10 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1314 microversion: 2.1 time: 0.700318 Jul 20 11:10:29.966273 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2168/4356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:29 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:30.027893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:30.040604 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44888140-91d9-4aa3-a96a-55d05b8b1bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1682 microversion: 2.1 time: 0.773648 Jul 20 11:10:30.041222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2189/4357] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:29 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1682 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:30.984067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:30.985324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:30.998886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.003009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:31.004054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.005335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:31.059815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:31.060314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:31.094931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.099256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:31.104824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.105394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:31.566035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:31.574732 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-196db6f9-718c-433b-8a0a-a81e05c5e951 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.520451 Jul 20 11:10:31.595213 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2190/4358] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:31 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:31.620307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:31.633717 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e3a5505e-f8af-4f55-a346-f52bc0f01298 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1314 microversion: 2.1 time: 0.653410 Jul 20 11:10:31.634329 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2169/4359] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:30 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:31.636746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a5889ed1-cde4-4d35-842c-7db1854b5b4f req-479e2c4c-62d4-41e8-9d9a-38d6cbcd036d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11861070-524a-4985-aa2a-2424d03c15f9", "name": "network-vif-plugged", "status": "completed", "tag": "afc18747-d991-4fe8-9e53-71f218268e22"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:31.649346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a5889ed1-cde4-4d35-842c-7db1854b5b4f req-479e2c4c-62d4-41e8-9d9a-38d6cbcd036d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.649795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a5889ed1-cde4-4d35-842c-7db1854b5b4f req-479e2c4c-62d4-41e8-9d9a-38d6cbcd036d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:31.677839 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a5889ed1-cde4-4d35-842c-7db1854b5b4f req-479e2c4c-62d4-41e8-9d9a-38d6cbcd036d service nova] Creating event network-vif-plugged:afc18747-d991-4fe8-9e53-71f218268e22 for instance 11861070-524a-4985-aa2a-2424d03c15f9 on n-h2-846219-10 Jul 20 11:10:31.694059 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a5889ed1-cde4-4d35-842c-7db1854b5b4f req-479e2c4c-62d4-41e8-9d9a-38d6cbcd036d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065711 Jul 20 11:10:31.694697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2191/4360] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:10:31.860084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:31.860788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:31.874245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.875852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:31.876828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:31.878512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:32.257153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:32.267669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e8bcd2ff-d7ee-4110-a7f1-07d3da9f4843 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.412572 Jul 20 11:10:32.279411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2170/4361] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:31 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:32.418199 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:10:32.418434 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:10:32.654794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:32.656675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:32.675136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:32.675861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:32.676899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:32.681563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:33.122446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:33.153030 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b2993111-ba70-4c25-99f2-04e3c93231fc tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1314 microversion: 2.1 time: 0.497754 Jul 20 11:10:33.155796 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2192/4362] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:32 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:33.751956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c00f8bea-34d7-4232-ad13-e37d15736b8e req-45b3b603-25eb-494a-a4fc-a6d92116aeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-unplugged", "status": "completed", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:33.768107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c00f8bea-34d7-4232-ad13-e37d15736b8e req-45b3b603-25eb-494a-a4fc-a6d92116aeca service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:33.771658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c00f8bea-34d7-4232-ad13-e37d15736b8e req-45b3b603-25eb-494a-a4fc-a6d92116aeca service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:33.796142 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c00f8bea-34d7-4232-ad13-e37d15736b8e req-45b3b603-25eb-494a-a4fc-a6d92116aeca service nova] Creating event network-vif-unplugged:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:10:33.817382 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c00f8bea-34d7-4232-ad13-e37d15736b8e req-45b3b603-25eb-494a-a4fc-a6d92116aeca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069965 Jul 20 11:10:33.818713 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2171/4363] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:34.172380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:34.174465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:34.189449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.190144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.191204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.193612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.203899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:34.528192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:34.538413 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6dabae52-8f16-4b41-ba52-b87e8427cc07 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1502 microversion: 2.1 time: 0.370239 Jul 20 11:10:34.551894 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2193/4364] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:34 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1502 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:34.562096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:34.563023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:34.584662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.585908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.587311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.587982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.627120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lazy-loading 'flavor' on Instance uuid 11861070-524a-4985-aa2a-2424d03c15f9 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:10:34.797205 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84de1126-06c4-44ee-a63d-19ea1be08849 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "POST /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9/action" status: 202 len: 0 microversion: 2.1 time: 0.240666 Jul 20 11:10:34.802623 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2172/4365] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:10:34 2022] POST /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:10:34.812601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:34.814287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:34.832961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.836002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.850223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.852854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.943149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:34.944569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:34.953519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.954367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:34.955922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:34.956435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:35.232589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:35.246562 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f98e7c4-dda9-4faf-bbd3-9ec730e9339e tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1510 microversion: 2.1 time: 0.438958 Jul 20 11:10:35.275205 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2194/4366] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:34 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:35.309685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:35.318211 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7a74d364-d6e2-4e25-a6da-1dc7f243292c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.380544 Jul 20 11:10:35.325612 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2173/4367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:34 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:35.347058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:35.347759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:35.358742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:35.359217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:35.360013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:35.360459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:35.800879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:35.817448 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f6d2b155-aae5-4760-a77e-c63ea1e99536 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.477012 Jul 20 11:10:35.818914 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2195/4368] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:35 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:35.843363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:35.845364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:35.865714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:35.866433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:35.867849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:35.868500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.280789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:36.281602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:36.289826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.290406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.291318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.291911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.656916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:36.667872 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-823d0cdb-200b-4ba8-a4a6-bc2f833a8af9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.835633 Jul 20 11:10:36.678793 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2174/4369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:35 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:36.697327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:36.698376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:36.709415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.711005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.712108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.712781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.750578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:36.786028 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b037b718-4765-4ac8-aabe-d660c7ecd25c tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1493 microversion: 2.1 time: 0.508966 Jul 20 11:10:36.786646 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2196/4370] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:36 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1493 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:36.805756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:36.807718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:36.830669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.833250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.834499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.835234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.880022 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4eaf25e6-886b-4587-ad84-e38b9a0994f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.181267 Jul 20 11:10:36.884873 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2175/4371] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:10:36 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:10:36.900181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:36.900904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:36.912959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:10:36.929480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.930250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:36.931288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:36.932152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:37.103227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a342ae2-774e-4598-985e-01b11dd5724f tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 204 len: 0 microversion: 2.1 time: 0.304108 Jul 20 11:10:37.106318 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2197/4372] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:36 2022] DELETE /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:10:37.115516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:37.122724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:37.132531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:37.133226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:37.134030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:37.134480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:37.214442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:37.227747 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-37c4c00a-7b3a-4b72-925d-99459086f1e8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1671 microversion: 2.1 time: 0.337673 Jul 20 11:10:37.229014 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2176/4373] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:36 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1671 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:37.445979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:37.455210 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-774ad6ea-ab24-4933-9356-4bc9b30b6692 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1499 microversion: 2.1 time: 0.344153 Jul 20 11:10:37.458327 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2198/4374] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:37 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1499 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:38.252736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:38.256809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:38.310981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:38.310981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:38.312365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:38.312365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:38.479441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:38.482855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:38.493097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:38.493825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:38.499227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:38.499921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:38.695818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:38.717718 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7fade610-379f-4625-a6cc-c96b78c26615 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1671 microversion: 2.1 time: 0.472862 Jul 20 11:10:38.718330 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2177/4375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:38 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1671 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:38.894909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:38.916581 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-157a7cdc-db10-421a-aee5-fd63b93d18ac tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1499 microversion: 2.1 time: 0.445557 Jul 20 11:10:38.917185 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2199/4376] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:38 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1499 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:39.742920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:39.743687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:39.764882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:39.771972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:39.775981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:39.776637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:39.935281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:39.935862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:39.969924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:39.970404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:39.971342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:39.972569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:40.241303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c3eeb31db074ffb8b820b11f793fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fb963135ff4e3086b956c7ea23c766', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:40.267222 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79683d83-63f0-47ee-9dc1-09ad99ff9d1d tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 200 len: 1457 microversion: 2.1 time: 0.335213 Jul 20 11:10:40.268249 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2200/4377] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:39 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 1457 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:40.293587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-acc4b087-bb86-4e2d-9eee-c430dcf63625 req-74095ac1-82d9-4f29-9e3b-d77713692561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11861070-524a-4985-aa2a-2424d03c15f9", "name": "network-vif-deleted", "tag": "afc18747-d991-4fe8-9e53-71f218268e22"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:40.319154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-acc4b087-bb86-4e2d-9eee-c430dcf63625 req-74095ac1-82d9-4f29-9e3b-d77713692561 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:40.321537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-acc4b087-bb86-4e2d-9eee-c430dcf63625 req-74095ac1-82d9-4f29-9e3b-d77713692561 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:40.347009 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-acc4b087-bb86-4e2d-9eee-c430dcf63625 req-74095ac1-82d9-4f29-9e3b-d77713692561 service nova] Creating event network-vif-deleted:afc18747-d991-4fe8-9e53-71f218268e22 for instance 11861070-524a-4985-aa2a-2424d03c15f9 on n-h2-846219-10 Jul 20 11:10:40.369068 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-acc4b087-bb86-4e2d-9eee-c430dcf63625 req-74095ac1-82d9-4f29-9e3b-d77713692561 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076663 Jul 20 11:10:40.369234 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2201/4378] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:40.495719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:40.511684 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fffc94b-493d-4479-9928-93a62b263a55 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1676 microversion: 2.1 time: 0.775560 Jul 20 11:10:40.515635 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2178/4379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:39 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1676 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:41.287762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.288474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.302847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.305303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.307832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.308696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.352638 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 HTTP/1.1 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '11861070-524a-4985-aa2a-2424d03c15f9'} Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.357107 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a897cf3-53ca-4ba2-9984-2c7f9fdd51d9 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 404 len: 111 microversion: 2.1 time: 0.076746 Jul 20 11:10:41.366571 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2202/4380] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:41 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.371034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.371599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.376648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:41.382843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.383354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.384165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.384612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.439248 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 HTTP/1.1 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '11861070-524a-4985-aa2a-2424d03c15f9'} Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.448010 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.452108 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.459309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.460740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23933c72-79b1-4abf-b57d-b21089e0b640 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 404 len: 111 microversion: 2.1 time: 0.094220 Jul 20 11:10:41.462717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2179/4381] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:41 2022] DELETE /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.470607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.471272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 11861070-524a-4985-aa2a-2424d03c15f9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.480347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.480814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.481615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.491680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.524835 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 HTTP/1.1 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '11861070-524a-4985-aa2a-2424d03c15f9'} Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.526460 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.530648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 11861070-524a-4985-aa2a-2424d03c15f9 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.534015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9e83cc77-ce70-4cff-a2cc-69e674e2fa83 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9" status: 404 len: 111 microversion: 2.1 time: 0.066918 Jul 20 11:10:41.537863 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2203/4382] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:41 2022] GET /compute/v2.1/servers/11861070-524a-4985-aa2a-2424d03c15f9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.541828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.542742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.548794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.549236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.553843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.555013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.556239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.556923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.579763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.580233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.582277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.583116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.644650 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 HTTP/1.1 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f6b59476-aba2-4c63-a3e1-d8681d6edd92'} Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.646590 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd72ed01-cf05-41fd-bf1c-ecf013ff53da tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 404 len: 111 microversion: 2.1 time: 0.109210 Jul 20 11:10:41.650697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2204/4383] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:41 2022] DELETE /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.684033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.684602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: f6b59476-aba2-4c63-a3e1-d8681d6edd92] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.704495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.707055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.712235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.712701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.748159 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 HTTP/1.1 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f6b59476-aba2-4c63-a3e1-d8681d6edd92'} Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.751535 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. Jul 20 11:10:41.757732 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.764055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance f6b59476-aba2-4c63-a3e1-d8681d6edd92 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.765589 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e09c94d-a6f1-4177-837c-3a340e3090ae tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92" status: 404 len: 111 microversion: 2.1 time: 0.109304 Jul 20 11:10:41.774074 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2205/4384] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:41 2022] GET /compute/v2.1/servers/f6b59476-aba2-4c63-a3e1-d8681d6edd92 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.784454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.787778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.806615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.807163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.808061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.808579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.830814 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 HTTP/1.1 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2'} Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.834358 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.840551 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.843283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.846607 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d6a0b4a-f3ab-46fd-bb63-322d27c2d9e2 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 404 len: 111 microversion: 2.1 time: 0.071045 Jul 20 11:10:41.849168 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2206/4385] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:41 2022] DELETE /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.867433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.868406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.885144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.885542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.886587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.888230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.932908 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 HTTP/1.1 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2'} Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:41.939018 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d6d5ee9-4f19-4218-bbb5-580f522cbed0 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2" status: 404 len: 111 microversion: 2.1 time: 0.086995 Jul 20 11:10:41.944573 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2207/4386] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:41 2022] GET /compute/v2.1/servers/5ef511fe-159f-4ad6-ad2c-d92d8d23a5a2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:41.960101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:41.961639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:41.987144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.987995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:41.997941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:41.998684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.046405 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 HTTP/1.1 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ab54db46-9076-4a17-b1e6-1c05fbe4b9a8'} Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:42.053368 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-403ef0f4-5544-4204-a4d5-cd5220261779 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 404 len: 111 microversion: 2.1 time: 0.108988 Jul 20 11:10:42.057986 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2208/4387] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:41 2022] DELETE /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:10:42.081654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:42.082419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: ab54db46-9076-4a17-b1e6-1c05fbe4b9a8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:42.105946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.106406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.114749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.115722 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.167004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:42.169237 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 HTTP/1.1 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ab54db46-9076-4a17-b1e6-1c05fbe4b9a8'} Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.177839 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:42.185776 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d7da82a-d491-4a03-8c14-661b2f4e0c19 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8" status: 404 len: 111 microversion: 2.1 time: 0.121238 Jul 20 11:10:42.186646 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f27ded8-b63c-48ac-ba44-f3892f3d574e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.640665 Jul 20 11:10:42.186744 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2209/4388] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:42 2022] GET /compute/v2.1/servers/ab54db46-9076-4a17-b1e6-1c05fbe4b9a8 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:42.186826 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2180/4389] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:41 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:42.191733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:42.192250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:42.203313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:42.206800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:42.217478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.218747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.219740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.223659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.228700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.230564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.232122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.236596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.263345 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 HTTP/1.1 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8fcdf99c-c6a8-4266-a50e-c20592085b19'} Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:42.265198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.270647 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.272346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:42.273460 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a285954-0939-4954-92f3-f3ec83f3dc44 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 404 len: 111 microversion: 2.1 time: 0.087233 Jul 20 11:10:42.274546 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2210/4390] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:42 2022] DELETE /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:42.285744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:42.286379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 8fcdf99c-c6a8-4266-a50e-c20592085b19] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:42.300059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.300629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.302939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.303483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.320187 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0397bd58-fbe5-4e61-a2cc-fbdbacd5fef3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 200 len: 322 microversion: 2.1 time: 0.120998 Jul 20 11:10:42.321529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2181/4391] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:10:42 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 322 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:42.330052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 HTTP/1.1 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8fcdf99c-c6a8-4266-a50e-c20592085b19'} Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:42.331681 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 8fcdf99c-c6a8-4266-a50e-c20592085b19 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:42.336848 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-730f4e56-5590-4950-9d22-95b725411e94 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19" status: 404 len: 111 microversion: 2.1 time: 0.054351 Jul 20 11:10:42.338787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:42.339030 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2211/4392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:42 2022] GET /compute/v2.1/servers/8fcdf99c-c6a8-4266-a50e-c20592085b19 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:42.340290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:42.358609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.359349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.361168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.362825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.858531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:42.875874 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f126184-8698-45ba-8a1a-a4afb844a816 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.548972 Jul 20 11:10:42.876465 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2182/4393] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:42 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:10:42.914679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:42.916389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:42.932559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.933993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:42.935782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:42.936512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:43.281769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:43.296558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a1672260-c4e6-4432-a148-fb49ce53b1fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.392716 Jul 20 11:10:43.301672 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2212/4394] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:42 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:43.318816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:43.319841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:43.331464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:43.332028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:43.332963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:43.333451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:43.608544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:43.619962 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e23e673f-339f-420c-83f2-76a176683406 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.304033 Jul 20 11:10:43.634570 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2183/4395] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:43 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:43.638366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:43.639976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:43.657100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:43.657576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:43.658936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:43.659703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:44.179562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:44.197958 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43aef82c-c07a-4c93-b2d6-156e263474e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.557572 Jul 20 11:10:44.198890 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2213/4396] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:43 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:44.462365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-737179707", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "eec87b6d-7d5e-44a0-b831-62582b4dcc3f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:44.896350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] validate_networks() for [('eec87b6d-7d5e-44a0-b831-62582b4dcc3f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:10:45.695321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:10:45.695839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:10:45.704983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:10:45.708531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:10:45.709630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:10:45.740812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:45.741561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:45.742609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:45.744452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:45.758916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:45.798860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:10:45.827112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for user 85fdcf2c53c648548248e606e639b974 and project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:10:45.873279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:10:45.876882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:10:45.984309 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15a87830-4396-46bd-ab94-e5549d990421 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531517 Jul 20 11:10:45.990428 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2184/4397] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:10:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:10:45.998192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a75d4748-f4ba-4bbd-9a38-0984878f5d54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:45.998823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a75d4748-f4ba-4bbd-9a38-0984878f5d54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:46.593900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a75d4748-f4ba-4bbd-9a38-0984878f5d54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:46.636447 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a75d4748-f4ba-4bbd-9a38-0984878f5d54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1214 microversion: 2.1 time: 0.634872 Jul 20 11:10:46.637963 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2214/4398] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:45 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1214 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:47.657508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:47.658693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:47.673561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:47.678699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:47.679823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:47.680474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.146592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:48.147959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:48.194992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.196191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.197166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.197730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.237769 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d HTTP/1.1 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '688e2be6-67cd-49e5-bda0-5d5a2ed8343d'} Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:48.242314 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.247233 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.249277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:48.251476 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4dde403b-3492-4d13-a820-1b3dd06b13c3 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 404 len: 111 microversion: 2.1 time: 0.108444 Jul 20 11:10:48.258321 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2215/4399] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:48 2022] DELETE /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:48.270373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:48.273441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 688e2be6-67cd-49e5-bda0-5d5a2ed8343d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:48.292640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.294029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.295059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.295800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.341052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d HTTP/1.1 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '688e2be6-67cd-49e5-bda0-5d5a2ed8343d'} Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.344250 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. Jul 20 11:10:48.349556 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.351444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 688e2be6-67cd-49e5-bda0-5d5a2ed8343d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:48.354189 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c16b96e1-0e7d-42f3-84b1-eb68d0555a53 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d" status: 404 len: 111 microversion: 2.1 time: 0.092888 Jul 20 11:10:48.355315 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2216/4400] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:48 2022] GET /compute/v2.1/servers/688e2be6-67cd-49e5-bda0-5d5a2ed8343d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:48.371905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:48.372597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:48.383779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.384776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.387258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.388366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.430565 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 HTTP/1.1 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9b35049c-be9d-4dbe-9def-b91aded44119'} Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:48.434674 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.439546 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.442386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:48.445430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5f19db0c-b3be-4489-a842-3fc0db4efba1 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 404 len: 111 microversion: 2.1 time: 0.083375 Jul 20 11:10:48.446181 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2217/4401] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:10:48 2022] DELETE /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:48.446338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:48.455098 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e4b0648-3e96-4a00-9590-409ccf07ee91 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1274 microversion: 2.1 time: 0.802762 Jul 20 11:10:48.459963 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2185/4402] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:47 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1274 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:48.478442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:48.479276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] [instance: 9b35049c-be9d-4dbe-9def-b91aded44119] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:48.496661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.497296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.499358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:48.501143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:48.535782 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] HTTP exception thrown: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Request method failure captured: Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 HTTP/1.1 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-FN3M8Jv0NddsdBUt1UJPVhP6HhXw6awB-5GSmJJxLeycg0xJCaPqrTBmbsmfXx6bKSqyj3zAkkt4fWeydAKSbzguSS92TX4xcJDPUVhvubIeTvp3sakTNjuuob9A8Yg0m61fQVmpUl7iUjFGz9dCbJd4YGG3-QIYjoL_GA--gUc_s Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79fb963135ff4e3086b956c7ea23c766", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79fb963135ff4e3086b956c7ea23c766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 79fb963135ff4e3086b956c7ea23c766 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-847198555 Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2c3eeb31db074ffb8b820b11f793fe4a Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-847198555-project Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9b35049c-be9d-4dbe-9def-b91aded44119'} Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:10:48.538203 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. Jul 20 11:10:48.542485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:10:48.547888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] Returning 404 to user: Instance 9b35049c-be9d-4dbe-9def-b91aded44119 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:10:48.549205 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e94ed76-f6ae-4773-b237-daf767c62b80 tempest-DeleteServersTestJSON-847198555 tempest-DeleteServersTestJSON-847198555-project] 10.222.0.79 "GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119" status: 404 len: 111 microversion: 2.1 time: 0.097485 Jul 20 11:10:48.550298 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2218/4403] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:48 2022] GET /compute/v2.1/servers/9b35049c-be9d-4dbe-9def-b91aded44119 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:10:49.477269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:49.478526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:49.487320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:49.488029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:49.489194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:49.490012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:49.866209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:49.885831 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96d8df96-95c5-48e8-8b4d-56489e970890 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 0.412731 Jul 20 11:10:49.887095 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2186/4404] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:49 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:50.907000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:50.908529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:50.921648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:50.924373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:50.926813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:50.929762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:50.941016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:51.220381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ff2d6c1e-96d2-4e8c-9a6e-425e4172d48e req-8c973b26-7344-480c-b086-af1ca336a57f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78237c0d-be5c-4750-a39c-4cd616af234d", "tag": "46f148af-bcb0-4131-99c9-1b47fc996945"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:51.262908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ff2d6c1e-96d2-4e8c-9a6e-425e4172d48e req-8c973b26-7344-480c-b086-af1ca336a57f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:51.266347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ff2d6c1e-96d2-4e8c-9a6e-425e4172d48e req-8c973b26-7344-480c-b086-af1ca336a57f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:51.301612 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ff2d6c1e-96d2-4e8c-9a6e-425e4172d48e req-8c973b26-7344-480c-b086-af1ca336a57f service nova] Creating event network-changed:46f148af-bcb0-4131-99c9-1b47fc996945 for instance 78237c0d-be5c-4750-a39c-4cd616af234d on n-h2-846219-10 Jul 20 11:10:51.313508 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ff2d6c1e-96d2-4e8c-9a6e-425e4172d48e req-8c973b26-7344-480c-b086-af1ca336a57f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097276 Jul 20 11:10:51.314639 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2187/4405] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:10:52.221553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:52.260813 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-146f6c9c-7b88-4b8a-93d3-30cafe11f5cf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 1.341228 Jul 20 11:10:52.267458 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2219/4406] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:50 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:53.287322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:53.288246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:53.313233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:53.313697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:53.337694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:53.338171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:54.065541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:54.074242 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52261ae5-35ba-436c-871e-b5c1182ec96a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 0.793139 Jul 20 11:10:54.074859 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2188/4407] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:53 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:55.099051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:55.101633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:55.104982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:55.123247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:55.123898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:55.130208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:55.130940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:55.501376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:55.515600 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9c9919dd-ad8c-4379-adcc-0000b6fb5899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 0.427966 Jul 20 11:10:55.529370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2220/4408] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:55 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:56.537951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:56.538575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:56.552272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:56.558548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:56.558548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:56.558548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:56.559631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:56.562893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:57.156533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:57.208664 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-372fbcfe-d6ee-4816-a7fe-a96a68bbad6f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 0.674266 Jul 20 11:10:57.224519 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2189/4409] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:56 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:57.526474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-39061b55-a2c2-4387-a5c0-611a5b0bc1f4 req-a2576aa2-2471-463d-81ad-bca519dd39b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78237c0d-be5c-4750-a39c-4cd616af234d", "name": "network-vif-plugged", "status": "completed", "tag": "46f148af-bcb0-4131-99c9-1b47fc996945"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:10:57.571703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:10:57.612338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-39061b55-a2c2-4387-a5c0-611a5b0bc1f4 req-a2576aa2-2471-463d-81ad-bca519dd39b4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:57.618004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-39061b55-a2c2-4387-a5c0-611a5b0bc1f4 req-a2576aa2-2471-463d-81ad-bca519dd39b4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:57.671311 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-39061b55-a2c2-4387-a5c0-611a5b0bc1f4 req-a2576aa2-2471-463d-81ad-bca519dd39b4 service nova] Creating event network-vif-plugged:46f148af-bcb0-4131-99c9-1b47fc996945 for instance 78237c0d-be5c-4750-a39c-4cd616af234d on n-h2-846219-10 Jul 20 11:10:57.692559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-39061b55-a2c2-4387-a5c0-611a5b0bc1f4 req-a2576aa2-2471-463d-81ad-bca519dd39b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167728 Jul 20 11:10:57.699493 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2221/4410] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:10:58.227452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:58.228877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:58.249923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:58.252555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:58.255806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:58.256437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:59.005768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:10:59.016724 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d3731e9-80cd-4f81-938c-613d19590fc6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 0.794479 Jul 20 11:10:59.030652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2190/4411] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:10:58 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:10:59.555851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:10:59.556461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:10:59.590003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:59.590715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:59.591726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:10:59.592342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:10:59.651227 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9710584c-0c97-4fc4-8ccf-d66e72c601f1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/ips" status: 200 len: 151 microversion: 2.20 time: 0.106159 Jul 20 11:10:59.660915 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2222/4412] 10.222.0.79 () {60 vars in 1288 bytes} [Wed Jul 20 11:10:59 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/ips => generated 151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:11:00.038034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:00.038668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:00.057613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:00.060047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:00.063547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:00.063907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:00.750480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:00.768466 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-786f07d1-f0e4-4f2a-884e-1018e603d346 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1314 microversion: 2.1 time: 0.734499 Jul 20 11:11:00.781265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2191/4413] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:00 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:01.789600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:01.790236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:01.813293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:01.813573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:01.814385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:01.814823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:02.533342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:02.561092 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5d895184-9103-4ee7-9952-51b2e28142bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1501 microversion: 2.1 time: 0.774991 Jul 20 11:11:02.583198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2677e11b-f954-45e0-bc57-f451ca8344d5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:02.591769 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2223/4414] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:01 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1501 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:02.600641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2677e11b-f954-45e0-bc57-f451ca8344d5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:02.603047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2677e11b-f954-45e0-bc57-f451ca8344d5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:02.661493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2677e11b-f954-45e0-bc57-f451ca8344d5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Going to try to stop instance {{(pid=125886) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:11:02.797590 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2677e11b-f954-45e0-bc57-f451ca8344d5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d/action" status: 202 len: 0 microversion: 2.1 time: 0.203779 Jul 20 11:11:02.805982 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2192/4415] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:02 2022] POST /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:11:02.814035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:02.815533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:02.835530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:02.836277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:02.839088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:02.840035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:03.300285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:03.301264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:03.314028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:03.314731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:03.315773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:03.316411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:03.374673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lazy-loading 'flavor' on Instance uuid bb1f20dc-f27d-4e5b-97fb-35a4393cd592 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:11:03.771246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:03.790335 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b37fe9fe-2d0e-49db-b85e-7e16816e00e7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.982129 Jul 20 11:11:03.795544 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2224/4416] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:02 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:04.200079 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b7f16143-b71d-4556-b466-4dc2be7ae12f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/action" status: 202 len: 0 microversion: 2.20 time: 0.903889 Jul 20 11:11:04.207231 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2193/4417] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 11:11:03 2022] POST /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/action => generated 0 bytes in 912 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:11:04.216633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:04.217988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:04.249932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:04.258673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:04.261357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:04.263120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:04.684908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:04.699807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:04.703760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:04.707337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9383df40-469c-4030-b545-cbe1463f9112 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.492877 Jul 20 11:11:04.710203 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2225/4418] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:04 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:04.812201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:04.812906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:04.832132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:04.833041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:04.834005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:04.834865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:05.183646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:05.192672 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f17d3cb-6627-41af-bad9-c85f92322c28 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.384424 Jul 20 11:11:05.204132 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2194/4419] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:04 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:05.730906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:05.731615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:05.753204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:05.754590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:05.756801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:05.757333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:06.105726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:06.115564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:06.118401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:06.120037 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-77ef3215-cdeb-4b2e-9e35-74233c5da668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.394939 Jul 20 11:11:06.121416 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2226/4420] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:05 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:06.226143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:06.227902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:06.247049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:06.251095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:06.255849 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:06.257449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:06.599908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:06.616258 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e3ac5729-24df-461a-b846-8f7f2bdc36b9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.396206 Jul 20 11:11:06.642504 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2195/4421] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:06 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:07.140653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:07.141519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:07.161340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:07.166024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:07.167305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:07.167957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:07.453488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:07.467437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:07.471067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:07.476482 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e1f3cced-2619-4eee-a089-382020079dd7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.341630 Jul 20 11:11:07.479257 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2227/4422] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:07 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:07.648808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:07.650113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:07.671162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:07.673178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:07.674247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:07.677888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:08.230219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:08.245268 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a2f10f27-2e6e-401a-b768-2a68ece72d59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.599470 Jul 20 11:11:08.248146 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2196/4423] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:07 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:08.498716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:08.500094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:08.517274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:08.518611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:08.521053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:08.525269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:08.847902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:08.857986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:08.871252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:08.873892 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-076d2814-cc99-4a10-8d33-6d83908d3e3d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.380752 Jul 20 11:11:08.874883 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2228/4424] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:08 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:09.267124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:09.269981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:09.293898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:09.296217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:09.297747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:09.298451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:09.504217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:09.516964 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ae872681-55a2-4a91-9fdf-e536fc81fb4d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.254007 Jul 20 11:11:09.518208 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2197/4425] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:09 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:09.892659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:09.893909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:09.909326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:09.911514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:09.915423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:09.915918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:10.410676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:10.420987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:10.422649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:10.424122 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5157997-ea77-4ce6-9d47-635317e1007a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.535448 Jul 20 11:11:10.437699 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2229/4426] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:09 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:10.536427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:10.537192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:10.556395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:10.557773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:10.560843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:10.562479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:11.287453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:11.297595 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf4097f8-70ca-4bfc-a754-524b69e44c7e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.766177 Jul 20 11:11:11.301547 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2198/4427] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:10 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:11.451036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:11.451685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:11.468110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:11.471926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:11.475420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:11.480891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:11.801242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1238310875", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "5b47dc89-9a05-4690-a5ac-fcef9c72eb06"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:11.822635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:11.918257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] validate_networks() for [('5b47dc89-9a05-4690-a5ac-fcef9c72eb06', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:11:12.131062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:12.155231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:12.165522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:12.173692 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08657504-2f6b-4ca2-8040-c68f6b85e16b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.727659 Jul 20 11:11:12.187221 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2230/4428] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:11 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:12.318960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:12.320480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:12.338847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:12.349378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:12.353227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:12.353912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:12.974745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:12.985459 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e1cab878-1c5f-434b-bac7-cf77f0124280 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.671377 Jul 20 11:11:12.986074 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2231/4429] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:12 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:13.193045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:13.194131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:13.206828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:13.207411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:13.215135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:13.215799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:13.304325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:11:13.304774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:11:13.305206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:11:13.305615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:11:13.306082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:11:13.333518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:13.333975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:13.335835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:13.336294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:13.356948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:13.384548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Getting quotas for project 60dcbf4b95e24a2199e995e69b6a6781. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:11:13.396016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Getting quotas for user af8e6205bc5d41e581a675640ea82c50 and project 60dcbf4b95e24a2199e995e69b6a6781. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:11:13.416031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:11:13.418457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:11:13.450701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:13.463435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:13.465053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:13.466270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2bb5db73-e387-4100-9c72-625bd3be2033 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.278025 Jul 20 11:11:13.466956 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2232/4430] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:13 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:11:13.481009 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-93711f21-66c5-4838-a0e3-4581f28cd92f tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039495 Jul 20 11:11:13.482313 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2199/4431] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:11:13.505937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e1c45ee-e013-4dda-90df-db5fc44bae2b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:13.506483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e1c45ee-e013-4dda-90df-db5fc44bae2b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:13.586558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5e1c45ee-e013-4dda-90df-db5fc44bae2b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:13.593648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e1c45ee-e013-4dda-90df-db5fc44bae2b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1225 microversion: 2.1 time: 0.100285 Jul 20 11:11:13.606988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2233/4432] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:13 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:14.006102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:14.007376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:14.021066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:14.022948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:14.024041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:14.027837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:14.359370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:14.372319 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5272eee6-00b3-457e-b39e-952891baa897 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.371397 Jul 20 11:11:14.373742 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2200/4433] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:13 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:14.485803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:14.486444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:14.509640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:14.511900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:14.513009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:14.515511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:14.616892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:14.617719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:14.643536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:14.648223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:14.650157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:14.654141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:14.991863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:15.031055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:15.045374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:15.053035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:15.059611 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c036ad6c-c831-4f69-a912-9a4f8c09b860 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.574781 Jul 20 11:11:15.065026 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2234/4434] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:14 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:15.070527 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e4ee8867-3a94-4ea7-abd4-0feb23cbf70d tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1229 microversion: 2.1 time: 0.456016 Jul 20 11:11:15.075305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2201/4435] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:14 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1229 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:15.391606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:15.392342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:15.426461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:15.427415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:15.428641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:15.429494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:16.086006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:16.087280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:16.101606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:16.107545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:16.108581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:16.109670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:16.364818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:16.380608 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-576d8472-0a8e-4c3f-9540-b391d6897bbe tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.994270 Jul 20 11:11:16.381222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2235/4436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:15 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:16.403047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:16.403741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:16.417355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:16.422101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:16.424097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:16.431370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:16.730370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:16.754406 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf065bb2-09ca-4aa0-8b5a-6ba2e3ab33ac tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1283 microversion: 2.1 time: 0.372062 Jul 20 11:11:16.758837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2236/4437] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:16 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1283 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:16.867011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:16.878925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:16.885893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:16.889367 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fcf855f9-90e4-4ab8-bf4a-fee9a505af07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1742 microversion: 2.20 time: 0.808748 Jul 20 11:11:16.890630 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2202/4438] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:16 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1742 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:11:17.400823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:17.402293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:17.431664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:17.434303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:17.439391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:17.443350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:17.776233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:17.776885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:17.797778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:17.799883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:17.803264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:17.809566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:18.711917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:18.729726 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2e22878-fe3d-4235-808e-8510d169fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1283 microversion: 2.1 time: 0.957259 Jul 20 11:11:18.730588 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2203/4439] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:17 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1283 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:18.737338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:18.738782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:18.748614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:18.749343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:18.750308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:18.750931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:19.041656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:19.051095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:19.053906 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-830382a6-2f6a-4a1a-8d7d-34b57f69559d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 1.658746 Jul 20 11:11:19.054755 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2237/4440] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:17 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:19.632850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:19.642790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:19.645131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:19.646365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b18b707b-a3cc-41a4-8fd7-76089fcf09b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.914428 Jul 20 11:11:19.682929 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2204/4441] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:18 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:19.747721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:19.748575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:19.767846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:19.771696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:19.783745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:19.786804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:20.074028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:20.075055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:20.089218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:20.094562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:20.099875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:20.100745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:20.839209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:20.873115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:20.883251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dcb7b72f-ac79-4812-8097-2118b519b73e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.800655 Jul 20 11:11:20.887924 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2205/4442] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:20 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:20.906455 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d5417d4-425a-481c-bfe7-498b6617f0af tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 1.152290 Jul 20 11:11:20.923455 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2238/4443] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:19 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:20.932503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9a96e8ee-465d-4de5-8cb8-91dd24770446 req-a7baa648-d587-4313-bac6-f01aa14d0f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "name": "network-vif-plugged", "status": "completed", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:20.944128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:20.944790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:20.958739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9a96e8ee-465d-4de5-8cb8-91dd24770446 req-a7baa648-d587-4313-bac6-f01aa14d0f65 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:20.959207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9a96e8ee-465d-4de5-8cb8-91dd24770446 req-a7baa648-d587-4313-bac6-f01aa14d0f65 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:20.975101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:20.975729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:20.977179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:20.977847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:21.023855 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9a96e8ee-465d-4de5-8cb8-91dd24770446 req-a7baa648-d587-4313-bac6-f01aa14d0f65 service nova] Creating event network-vif-plugged:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:11:21.044068 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9a96e8ee-465d-4de5-8cb8-91dd24770446 req-a7baa648-d587-4313-bac6-f01aa14d0f65 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153543 Jul 20 11:11:21.044933 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2206/4444] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:21.906001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:21.906723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:21.926536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:21.926994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:21.930541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:21.934260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:22.101071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:22.119476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:22.121052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:22.139586 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-62c5dc4f-fd95-4a4d-8924-3d55a33b0567 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 1.214864 Jul 20 11:11:22.142710 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2239/4445] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:20 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:22.160843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:22.161939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:22.190703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:22.198679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:22.200851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:22.210698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:22.682332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:22.707592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43280721-74bd-46dd-bf48-7ef27cbf9ed0 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 0.563351 Jul 20 11:11:22.710775 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2240/4446] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:22 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:22.761814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:22.785631 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be711343-4704-4e06-96e4-576931c68754 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.885475 Jul 20 11:11:22.788941 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2207/4447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:21 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:23.178506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:23.179334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:23.201013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:23.201481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:23.202321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:23.202770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:23.590948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:23.731528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:23.733234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:23.734783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:23.759941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:23.767962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:23.770393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:23.780295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:23.789996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:23.791220 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5edc9a4b-d651-4970-9bac-74b306a15df5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.635097 Jul 20 11:11:23.794387 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2241/4448] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:23 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:23.795534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:23.796574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:23.802654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:23.817043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:23.827660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:23.848930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:23.852262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:23.862744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:23.864783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:25.060781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:25.167591 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f8d3fca-11ab-4535-9de7-0852bfa82ac9 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 1.429051 Jul 20 11:11:25.180615 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2208/4449] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:23 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:25.193362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8858a433-6f2a-4b90-a598-cca47c277c95 req-5adbb02d-85d5-4beb-86d7-31b7bc9de769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b45769c-7334-494c-b3bd-7e42ce197e9a", "tag": "95003ede-a7f5-4703-8d3d-9b5b14651591"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:25.244458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8858a433-6f2a-4b90-a598-cca47c277c95 req-5adbb02d-85d5-4beb-86d7-31b7bc9de769 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:25.244888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8858a433-6f2a-4b90-a598-cca47c277c95 req-5adbb02d-85d5-4beb-86d7-31b7bc9de769 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:25.261381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:25.280497 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e346545b-c54b-4bbc-9c75-eeaa1b4fa652 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 1.471374 Jul 20 11:11:25.287473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2242/4450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:23 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:25.303086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8858a433-6f2a-4b90-a598-cca47c277c95 req-5adbb02d-85d5-4beb-86d7-31b7bc9de769 service nova] Creating event network-changed:95003ede-a7f5-4703-8d3d-9b5b14651591 for instance 9b45769c-7334-494c-b3bd-7e42ce197e9a on n-h2-846219-10 Jul 20 11:11:25.310699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:25.311715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:25.316477 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8858a433-6f2a-4b90-a598-cca47c277c95 req-5adbb02d-85d5-4beb-86d7-31b7bc9de769 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126671 Jul 20 11:11:25.324143 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2209/4451] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:25.330428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=48 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:25.335930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:25.339532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:25.340631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:25.341318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:26.046074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:26.070859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:26.073157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:26.083708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f5731c56-5eb4-4220-b5f2-194c66d95cdd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.788141 Jul 20 11:11:26.090469 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2243/4452] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:25 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:26.187413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:26.188130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:26.221070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:26.223442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:26.226444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:26.227003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:26.305322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:26.306886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:26.326110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:26.327116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:26.331057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:26.332171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:26.702529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:26.719970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c058152a-d135-4615-98d7-ed17bda09dc7 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 0.537454 Jul 20 11:11:26.735740 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2210/4453] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:26 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:26.810299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:26.821677 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55a3a018-77f8-430a-8ebf-cdfa3e6a4dda tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1511 microversion: 2.1 time: 0.521320 Jul 20 11:11:26.825663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2244/4454] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:26 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:27.118249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:27.119161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:27.133293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:27.135186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:27.136950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:27.139690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:27.742878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:27.743556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:27.763105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:27.763592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:27.764391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:27.764836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:28.748171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:28.762349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:28.772367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:28.774859 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e70d6a42-1f7f-4f78-b700-2597255aed58 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 1.662971 Jul 20 11:11:28.775705 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2211/4455] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:27 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:28.780884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:28.788080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:28.796059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:28.808622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:28.809497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:28.809951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:29.308360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:29.341110 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c262734e-9529-4fbf-a126-a0dc07007f28 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 1.602583 Jul 20 11:11:29.359315 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2245/4456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:27 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:29.672106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:29.699655 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07600616-d2d0-40b6-8135-84f774dccb6a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1488 microversion: 2.1 time: 0.922341 Jul 20 11:11:29.700519 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2212/4457] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:28 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1488 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:29.728253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:29.732454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:29.756104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:29.761094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:29.770199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:29.771394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:29.796279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:29.797767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:29.840475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:29.841591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:29.844048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:29.847964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:29.920510 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81882f4e-52d2-4705-a76f-9471a9c56cf5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 200 len: 180 microversion: 2.1 time: 0.204021 Jul 20 11:11:29.921656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2246/4458] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:29 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 180 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:29.932374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:29.933660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:29.966202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:29.982766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:29.993727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:29.994742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:30.381423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:30.410000 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-108028d3-aed8-4838-b7e5-0a538436ced7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.482508 Jul 20 11:11:30.410996 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2247/4459] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:29 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:30.416892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:30.417532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:30.443573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:30.444251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:30.446591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:30.448072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:30.464235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:30.480435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:30.482903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:30.487105 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b8fff1c4-5db0-4d55-a3be-c54039927503 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.696379 Jul 20 11:11:30.490490 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2213/4460] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:29 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:11:30.508004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:30.509005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:30.517623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:30.518983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:30.520304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:30.521007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:31.646274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:31.659739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:31.672752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0936129b-4057-42ee-89b6-0b5c474ae0ed tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 1.260362 Jul 20 11:11:31.673351 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2248/4461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:30 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:31.673760 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8175ebe4-1de0-4365-b74b-634bf3bd629d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.179531 Jul 20 11:11:31.674541 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2214/4462] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:30 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:31.700797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e12d948b-a96b-46f6-837d-d312f6c54d37 req-d349c16c-7727-499b-adce-7e4f8449564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b45769c-7334-494c-b3bd-7e42ce197e9a", "name": "network-vif-plugged", "status": "completed", "tag": "95003ede-a7f5-4703-8d3d-9b5b14651591"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:31.703546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:31.715748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:31.731423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e12d948b-a96b-46f6-837d-d312f6c54d37 req-d349c16c-7727-499b-adce-7e4f8449564d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:31.732618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:31.735835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:31.736647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e12d948b-a96b-46f6-837d-d312f6c54d37 req-d349c16c-7727-499b-adce-7e4f8449564d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:31.737879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:31.740634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:31.768965 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e12d948b-a96b-46f6-837d-d312f6c54d37 req-d349c16c-7727-499b-adce-7e4f8449564d service nova] Creating event network-vif-plugged:95003ede-a7f5-4703-8d3d-9b5b14651591 for instance 9b45769c-7334-494c-b3bd-7e42ce197e9a on n-h2-846219-10 Jul 20 11:11:31.784024 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e12d948b-a96b-46f6-837d-d312f6c54d37 req-d349c16c-7727-499b-adce-7e4f8449564d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107102 Jul 20 11:11:31.787277 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2215/4463] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:31.797630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:31.800400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:31.828631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:31.842992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:31.849216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:31.850011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:32.070883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:32.083149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:32.094137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:32.097373 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12cf927b-7698-4eb1-9bb1-7c57771ec307 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.419023 Jul 20 11:11:32.100398 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2249/4464] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:31 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:32.166580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:32.198274 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-018ea114-0dce-4e0f-87d5-91f951eb8e5c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.408407 Jul 20 11:11:32.200088 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2216/4465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:31 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:32.217771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:32.218549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:32.240005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:32.242754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:32.243969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:32.247338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:32.689640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:32.690325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:32.691600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:32.700597 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-01869c76-7d7c-4bcf-be26-65b2ea331ba1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.487365 Jul 20 11:11:32.711694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:32.716579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:32.719064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:32.719750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:32.727819 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2250/4466] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:32 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:32.963541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-680332420", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "eec87b6d-7d5e-44a0-b831-62582b4dcc3f"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:33.014087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:33.037160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f27a4b0c-345b-41b8-9d25-78fd62fef0b8 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 0.349750 Jul 20 11:11:33.040052 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2217/4467] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:32 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:33.110519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] validate_networks() for [('eec87b6d-7d5e-44a0-b831-62582b4dcc3f', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:11:33.150732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:33.160323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:33.186258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:33.188491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:33.191968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:33.194943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:33.255988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:33.743846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:33.752259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:33.753824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:33.755041 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e93d1c18-7c45-4cef-83bc-1946bcdcb976 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.638561 Jul 20 11:11:33.770150 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2218/4468] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:33 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:33.975816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:11:33.976429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:11:33.977139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:11:33.977908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:11:33.978555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:11:34.000155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:34.001464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:34.002491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:34.003927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:34.053111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:11:34.059316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:34.060206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:34.070392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for user 85fdcf2c53c648548248e606e639b974 and project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:11:34.072555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:34.073206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:34.074187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:34.079233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:34.105660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:11:34.118401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:11:34.272845 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf4022cd-749c-46de-8ef6-2cb54c797879 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.312361 Jul 20 11:11:34.280511 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2251/4469] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:11:34.292834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eab551dd-06dd-4773-a769-ab233b4e6eae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:34.295039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eab551dd-06dd-4773-a769-ab233b4e6eae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:34.513648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eab551dd-06dd-4773-a769-ab233b4e6eae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:34.522217 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eab551dd-06dd-4773-a769-ab233b4e6eae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1214 microversion: 2.1 time: 0.240174 Jul 20 11:11:34.535863 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2252/4470] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:34 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1214 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:34.583303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:34.601765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c22e7ee6-874a-4128-832f-812f10930934 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1325 microversion: 2.1 time: 0.550049 Jul 20 11:11:34.605367 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2219/4471] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:34 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:34.776986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:34.777622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:34.796401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:34.796883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:34.797703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:34.798318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:35.336907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:35.354232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:35.356702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:35.360765 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8315bc1-5278-4ee4-9034-b0d5f503a4aa tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.588056 Jul 20 11:11:35.366748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2253/4472] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:34 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:35.540893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:35.541738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:35.575237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:35.575721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:35.576555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:35.576997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:35.628965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:35.629610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:35.647534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:35.649724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:35.652256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:35.652947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:35.881722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:35.925461 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17698cb1-1eb9-4f8d-8958-0c9c70e41882 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1210 microversion: 2.1 time: 0.379596 Jul 20 11:11:35.926809 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2220/4473] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:35 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1210 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:36.143844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:36.154196 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b03699a0-e7fc-41e9-8ff4-df8b52238948 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1522 microversion: 2.1 time: 0.530508 Jul 20 11:11:36.185394 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2254/4474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:35 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:36.191637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:36.192200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:36.205112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.206929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.207801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.208253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.282017 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] HTTP exception thrown: Action 999 not found Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Request method failure captured: Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a/os-instance-actions/999 HTTP/1.1 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-LPSHk7CxR4po08cGgW7CJOJ6ADOvAgay-jov4_AC8iQkrWP1vlpRQCc9TmUze_k5pcD2FryJ5kYnqqwLIHJuh4CpHJAaNtpIBixwmgHrzKvZx1veHNslL4Fv8NTsSZakSiX5Wo7F9N9OdThxKI2fIN11l8ULv2pPT_EJKo77o2Y6k Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 60dcbf4b95e24a2199e995e69b6a6781 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_60dcbf4b95e24a2199e995e69b6a6781", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 60dcbf4b95e24a2199e995e69b6a6781 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-InstanceActionsNegativeTestJSON-384678374-project Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: af8e6205bc5d41e581a675640ea82c50 Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-384678374-project Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: exception: Action 999 not found Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'server_id': '9b45769c-7334-494c-b3bd-7e42ce197e9a', 'id': '999'} Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 20 11:11:36.290606 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.296330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Returning 404 to user: Action 999 not found {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:11:36.297485 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-28cea0e4-2362-49cb-ac91-7e786216cb71 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.110534 Jul 20 11:11:36.298627 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2221/4475] 10.222.0.79 () {58 vars in 1307 bytes} [Wed Jul 20 11:11:36 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a/os-instance-actions/999 => generated 66 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:11:36.309453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2a302f2-f6ee-4ce8-8d7f-c3e4f8d2fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '.version_select at 0x7f2c50d2bc10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:36.310334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2a302f2-f6ee-4ce8-8d7f-c3e4f8d2fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: ccec95ba-51d2-4ecb-b61e-99996900b709] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:36.323685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d2a302f2-f6ee-4ce8-8d7f-c3e4f8d2fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] HTTP exception thrown: Instance ccec95ba-51d2-4ecb-b61e-99996900b709 could not be found. Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2a302f2-f6ee-4ce8-8d7f-c3e4f8d2fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Request method failure captured: Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ccec95ba-51d2-4ecb-b61e-99996900b709/os-instance-actions HTTP/1.1 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-LPSHk7CxR4po08cGgW7CJOJ6ADOvAgay-jov4_AC8iQkrWP1vlpRQCc9TmUze_k5pcD2FryJ5kYnqqwLIHJuh4CpHJAaNtpIBixwmgHrzKvZx1veHNslL4Fv8NTsSZakSiX5Wo7F9N9OdThxKI2fIN11l8ULv2pPT_EJKo77o2Y6k Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 60dcbf4b95e24a2199e995e69b6a6781 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_60dcbf4b95e24a2199e995e69b6a6781", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 60dcbf4b95e24a2199e995e69b6a6781 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-InstanceActionsNegativeTestJSON-384678374-project Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: af8e6205bc5d41e581a675640ea82c50 Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-384678374-project Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ccec95ba-51d2-4ecb-b61e-99996900b709 could not be found. Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': 'ccec95ba-51d2-4ecb-b61e-99996900b709'} Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccec95ba-51d2-4ecb-b61e-99996900b709 could not be found. Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:11:36.325708 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccec95ba-51d2-4ecb-b61e-99996900b709 could not be found. Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccec95ba-51d2-4ecb-b61e-99996900b709 could not be found. Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2a302f2-f6ee-4ce8-8d7f-c3e4f8d2fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Returning 404 to user: Instance ccec95ba-51d2-4ecb-b61e-99996900b709 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:11:36.331339 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2a302f2-f6ee-4ce8-8d7f-c3e4f8d2fbcb tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/ccec95ba-51d2-4ecb-b61e-99996900b709/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.021891 Jul 20 11:11:36.333146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2255/4476] 10.222.0.79 () {58 vars in 1295 bytes} [Wed Jul 20 11:11:36 2022] GET /compute/v2.1/servers/ccec95ba-51d2-4ecb-b61e-99996900b709/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:11:36.347220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:36.348040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:36.359030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.360478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.361540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.362217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.392413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:36.396354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:36.441302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.441866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.462980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.463478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.524933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:11:36.790251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2e9e0cd-6384-4d01-b7f3-6e67f71cb376 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 204 len: 0 microversion: 2.1 time: 0.450605 Jul 20 11:11:36.794602 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2222/4477] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:11:36 2022] DELETE /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 11:11:36.803617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:36.804343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:36.851180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.851658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:36.852459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:36.852906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:37.309274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:37.341238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:37.351763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:37.359904 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e6318471-5fa5-4d1f-86a5-3b1fa20bd408 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.973789 Jul 20 11:11:37.363683 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2256/4478] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:36 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:37.373536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:37.381325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:37.401807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:37.402983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:37.404087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:37.406817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:37.444817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:37.452330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:37.453835 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5621cdd-abab-4fad-b265-47833b34924c tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1528 microversion: 2.1 time: 0.657314 Jul 20 11:11:37.467556 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2223/4479] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:36 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1528 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:37.686173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:37.699813 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7779cb2e-8bf2-4522-9bc2-94b6e33b1a9e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1272 microversion: 2.1 time: 0.334083 Jul 20 11:11:37.700781 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2257/4480] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:37 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:38.379953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:38.380564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:38.405785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:38.406243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:38.407034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:38.407505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:38.474070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:38.475123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:38.510640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:38.515591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:38.516602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:38.521215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:39.106624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:39.121055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:39.131361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:39.136234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-64a10a5c-0e4a-43c1-b58f-c7a8112e877c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.759316 Jul 20 11:11:39.138603 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2224/4481] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:38 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:39.164251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:39.165149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:39.173057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:39.173744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:39.174853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:39.175583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:40.469611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:40.478807 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61d7cfc3-bc8a-4726-8bce-225d98b5a0d6 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1528 microversion: 2.1 time: 2.008700 Jul 20 11:11:40.481801 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2258/4482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:38 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1528 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:40.495113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:40.496168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:40.510082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:40.510915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:40.512009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:40.512724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:40.633021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:40.643090 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1776864d-fab3-4c73-ba05-7ed7e420d3cd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1314 microversion: 2.1 time: 1.500378 Jul 20 11:11:40.644908 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2225/4483] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:39 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1314 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:40.657024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e84803c5-e390-45d9-8959-85f45ab05498 req-ec287e78-1cec-4748-9e5e-a910706b72e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397813f8-965b-4015-bc61-9f008d0f4024", "tag": "72f313fa-f8d2-4aff-87f7-e3fc276e6908"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:40.688104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e84803c5-e390-45d9-8959-85f45ab05498 req-ec287e78-1cec-4748-9e5e-a910706b72e6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:40.688853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e84803c5-e390-45d9-8959-85f45ab05498 req-ec287e78-1cec-4748-9e5e-a910706b72e6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:40.731075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e84803c5-e390-45d9-8959-85f45ab05498 req-ec287e78-1cec-4748-9e5e-a910706b72e6 service nova] Creating event network-changed:72f313fa-f8d2-4aff-87f7-e3fc276e6908 for instance 397813f8-965b-4015-bc61-9f008d0f4024 on n-h2-846219-10 Jul 20 11:11:40.736858 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e84803c5-e390-45d9-8959-85f45ab05498 req-ec287e78-1cec-4748-9e5e-a910706b72e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090442 Jul 20 11:11:40.742284 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2226/4484] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:40.884613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:40.918058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:40.921349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:40.923202 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1ea6c49-7f95-4d05-a9f4-e551bdee5082 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.440075 Jul 20 11:11:40.924070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2259/4485] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:40 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:41.499282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:41.501789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:41.544267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.545099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:41.553169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.553754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:41.665412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:41.666030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:41.685751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.687678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:41.689644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.692489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:41.748952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:41.762452 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f84f075-cf66-49a2-b776-298429a0e58e tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1486 microversion: 2.1 time: 0.268213 Jul 20 11:11:41.771143 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2227/4486] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:41 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1486 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:41.776730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-48c9d1ab-02a8-4b42-94e6-912c6d9ad5ed req-76635dd1-991c-4c09-8917-6bd996334a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b45769c-7334-494c-b3bd-7e42ce197e9a", "name": "network-vif-deleted", "tag": "95003ede-a7f5-4703-8d3d-9b5b14651591"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:41.786063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-48c9d1ab-02a8-4b42-94e6-912c6d9ad5ed req-76635dd1-991c-4c09-8917-6bd996334a09 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.786858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-48c9d1ab-02a8-4b42-94e6-912c6d9ad5ed req-76635dd1-991c-4c09-8917-6bd996334a09 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:41.840342 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-48c9d1ab-02a8-4b42-94e6-912c6d9ad5ed req-76635dd1-991c-4c09-8917-6bd996334a09 service nova] Creating event network-vif-deleted:95003ede-a7f5-4703-8d3d-9b5b14651591 for instance 9b45769c-7334-494c-b3bd-7e42ce197e9a on n-h2-846219-10 Jul 20 11:11:41.857118 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-48c9d1ab-02a8-4b42-94e6-912c6d9ad5ed req-76635dd1-991c-4c09-8917-6bd996334a09 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084261 Jul 20 11:11:41.857806 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2228/4487] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:41.943226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:41.944796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:41.959366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:41.963929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.968315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:41.971131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:41.973582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:42.314093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:42.336722 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e6f8c147-84c9-4d2c-96b3-9cc4b85cb937 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1314 microversion: 2.1 time: 0.669677 Jul 20 11:11:42.349513 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2260/4488] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:41 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:42.438128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:42.489290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:42.503581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:42.504971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-70cecfed-8eca-4e2d-8090-c5e74d8cdf69 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.566864 Jul 20 11:11:42.505584 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2229/4489] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:41 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:42.791022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:42.792831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:42.808458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:42.809222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:42.810232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:42.810857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:42.940540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:42.940816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:42.943921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lazy-loading 'fault' on Instance uuid 9b45769c-7334-494c-b3bd-7e42ce197e9a {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:11:43.078309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af8e6205bc5d41e581a675640ea82c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60dcbf4b95e24a2199e995e69b6a6781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:43.090025 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bd2174ea-bd0e-4576-9827-9145e4d3c994 tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 200 len: 1315 microversion: 2.1 time: 0.304466 Jul 20 11:11:43.105795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2261/4490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:42 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:43.356930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:43.357603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:43.383843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:43.384306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:43.385109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:43.385643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:43.527881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:43.528503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:43.550836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:43.553829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:43.554679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:43.555130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:44.028301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:44.523437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:44.549099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:44.569862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:44.595311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:44.609806 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab5eef24-36ae-4d8e-914e-c66972baa335 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 1.079355 Jul 20 11:11:44.613656 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2262/4491] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:43 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:44.630039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:44.639883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] [instance: 9b45769c-7334-494c-b3bd-7e42ce197e9a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:44.663104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:44.663776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:44.666512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:44.669963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:44.720114 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] HTTP exception thrown: Instance 9b45769c-7334-494c-b3bd-7e42ce197e9a could not be found. Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Request method failure captured: Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a HTTP/1.1 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-LPSHk7CxR4po08cGgW7CJOJ6ADOvAgay-jov4_AC8iQkrWP1vlpRQCc9TmUze_k5pcD2FryJ5kYnqqwLIHJuh4CpHJAaNtpIBixwmgHrzKvZx1veHNslL4Fv8NTsSZakSiX5Wo7F9N9OdThxKI2fIN11l8ULv2pPT_EJKo77o2Y6k Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 60dcbf4b95e24a2199e995e69b6a6781 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_60dcbf4b95e24a2199e995e69b6a6781", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/60dcbf4b95e24a2199e995e69b6a6781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 60dcbf4b95e24a2199e995e69b6a6781 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-384678374 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-InstanceActionsNegativeTestJSON-384678374-project Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: af8e6205bc5d41e581a675640ea82c50 Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-384678374-project Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9b45769c-7334-494c-b3bd-7e42ce197e9a could not be found. Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9b45769c-7334-494c-b3bd-7e42ce197e9a'} Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b45769c-7334-494c-b3bd-7e42ce197e9a could not be found. Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b45769c-7334-494c-b3bd-7e42ce197e9a could not be found. Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:44.722316 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b45769c-7334-494c-b3bd-7e42ce197e9a could not be found. Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] Returning 404 to user: Instance 9b45769c-7334-494c-b3bd-7e42ce197e9a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-66e0d23f-a68e-42d4-a1d5-46f6c812c37b tempest-InstanceActionsNegativeTestJSON-384678374 tempest-InstanceActionsNegativeTestJSON-384678374-project] 10.222.0.79 "GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a" status: 404 len: 111 microversion: 2.1 time: 0.108172 Jul 20 11:11:44.729512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2263/4492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:44 2022] GET /compute/v2.1/servers/9b45769c-7334-494c-b3bd-7e42ce197e9a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:11:44.958633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:44.986281 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0024e940-be51-4e61-a97b-09f9da5ab638 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1314 microversion: 2.1 time: 1.634978 Jul 20 11:11:44.993433 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2230/4493] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:43 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1314 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:45.630273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:45.631036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:45.642367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:45.645350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:45.646291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:45.647017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:46.011759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:46.013098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:46.040060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:46.040473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:46.041278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:46.041724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:46.208272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:46.223581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:46.225159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:46.241685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff2cfc2e-1e06-4e9b-a958-f44bbbace0bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.615556 Jul 20 11:11:46.273138 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2264/4494] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:45 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:46.321642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-370bdd22-3d4c-4ffa-9bf3-7a02757eb00e req-d57ee3a5-f0cb-45ad-80e8-4604490b0f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397813f8-965b-4015-bc61-9f008d0f4024", "name": "network-vif-plugged", "status": "completed", "tag": "72f313fa-f8d2-4aff-87f7-e3fc276e6908"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:46.353864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-370bdd22-3d4c-4ffa-9bf3-7a02757eb00e req-d57ee3a5-f0cb-45ad-80e8-4604490b0f2d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:46.362540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-370bdd22-3d4c-4ffa-9bf3-7a02757eb00e req-d57ee3a5-f0cb-45ad-80e8-4604490b0f2d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:46.410151 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-370bdd22-3d4c-4ffa-9bf3-7a02757eb00e req-d57ee3a5-f0cb-45ad-80e8-4604490b0f2d service nova] Creating event network-vif-plugged:72f313fa-f8d2-4aff-87f7-e3fc276e6908 for instance 397813f8-965b-4015-bc61-9f008d0f4024 on n-h2-846219-10 Jul 20 11:11:46.458191 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-370bdd22-3d4c-4ffa-9bf3-7a02757eb00e req-d57ee3a5-f0cb-45ad-80e8-4604490b0f2d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131338 Jul 20 11:11:46.461493 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2265/4495] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:11:47.304222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:47.307514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:47.321041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:47.321939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:47.323882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:47.324688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:47.723332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:47.730966 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3694ba88-ee5d-4c5f-af09-44a1bd89c18b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1314 microversion: 2.1 time: 1.728966 Jul 20 11:11:47.741409 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2231/4496] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:46 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1314 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:11:48.053238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:48.066929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:48.070347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:48.071622 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1f292a0a-bcf0-46a6-bcec-a9fdeedc215a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1737 microversion: 2.20 time: 0.780639 Jul 20 11:11:48.077555 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2266/4497] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:47 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1737 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:11:48.758618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:48.762407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:48.775678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:48.776729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:48.777683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:48.778288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:49.093568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:49.094418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:49.113304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:49.113774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:49.129567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:49.131947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:49.389204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:49.398151 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33aad94d-c793-4b6c-acf3-10f682138c09 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1314 microversion: 2.1 time: 0.643342 Jul 20 11:11:49.405152 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2232/4498] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:48 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:49.628389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:49.648401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:49.650941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:49.652592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7bd00a87-ef8f-4c79-bfad-b511fcc55d71 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1719 microversion: 2.20 time: 0.566298 Jul 20 11:11:49.653957 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2267/4499] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:49 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1719 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:11:50.215881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-be6cad1d-9d6d-408e-a0bc-523ce666c293 req-1e967c66-77b1-4d66-a1f9-31339e604515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "name": "network-vif-unplugged", "status": "completed", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:50.240686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-be6cad1d-9d6d-408e-a0bc-523ce666c293 req-1e967c66-77b1-4d66-a1f9-31339e604515 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.241145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-be6cad1d-9d6d-408e-a0bc-523ce666c293 req-1e967c66-77b1-4d66-a1f9-31339e604515 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:50.270419 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-be6cad1d-9d6d-408e-a0bc-523ce666c293 req-1e967c66-77b1-4d66-a1f9-31339e604515 service nova] Creating event network-vif-unplugged:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:11:50.279015 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-be6cad1d-9d6d-408e-a0bc-523ce666c293 req-1e967c66-77b1-4d66-a1f9-31339e604515 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074721 Jul 20 11:11:50.294904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2233/4500] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 20 11:11:50.422144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:50.423106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:50.438628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.442361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:50.443808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.445354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:50.674095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:50.674760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:50.693911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.697203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:50.698257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.698715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:50.916788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:50.925856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-350481d8-875b-48c4-a757-07f9a4867734 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1501 microversion: 2.1 time: 0.507760 Jul 20 11:11:50.932946 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2268/4501] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:11:50 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1501 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:11:50.942832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:50.943845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:50.968776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.969447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:50.970327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:50.971531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:51.026826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:51.040988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:51.043331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:51.044998 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-54812e2d-464a-484a-a8aa-0cbead2c49b9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1719 microversion: 2.20 time: 0.376368 Jul 20 11:11:51.046234 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2234/4502] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:50 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1719 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:11:51.438452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-56333fb7-0269-40db-9aa5-3614d1e17119 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.500012 Jul 20 11:11:51.439122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2269/4503] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:50 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:11:52.067153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:52.067775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:52.105040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:52.109688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:52.110775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:52.111260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:52.163148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:52.450579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:52.451207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:52.483391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:52.488870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:52.489379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:52.490116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:52.490547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:52.494809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:52.517570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:52.521392 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81f71ff5-e8d7-4314-9f4d-03b935037b9e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1722 microversion: 2.20 time: 0.459420 Jul 20 11:11:52.535247 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2235/4504] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:52 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:52.545429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "226d79ab-9477-4f22-97b9-9a4567bc0f24"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:52.547625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:52.554563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:52.555446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:52.559530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:52.560347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:52.577804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b4355d7-4572-4dc3-a638-9c5e9b483454 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.132004 Jul 20 11:11:52.578984 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2270/4505] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:52 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:11:53.140087 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-22ae2c7f-2ac2-42ae-8518-bb63364c6ad9 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.600060 Jul 20 11:11:53.142338 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2236/4506] 10.222.0.79 () {62 vars in 1363 bytes} [Wed Jul 20 11:11:52 2022] POST /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 188 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:11:53.375329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:53.376205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:53.384944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:53.385411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:53.386190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:53.386638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:53.592281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:53.593582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:53.612733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:53.613465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:53.615895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:53.616502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:53.634924 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bbdbebac-53da-4db3-9424-72bc262a45de tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/action" status: 202 len: 0 microversion: 2.20 time: 0.264286 Jul 20 11:11:53.636390 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2271/4507] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 11:11:53 2022] POST /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:11:53.657462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:53.658258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:53.671059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:53.672446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:53.673958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:53.675392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:53.715846 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01e35b62-d686-4ea7-b763-bcc23898144a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.127872 Jul 20 11:11:53.721903 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2237/4508] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:53 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:11:53.959336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:53.968861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:53.970392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:53.981190 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-196a5bb1-1ed8-473b-9d93-7d341c9c1bf7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1748 microversion: 2.20 time: 0.332153 Jul 20 11:11:53.982293 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2272/4509] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:53 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1748 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:54.732080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:54.734445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:54.754111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:54.754564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:54.761390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:54.791808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:54.914569 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-033cadd4-6c11-4f2c-8e06-02fe89f16f99 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.190166 Jul 20 11:11:54.915239 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2238/4510] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:54 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:11:55.001581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:55.003266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:55.015419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:55.016332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:55.017316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:55.018272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:55.465038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:55.474381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:55.475964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:55.477514 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ed324d4-dc6b-402d-a7d0-577604a38ed0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1748 microversion: 2.20 time: 0.480587 Jul 20 11:11:55.487267 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2273/4511] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:54 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1748 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:55.927570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:55.929277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:55.943936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:55.945706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:55.947568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:55.948311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:56.028924 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e01b003b-a974-4de3-9314-1889ecdfb436 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.107310 Jul 20 11:11:56.033939 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2239/4512] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:55 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:11:56.512434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:56.514233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:56.577057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:56.579593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:56.580679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:56.583605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:56.584215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:57.042744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:57.044178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:57.068488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:57.070186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:57.072188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:57.073843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:57.087906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:57.090160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:11:57.104782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:57.106299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:57.120186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-93c02fc2-9f02-4da5-96da-f604faafa392 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 0.611580 Jul 20 11:11:57.122318 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2274/4513] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:56 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:57.131316 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e01ecfe8-54d8-4d4d-a074-7f62b5fd9a34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.094523 Jul 20 11:11:57.134478 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2240/4514] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:57 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:11:58.144903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:58.145527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:58.147098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:58.149557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:58.159773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:58.160598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:58.162057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:58.162709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:58.182869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:58.183377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:58.184240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:58.184716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:58.235007 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b6c340ac-777b-4d44-a06c-c02de2e9f139 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.094526 Jul 20 11:11:58.240241 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2241/4515] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:58 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:11:58.593214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:58.617633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:58.619327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:11:58.630561 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ae945a07-cddc-47a5-8b63-a56985e7ee4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 0.489818 Jul 20 11:11:58.631430 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2275/4516] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:58 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:11:59.253172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:11:59.254376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:59.296365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:59.299918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:59.300982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:59.301598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:59.402803 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f57fa48-15a7-4e47-ae1a-8afc8cfe3fb5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.159253 Jul 20 11:11:59.403813 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2242/4517] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:11:59 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:11:59.650273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:11:59.651684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:11:59.661827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:59.666884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:11:59.667804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:11:59.668264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:00.416114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:00.417503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:00.430943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:00.433291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:00.436467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:00.440732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:00.555778 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ccabe0d3-9a27-4e5f-bbf0-9265751709db tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 14 microversion: 2.1 time: 0.143857 Jul 20 11:12:00.556881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2243/4518] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:00 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:12:00.758816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:00.771688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:00.784863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:00.787774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd38c562-62b3-41a2-b6ee-7f4f31063f30 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 1.141449 Jul 20 11:12:00.790112 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2276/4519] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:11:59 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:01.569591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:01.570993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:01.589132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:01.589626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:01.592476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:01.593132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:01.708736 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b202554-c9a3-4b2d-b464-e31acd8fba54 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action" status: 200 len: 8205 microversion: 2.1 time: 0.144463 Jul 20 11:12:01.714264 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2244/4520] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:01 2022] POST /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024/action => generated 8205 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:01.720106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:01.721032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:01.733606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:01.734092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:01.734896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:01.735386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:01.806592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:01.807356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:01.842166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:01.842909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:01.844948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:01.850615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:02.692028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:02.702205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:02.711487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:02.713139 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0353cd3-997c-47b6-b747-3f5f1c502694 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 0.910931 Jul 20 11:12:02.734205 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2245/4521] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:01 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:02.754025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:02.777696 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-718b8eb4-a8cb-4c1a-bd34-28c5b39fb178 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.061820 Jul 20 11:12:02.778630 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2277/4522] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:01 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:02.804747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:02.809781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:02.835287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:02.836754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:02.840801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:02.842538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:03.372579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:03.386999 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11791825-566c-4598-b7be-32fc14a950fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.586167 Jul 20 11:12:03.390150 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2246/4523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:02 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:03.412527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:03.413538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:03.430064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:03.432487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:03.434223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:03.437423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:03.737536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:03.738197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:03.761219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:03.761897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:03.762827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:03.763300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:03.957978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:03.979942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-972865d2-142a-433a-8f3c-902966d7bb5b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.571758 Jul 20 11:12:03.985320 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2278/4524] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:03 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:03.996827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:03.999916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:04.024114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:04.024733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:04.025653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:04.031604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:04.110042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:04.132023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:04.133706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:04.137220 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b5d36a60-591b-4e30-ba6b-bcff7f391d3f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 0.406023 Jul 20 11:12:04.143546 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2247/4525] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:03 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:04.432290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:04.443609 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e480335e-b24d-4c3e-8246-c8aecfc2d6c5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.450478 Jul 20 11:12:04.465148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:04.465763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:04.473219 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2279/4526] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:03 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:04.479113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:04.479930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:04.480933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:04.488595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:04.592495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Locking {{(pid=125886) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 20 11:12:04.720378 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6655f1ba-fdba-4df4-a45a-c2eb4dd6b735 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.260490 Jul 20 11:12:04.722975 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2248/4527] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:04 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:04.730811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:04.731406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:04.745706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:04.746180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:04.747053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:04.747730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:05.156738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:05.159602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:05.176147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:05.176841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:05.179801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:05.180490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:05.216076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:05.707986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:05.721221 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ee98a23-4a3b-4812-a858-ca5e3358a525 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.993696 Jul 20 11:12:05.721965 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2280/4528] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:04 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:06.128253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:06.168325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:06.179473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:06.184726 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-afe0abe9-f265-4ed6-8cc5-251339c260f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 1.031770 Jul 20 11:12:06.186678 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2249/4529] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:05 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:06.202443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:06.238159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.238813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.305720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:06.307361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:06.313065 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] HTTP exception thrown: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 is locked Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Request method failure captured: Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action HTTP/1.1 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 15 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-HeInRY8jaXVre14IaJ8jR0RlW9tdCDElkwKI6IzDfFwVeVOoDWGyw177v8nv0VXSEzQ8ypidVH2oZuea9CHg3CTLRYK0VtA1FsIarWqTWu4oOFGDy0OjuCxSu-3wU1w2c9K7FmV40j0pMbHumX7yxs7e_ssTQbHRi83JjARo0dN4E Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bef632298d2416b8bd9b6ebcd073a61", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 85fdcf2c53c648548248e606e639b974 Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: {"os-stop": {}} Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 is locked Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fd01dea7-6154-40bc-92c8-c4534543d8b0', 'body': {'os-stop': {}}} Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 is locked Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 is locked Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 is locked Jul 20 11:12:06.319437 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:12:06.324288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.324288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.324288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.324288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.327782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Returning 409 to user: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 is locked {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:12:06.331434 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f31d2013-1b8a-48cb-90e9-beaba3f92899 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 409 len: 107 microversion: 2.1 time: 0.139857 Jul 20 11:12:06.332412 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2250/4530] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:06 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 107 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:12:06.363986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:06.367288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:06.396229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.397891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.398995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.404996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.450185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:12:06.557212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Unlocking {{(pid=125886) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 11:12:06.688239 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fbd83b55-b52d-48e7-905a-aabbe1f2b294 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.346190 Jul 20 11:12:06.692717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2251/4531] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:06 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:06.717473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-157896de-fba2-49d8-9350-61d19883280d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:06.740995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-157896de-fba2-49d8-9350-61d19883280d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.744239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-157896de-fba2-49d8-9350-61d19883280d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.769596 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f3cabce1-d565-4b9f-8d11-fe2075484d74 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 204 len: 0 microversion: 2.32 time: 1.029326 Jul 20 11:12:06.778120 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2281/4532] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:12:05 2022] DELETE /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:12:06.796585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:06.803785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:06.829413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.840347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.843071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:06.845208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:06.864459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-157896de-fba2-49d8-9350-61d19883280d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Going to try to stop instance {{(pid=125886) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:12:06.978767 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-157896de-fba2-49d8-9350-61d19883280d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.282779 Jul 20 11:12:06.979735 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2252/4533] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:06 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:07.004718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:07.005496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:07.024818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:07.025278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:07.026125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:07.026570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:07.944937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:07.952519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:07.953291 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0431d636-054b-4106-bb16-00cef0988e19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.965807 Jul 20 11:12:07.962872 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2253/4534] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:06 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:12:07.967972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:07.969797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:07.976270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-20af39c6-e28d-4aec-b938-81353e71b07b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2956 microversion: 2.32 time: 1.194673 Jul 20 11:12:07.977537 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2282/4535] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:06 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2956 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:07.991263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:07.993451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:08.001739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:08.007070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:08.008443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:08.009117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:08.336012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:08.347366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:08.352395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:08.353899 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a4cf8fb-19ec-4525-a935-f6a7c6efdde6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 0.387686 Jul 20 11:12:08.354661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2254/4536] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:07 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:08.981350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:08.985379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:08.998121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:08.998735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:09.003391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:09.006572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:09.009526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:09.012781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:09.013465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:09.020919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:09.022596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:09.025259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:09.990763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.002861 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6aa02e4d-9cb0-4df8-89f4-139163b9c8d4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 1.025713 Jul 20 11:12:10.032125 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2283/4537] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:08 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:10.045242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:10.052227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.058077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:10.068541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.070930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.072936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fdcccb2-5480-4517-933e-592fcb65ca2e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2956 microversion: 2.32 time: 1.078887 Jul 20 11:12:10.074382 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2255/4538] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:08 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2956 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:10.088698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:10.095633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:10.097620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:10.098885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:10.378183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.396180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.397705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:10.398918 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7695108b-7b16-4f30-a953-7118f71c60f2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1750 microversion: 2.20 time: 0.364902 Jul 20 11:12:10.407322 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2284/4539] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:10 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1750 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:10.476650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-798748110", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:10.550091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] validate_networks() for [('f36d644a-8cac-42d1-bdf1-fc10ca0468c5', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:12:11.038220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:11.039568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:11.067089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:11.072267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:11.073598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:11.076403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:11.694144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:11.707966 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fb1d5302-030e-4d8f-bb15-58d6a4c836ce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.674763 Jul 20 11:12:11.711897 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2285/4540] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:11 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:12:11.738641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:11.748067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:11.777352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:11.778881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:11.782285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:11.787005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:12.777862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:12:12.779426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:12:12.780104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:12:12.780694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:12:12.781707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:12:12.790337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=56 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:12.811999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:12.812786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:12.814618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:12.817129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:12.910908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:12:12.922967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for user e12c89deab734e6884cf37d0e2a9be44 and project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:12:12.957981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:12:12.964881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:12:13.071593 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4e0a40c7-35af-4595-bca0-8b479d6e4274 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.994896 Jul 20 11:12:13.072562 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2256/4541] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:12:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:12:13.078197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:13.079067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:13.086781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:13.087621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:13.088580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:13.089223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:13.156583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:13.195845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:13.197483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:13.216221 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-571de6f2-2a58-43d4-bbbc-56c17913bc4c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2935 microversion: 2.32 time: 1.485244 Jul 20 11:12:13.223511 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2286/4542] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:11 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2935 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:13.547642 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:12:13.547800 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 (ip 10.222.0.79) !!! Jul 20 11:12:14.017912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:14.019016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:14.042816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:14.046790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:14.053368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:14.057274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:14.108729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:14.131057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:14.137414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:14.146023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f2b25d9-6209-4a37-9367-cd84ddf35b25 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 1.072152 Jul 20 11:12:14.175451 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2257/4543] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:13 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:14.646310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-dccd9f46-b757-4f66-bf10-f2ab11f63b4b req-4b0b825b-7c93-4cf3-be3b-4f2ba962e759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-unplugged", "status": "completed", "tag": "0298200c-fbfd-493c-a9ca-617cb89c0f7c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:14.667816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-dccd9f46-b757-4f66-bf10-f2ab11f63b4b req-4b0b825b-7c93-4cf3-be3b-4f2ba962e759 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:14.670599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-dccd9f46-b757-4f66-bf10-f2ab11f63b4b req-4b0b825b-7c93-4cf3-be3b-4f2ba962e759 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:14.723842 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-dccd9f46-b757-4f66-bf10-f2ab11f63b4b req-4b0b825b-7c93-4cf3-be3b-4f2ba962e759 service nova] Creating event network-vif-unplugged:0298200c-fbfd-493c-a9ca-617cb89c0f7c for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:14.751002 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-dccd9f46-b757-4f66-bf10-f2ab11f63b4b req-4b0b825b-7c93-4cf3-be3b-4f2ba962e759 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.568829 Jul 20 11:12:14.757340 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2258/4544] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:14.771259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a96c4fe-0a8f-4bce-8689-8a2b9d2a82e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:14.781464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a96c4fe-0a8f-4bce-8689-8a2b9d2a82e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:15.120232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:15.137663 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-674942ab-7e58-4a93-a185-0c157da91e7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 1.911431 Jul 20 11:12:15.140512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2287/4545] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:13 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:15.148348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:15.154660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:15.169997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:15.170807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:15.173200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:15.182931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:15.623280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a96c4fe-0a8f-4bce-8689-8a2b9d2a82e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:15.645727 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a96c4fe-0a8f-4bce-8689-8a2b9d2a82e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1221 microversion: 2.1 time: 0.870454 Jul 20 11:12:15.646395 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2259/4546] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:14 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1221 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:15.657715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:15.663865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:15.703496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:15.705020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:15.709260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:15.709735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:16.385094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:16.395472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:16.402705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:16.408272 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7742e27-b186-4aa9-9f08-0484c194ca1a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2867 microversion: 2.32 time: 1.262819 Jul 20 11:12:16.409492 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2288/4547] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:15 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2867 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:16.418660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-789817654", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:16.528428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] validate_networks() for [('f36d644a-8cac-42d1-bdf1-fc10ca0468c5', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:12:17.879810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:17.906617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:17.915976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:17.928267 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-88c30882-2d65-4d14-be98-e56bcca6b822 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 2.277622 Jul 20 11:12:17.929162 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2260/4548] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:15 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:18.575805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-6f231417-03b2-43fa-a7df-4a95e2032fbb req-588e40b0-56aa-4ca6-9947-6fe0fd11479e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-deleted", "tag": "0298200c-fbfd-493c-a9ca-617cb89c0f7c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:18.597699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6f231417-03b2-43fa-a7df-4a95e2032fbb req-588e40b0-56aa-4ca6-9947-6fe0fd11479e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:18.598121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-6f231417-03b2-43fa-a7df-4a95e2032fbb req-588e40b0-56aa-4ca6-9947-6fe0fd11479e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:18.633112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-6f231417-03b2-43fa-a7df-4a95e2032fbb req-588e40b0-56aa-4ca6-9947-6fe0fd11479e service nova] Creating event network-vif-deleted:0298200c-fbfd-493c-a9ca-617cb89c0f7c for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:18.662539 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-6f231417-03b2-43fa-a7df-4a95e2032fbb req-588e40b0-56aa-4ca6-9947-6fe0fd11479e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.726588 Jul 20 11:12:18.664652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2261/4549] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:18.671504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:18.672753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:18.682746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:18.683625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:18.691870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:18.693468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.082102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:19.098333 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-057dfdc6-0ae2-41bb-8f65-5f510624a340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.432051 Jul 20 11:12:19.104240 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2262/4550] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:18 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:19.125621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-unplugged", "status": "completed", "tag": "1de386d0-c8be-401e-8561-0735b8431467"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-unplugged", "status": "completed", "tag": "06f51a83-1a03-4238-a830-39f5693112ee"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-unplugged", "status": "completed", "tag": "67f4832e-193e-46ee-97a7-ca0940d4e922"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-unplugged", "status": "completed", "tag": "084c15f7-7ed1-4084-802d-d9cce3f7f535"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:19.165009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.165506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.209059 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Creating event network-vif-unplugged:1de386d0-c8be-401e-8561-0735b8431467 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:19.209888 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Creating event network-vif-unplugged:06f51a83-1a03-4238-a830-39f5693112ee for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:19.211092 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Creating event network-vif-unplugged:67f4832e-193e-46ee-97a7-ca0940d4e922 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:19.211904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] Creating event network-vif-unplugged:084c15f7-7ed1-4084-802d-d9cce3f7f535 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:19.219012 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fabf3b3e-3743-4c7f-a3cf-47fb99e80fc7 req-f760f589-7519-41c3-9879-40f3884606e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.113202 Jul 20 11:12:19.220256 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2263/4551] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:19.229608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:19.230501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:19.241306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.242253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.246262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.246919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.487577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:12:19.488208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:12:19.488808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:12:19.489330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:12:19.489953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:12:19.516895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.520067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.524149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.525321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.603236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:12:19.621910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for user e12c89deab734e6884cf37d0e2a9be44 and project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:12:19.649845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:12:19.660027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:12:19.757872 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9995d2cd-be6b-481d-8222-4a1bd756f696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.347037 Jul 20 11:12:19.764038 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2289/4552] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:12:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:12:19.770772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:19.771821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:19.780013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.780727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.781708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:19.782425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:19.826055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:20.559540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.583316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.588684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.590011 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9e7ae0cd-12d8-469f-a9eb-6103c12bd626 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2440 microversion: 2.32 time: 1.368197 Jul 20 11:12:20.608859 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2264/4553] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:19 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2440 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:20.630452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-26240b30-5589-4395-a1dc-13091c2f994f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:20.631124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-26240b30-5589-4395-a1dc-13091c2f994f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:20.683445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.711484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.726492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.731595 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d0d8808-aed6-4b1b-9284-64dd8412071c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.965825 Jul 20 11:12:20.737330 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2290/4554] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:19 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:20.767610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:20.772950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:20.804477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:20.805362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:20.806726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:20.807457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:20.855598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-26240b30-5589-4395-a1dc-13091c2f994f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:20.872913 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-26240b30-5589-4395-a1dc-13091c2f994f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1221 microversion: 2.1 time: 0.262295 Jul 20 11:12:20.874981 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2265/4555] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:20 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:20.901606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-deleted", "tag": "06f51a83-1a03-4238-a830-39f5693112ee"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-deleted", "tag": "084c15f7-7ed1-4084-802d-d9cce3f7f535"}, {"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-deleted", "tag": "67f4832e-193e-46ee-97a7-ca0940d4e922"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:20.934263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:20.937580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:20.972438 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] Creating event network-vif-deleted:06f51a83-1a03-4238-a830-39f5693112ee for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:20.976355 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] Creating event network-vif-deleted:084c15f7-7ed1-4084-802d-d9cce3f7f535 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:20.978457 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] Creating event network-vif-deleted:67f4832e-193e-46ee-97a7-ca0940d4e922 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:20.999508 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d287184e-3139-43e4-a477-d3165cb5d924 req-c6ed7870-285b-4535-8b0d-fb90af8dbb3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.107385 Jul 20 11:12:21.000745 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2266/4556] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:21.231495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:21.240892 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-29871af5-c314-4559-b8cb-08cd2a910012 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1656 microversion: 2.1 time: 0.495349 Jul 20 11:12:21.248706 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2291/4557] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:20 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1656 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:21.269459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1b032a6-2252-40f1-86a3-ab2a814b94de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:21.293963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1b032a6-2252-40f1-86a3-ab2a814b94de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:21.295958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1b032a6-2252-40f1-86a3-ab2a814b94de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:21.406868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1b032a6-2252-40f1-86a3-ab2a814b94de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Going to try to start instance {{(pid=125886) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 11:12:21.533827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:21.575276 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1b032a6-2252-40f1-86a3-ab2a814b94de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.310680 Jul 20 11:12:21.579372 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2267/4558] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:21 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:21.590790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:21.592302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:21.616814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:21.617949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:21.620637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:21.621137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:21.624020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:21.628264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:21.645452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:21.654404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:21.655746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:21.656374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:22.258657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:22.277737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:22.281196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:22.285734 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ea09933c-ccd8-4f6d-904c-6cb85d93d85b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 2031 microversion: 2.32 time: 0.678555 Jul 20 11:12:22.288658 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2268/4559] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:21 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 2031 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:22.303678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:22.310213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:22.333771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:22.335423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:22.337797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:22.340396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:22.873497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:23.244455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.260664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-26d646e6-880a-4970-ad71-808b288cdd87 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1665 microversion: 2.1 time: 1.676711 Jul 20 11:12:23.273691 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2292/4560] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:21 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1665 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:23.280441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:23.282808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:23.303112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:23.303908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:23.304982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:23.306218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:23.352856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.366878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.374334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.376022 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-27bec585-8add-41ce-9d82-7fb0005bf8eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 1.081137 Jul 20 11:12:23.377363 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2269/4561] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:22 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:23.387862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:23.388904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:23.401409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:23.405074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:23.406179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:23.406914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:23.543697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.556923 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3799c18e-fd1e-48e8-a720-8c05bb5d2471 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1279 microversion: 2.1 time: 0.281703 Jul 20 11:12:23.557531 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2293/4562] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:23 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1279 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:23.639467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.650484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.659688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:23.663903 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-849cefe3-c582-4fd7-9602-f3f7126c5f79 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.284867 Jul 20 11:12:23.677832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2270/4563] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:23 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:23.820829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bd0ab655-ec1c-40a2-97bd-8cf01f2a4103 req-2f3d1857-3ae8-4120-ad7b-3aebbd30295e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcb93f-5f60-4328-8a11-98896ebd7e57", "name": "network-vif-deleted", "tag": "1de386d0-c8be-401e-8561-0735b8431467"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:23.839917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bd0ab655-ec1c-40a2-97bd-8cf01f2a4103 req-2f3d1857-3ae8-4120-ad7b-3aebbd30295e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:23.840369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bd0ab655-ec1c-40a2-97bd-8cf01f2a4103 req-2f3d1857-3ae8-4120-ad7b-3aebbd30295e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:23.918112 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bd0ab655-ec1c-40a2-97bd-8cf01f2a4103 req-2f3d1857-3ae8-4120-ad7b-3aebbd30295e service nova] Creating event network-vif-deleted:1de386d0-c8be-401e-8561-0735b8431467 for instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 on n-h2-846219-10 Jul 20 11:12:23.957803 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bd0ab655-ec1c-40a2-97bd-8cf01f2a4103 req-2f3d1857-3ae8-4120-ad7b-3aebbd30295e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140792 Jul 20 11:12:23.958735 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2294/4564] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:12:24.282985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:24.284383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:24.309851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:24.311061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:24.314753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:24.321179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:24.396141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:24.396909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:24.410235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:24.411936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:24.414923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:24.417470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:25.401165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.418054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.440498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.444785 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08ba658f-94da-4aca-aa79-f0620a1f3445 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 1.054200 Jul 20 11:12:25.445690 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2295/4565] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:24 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:25.464876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:25.471152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:25.471794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.487327 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3728ee59-184f-4c4c-9221-253614851219 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1665 microversion: 2.1 time: 1.209538 Jul 20 11:12:25.491785 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2271/4566] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:24 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1665 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:25.498747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:25.507764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:25.512187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:25.512656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:25.513458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:25.513891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:25.527355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:25.530179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:25.535452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:25.539441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:25.876450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.897054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.909484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:25.912633 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8920d170-d6e9-4a65-a91d-4ee80e42e114 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.419408 Jul 20 11:12:25.917063 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2272/4567] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:25 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:25.940660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f840e63e-7309-4a60-ae81-37db33c6f449 req-07615b5e-bac6-4a2b-b9a2-b4931c8435d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c392af3-eb42-4caa-bd4f-dc80b5e2da96", "tag": "ede41fad-540c-4b5f-93ea-d2b0ba899348"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:25.962096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f840e63e-7309-4a60-ae81-37db33c6f449 req-07615b5e-bac6-4a2b-b9a2-b4931c8435d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:25.962868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f840e63e-7309-4a60-ae81-37db33c6f449 req-07615b5e-bac6-4a2b-b9a2-b4931c8435d2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:25.994923 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f840e63e-7309-4a60-ae81-37db33c6f449 req-07615b5e-bac6-4a2b-b9a2-b4931c8435d2 service nova] Creating event network-changed:ede41fad-540c-4b5f-93ea-d2b0ba899348 for instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 on n-h2-846219-10 Jul 20 11:12:26.014287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f840e63e-7309-4a60-ae81-37db33c6f449 req-07615b5e-bac6-4a2b-b9a2-b4931c8435d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083623 Jul 20 11:12:26.019619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:26.033277 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2273/4568] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:12:26.035308 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27494fae-a369-4ef5-8a8b-d67241be685f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.580507 Jul 20 11:12:26.046308 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2296/4569] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:25 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:26.465131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:26.466277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:26.480195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:26.485153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:26.487023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:26.490253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:26.506744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:26.508450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:26.527464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:26.543464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:26.544332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:26.544773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:27.203001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.225102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.245068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.247136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c8c5b2f-1260-4300-93dd-25cfc16f241c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.786967 Jul 20 11:12:27.252358 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2274/4570] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:26 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:27.270776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:27.271624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:27.312785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:27.321376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:27.322624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:27.328611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:27.847271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.883797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.906740 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ef2684c-1f60-4fec-aa70-5756bc678f05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.404365 Jul 20 11:12:27.913291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.918559 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2297/4571] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:26 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:27.933760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:27.943977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:27.948504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1a7d686-a37b-48b3-bb2f-38a6c200a4f6 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.694052 Jul 20 11:12:27.952466 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2275/4572] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:27 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:27.963045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:27.964122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:27.974842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:27.988887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:28.010069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:28.011852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:28.012915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:28.025634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:28.027676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:28.028459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:28.036700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:28.043715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:29.431425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:29.451111 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a96de0eb-a568-45f3-bfa1-f81d0d1f9058 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 1.527589 Jul 20 11:12:29.463541 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2298/4573] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:27 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:29.478005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:29.482866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:29.497522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:29.498301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:29.499410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:29.499887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:29.526328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:29.548185 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b46a0c0a-35a5-4d0d-87f9-18aa1d61b6fd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.588966 Jul 20 11:12:29.560021 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2276/4574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:27 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:29.564997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:29.565621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:29.574363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:29.580686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:29.581237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:29.582019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:29.582667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:29.643241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:29.967145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:29.993236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:30.012458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:30.015879 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6cdec60-5d0c-4eba-8127-942c2e1993db tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.455240 Jul 20 11:12:30.034505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2277/4575] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:29 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:30.047987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:30.061390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:30.100767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:30.101338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:30.105527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:30.113526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:30.347972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Unlocking {{(pid=125886) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 20 11:12:30.494530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:30.510460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:30.529901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:30.544995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28746624-91a4-45b6-a5ab-ac6fb90cacbf tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 1.079912 Jul 20 11:12:30.549935 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2299/4576] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:29 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:30.567746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:30.575015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:30.605746 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c23dd550-fc79-45cd-96a1-83e00fda966f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.563484 Jul 20 11:12:30.613575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:30.614293 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2278/4577] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:30 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:30.629394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:30.645244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:30.651134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:30.655599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:30.660567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:30.677153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:30.677611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:30.678396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:30.678830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:30.863441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:32.078519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:32.092354 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-abf11ef1-71d0-4277-93d3-c0524a3554bd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 1.533573 Jul 20 11:12:32.106782 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2300/4578] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:30 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:32.113531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:32.115577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:32.123272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.124000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:32.125697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.127018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:32.415060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:32.435383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:32.441844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:32.447101 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-61adb894-aef8-42a0-82b6-741304c38f56 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.338469 Jul 20 11:12:32.461515 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2301/4579] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:32 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:32.468354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:32.469298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:32.479104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.480892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:32.483567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.485839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:32.784409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:32.792838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd091fe2-11bc-4b3a-85b7-bf9b5c428b05 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 2.167803 Jul 20 11:12:32.793434 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2279/4580] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:30 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:32.808262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-faed3ff9-c499-41e2-878a-700097a9ccdd req-9371d7a1-c475-4d69-8246-7264d319f6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e02e9ad-0e6d-4fa1-baff-10ce30573f34", "tag": "1d735cda-27da-461c-8955-9e268908d36f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:32.832009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-faed3ff9-c499-41e2-878a-700097a9ccdd req-9371d7a1-c475-4d69-8246-7264d319f6a3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.832461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-faed3ff9-c499-41e2-878a-700097a9ccdd req-9371d7a1-c475-4d69-8246-7264d319f6a3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:32.857649 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-faed3ff9-c499-41e2-878a-700097a9ccdd req-9371d7a1-c475-4d69-8246-7264d319f6a3 service nova] Creating event network-changed:1d735cda-27da-461c-8955-9e268908d36f for instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 on n-h2-846219-10 Jul 20 11:12:32.871570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-faed3ff9-c499-41e2-878a-700097a9ccdd req-9371d7a1-c475-4d69-8246-7264d319f6a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074067 Jul 20 11:12:32.872529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2280/4581] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:32.886196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:32.887198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:32.905349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.905800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:32.906643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:32.907079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:33.755756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:33.780932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:33.782572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:33.788251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4340bba4-cb1d-46ef-ab0a-d325cc6299a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 1.320632 Jul 20 11:12:33.788920 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2302/4582] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:32 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:33.804754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:33.808232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:33.821812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:33.830651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4ac14f5-1137-4196-a27b-2a7f82cd96ff tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.956829 Jul 20 11:12:33.834783 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2281/4583] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:32 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:33.841971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:33.847940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:33.848612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:33.849586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:33.850212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:33.850420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:33.868714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:33.869186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:33.869964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:33.870403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.007192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:34.015916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:34.021366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:34.023250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:34.024791 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48b86768-a7be-43f7-b716-f5b143cd9fd5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.186789 Jul 20 11:12:34.038030 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2282/4584] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:33 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:34.044281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:34.045445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:34.062226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.063275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.066438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.067605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.337898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:34.362647 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9859ce0f-8e4f-432c-a296-cc1e70b3fe27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.564094 Jul 20 11:12:34.365858 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2303/4585] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:33 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:34.420670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:34.430247 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a618af4-d0b7-4a7c-984e-0af89bf2f69b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.390759 Jul 20 11:12:34.443609 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2283/4586] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:34 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:34.458708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:34.459296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:34.466815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.467310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.468100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.468538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.572040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b43756c3-a461-4bb9-a124-07f15ec847af tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.116759 Jul 20 11:12:34.574571 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2304/4587] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:34 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:34.582965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:34.583919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:34.596543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.601087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.604011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.604437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.811139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:34.811868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:34.836956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.838797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:34.842117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:34.843555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:35.258197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.274071 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9f52cc7-2a47-4e91-ac19-c526c0f6d56c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1674 microversion: 2.1 time: 0.696344 Jul 20 11:12:35.287510 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2284/4588] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:34 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1674 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:35.305550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:35.310368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:35.334743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:35.336566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:35.338550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:35.341854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:35.449727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.465549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.470581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.473337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e50ffbd1-1877-472f-baca-ddafd0dcfb18 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.666895 Jul 20 11:12:35.479161 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2305/4589] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:34 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:35.491993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:35.493962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:35.509452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:35.510619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:35.514020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:35.515969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:35.634769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.645262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.646767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.647991 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19aa2a90-691d-4416-b5ff-c14df252bd4b tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.359170 Jul 20 11:12:35.671541 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2285/4590] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:35 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:35.916874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:35.920266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:35.929672 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ddaebac-739f-4ff0-b9d6-f65816f7ef1a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.449146 Jul 20 11:12:35.944159 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2306/4591] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:35 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:36.297732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:36.301773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:36.319069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:36.319471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:36.321915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:36.322443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:36.503050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:36.503712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:36.528512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:36.530470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:36.533006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:36.538612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.004386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.013957 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-63b09e35-5d3f-441c-a9ee-7d18ece0bca3 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1654 microversion: 2.1 time: 0.724540 Jul 20 11:12:37.014554 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2286/4592] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:36 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1654 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:37.041252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:37.041966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:37.053916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.054352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.055190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.058991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.324027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.344418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.350671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.357616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.366413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.368072 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dcfdcd13-0719-4e74-ad6f-b3ba71aab239 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.869399 Jul 20 11:12:37.368241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:37.370152 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbf9bc4c-f72e-4d7a-a483-1f91b1d02e35 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.344635 Jul 20 11:12:37.372142 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2307/4593] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:36 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:37.375558 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2287/4594] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:37 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:37.386160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:37.390334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:37.394333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:37.396614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:37.416973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.417445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.420560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.421015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.421796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.422258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.430070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.430614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.607869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-efd408d6-e5cf-4cc4-83ab-05b39429d02d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.228774 Jul 20 11:12:37.615255 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2288/4595] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:37 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:12:37.640990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:37.646574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:37.680835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.682429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:37.685215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:37.688021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:38.362932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:38.372626 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55cfe9f9-f4bc-478b-bee0-8ce77c30f83e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.998873 Jul 20 11:12:38.373351 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2308/4596] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:37 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:38.395956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:38.397236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:38.417939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:38.418390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:38.422983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:38.423811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:38.539386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:38.557627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e66a5615-f602-469d-8faa-810583089308 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1661 microversion: 2.1 time: 0.931275 Jul 20 11:12:38.561330 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2289/4597] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:37 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1661 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:38.578671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:38.587213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:38.614718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:38.615273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:38.628261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:38.628781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:39.141416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:39.178482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:39.181247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:39.183866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0736c22b-16cc-4e39-be21-e5c80e8f9ee8 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.619092 Jul 20 11:12:39.185569 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2290/4598] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:38 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:39.401962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:39.402750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:39.433515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:39.436498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:39.438391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:39.440177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:39.605549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:39.621008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:39.624417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:39.627926 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf49f766-0c7f-473c-ba7d-ca5071d99cb2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 1.241707 Jul 20 11:12:39.634073 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2309/4599] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:38 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:39.642413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:39.650757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:39.664653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:39.668004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:39.672201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:39.673417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.046707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:40.058966 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d9165967-b640-4c3f-bc56-a0c6862f57c4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.670341 Jul 20 11:12:40.060382 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2291/4600] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:39 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:40.212015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:40.212729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:40.225097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.225576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.228009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.228468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.415384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:40.435421 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-86f54ff1-c808-42a5-8019-a454e2ec7b61 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.799777 Jul 20 11:12:40.447384 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2310/4601] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:39 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:40.447791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:40.456457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:40.457079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:40.461624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:40.467336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:40.469161 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a676305c-3aad-43a9-8dbd-19c1687908a2 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.267897 Jul 20 11:12:40.470819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.471318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.472119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.474494 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2292/4602] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:40 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:40.485895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.565945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f5dcc06d-a061-4300-bb05-8a2fdd1c7f79 req-2939d2de-c831-4642-8a0b-68dc429c5119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c392af3-eb42-4caa-bd4f-dc80b5e2da96", "name": "network-vif-plugged", "status": "completed", "tag": "ede41fad-540c-4b5f-93ea-d2b0ba899348"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:40.593059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f5dcc06d-a061-4300-bb05-8a2fdd1c7f79 req-2939d2de-c831-4642-8a0b-68dc429c5119 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.593867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f5dcc06d-a061-4300-bb05-8a2fdd1c7f79 req-2939d2de-c831-4642-8a0b-68dc429c5119 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.629599 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f5dcc06d-a061-4300-bb05-8a2fdd1c7f79 req-2939d2de-c831-4642-8a0b-68dc429c5119 service nova] Creating event network-vif-plugged:ede41fad-540c-4b5f-93ea-d2b0ba899348 for instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 on n-h2-846219-10 Jul 20 11:12:40.643110 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f5dcc06d-a061-4300-bb05-8a2fdd1c7f79 req-2939d2de-c831-4642-8a0b-68dc429c5119 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083840 Jul 20 11:12:40.646524 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2293/4603] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:40.659915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:40.660948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:40.686352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.688037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.689862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.691748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.885178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:40.914221 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da678e2b-616b-4b2e-9b30-48fe5ca52ee4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.461704 Jul 20 11:12:40.919513 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2311/4604] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:40 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:40.969730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:40.970374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:40.992968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.993786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:40.994825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:40.995566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:41.583685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:41.607274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:41.618448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:41.618448 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16bc30be-7d52-4aa6-9241-e37bbf86e483 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.967446 Jul 20 11:12:41.631862 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2294/4605] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:40 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:41.640949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:41.642166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:41.659851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:41.660287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:41.668379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:41.668831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:41.864580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:41.878850 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0ea9577-f0f6-4a95-86e6-73d3eac0c358 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.944786 Jul 20 11:12:41.882134 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2312/4606] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:40 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:12:41.898345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:41.899756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:41.913597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:41.915327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:41.918719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:41.919267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:42.039083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:42.043840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:42.052537 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58f26548-e45f-4595-b5db-d969d4623f8f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.419511 Jul 20 11:12:42.059965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:42.062462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:42.063016 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2295/4607] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:41 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:42.066584 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c5d68ef1-9fc5-4c8b-946c-33c3785a4562 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.183383 Jul 20 11:12:42.067387 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2313/4608] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:41 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:42.070819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:42.071477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:42.098516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:42.098992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:42.104341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:42.104808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:42.645910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:42.646538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:42.677239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:42.677685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:42.678490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:42.678935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.416380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.436922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.443004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.448795 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cbba65d4-8840-4689-9aa0-cfda6bc36d37 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.805743 Jul 20 11:12:43.449748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2314/4609] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:42 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:43.455928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d801e75b-a946-4ef5-ba2f-fec799e701a6 req-daea2dd2-b900-49bc-9fd5-91c1997ee56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e02e9ad-0e6d-4fa1-baff-10ce30573f34", "name": "network-vif-plugged", "status": "completed", "tag": "1d735cda-27da-461c-8955-9e268908d36f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:43.479063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d801e75b-a946-4ef5-ba2f-fec799e701a6 req-daea2dd2-b900-49bc-9fd5-91c1997ee56c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.480022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d801e75b-a946-4ef5-ba2f-fec799e701a6 req-daea2dd2-b900-49bc-9fd5-91c1997ee56c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.514165 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d801e75b-a946-4ef5-ba2f-fec799e701a6 req-daea2dd2-b900-49bc-9fd5-91c1997ee56c service nova] Creating event network-vif-plugged:1d735cda-27da-461c-8955-9e268908d36f for instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 on n-h2-846219-10 Jul 20 11:12:43.525860 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d801e75b-a946-4ef5-ba2f-fec799e701a6 req-daea2dd2-b900-49bc-9fd5-91c1997ee56c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073800 Jul 20 11:12:43.529972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.538607 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2315/4610] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:12:43.560126 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-446757bb-e4e6-43aa-b81b-def2646d7b2e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.495284 Jul 20 11:12:43.563071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:43.565085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:43.573431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.574094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.575429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.575628 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2296/4611] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:42 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:43.576416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.608010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:43.608667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:43.622321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:43.630529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.637656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.643463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.645122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.933951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.951248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.953304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:43.962258 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f63163e-cf37-48fd-8f5b-afdf5639491d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.378534 Jul 20 11:12:43.963431 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2297/4612] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:43 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:43.975852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:43.976933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:43.987110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.987949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:43.989518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:43.990120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:44.030874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:44.043410 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d91403a9-ad11-47c8-8d2a-27ed0993c76e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.484146 Jul 20 11:12:44.044065 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2316/4613] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:43 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:44.319911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:44.335801 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a0f9cfdf-2115-4a1e-a39f-ba6f21194314 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.363874 Jul 20 11:12:44.337179 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2298/4614] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:43 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:44.357204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:44.359260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:44.377290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:44.379225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:44.380575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:44.381217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:44.470109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:44.471125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:44.481223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:44.491904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:44.500122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:44.501127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:44.542456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:44.933711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:44.947547 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e15dc4cc-55ab-437f-9de5-649ca8046d33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.593777 Jul 20 11:12:44.948206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2317/4615] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:44 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:44.982519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:44.983070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:44.993602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:44.997776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:44.998893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:44.999568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:45.085866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.117803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.119447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.128526 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c876590-9f83-4524-9bf9-53908f248b93 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.664056 Jul 20 11:12:45.129704 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2299/4616] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:44 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:45.136975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:45.140075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:45.163539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:45.164497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:45.165653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:45.167770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:45.179894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.201073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.202872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.204849 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b33e811d-6665-4f4f-80cc-8f4d0ca8aa8a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.226053 Jul 20 11:12:45.216161 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2318/4617] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:44 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:45.523824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:45.533406 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc47dda6-68a0-440e-88a5-9836b6f9bca0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1321 microversion: 2.1 time: 0.401887 Jul 20 11:12:45.536104 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2300/4618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:45 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:46.152452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:46.153099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:46.167680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:46.168147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:46.168954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:46.169418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:46.227965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:46.229726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:46.245272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:46.246332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:46.257795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:46.268186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:46.453407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:46.474970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:46.479281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:46.483722 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-24d0db56-7084-4cd7-89e4-888955650397 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.262753 Jul 20 11:12:46.486381 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2301/4619] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:46 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:46.541491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:46.559460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:46.560528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:46.601966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:46.602391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:46.605381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:46.606662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:46.608960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:46.609909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:46.616736 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-87a5a05d-d714-4947-937f-41bcbb6be5c6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.468724 Jul 20 11:12:46.618048 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2319/4620] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:46 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:47.131372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:47.146381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e27e9ec6-852d-41e0-a7c0-5408a271ca7b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1516 microversion: 2.1 time: 0.595379 Jul 20 11:12:47.163908 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2302/4621] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:46 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1516 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:47.169463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:47.171789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:47.193441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.194634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.195756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.196444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.272701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lazy-loading 'flavor' on Instance uuid 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:12:47.486981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19fb72e6-7336-4d6f-be4d-6082d03e6510 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action" status: 200 len: 32 microversion: 2.1 time: 0.320229 Jul 20 11:12:47.497362 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2320/4622] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:12:47 2022] POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:12:47.563099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:47.571081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:47.574538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:47.575689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:47.583443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.584197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.585687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.586297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.602009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.602482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.604658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.608624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.860801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:47.871498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:47.872896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:47.874396 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7debe715-79a4-4025-84ff-2a3d010dac9d tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.315035 Jul 20 11:12:47.874396 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2321/4623] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:47 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:47.881334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:47.881637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:47.888661 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.889507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.892812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:47.893314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:47.898405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:48.033892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:48.048686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a1e619a9-2edb-4811-b859-c517b8618966 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.541355 Jul 20 11:12:48.049288 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2303/4624] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:47 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:12:48.742344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:48.760523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:48.762539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:48.766278 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8dd22e9-cf39-446d-acab-2edf446d234a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.890210 Jul 20 11:12:48.785970 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2322/4625] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:47 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:48.912531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:48.915724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:48.947678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:48.948563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:48.953290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:48.954888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:49.069399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:49.070632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:49.098217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:49.101942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:49.107988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:49.109642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:49.257607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:49.286149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:49.298943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:49.309774 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2aae09f-dbe2-43b8-9c1f-344e74f632dc tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.406184 Jul 20 11:12:49.311153 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2304/4626] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:48 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:49.799130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:49.803559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:49.819117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:49.824559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:49.828377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:49.829821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:49.858578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:49.885789 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7f1a7ae9-33e4-40bc-8e2b-4e32565b26ba tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.822919 Jul 20 11:12:49.892293 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2323/4627] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:49 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:50.130172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:50.142290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:50.144065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:50.145243 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1525feba-399b-462f-b696-d5c547d5232e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.356448 Jul 20 11:12:50.155897 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2305/4628] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:49 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:50.334980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:50.335879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:50.366014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:50.378924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:50.382209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:50.384022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:50.633078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:50.654148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:50.656508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:50.658621 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-686e7b22-1c21-4060-95b6-a02a23beae0a tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.327881 Jul 20 11:12:50.662391 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2324/4629] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:50 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:50.788136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-15d10d6d-aa01-4046-8f58-6afe79c71d84 req-5656cb77-36dd-4557-941a-85b9f7e010aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "name": "network-vif-plugged", "status": "completed", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:12:50.825330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-15d10d6d-aa01-4046-8f58-6afe79c71d84 req-5656cb77-36dd-4557-941a-85b9f7e010aa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:50.826171 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-15d10d6d-aa01-4046-8f58-6afe79c71d84 req-5656cb77-36dd-4557-941a-85b9f7e010aa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:50.843962 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-15d10d6d-aa01-4046-8f58-6afe79c71d84 req-5656cb77-36dd-4557-941a-85b9f7e010aa service nova] Creating event network-vif-plugged:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:12:50.852040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-15d10d6d-aa01-4046-8f58-6afe79c71d84 req-5656cb77-36dd-4557-941a-85b9f7e010aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068389 Jul 20 11:12:50.852876 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2306/4630] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:12:50.907624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:50.908382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:50.923120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:50.924220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:50.925806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:50.927117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:51.168780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:51.170180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:51.186307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:51.192012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:51.193143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:51.193759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:51.260734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.275576 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-43e6669a-0923-479f-a3ab-e00d866ac0ab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.372602 Jul 20 11:12:51.281619 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2325/4631] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:50 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:51.529789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.542669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.550120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.553785 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f511bd5-5bb9-42fd-96bf-18553cb76908 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.389279 Jul 20 11:12:51.554655 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2307/4632] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:51 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:51.684008 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:51.686222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:51.705290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:51.706583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:51.707896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:51.714127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:51.859967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.897370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.904122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:51.908664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-78df95fa-c607-431a-855d-581efe0da7e5 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.231151 Jul 20 11:12:51.925893 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2326/4633] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:51 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:52.299695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:52.302281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:52.319957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:52.323073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:52.324501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:52.324944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:52.575285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:52.575285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:52.583904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:52.585042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:52.585645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:52.586034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:52.631683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:52.657514 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1b57562a-9540-4b43-9ac5-154cd73b8f09 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.361899 Jul 20 11:12:52.679213 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2308/4634] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:52 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:52.896004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:52.918378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:52.925592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:52.926841 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e84cdc6-bf99-4a5a-b10e-d8720bc96805 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.358090 Jul 20 11:12:52.940024 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2327/4635] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:52 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:52.944318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:52.945128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:52.956987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:52.957828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:52.958801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:52.962438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:53.134907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:53.144510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:53.160628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:53.161995 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f0183b97-e200-492e-89fe-2bb9ce471a77 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.233276 Jul 20 11:12:53.162571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2309/4636] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:52 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:53.691346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:53.691974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:53.704793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:53.705271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:53.716156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:53.716983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:53.954050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:53.955078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:53.984708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:53.989190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:53.996199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:53.998494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:54.395459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.416316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.429028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.430647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.431866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ed4dfea4-1b73-41ce-9db0-39fc945299c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1806 microversion: 2.20 time: 0.487521 Jul 20 11:12:54.435822 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2310/4637] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:53 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1806 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:54.437586 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42a5fcef-9f94-4b29-8c9e-d35550858c69 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.755236 Jul 20 11:12:54.440952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:54.451199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:54.464847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:54.467277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:54.467554 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2328/4638] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:53 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:54.468598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:54.476288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:54.576052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.588893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.591399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:54.592982 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9519dc8a-3614-4fc1-8bd0-71c19fc7995c tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.155924 Jul 20 11:12:54.594046 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2311/4639] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:54 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:55.456618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:55.457566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:55.462233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:55.463613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:55.473406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:55.473874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:55.474591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:55.474801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:55.475103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:55.475879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:55.477125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:55.478720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:56.373916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.399691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67af62a8-36bc-45b1-8fe2-a66e47991f27 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.947174 Jul 20 11:12:56.402942 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2329/4640] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:55 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:56.419575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:56.420518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:56.428391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:56.429601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:56.432082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:56.432773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:56.586749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.602334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.604014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.605361 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f4f14e4-8d99-486b-aaf1-8e49773567bb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1793 microversion: 2.20 time: 1.153816 Jul 20 11:12:56.611915 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2312/4641] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:55 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1793 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:56.622079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.640891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.643418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:56.647231 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-79a845da-d892-48e8-b59a-ec8dc1b1c520 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.231109 Jul 20 11:12:56.647947 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2330/4642] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:56 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:12:57.420777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:57.426063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:57.443207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:57.444762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:57.445836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:57.446664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:57.666060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:57.668044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:57.694860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:57.695787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:57.696673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:57.697183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:57.883931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:57.897666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:57.901717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dd04112c4ef4700a7eef39d840d3ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46390237efb4949bda0460063e81c63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:57.908972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-581df46e-a7fe-421b-ac61-0c98ff042d2f tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 200 len: 1604 microversion: 2.32 time: 0.246869 Jul 20 11:12:57.919981 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2331/4643] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:57 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:12:57.926284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:57.943985 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a964da8c-74d2-4d7d-a778-e344227fbb6f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.527366 Jul 20 11:12:57.945430 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2313/4644] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:57 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:12:58.931253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:58.931996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:58.939275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=68 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:12:58.964467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:58.965555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:12:58.972488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:58.977053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:58.981138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:58.986971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:58.999385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:58.999857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:59.005176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:12:59.005670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:12:59.020525 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] HTTP exception thrown: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Request method failure captured: Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 HTTP/1.1 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Ftz--spgv9Fmv0JgswBap7UqaT5D7F1EmIqdnTY70RJXB4hBAMZsrYOulY0oPrYBpxTf_GsBRSiBIROHlL7Lc9Cz9c7Ry1mInGmOgKhSUkLcEjy6CNiUgIERDPVSayWxXiZhJTBuwIztIDEmlOhfzjvw_erekn-JnZTXVDonGeMJQ Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: e46390237efb4949bda0460063e81c63 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e46390237efb4949bda0460063e81c63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e46390237efb4949bda0460063e81c63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e46390237efb4949bda0460063e81c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e46390237efb4949bda0460063e81c63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: e46390237efb4949bda0460063e81c63 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TaggedBootDevicesTest-1498174766-project Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 1dd04112c4ef4700a7eef39d840d3ad2 Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TaggedBootDevicesTest-1498174766-project Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fdbcb93f-5f60-4328-8a11-98896ebd7e57'} Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:12:59.024011 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Returning 404 to user: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c2387585-0262-47ab-a1d9-bab39ed1344e tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 404 len: 111 microversion: 2.32 time: 0.099666 Jul 20 11:12:59.030224 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2332/4645] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:12:58 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:12:59.038367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-241c4dcf-aff3-4800-8f41-480c7f83f4d0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '.version_select at 0x7f2c3f76eca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:12:59.080905 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-241c4dcf-aff3-4800-8f41-480c7f83f4d0 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505905735" status: 204 len: 0 microversion: 2.32 time: 0.047298 Jul 20 11:12:59.099870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2333/4646] 10.222.0.79 () {60 vars in 1258 bytes} [Wed Jul 20 11:12:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505905735 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:12:59.392303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:12:59.408592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-424c2d70-d416-417c-96e3-20741ce219e3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.449600 Jul 20 11:12:59.414234 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2314/4647] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:12:58 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:00.431219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:00.431841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:00.443394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:00.443394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:00.443394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:00.443394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:00.815476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:00.824372 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-198a18f6-4b24-4859-be45-852c975d9476 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.396906 Jul 20 11:13:00.829637 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2334/4648] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:00 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:01.847391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:01.849408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:01.869996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:01.872460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:01.878533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:01.879652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:02.353057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:02.365615 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d9f3515a-471e-44fa-967b-5b807e4a4b9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.523294 Jul 20 11:13:02.366582 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2315/4649] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:01 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:03.385772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:03.386533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:03.400281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:03.402451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:03.404046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:03.408967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:03.752482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:03.764348 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0c8860f-0679-4e99-ad94-4d6b1dc32eb5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.382878 Jul 20 11:13:03.782623 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2335/4650] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:03 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:04.785798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:04.787159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:04.794931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:04.795780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:04.796841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:04.798128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:04.844830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:05.186640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:05.211473 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a13e432-6d89-4fd5-ac00-028126dac1bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.430996 Jul 20 11:13:05.212076 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2316/4651] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:04 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:05.537077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:05.538789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:05.584804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:05.588056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:05.589087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:05.595961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:05.767474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af80d70c-e16b-443b-a86b-9174f7ce9d8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.241090 Jul 20 11:13:05.768587 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2336/4652] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:05 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:13:05.777705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:05.778330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:05.788022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:05.788698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:05.791972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:05.792575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:06.228527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:06.229175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:06.249454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:06.251389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:06.259930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:06.261038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:06.262319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:06.263036 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15e25d16-d6e2-41bf-a8ab-c35bc9d75757 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1671 microversion: 2.1 time: 0.489428 Jul 20 11:13:06.265530 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2317/4653] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:05 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1671 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:06.858217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:06.862671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:06.884884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:06.886004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:06.890487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:06.892046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:06.930520 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] HTTP exception thrown: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Request method failure captured: Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 HTTP/1.1 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Ftz--spgv9Fmv0JgswBap7UqaT5D7F1EmIqdnTY70RJXB4hBAMZsrYOulY0oPrYBpxTf_GsBRSiBIROHlL7Lc9Cz9c7Ry1mInGmOgKhSUkLcEjy6CNiUgIERDPVSayWxXiZhJTBuwIztIDEmlOhfzjvw_erekn-JnZTXVDonGeMJQ Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: e46390237efb4949bda0460063e81c63 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e46390237efb4949bda0460063e81c63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e46390237efb4949bda0460063e81c63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e46390237efb4949bda0460063e81c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e46390237efb4949bda0460063e81c63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: e46390237efb4949bda0460063e81c63 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TaggedBootDevicesTest-1498174766-project Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 1dd04112c4ef4700a7eef39d840d3ad2 Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TaggedBootDevicesTest-1498174766-project Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fdbcb93f-5f60-4328-8a11-98896ebd7e57'} Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:13:06.935688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Returning 404 to user: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d83fa27c-fc34-45db-9a60-c8eb591626fd tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 404 len: 111 microversion: 2.32 time: 0.094221 Jul 20 11:13:06.944718 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2318/4654] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:13:06 2022] DELETE /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:13:06.953115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:06.958051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] [instance: fdbcb93f-5f60-4328-8a11-98896ebd7e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:06.970707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:06.971423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:06.972517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:06.973806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:07.058945 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] HTTP exception thrown: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Request method failure captured: Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 HTTP/1.1 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Ftz--spgv9Fmv0JgswBap7UqaT5D7F1EmIqdnTY70RJXB4hBAMZsrYOulY0oPrYBpxTf_GsBRSiBIROHlL7Lc9Cz9c7Ry1mInGmOgKhSUkLcEjy6CNiUgIERDPVSayWxXiZhJTBuwIztIDEmlOhfzjvw_erekn-JnZTXVDonGeMJQ Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.32 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: e46390237efb4949bda0460063e81c63 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e46390237efb4949bda0460063e81c63", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e46390237efb4949bda0460063e81c63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e46390237efb4949bda0460063e81c63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e46390237efb4949bda0460063e81c63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: e46390237efb4949bda0460063e81c63 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1498174766 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TaggedBootDevicesTest-1498174766-project Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 1dd04112c4ef4700a7eef39d840d3ad2 Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TaggedBootDevicesTest-1498174766-project Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fdbcb93f-5f60-4328-8a11-98896ebd7e57'} Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:07.065214 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] Returning 404 to user: Instance fdbcb93f-5f60-4328-8a11-98896ebd7e57 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cf45208b-8fbf-4b3f-b04a-d51f6941b476 tempest-TaggedBootDevicesTest-1498174766 tempest-TaggedBootDevicesTest-1498174766-project] 10.222.0.79 "GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57" status: 404 len: 111 microversion: 2.32 time: 0.122197 Jul 20 11:13:07.072481 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2319/4655] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:13:06 2022] GET /compute/v2.1/servers/fdbcb93f-5f60-4328-8a11-98896ebd7e57 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:13:07.284506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:07.285552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:07.298790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:07.300024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:07.303937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:07.304739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:07.407109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:07.427294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30630dca-bc56-45e8-84b0-740ed0b19a71 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 1.196084 Jul 20 11:13:07.431129 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2337/4656] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:06 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:07.959413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:07.971951 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7cb17698-423e-4195-8299-5b62ca4da7b5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1671 microversion: 2.1 time: 0.693121 Jul 20 11:13:07.985728 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2320/4657] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:07 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1671 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:08.449578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:08.450196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:08.464502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:08.467027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:08.467912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:08.470907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:08.781518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:08.795503 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-60fa6719-b0ee-46b6-9b59-59d0d3f7aece tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.346045 Jul 20 11:13:08.797449 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2338/4658] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:08 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:08.991783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:08.992569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:09.010475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:09.010932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:09.011749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:09.012187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:09.479651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:09.490203 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-15d20cce-7f9d-46ae-9976-31d46d08164b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1676 microversion: 2.1 time: 0.502208 Jul 20 11:13:09.491004 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2321/4659] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:08 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1676 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:09.815808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:09.816880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:09.832007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:09.834916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:09.836170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:09.839063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:09.884659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:10.123039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:10.133281 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-45bf72d4-78af-4533-980e-bdff641bb003 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.323229 Jul 20 11:13:10.134551 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2339/4660] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:09 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:10.510456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:10.511428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:10.524833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:10.532540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:10.534163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:10.534776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:10.951546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:10.962313 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-154eed7b-02fd-4cc3-aa46-02338cacec79 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.456058 Jul 20 11:13:10.965410 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2322/4661] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:10 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:11.174418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:11.175042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:11.190203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:11.191197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:11.192685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:11.193133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:11.471245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:11.481140 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-72f94aae-0d65-41c3-adc7-2d598a4307a7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.321454 Jul 20 11:13:11.496209 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2340/4662] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:11 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:12.504346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:12.505064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:12.526027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:12.527086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:12.531153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:12.533276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:12.890555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:12.937884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9ae470c8-e9c3-411c-b9ab-2209a091339a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.437680 Jul 20 11:13:12.957942 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2323/4663] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:12 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:13.972322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:13.975679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:14.015281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:14.016187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:14.020327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:14.021131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:14.527736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:14.541392 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6a1fa041-cd1e-463c-9600-1bee5f155193 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.579103 Jul 20 11:13:14.548063 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2341/4664] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:13 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:15.565041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:15.567852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:15.570625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=54 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:15.612204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:15.614301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:15.617819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:15.618370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:16.097925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:16.114846 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c11a2d51-15ed-4941-89db-1a08c89af874 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.554707 Jul 20 11:13:16.116706 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2324/4665] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:15 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:17.133864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:17.134498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:17.151228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:17.151689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:17.152490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:17.152931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:17.616349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:17.641118 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5376e94-ea88-4104-b74e-740c519b49ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.508682 Jul 20 11:13:17.645705 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2342/4666] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:17 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:18.680132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:18.680794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:18.717024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:18.717486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:18.723917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:18.724652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:19.599206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:19.608234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3923a1da-f542-4b7b-aeed-fa41cd68f8aa tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.936787 Jul 20 11:13:19.608833 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2325/4667] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:18 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:20.627511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:20.632157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:20.648808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:20.649268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:20.650062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:20.650503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:21.258755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:21.270882 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5f590e38-f8ee-4bb9-9e25-ee725f78c96d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.649926 Jul 20 11:13:21.295212 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2343/4668] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:20 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:22.303491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:22.304947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:22.319363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:22.320071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:22.321079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:22.321740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:22.660360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:22.669686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4598e8b9-d4ad-4778-9582-e2f35ba764db tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1522 microversion: 2.1 time: 0.370497 Jul 20 11:13:22.671691 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2326/4669] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:22 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:23.689006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:23.689791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:23.704413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:23.708192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:23.709658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:23.713524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:24.072038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:24.089253 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-510d3617-47e8-45fd-9c32-da200be7573a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1502 microversion: 2.1 time: 0.404793 Jul 20 11:13:24.091489 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2344/4670] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:23 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:24.119635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:24.120418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:24.138035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:24.141869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:24.144376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:24.145078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:24.531679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:24.546944 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07a6f3d6-53c2-47b5-bb29-155da5023dd7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1515 microversion: 2.1 time: 0.440024 Jul 20 11:13:24.548031 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2327/4671] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:24 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1515 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:24.571915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7f3279a-bac1-4aa7-8f54-a31c5f81690f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:24.573607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d7f3279a-bac1-4aa7-8f54-a31c5f81690f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 3835b09f-1fe2-4f86-8e38-3bc259390ee7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:24.584778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d7f3279a-bac1-4aa7-8f54-a31c5f81690f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Instance 3835b09f-1fe2-4f86-8e38-3bc259390ee7 could not be found. Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7f3279a-bac1-4aa7-8f54-a31c5f81690f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/3835b09f-1fe2-4f86-8e38-3bc259390ee7/action HTTP/1.1 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 14 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: {"rescue": {}} Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 3835b09f-1fe2-4f86-8e38-3bc259390ee7 could not be found. Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3835b09f-1fe2-4f86-8e38-3bc259390ee7', 'body': {'rescue': {}}} Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3835b09f-1fe2-4f86-8e38-3bc259390ee7 could not be found. Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3835b09f-1fe2-4f86-8e38-3bc259390ee7 could not be found. Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:24.600278 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:24.605873 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:24.605873 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:24.605873 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:13:24.605873 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:13:24.605873 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3835b09f-1fe2-4f86-8e38-3bc259390ee7 could not be found. Jul 20 11:13:24.605873 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:24.606837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7f3279a-bac1-4aa7-8f54-a31c5f81690f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 404 to user: Instance 3835b09f-1fe2-4f86-8e38-3bc259390ee7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:13:24.608776 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7f3279a-bac1-4aa7-8f54-a31c5f81690f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/3835b09f-1fe2-4f86-8e38-3bc259390ee7/action" status: 404 len: 111 microversion: 2.1 time: 0.040834 Jul 20 11:13:24.614371 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2345/4672] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:24 2022] POST /compute/v2.1/servers/3835b09f-1fe2-4f86-8e38-3bc259390ee7/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:13:24.621806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:24.622656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:24.637044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:24.641704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:24.644602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:24.648811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:24.805137 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b31540d8-1082-460d-b756-d9c866e671f7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action" status: 202 len: 0 microversion: 2.1 time: 0.188871 Jul 20 11:13:24.809430 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2328/4673] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:24 2022] POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:13:24.818088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:24.819485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:24.832271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:24.836286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:24.843556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:24.844725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:25.356522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:25.371529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-414adc49-092f-4f84-b1fc-9d41bb2d8aac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1520 microversion: 2.1 time: 0.557133 Jul 20 11:13:25.384093 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2346/4674] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:24 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:26.398549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:26.401990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:26.410387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:26.411026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:26.411998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:26.412605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:27.207235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:27.216720 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d75a7cf-e97f-4c61-a2ed-de04afa8a696 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1500 microversion: 2.1 time: 0.826163 Jul 20 11:13:27.223733 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2329/4675] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:26 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1500 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:27.242539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:27.243996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:27.307976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:27.308521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:27.309429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:27.309882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:27.365876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lazy-loading 'flavor' on Instance uuid 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:13:27.399327 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Cannot 'rescue' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state paused Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action HTTP/1.1 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 14 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: {"rescue": {}} Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot 'rescue' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state paused Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '4c392af3-eb42-4caa-bd4f-dc80b5e2da96', 'body': {'rescue': {}}} Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 in vm_state paused. Cannot rescue while the instance is in this state. Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state paused Jul 20 11:13:27.409746 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state paused Jul 20 11:13:27.415894 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:27.418721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 409 to user: Cannot 'rescue' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state paused {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:13:27.420889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-71390798-2c00-484f-841d-3bbde48eacc3 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action" status: 409 len: 144 microversion: 2.1 time: 0.184272 Jul 20 11:13:27.423771 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2347/4676] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:27 2022] POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action => generated 144 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:13:27.435501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:27.438767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:27.448794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:27.450353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:27.452496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:27.454613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:27.693501 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35f58760-a82d-4a72-b627-e24167fe9c72 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action" status: 202 len: 0 microversion: 2.1 time: 0.265834 Jul 20 11:13:27.698408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2330/4677] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:27 2022] POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:13:27.713728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:27.714841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:27.725897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:27.726771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:27.728259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:27.728987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:28.323548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:28.335280 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-797a9464-ae66-40ae-bbc4-e96b09754822 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1507 microversion: 2.1 time: 0.631511 Jul 20 11:13:28.339987 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2348/4678] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:27 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:29.359708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:29.361208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:29.383952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:29.388914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:29.390850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:29.393140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:29.787571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:29.818404 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0eeda10e-ee8e-4b75-8fef-e44e9a5e8bda tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1515 microversion: 2.1 time: 0.464651 Jul 20 11:13:29.826622 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2331/4679] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:29 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:34.054417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:34.055795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:34.071505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:34.079401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:34.079872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:34.080687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:34.082369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:34.149320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lazy-loading 'flavor' on Instance uuid 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:13:34.344046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59384173-e6b8-4bcb-b4c8-5c631669c85d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action" status: 200 len: 32 microversion: 2.1 time: 0.293308 Jul 20 11:13:34.357596 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2349/4680] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:34 2022] POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:13:34.393840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:34.401579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:34.439470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:34.448235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:34.449096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:34.449540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:34.526772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:34.916733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:34.917826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:34.937633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:34.939639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:34.942238 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:34.944061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:35.040073 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1be54fb3-b415-467f-a30b-95cb490b09b5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments/226d79ab-9477-4f22-97b9-9a4567bc0f24" status: 200 len: 194 microversion: 2.20 time: 0.128576 Jul 20 11:13:35.043606 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2350/4681] 10.222.0.79 () {60 vars in 1453 bytes} [Wed Jul 20 11:13:34 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments/226d79ab-9477-4f22-97b9-9a4567bc0f24 => generated 194 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:13:35.136771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:35.137403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:35.159042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:35.159982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:35.161255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:35.161924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:35.373270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lazy-loading 'services' on Instance uuid bb1f20dc-f27d-4e5b-97fb-35a4393cd592 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:13:35.634456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:35.640619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7fc2fca9-b208-4156-9f62-fb43181921c1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments/226d79ab-9477-4f22-97b9-9a4567bc0f24" status: 202 len: 0 microversion: 2.20 time: 0.509984 Jul 20 11:13:35.644795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2351/4682] 10.222.0.79 () {60 vars in 1456 bytes} [Wed Jul 20 11:13:35 2022] DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments/226d79ab-9477-4f22-97b9-9a4567bc0f24 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:13:35.650323 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3e413bcc-42f4-4c30-91cd-7bc1c2a09ce8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 1.289882 Jul 20 11:13:35.650908 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2332/4683] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:34 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:35.677922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:35.690447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:35.703988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:35.706552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:35.707684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:35.711560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:35.825182 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d87ab443-9db5-4965-babf-5f85c50cc66e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175073 Jul 20 11:13:35.831089 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2352/4684] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:35 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:36.669869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:36.670489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:36.685009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:36.689175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:36.692266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:36.694247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:36.840742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:36.841379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:36.864880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:36.865368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:36.866160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:36.867448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:36.991574 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3875e6f7-3aff-4b01-a8e8-dc5282a2ed5b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150655 Jul 20 11:13:36.999264 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2353/4685] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:36 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:13:38.009981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:38.024613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:38.054177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:38.058840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:38.065650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:38.067379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:38.140181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:38.224045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:38.242730 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-088e32a3-47ef-4ca0-acf3-58b79969b60f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.241761 Jul 20 11:13:38.244649 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2354/4686] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:37 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:38.259075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-445c9583-9017-418a-876a-14e8f105f9ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 1.578877 Jul 20 11:13:38.259793 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2333/4687] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:36 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:39.258077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:39.259036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:39.274484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:39.274842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:39.275870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:39.276838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:39.279802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:39.281540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:39.325829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:39.326352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:39.330864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:39.336868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:39.348427 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2dd45350-ce7a-42b6-8068-8c832f274c4c tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094280 Jul 20 11:13:39.349820 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2355/4688] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:39 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:39.912817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:39.942066 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3a585207-ca52-48f6-aef1-180587e5dfd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.661737 Jul 20 11:13:39.943519 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2334/4689] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:39 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:13:40.361690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:40.362637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:40.385204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:40.385668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:40.386461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:40.394305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:40.490521 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-050b209e-687e-47cc-9cc6-66bb57baaadd tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133440 Jul 20 11:13:40.507227 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2356/4690] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:40 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:40.960488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:40.961380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:40.989897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:40.990360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:40.991246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:40.991701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:41.503455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:41.504705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:41.532172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:41.532841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:41.534554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:41.536888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:41.600158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:41.625483 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb9189ad-cc0f-4b3c-99fa-7832743c93b8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.668410 Jul 20 11:13:41.631085 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2335/4691] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:40 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:41.658468 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3fc7610-ef2b-482a-a111-e415f9f8928e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159495 Jul 20 11:13:41.662062 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2357/4692] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:41 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:42.649683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:42.650288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:42.662531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:42.662975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:42.664178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:42.664402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:42.673819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:42.675096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:42.690906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:42.693153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:42.695400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:42.696700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:42.786250 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27bb0d37-74fc-4f19-8431-7f86efcd99e6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117823 Jul 20 11:13:42.787283 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2358/4693] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:42 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:13:43.178866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:43.193193 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d360d2f0-acbb-4c2c-89a0-b0d7c4bd4ceb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.547630 Jul 20 11:13:43.193789 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2336/4694] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:42 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:43.847450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:43.848336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:43.870148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:43.870606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:43.872361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:43.872813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:43.989349 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7c059be-3a62-4b44-bded-cc5acb2746a4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.194542 Jul 20 11:13:44.004685 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2359/4695] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:43 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:44.210297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:44.211376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:44.271957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:44.272409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:44.273394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:44.274002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:45.004113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:45.006689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:45.027951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:45.030333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:45.033951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:45.036453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:45.184437 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4984e96f-b1c7-42c2-8fee-3ef75d344c49 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.186794 Jul 20 11:13:45.191717 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2360/4696] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:44 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:45.224798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:45.241441 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-733f13cf-6cfc-4848-a1c7-cfd8a138285e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 1.034228 Jul 20 11:13:45.244204 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2337/4697] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:44 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:46.209264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:46.219549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:46.227394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:46.228829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:46.240519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.240985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.241780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.242230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.244120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=28 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:46.247124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.250694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.252086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.252732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.323226 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c51da185-7e6b-4336-b695-16b772017676 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126213 Jul 20 11:13:46.331535 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2361/4698] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:46 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:46.341764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:46.347577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:46.361618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.366986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.368408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.369245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.826553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:46.842832 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c135f073-a4c2-4a6c-8d11-29fad54e9643 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.620185 Jul 20 11:13:46.845056 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2338/4699] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:46 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:46.856331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:46.876713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:46.877391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:46.879784 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b2c9b21c-a06b-400d-bb6e-a74c361cd7df tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.544473 Jul 20 11:13:46.897747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2362/4700] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:46 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:46.899358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.900397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:46.902894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:46.903754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:47.345917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:47.347133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:47.425511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:47.425511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:47.429480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:47.430080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:47.529273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ece22c87-80b8-48e2-af49-34d80bccdfb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190093 Jul 20 11:13:47.533909 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2363/4701] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:47 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:13:47.714036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:47.732648 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-808e3df0-5fd8-4e3b-a9a2-1183c7f57548 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.868023 Jul 20 11:13:47.739812 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2339/4702] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:46 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:47.761064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:47.762981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:47.803908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:47.804790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:47.806427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:47.807670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:47.904641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:47.905490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:47.912243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:47.914104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:47.915602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:47.917277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:48.434263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:48.448899 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-820bbd3f-64fa-4320-80d1-fedb71e8f4d8 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.547826 Jul 20 11:13:48.460397 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2340/4703] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:47 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:48.547922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:48.549943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:48.570348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:48.576224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:48.580721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:48.581176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:48.663592 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4686c8b8-51a4-4389-8003-b98dc78d9cb5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123122 Jul 20 11:13:48.668538 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2341/4704] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:48 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:13:49.020186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:49.032782 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-70a1b072-74a4-4de5-a827-7dcd0630481c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.284111 Jul 20 11:13:49.043717 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2364/4705] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:47 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:49.049880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:49.051354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:49.058139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:49.058916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:49.059931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:49.060567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:49.334116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:49.362277 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5934ad32-f25b-4830-b588-08ced91b6cae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.311990 Jul 20 11:13:49.381348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2342/4706] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:49 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:49.467206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:49.468300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:49.486984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:49.487478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:49.495574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:49.496114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:49.675681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:49.676888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:49.690246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:49.690948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:49.691953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:49.692562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:49.728186 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3a18290-b790-4f4e-a94f-222c77c8d389 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056853 Jul 20 11:13:49.735205 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2343/4707] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:13:49 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:13:49.741827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-332119839", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "eec87b6d-7d5e-44a0-b831-62582b4dcc3f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:49.814644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] validate_networks() for [('eec87b6d-7d5e-44a0-b831-62582b4dcc3f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:13:50.150894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:50.160955 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-87250352-0d43-4a0f-ae75-1e3b8b3a6992 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.697834 Jul 20 11:13:50.172437 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2365/4708] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:49 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:50.178761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:50.178909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:50.185803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:50.186260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:50.187962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:50.188463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:50.258500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:13:50.370681 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c41e426f-e6d8-4ec5-b012-e95aa4fb4186 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 204 len: 0 microversion: 2.20 time: 0.196577 Jul 20 11:13:50.372127 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2366/4709] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:13:50 2022] DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:13:50.790470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7fb005ba-8e7a-4b74-8643-582f152cf166 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: .version_select at 0x7f2c3ea740d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2065056248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGguhZB3lM+0OzJiqnBFAIy6LOLQGPTdStYH9AbZGovucohUXGJVx3wpT2kK0sv8xny7+vgnGB7OaSATcqtQp4HV2r3fSKbWBZbvPBJ9NXIzvXW1GzGMEm0ytqaSb9zRGg=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:50.814958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-7fb005ba-8e7a-4b74-8643-582f152cf166 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:13:50.831815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-7fb005ba-8e7a-4b74-8643-582f152cf166 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:13:50.873657 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7fb005ba-8e7a-4b74-8643-582f152cf166 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.499773 Jul 20 11:13:50.886916 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2367/4710] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:13:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:13:50.897075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:50.898054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:50.907832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:50.910905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:50.911930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:50.912575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:51.719778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:13:51.720456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:13:51.720941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:13:51.721753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:13:51.722555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:13:51.744256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:51.746106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:51.746971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:51.750767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:51.789246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:13:51.795621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for user 85fdcf2c53c648548248e606e639b974 and project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:13:51.798902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:51.810469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:51.813775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:13:51.814643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:51.816291 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f9466274-6332-4ddc-af86-344b8b7c94be tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.928006 Jul 20 11:13:51.816568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:13:51.837720 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2368/4711] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:13:50 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:13:51.852674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:51.853882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:51.866021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:51.868575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:51.869656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:51.872398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:51.896998 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e0cb8ce-59fe-4ed4-b6a6-7f28899fdb0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.159460 Jul 20 11:13:51.899202 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2344/4712] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:13:51.913540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9846bc5-c084-4e26-965c-4167cae3cd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:51.924246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9846bc5-c084-4e26-965c-4167cae3cd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:52.137110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9846bc5-c084-4e26-965c-4167cae3cd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:52.155197 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9846bc5-c084-4e26-965c-4167cae3cd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1214 microversion: 2.1 time: 0.240237 Jul 20 11:13:52.176866 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2345/4713] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:51 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:52.339402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:52.348827 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b079e3a3-5d93-4dc6-9bcf-037359f8e225 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.508334 Jul 20 11:13:52.351993 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2369/4714] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:51 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:52.443010 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:13:52.443147 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:13:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:13:52.843865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:52.844981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:52.872047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:52.872847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:52.878252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:52.882410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.188227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:53.189627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:53.257327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.258642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.262595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.263855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.357264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:53.420760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:53.433857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:53.435498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:53.459949 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95f0eb8a-8002-4211-ac28-896462f69758 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1721 microversion: 2.20 time: 0.607836 Jul 20 11:13:53.460834 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2346/4715] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:13:52 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1721 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:13:53.471156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:53.472523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:53.487359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.495763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.497008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.500198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.555619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:53.601921 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a85617ec-de3d-46a5-a114-63e672e8f7ab tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1218 microversion: 2.1 time: 0.407299 Jul 20 11:13:53.610093 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2370/4716] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:53 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1218 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:53.757450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:53.766277 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-475913d3-7317-4f52-a218-ccf91d103706 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1501 microversion: 2.1 time: 0.303511 Jul 20 11:13:53.769607 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2347/4717] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:53 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1501 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:53.788177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df560f5-3e01-4349-b964-406d41cf4468"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:53.789633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:53.802388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.802388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.802388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.802388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.840235 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Cannot 'attach_volume' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state rescued Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/os-volume_attachments HTTP/1.1 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 74 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: {"volumeAttachment": {"volumeId": "5df560f5-3e01-4349-b964-406d41cf4468"}} Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot 'attach_volume' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state rescued Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'server_id': '4c392af3-eb42-4caa-bd4f-dc80b5e2da96', 'body': {'volumeAttachment': {'volumeId': '5df560f5-3e01-4349-b964-406d41cf4468'}}} Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 11:13:53.842205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state rescued Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state rescued Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 409 to user: Cannot 'attach_volume' instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 while it is in vm_state rescued {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-522f4d46-6ed0-49ce-a1f3-bc353835c8d4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061277 Jul 20 11:13:53.847723 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2371/4718] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:13:53 2022] POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:13:53.855267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:53.856487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:53.866665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.875940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.877152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:53.877835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:53.995214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01cb2112-ec8e-4fd8-a238-57d9188d6007 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action" status: 202 len: 0 microversion: 2.1 time: 0.143870 Jul 20 11:13:54.000152 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2348/4719] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:13:53 2022] POST /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:13:54.016937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:54.019202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:54.105964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:54.109924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:54.114500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:54.115474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:54.480906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:54.481892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:54.500414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:54.500878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:54.503990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:54.504598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:54.729944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:54.747251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d1b6382-a13b-4520-b7a5-237777e1ecf4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1509 microversion: 2.1 time: 0.737587 Jul 20 11:13:54.748031 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2372/4720] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:53 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:54.764633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:54.765694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:54.789818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:54.790262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:54.803103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:54.804197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:54.994306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:55.004874 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-df764e5d-62b8-439c-bf06-b32e29c95743 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1272 microversion: 2.1 time: 0.245853 Jul 20 11:13:55.005473 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2373/4721] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:54 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1272 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:55.536448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:55.541648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:13:55.558706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:55.589661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:55.604494 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eee65549-4b9b-462a-ba00-6182abbb1c07 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1654 microversion: 2.20 time: 1.116580 Jul 20 11:13:55.624939 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2349/4722] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:13:54 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1654 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:13:55.772563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:55.773200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:55.793556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:55.795148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:55.796113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:55.796872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:56.022121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:56.022986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:56.039470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:56.045079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:56.046763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:56.056350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:56.434112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:56.466155 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-24ac7b8a-cc51-4e60-8f1e-bd14ab9f35e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1272 microversion: 2.1 time: 0.447829 Jul 20 11:13:56.470810 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2350/4723] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:56 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1272 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:13:56.632142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:56.634024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:56.643201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:56.652582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:56.653879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:56.654597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:56.662999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:56.675068 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e0cf0c73-7607-4c2e-903e-cfe29b7ac914 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1509 microversion: 2.1 time: 0.913205 Jul 20 11:13:56.686781 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2374/4724] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:55 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1509 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:57.034442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:57.048992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:57.056399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:57.057638 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cebab39e-4f77-4921-8979-8740ec6349ad tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1654 microversion: 2.20 time: 0.430566 Jul 20 11:13:57.074970 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2351/4725] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:13:56 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1654 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:13:57.347848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4417fa03-bcf1-475f-b4c2-28cef3b8603c req-83b8d225-8bf6-4617-8cc8-003b764761c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb1f20dc-f27d-4e5b-97fb-35a4393cd592", "name": "network-vif-deleted", "tag": "2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:13:57.366554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4417fa03-bcf1-475f-b4c2-28cef3b8603c req-83b8d225-8bf6-4617-8cc8-003b764761c3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:57.367015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4417fa03-bcf1-475f-b4c2-28cef3b8603c req-83b8d225-8bf6-4617-8cc8-003b764761c3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:57.391977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4417fa03-bcf1-475f-b4c2-28cef3b8603c req-83b8d225-8bf6-4617-8cc8-003b764761c3 service nova] Creating event network-vif-deleted:2fb1f9cd-de28-49e6-b286-7ef3b2e22a2a for instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 on n-h2-846219-10 Jul 20 11:13:57.405142 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4417fa03-bcf1-475f-b4c2-28cef3b8603c req-83b8d225-8bf6-4617-8cc8-003b764761c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275857 Jul 20 11:13:57.406474 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2375/4726] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:13:57.487970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:57.488922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:57.506892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:57.507663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:57.508630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:57.509250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:57.694754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:57.695824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:57.706692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:57.709149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:57.712837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:57.713538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:58.660374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:58.677339 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38446bb6-814a-4652-acff-31bd8346fed6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1509 microversion: 2.1 time: 0.986810 Jul 20 11:13:58.691244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2376/4727] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:57 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1509 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:13:58.705557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:58.707075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:58.760498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:58.761374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:58.762501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:58.769552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:58.775777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:58.792182 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16fff76f-1f4d-4176-8087-70b11dd358e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 1.308167 Jul 20 11:13:58.804663 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2352/4728] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:57 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:13:58.888670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:58.890200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:58.891152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lazy-loading 'fault' on Instance uuid bb1f20dc-f27d-4e5b-97fb-35a4393cd592 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:13:59.059781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:59.076459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:59.086666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:13:59.093590 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5740bfcd-2784-4e35-8370-6d154d1a059d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 200 len: 1370 microversion: 2.20 time: 0.400475 Jul 20 11:13:59.102293 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2377/4729] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:13:58 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:13:59.697600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:59.698157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:59.722443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:59.722884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:59.727668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:59.728498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:59.812411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:13:59.813618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:13:59.829650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:59.830118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:13:59.830926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:13:59.834468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:00.568237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:00.580676 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5941250-c8f7-414b-8b25-42f34f1905b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1515 microversion: 2.1 time: 0.888117 Jul 20 11:14:00.599066 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2353/4730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:59 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1515 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:00.627794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:00.630349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:00.641457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:00.642350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:00.643820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:00.646242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:00.714951 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] HTTP exception thrown: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Request method failure captured: Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 HTTP/1.1 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-KBgOqPITi6XWd2W0DLp7SvK9xJf0kJlcN_aLAsxbQr6nUh9T3rvUucwksCDdK9qfUdAhrx8UyeXMUraDGrp-OxauWDgycodHVLC5eAShRopFt2IaauTo1D4GZi8Y01sYEJiRq9vIqbrUP6PH50Cdg_hT5ZkfuN3I9QpwUnkwwHvmY Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08962304189a4134a48f4fc532a13400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08962304189a4134a48f4fc532a13400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 10d795e205ec46efa3393368a9567374 Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'bb1f20dc-f27d-4e5b-97fb-35a4393cd592'} Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:14:00.724602 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Returning 404 to user: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:14:00.731273 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-97fff3ca-806d-4c81-a95d-5f21c50d7569 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 404 len: 111 microversion: 2.20 time: 0.125208 Jul 20 11:14:00.737731 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2354/4731] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:00 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:14:00.753927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-996eeb08-add5-41c4-9f77-b7df4b648d05 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '.version_select at 0x7f2c3e7a1790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:00.791729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:00.810336 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-996eeb08-add5-41c4-9f77-b7df4b648d05 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834688256" status: 204 len: 0 microversion: 2.20 time: 0.071401 Jul 20 11:14:00.811848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2355/4732] 10.222.0.79 () {60 vars in 1258 bytes} [Wed Jul 20 11:14:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834688256 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:14:00.820296 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1291a108-75c5-4599-85b0-72ebaeb45174 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 1.002075 Jul 20 11:14:00.826123 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2378/4733] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:13:59 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:14:01.844878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:01.845833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:01.863219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:01.873400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:01.875675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:01.877859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:01.878488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:01.942769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-71ef06c4-4f8e-47dd-952f-d2c6fa20968d req-ea6782cc-79a8-4427-946a-f45dda27e8cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e25c28b-dbea-4da4-aeaa-18b20b349002", "tag": "29205aeb-da2c-42ef-8452-da1846fdf2e7"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:01.949614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:01.981930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-71ef06c4-4f8e-47dd-952f-d2c6fa20968d req-ea6782cc-79a8-4427-946a-f45dda27e8cd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:01.984688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-71ef06c4-4f8e-47dd-952f-d2c6fa20968d req-ea6782cc-79a8-4427-946a-f45dda27e8cd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:02.028605 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-71ef06c4-4f8e-47dd-952f-d2c6fa20968d req-ea6782cc-79a8-4427-946a-f45dda27e8cd service nova] Creating event network-changed:29205aeb-da2c-42ef-8452-da1846fdf2e7 for instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 on n-h2-846219-10 Jul 20 11:14:02.039673 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-71ef06c4-4f8e-47dd-952f-d2c6fa20968d req-ea6782cc-79a8-4427-946a-f45dda27e8cd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105895 Jul 20 11:14:02.040808 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2379/4734] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:14:02.146440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:02.633598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:02.643606 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b41ae7e0-530b-40bc-ad2e-652d4e7eaed0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 0.804094 Jul 20 11:14:02.661718 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2356/4735] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:01 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:03.518074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d204eb36-8bfa-41c0-9000-054e17eab19b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'create', calling method: .version_select at 0x7f2c3ea74c10>, body: {"keypair": {"name": "tempest-keypair-1593615059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtL2owboTpHCZLa1ruNROZXr/WXyS9F/s9y387T4BQuazmN3JgfnnZlq8qLQSg1lLQ8Yq2SGjb/bJJxyOcOydVAdUpHeum33DKeT8o7m9jxei54/ZYf/2pTHdMlEVdXDQ=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:03.573020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d204eb36-8bfa-41c0-9000-054e17eab19b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:03.586734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d204eb36-8bfa-41c0-9000-054e17eab19b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for user e12c89deab734e6884cf37d0e2a9be44 and project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:03.641813 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d204eb36-8bfa-41c0-9000-054e17eab19b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144883 Jul 20 11:14:03.647720 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2380/4736] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:14:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:03.665915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:03.667427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:03.681867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:03.683075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:03.684113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:03.684761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:04.605434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fccc918c-fe92-4246-95ae-1d75ac51300e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'create', calling method: .version_select at 0x7f2c3ea740d0>, body: {"keypair": {"name": "tempest-keypair-1059712358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnNdSBawf9Y5IoCE/uQrC/uSka/tLVZmwv1Yb0AFPFuPH1PDNogEO8g3FTVMn0B0lHd2f+d8ntPsq72T8nxsfG4gpX1VC9pkW8BzNGdF4leCWdKwQ9BuPE+n9zIAbb8Ww=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:04.624667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:04.663737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fccc918c-fe92-4246-95ae-1d75ac51300e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for project 08962304189a4134a48f4fc532a13400. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:04.677147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fccc918c-fe92-4246-95ae-1d75ac51300e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for user 10d795e205ec46efa3393368a9567374 and project 08962304189a4134a48f4fc532a13400. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:04.702481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:04.714493 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d028c06d-b026-4000-9fb4-b50bee473336 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 1.052385 Jul 20 11:14:04.719881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2357/4737] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:03 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:04.749364 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fccc918c-fe92-4246-95ae-1d75ac51300e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.147392 Jul 20 11:14:04.750423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2381/4738] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 11:14:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 11:14:05.735341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:05.736133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:05.747823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:05.748279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:05.751879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:05.752343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:06.319835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:06.336763 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-840f9a22-2c4a-41b9-84a9-fa2ee4992122 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 0.606173 Jul 20 11:14:06.337596 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2358/4739] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:05 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:07.358979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:07.359974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:07.375541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:07.376390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:07.378390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:07.379279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:08.315791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:08.332780 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8b006d1-af7b-4e63-ab48-1a79ff899fd2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 0.979624 Jul 20 11:14:08.343848 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2382/4740] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:07 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:08.419580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1308055825", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "4b17aaaa-6979-439e-8587-84064f41a39b"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:08.541024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] validate_networks() for [('4b17aaaa-6979-439e-8587-84064f41a39b', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:14:09.351391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:09.353070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:09.370693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:09.373644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:09.374668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:09.376857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:10.408076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:10.428902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-14b77594-1c55-40ca-852a-de51d83ee017 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 1.081609 Jul 20 11:14:10.435059 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2383/4741] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:09 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:10.849061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-916487067", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e46291c9-18b9-4313-bd7d-5fe3e547a263"}], "security_groups": [{"name": "tempest-securitygroup--45667692"}], "key_name": "tempest-keypair-1059712358", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:12.241416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] validate_networks() for [('e46291c9-18b9-4313-bd7d-5fe3e547a263', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:14:12.678575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:14:12.679381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:14:12.680183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:14:12.680956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:14:12.681726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:14:12.715382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:12.716202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:12.717785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:12.718573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:12.846147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Getting quotas for project 6166dba2eca24302b42939e682fada7d. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:12.878392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Getting quotas for user 87bc84fc12934106a340e48293e5d66c and project 6166dba2eca24302b42939e682fada7d. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:12.916049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:14:12.921699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:14:13.042421 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b36ced56-cfb9-48e7-a703-854fc06e4a5a tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.841860 Jul 20 11:14:13.043758 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2359/4742] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:14:13.051162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:13.053211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:13.060508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:13.061911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:13.062718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:13.063160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:13.901635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:13.924240 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d077eecc-2fa0-4b71-80a1-0332a677d27d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 0.879140 Jul 20 11:14:13.928398 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2360/4743] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:13 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:13.989224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-943453156", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f36d644a-8cac-42d1-bdf1-fc10ca0468c5"}], "security_groups": [{"name": "tempest-securitygroup--462406114"}], "key_name": "tempest-keypair-1593615059", "user_data": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:14.699688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:15.021985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:14:15.022421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:14:15.022957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:14:15.023479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:14:15.023914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:14:15.045687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:15.046121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:15.049937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:15.051732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:15.088991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for project 08962304189a4134a48f4fc532a13400. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:15.099887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Getting quotas for user 10d795e205ec46efa3393368a9567374 and project 08962304189a4134a48f4fc532a13400. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:15.148272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:14:15.157315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:14:15.247455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] validate_networks() for [('f36d644a-8cac-42d1-bdf1-fc10ca0468c5', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:14:15.269809 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f282807a-5a4e-471e-892f-e607864f3c9a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 4.424485 Jul 20 11:14:15.272184 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2384/4744] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 11:14:10 2022] POST /compute/v2.1/servers => generated 400 bytes in 4429 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:14:15.284611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:15.287496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:15.303971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:15.306101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:15.322107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:15.322939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:15.574019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:15.608277 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de679e12-b355-4f57-9646-68fcb15bda04 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1287 microversion: 2.1 time: 0.327285 Jul 20 11:14:15.617413 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2385/4745] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:15 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1287 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:15.631825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:15.632536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:15.677169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:15.677627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:15.679151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:15.679151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:16.297113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:16.606446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:16.629377 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ac0c6aec-a5f6-47de-99f1-a5f9d31aeecf tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 1.008873 Jul 20 11:14:16.632483 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2386/4746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:15 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:16.656703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:16.658037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:16.685635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:16.686100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:16.697906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:16.700590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:17.070194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:17.093056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:17.100065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:17.104298 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e2553f27-5129-4d00-907b-c92ae6a57efe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1333 microversion: 2.20 time: 0.469549 Jul 20 11:14:17.105957 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2387/4747] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:16 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1333 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:17.138071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-51734011-27ad-4f59-8487-7cdc0219df0f req-839d16ad-1b3e-4578-87b3-1078cdd82d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25c28b-dbea-4da4-aeaa-18b20b349002", "name": "network-vif-plugged", "status": "completed", "tag": "29205aeb-da2c-42ef-8452-da1846fdf2e7"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:17.175679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-51734011-27ad-4f59-8487-7cdc0219df0f req-839d16ad-1b3e-4578-87b3-1078cdd82d1a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:17.176128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-51734011-27ad-4f59-8487-7cdc0219df0f req-839d16ad-1b3e-4578-87b3-1078cdd82d1a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:17.224630 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-51734011-27ad-4f59-8487-7cdc0219df0f req-839d16ad-1b3e-4578-87b3-1078cdd82d1a service nova] Creating event network-vif-plugged:29205aeb-da2c-42ef-8452-da1846fdf2e7 for instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 on n-h2-846219-10 Jul 20 11:14:17.236902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-51734011-27ad-4f59-8487-7cdc0219df0f req-839d16ad-1b3e-4578-87b3-1078cdd82d1a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114828 Jul 20 11:14:17.239873 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2388/4748] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:17.246951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:17.259603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:17.278484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:17.283101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:17.300063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:17.300719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:17.633919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:17.648317 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8eeb1116-c5f8-4cf1-a728-c95216a42abe tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1275 microversion: 2.1 time: 0.405510 Jul 20 11:14:17.649742 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2389/4749] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:17 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1275 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:17.665047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2142379672", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "b1748982-ca19-4b71-8414-be925075623e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2065056248", "security_groups": [{"name": "tempest-secgroup-smoke-2143099872"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:17.760804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:14:17.761309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:14:17.761696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:14:17.762173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:14:17.762595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:14:17.788223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:17.788706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:17.792562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:17.793598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:17.853605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:17.869939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Getting quotas for user e12c89deab734e6884cf37d0e2a9be44 and project 048e92acb38c455c94e0eedd7bf079ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:17.901287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:14:17.903667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:14:18.017503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] validate_networks() for [('b1748982-ca19-4b71-8414-be925075623e', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:14:18.038839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c09a3aa-98c3-438e-98e9-9e79e3a14235 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.092216 Jul 20 11:14:18.055931 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2361/4750] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:14:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 4126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:14:18.062927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:18.074456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:18.090768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:18.091280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:18.092743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:18.093531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:19.258601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:19.274480 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff45a8ac-face-43da-800e-ab730cf23221 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1314 microversion: 2.1 time: 1.216247 Jul 20 11:14:19.288385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2362/4751] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:18 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1314 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:19.293434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:19.294384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:19.309414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:19.311788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:19.313168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:19.319611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:19.490598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:19.501404 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-437b5af9-92e5-49dc-a82c-7e6c77d9da3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1241 microversion: 2.1 time: 0.211697 Jul 20 11:14:19.508078 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2363/4752] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:19 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1241 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:19.513184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:19.524417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:19.531273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:19.531885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:19.534600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:19.535161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:20.184598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:20.207448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:20.229165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:20.233474 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6446bd0a-d343-4e8d-8b7c-0c6944621395 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1339 microversion: 2.20 time: 0.723201 Jul 20 11:14:20.243590 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2364/4753] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:19 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1339 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:20.253803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:20.256001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:20.275086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:20.282085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:20.283895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:20.287112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:20.396239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:14:20.396707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:14:20.397204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:14:20.397629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:14:20.398057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:14:20.440402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:20.444237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:20.447582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:20.448302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:20.517223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:20.547636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:20.644276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:14:20.649180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:14:20.807092 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c4e2746-44d2-4223-96df-05059e814f8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.155943 Jul 20 11:14:20.807796 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2390/4754] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:14:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 3157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:14:20.835643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:20.844039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:20.880916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:20.885464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:20.891260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:20.894446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:21.372256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:21.405387 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a753442b-f55f-4ecf-ab81-e7019d5e8a18 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1317 microversion: 2.1 time: 1.159681 Jul 20 11:14:21.410754 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2365/4755] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:20 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:21.421042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:21.438664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:21.462218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:21.463015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:21.465340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:21.467490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:21.659519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:21.669763 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1f50e06f-ee11-44ee-820f-65a0d2e40810 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1501 microversion: 2.1 time: 0.850449 Jul 20 11:14:21.684870 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2391/4756] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:20 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1501 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:21.715450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2eaa8cb3-126e-4569-8f40-06423762896c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:21.717424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2eaa8cb3-126e-4569-8f40-06423762896c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:21.954466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:21.964038 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff3a9524-2eff-45ee-af44-ae4299a510ef tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1303 microversion: 2.1 time: 0.547695 Jul 20 11:14:21.967696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2366/4757] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:21 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1303 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:21.988818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:21.991659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:22.023882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:22.032997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:22.034099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:22.034777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:22.090815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2eaa8cb3-126e-4569-8f40-06423762896c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:22.102419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2eaa8cb3-126e-4569-8f40-06423762896c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1267 microversion: 2.1 time: 0.414697 Jul 20 11:14:22.109718 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2392/4758] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:21 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1267 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:22.134686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a8c2d7cd-1690-4ce8-b49d-7998c611d12a req-03c3973b-da64-452c-8410-a78bb7fc0039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffee4d5-4441-41b9-bc95-b2c97eb66158", "tag": "c6ccd780-a70d-4de1-aff6-232855e697da"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:22.192821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a8c2d7cd-1690-4ce8-b49d-7998c611d12a req-03c3973b-da64-452c-8410-a78bb7fc0039 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:22.194043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a8c2d7cd-1690-4ce8-b49d-7998c611d12a req-03c3973b-da64-452c-8410-a78bb7fc0039 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:22.213744 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a8c2d7cd-1690-4ce8-b49d-7998c611d12a req-03c3973b-da64-452c-8410-a78bb7fc0039 service nova] Creating event network-changed:c6ccd780-a70d-4de1-aff6-232855e697da for instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 on n-h2-846219-10 Jul 20 11:14:22.231902 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a8c2d7cd-1690-4ce8-b49d-7998c611d12a req-03c3973b-da64-452c-8410-a78bb7fc0039 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119747 Jul 20 11:14:22.234087 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2393/4759] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:22.241509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:22.242546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:22.257973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:22.258771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:22.259814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:22.260454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:22.285540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:23.643270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:23.658751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:23.668653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:23.672667 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef4726d8-3c9d-4ab9-bed8-82da0dbc7728 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 1.703640 Jul 20 11:14:23.675820 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2367/4760] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:21 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:23.723678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:23.730416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:23.790716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:23.791764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:23.793107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:23.795910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:23.887612 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.network.security_group_api [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Removing security group 8e2c9b3f-5db5-4444-9a05-fde80a83126c from port 29205aeb-da2c-42ef-8452-da1846fdf2e7 Jul 20 11:14:24.365986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:24.380783 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb0eb4d5-585c-4445-9007-6173b9f4814e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1317 microversion: 2.1 time: 0.701831 Jul 20 11:14:24.381381 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2368/4761] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:23 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:24.391513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:24.392525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:24.405366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:24.411956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:24.412915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:24.413501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:24.463260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:24.585366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:24.603038 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-db462a0b-bdb5-4f90-85ff-2934407333ad tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1303 microversion: 2.1 time: 0.220312 Jul 20 11:14:24.604823 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2369/4762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:24 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1303 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:24.623704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:24.624549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:24.641423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:24.642006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:24.643044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:24.645869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:24.823332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:24.847290 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0183a42-c4a7-4aa8-b84d-d3abbe7c358c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1325 microversion: 2.1 time: 0.238995 Jul 20 11:14:24.852118 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2370/4763] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:24 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1325 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:24.859769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:24.865529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:24.882053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:24.887750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:24.889565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:24.895711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:25.732614 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-264952a2-d5a4-449b-8349-cf7f00dedc3d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002/action" status: 202 len: 0 microversion: 2.1 time: 3.495910 Jul 20 11:14:25.734517 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2394/4764] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:14:22 2022] POST /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002/action => generated 0 bytes in 3500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:14:25.740850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:25.741734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:25.772144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:25.780687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:25.781860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:25.782524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:25.880641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:25.910375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:25.923077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:25.926770 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-12b2f985-43bb-4e0f-81ba-5feb2130dc92 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 1.070837 Jul 20 11:14:25.938555 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2371/4765] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:24 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:25.979588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:25.980349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:26.003917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.005711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:26.011959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.012948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:26.282411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:26.302454 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5281968-defc-48e2-ad11-823e765b1a30 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1303 microversion: 2.1 time: 0.360912 Jul 20 11:14:26.305089 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2372/4766] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:25 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1303 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:26.345491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:26.354035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:26.369830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.370338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:26.371185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.371643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:26.686638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:26.707897 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3dc31379-d5ea-41e8-affa-d2f878838ab4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1459 microversion: 2.1 time: 0.371592 Jul 20 11:14:26.708505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2373/4767] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:26 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1459 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:26.727402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1b37974c-bff2-4e59-88e4-2b3c2581cfff req-93cf3a6d-cd49-46c4-8f81-9377ff3e5f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e25c28b-dbea-4da4-aeaa-18b20b349002", "tag": "29205aeb-da2c-42ef-8452-da1846fdf2e7"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:26.774194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1b37974c-bff2-4e59-88e4-2b3c2581cfff req-93cf3a6d-cd49-46c4-8f81-9377ff3e5f20 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.774873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1b37974c-bff2-4e59-88e4-2b3c2581cfff req-93cf3a6d-cd49-46c4-8f81-9377ff3e5f20 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:26.809673 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1b37974c-bff2-4e59-88e4-2b3c2581cfff req-93cf3a6d-cd49-46c4-8f81-9377ff3e5f20 service nova] Creating event network-changed:29205aeb-da2c-42ef-8452-da1846fdf2e7 for instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 on n-h2-846219-10 Jul 20 11:14:26.837116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1b37974c-bff2-4e59-88e4-2b3c2581cfff req-93cf3a6d-cd49-46c4-8f81-9377ff3e5f20 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115630 Jul 20 11:14:26.837747 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2374/4768] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:26.864744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:26.874715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:26.905938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.907300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:26.912317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:26.918516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:27.438598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:27.458290 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-26f59418-0853-4f7c-b849-809b5ce87fe0 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1317 microversion: 2.1 time: 1.721885 Jul 20 11:14:27.460335 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2395/4769] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:25 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1317 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:27.472810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:27.476126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:27.496320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:27.496781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:27.497585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:27.498605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:27.519654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:27.534609 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-929c02be-de0c-4b7b-ba87-aac7f447a58b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1325 microversion: 2.1 time: 0.687849 Jul 20 11:14:27.551381 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2375/4770] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:26 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1325 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:27.558962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:27.564013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:27.578450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:27.582548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:27.586312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:27.587163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:27.830754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:27.890781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=12 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:28.105688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:28.123972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65ea714c-7747-4e1f-9507-293685636580 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.662443 Jul 20 11:14:28.125101 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2396/4771] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:27 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:28.131693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:28.132519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:28.155616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:28.156401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:28.157362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:28.157964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:28.442330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:28.457741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:28.461210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:28.472014 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c480bd2-e701-4087-9dc9-3594c67eb78d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 0.913973 Jul 20 11:14:28.472953 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2376/4772] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:27 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:28.479977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:28.488527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:28.502982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:28.503720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:28.504837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:28.505427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:30.173466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:30.185885 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8442ef04-72a1-4f9e-bb03-98962ca8c5f5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 2.058521 Jul 20 11:14:30.201677 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2397/4773] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:28 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:30.208046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:30.208676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:30.226389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:30.226852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:30.249917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:30.251194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:30.281465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:30.303957 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b64e1dab-05f6-4e00-aee1-5841a64474d7 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.829655 Jul 20 11:14:30.317619 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2377/4774] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:28 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:30.325470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:30.328673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:30.338040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:30.338428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:30.339539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:30.340133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:30.462781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:31.219075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:31.243320 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04d6fbb9-591a-46ad-9703-6f594d1d9688 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1393 microversion: 2.1 time: 0.921741 Jul 20 11:14:31.251005 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2378/4775] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:30 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1393 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:31.280735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-51c6a90e-dd1e-4677-8751-346f65e93676 req-8b94107a-4d43-4c32-a8a1-5b672ec24f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:31.295817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-51c6a90e-dd1e-4677-8751-346f65e93676 req-8b94107a-4d43-4c32-a8a1-5b672ec24f46 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:31.296436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-51c6a90e-dd1e-4677-8751-346f65e93676 req-8b94107a-4d43-4c32-a8a1-5b672ec24f46 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:31.328212 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-51c6a90e-dd1e-4677-8751-346f65e93676 req-8b94107a-4d43-4c32-a8a1-5b672ec24f46 service nova] Creating event network-changed:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:14:31.339350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-51c6a90e-dd1e-4677-8751-346f65e93676 req-8b94107a-4d43-4c32-a8a1-5b672ec24f46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084908 Jul 20 11:14:31.339891 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2379/4776] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:31.358628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:31.367466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2997619e-a2b5-4520-be46-abfc29edbf85 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1317 microversion: 2.1 time: 1.163327 Jul 20 11:14:31.368260 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2398/4777] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:30 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:31.382059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:31.386484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f177ba14-0702-455a-aa1b-766fb7d8873a req-e379e0dd-8f28-44c9-b77f-cce06a266d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffee4d5-4441-41b9-bc95-b2c97eb66158", "name": "network-vif-plugged", "status": "completed", "tag": "c6ccd780-a70d-4de1-aff6-232855e697da"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:31.387879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:31.409136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f177ba14-0702-455a-aa1b-766fb7d8873a req-e379e0dd-8f28-44c9-b77f-cce06a266d89 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:31.409560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f177ba14-0702-455a-aa1b-766fb7d8873a req-e379e0dd-8f28-44c9-b77f-cce06a266d89 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:31.433440 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f177ba14-0702-455a-aa1b-766fb7d8873a req-e379e0dd-8f28-44c9-b77f-cce06a266d89 service nova] Creating event network-vif-plugged:c6ccd780-a70d-4de1-aff6-232855e697da for instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 on n-h2-846219-10 Jul 20 11:14:31.446512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f177ba14-0702-455a-aa1b-766fb7d8873a req-e379e0dd-8f28-44c9-b77f-cce06a266d89 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077070 Jul 20 11:14:31.446701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:31.447353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:31.447551 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2399/4778] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:31.450406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:31.452136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:31.458590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:31.483112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:31.502337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:31.502966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:31.504114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:31.504822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.062128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:32.064055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:32.076636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:32.078664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:32.080465 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a990550-a830-4b48-86ab-d12c52df4325 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 0.726827 Jul 20 11:14:32.081249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03f26015-d96a-4fb1-a9e9-a1f2cf3f07e5 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.630965 Jul 20 11:14:32.093722 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2400/4780] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:31 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:32.094299 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2380/4780] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:31 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:32.099820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:32.100601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:32.102612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-92ab2662-1190-4ef8-a185-b45fda171795 req-79cf8f01-841b-4d97-94e5-0fba184e2ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:32.110714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.111636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.112576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.113169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.125067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=14 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:32.127298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-92ab2662-1190-4ef8-a185-b45fda171795 req-79cf8f01-841b-4d97-94e5-0fba184e2ca7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.128990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-92ab2662-1190-4ef8-a185-b45fda171795 req-79cf8f01-841b-4d97-94e5-0fba184e2ca7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.160078 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-92ab2662-1190-4ef8-a185-b45fda171795 req-79cf8f01-841b-4d97-94e5-0fba184e2ca7 service nova] Creating event network-changed:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h2-846219-10 Jul 20 11:14:32.166552 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-92ab2662-1190-4ef8-a185-b45fda171795 req-79cf8f01-841b-4d97-94e5-0fba184e2ca7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076987 Jul 20 11:14:32.172543 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2401/4781] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:32.180092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:32.180801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:32.206134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.206712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.208449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.208966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.578903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:32.607538 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-237bad9d-5911-4380-ad6c-b5954f41145e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 0.511564 Jul 20 11:14:32.622084 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2381/4782] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:32 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:32.629370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:32.630146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:32.637669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.639068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.640638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.641459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.733521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:32.745402 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13e1078a-89d3-4df3-8c0d-eca59dbd4d7a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.571122 Jul 20 11:14:32.746275 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2402/4783] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:32 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:32.758700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:32.766272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:32.782252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.784236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:32.785274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:32.785756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:33.231639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:33.242072 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-da9e83fd-66dd-4b4f-af30-ec1d83881d42 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1393 microversion: 2.1 time: 0.617878 Jul 20 11:14:33.242673 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2382/4784] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:32 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1393 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:33.249142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1223191123", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "eec87b6d-7d5e-44a0-b831-62582b4dcc3f"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:33.320260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] validate_networks() for [('eec87b6d-7d5e-44a0-b831-62582b4dcc3f', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:14:33.394655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:33.418193 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-39562bf7-4423-4b8c-9ef7-63be13c4d020 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1317 microversion: 2.1 time: 0.666569 Jul 20 11:14:33.418790 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2403/4785] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:32 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:33.423983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:33.427947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:33.446782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:33.447309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:33.448102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:33.448551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:34.160107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:34.173654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:34.187644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:34.189098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-be4b9c10-9845-49b3-abc5-c6aee4d6c1c4 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 0.769040 Jul 20 11:14:34.189910 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2404/4786] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:33 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:34.197223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c20eb218-b772-4295-8b8e-8f752139ea78 req-c8bcb42a-a2da-4d27-a95f-d3d40cb42bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:34.273486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c20eb218-b772-4295-8b8e-8f752139ea78 req-c8bcb42a-a2da-4d27-a95f-d3d40cb42bc1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:34.273927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c20eb218-b772-4295-8b8e-8f752139ea78 req-c8bcb42a-a2da-4d27-a95f-d3d40cb42bc1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:34.310056 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c20eb218-b772-4295-8b8e-8f752139ea78 req-c8bcb42a-a2da-4d27-a95f-d3d40cb42bc1 service nova] Creating event network-changed:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:14:34.316617 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c20eb218-b772-4295-8b8e-8f752139ea78 req-c8bcb42a-a2da-4d27-a95f-d3d40cb42bc1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124572 Jul 20 11:14:34.317807 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2405/4787] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:34.324168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:34.325103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:34.332280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:34.333015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:34.333995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:34.334643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.006228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:14:35.007456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:14:35.008147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:14:35.008808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:14:35.009445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:14:35.030474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:35.031268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.039876 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:35.040002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.083274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:14:35.089574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Getting quotas for user 85fdcf2c53c648548248e606e639b974 and project 8bef632298d2416b8bd9b6ebcd073a61. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:14:35.151774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:14:35.158782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:14:35.225805 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-058942db-8ce6-40e7-91b7-75569ef7373b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980377 Jul 20 11:14:35.227009 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2383/4788] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:14:35.232118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:35.233525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:35.241135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:35.241781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.242766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:35.243401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.852993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:35.887234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce22e648-a588-49c5-a2b9-d72558e2c49e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 1.565744 Jul 20 11:14:35.887987 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2406/4789] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:34 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:35.900778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:35.903491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:35.925702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:35.929911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:35.930719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.931958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:35.935119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:35.982885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.009580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bfe1e120-cedd-4879-9f30-299568f6b362 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1393 microversion: 2.1 time: 0.780759 Jul 20 11:14:36.013743 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2384/4790] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:35 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1393 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:36.025989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:36.027763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:36.047782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.050386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.051504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.066845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.471332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.479945 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3f8d6b4-c65a-422f-976f-e683016ea412 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1506 microversion: 2.1 time: 0.590508 Jul 20 11:14:36.492766 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2407/4791] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:35 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:36.497967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:36.498828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:36.506116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.506578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.507433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.508082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.718664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.730421 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dc23fae9-b696-44d4-9ec1-00f6205a6839 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1267 microversion: 2.1 time: 0.236276 Jul 20 11:14:36.734772 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2408/4792] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:36 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:36.749035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.749873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d6ec9ce4-265b-498f-8e40-c451dee408ad req-6384a915-78c1-40f3-aa37-e3e980ca3401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "name": "network-vif-plugged", "status": "completed", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:36.760666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.762861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.766096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6396594e-fad7-4a20-a85e-681f7d0a8b54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 0.749531 Jul 20 11:14:36.767133 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2385/4793] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:36 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:36.771071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d6ec9ce4-265b-498f-8e40-c451dee408ad req-6384a915-78c1-40f3-aa37-e3e980ca3401 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.771574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d6ec9ce4-265b-498f-8e40-c451dee408ad req-6384a915-78c1-40f3-aa37-e3e980ca3401 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.772925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:36.773672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:36.782396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.783125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.784190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.785016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.811289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d6ec9ce4-265b-498f-8e40-c451dee408ad req-6384a915-78c1-40f3-aa37-e3e980ca3401 service nova] Creating event network-vif-plugged:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h2-846219-10 Jul 20 11:14:36.817463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d6ec9ce4-265b-498f-8e40-c451dee408ad req-6384a915-78c1-40f3-aa37-e3e980ca3401 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081342 Jul 20 11:14:36.818367 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2409/4794] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:36.862855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:36.864185 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-678781d5-b234-4bab-a345-e7662607b5d1 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158/os-instance-actions/req-b36ced56-cfb9-48e7-a703-854fc06e4a5a" status: 200 len: 313 microversion: 2.1 time: 0.095896 Jul 20 11:14:36.865679 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2386/4795] 10.222.0.79 () {58 vars in 1418 bytes} [Wed Jul 20 11:14:36 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158/os-instance-actions/req-b36ced56-cfb9-48e7-a703-854fc06e4a5a => generated 313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:36.879150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:36.883930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:36.907641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.910745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.915297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:36.917894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:36.926093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.928780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.959107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.962294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:36.963453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:36.967767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.168768 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1ffd557e-a50b-4928-b22c-159d893d7369 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "POST /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158/action" status: 202 len: 0 microversion: 2.1 time: 0.289381 Jul 20 11:14:37.170269 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2410/4796] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:14:36 2022] POST /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:14:37.182889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:37.189921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:37.207490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.207959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.208772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.209212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.407965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:37.459399 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-751fd5a5-ee9c-4837-bc5d-3d3921b2f58a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 0.549280 Jul 20 11:14:37.480854 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2387/4797] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:36 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:14:37.483799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:37.489923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:37.490556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:37.493146 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50acf588-151b-4487-bbfe-581fd7248ca6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1393 microversion: 2.1 time: 0.318651 Jul 20 11:14:37.493860 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2411/4798] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:37 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1393 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:37.509438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.510442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.511462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.512110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.518199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:37.691681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:37.702092 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f4865c17-81ca-47c1-84d4-e555138f2351 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1508 microversion: 2.1 time: 0.219790 Jul 20 11:14:37.731608 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2388/4799] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:37 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1508 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:37.750879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:37.751849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:37.767987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.768680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.769636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.770248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.784619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:37.785566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:37.821541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.822102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.822961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:37.823443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:37.909773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:37.914953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:37.927649 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e481c959-db70-4043-aca2-be867d86c744 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1273 microversion: 2.1 time: 0.180016 Jul 20 11:14:37.930326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2412/4800] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:37 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:38.143780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:38.158730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:38.160587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:38.161961 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c96c44ef-b423-4c1b-8964-2beea519139b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 0.381849 Jul 20 11:14:38.162713 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2389/4801] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:37 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:38.501061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:38.501720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:38.510194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:38.512236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:38.537110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:38.537580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:38.550899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:38.551452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:38.557051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:38.561568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:38.572039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:38.576296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.039879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:39.060647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:39.061142 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e749341-b695-4668-95f5-379af5c379e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1393 microversion: 2.1 time: 0.554551 Jul 20 11:14:39.062253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2390/4802] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:38 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1393 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:39.069036 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-75e9c2e4-752d-46ea-97ee-47138876f0b7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 0.584091 Jul 20 11:14:39.073437 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2413/4803] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:38 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:39.083019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7975367a-64a0-4c2c-ad76-7fe8269e6bfe req-a58daf7e-19eb-403f-be27-ad4a38d49883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "name": "network-vif-plugged", "status": "completed", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:39.084107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:39.085164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:39.100513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.101676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7975367a-64a0-4c2c-ad76-7fe8269e6bfe req-a58daf7e-19eb-403f-be27-ad4a38d49883 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.102128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7975367a-64a0-4c2c-ad76-7fe8269e6bfe req-a58daf7e-19eb-403f-be27-ad4a38d49883 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.111218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.112280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.113890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.127569 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7975367a-64a0-4c2c-ad76-7fe8269e6bfe req-a58daf7e-19eb-403f-be27-ad4a38d49883 service nova] Creating event network-vif-plugged:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:14:39.140469 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7975367a-64a0-4c2c-ad76-7fe8269e6bfe req-a58daf7e-19eb-403f-be27-ad4a38d49883 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065071 Jul 20 11:14:39.141683 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2414/4804] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:39.157933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:39.158814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:39.165684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.169130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.178078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.178926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.368132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:39.389174 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-83566c5c-0f62-4d41-a233-8d02bb1a0560 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1273 microversion: 2.1 time: 0.245475 Jul 20 11:14:39.389799 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2415/4805] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:39 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:39.394833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:39.395705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:39.410900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.411694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.412681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:39.413280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:39.642273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:39.661936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fc677e6a-35af-4456-be70-7ffeb158bf83 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1508 microversion: 2.1 time: 0.594548 Jul 20 11:14:39.663596 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2391/4806] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:39 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:40.078596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:40.079484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:40.099076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:40.099809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:40.100786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:40.101383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:40.751430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:40.763708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:40.769150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:40.771134 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2196c422-8ba7-4c64-bb12-8739d722e4f0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1405 microversion: 2.20 time: 1.380022 Jul 20 11:14:40.781552 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2416/4807] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:39 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1405 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:40.787142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:40.787777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:40.807872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:40.810605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:40.812055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:40.812863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:41.112981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:41.138689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-597c20dc-586a-4587-ac69-1fbd1c65ac33 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1565 microversion: 2.1 time: 1.062009 Jul 20 11:14:41.139448 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2392/4808] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:40 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1565 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:14:41.157003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:41.157882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:41.189306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:41.195804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:41.196910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:41.197522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:41.931773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:41.942544 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d395bac5-5294-4600-8a25-5dc2bca4c349 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 1.159752 Jul 20 11:14:41.943222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2417/4809] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:40 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:41.956469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:41.961892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:41.980405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:41.981131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:41.983288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:41.985412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:41.990078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:42.001694 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b80a3079-afc6-4d3d-81d2-7eaef46d70c2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1315 microversion: 2.1 time: 0.858581 Jul 20 11:14:42.002507 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2393/4810] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:41 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:42.028149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-cd6f932a-dfe2-44ff-b267-8b08a287eb06 req-d1358c55-5a5d-4035-b087-d80a6fe5667b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162791fe-9499-488a-bd5e-2ea8387b0310", "tag": "48f105a3-9010-42d4-9eac-9c1c637238fa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:42.038026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cd6f932a-dfe2-44ff-b267-8b08a287eb06 req-d1358c55-5a5d-4035-b087-d80a6fe5667b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.038776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cd6f932a-dfe2-44ff-b267-8b08a287eb06 req-d1358c55-5a5d-4035-b087-d80a6fe5667b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.051655 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-cd6f932a-dfe2-44ff-b267-8b08a287eb06 req-d1358c55-5a5d-4035-b087-d80a6fe5667b service nova] Creating event network-changed:48f105a3-9010-42d4-9eac-9c1c637238fa for instance 162791fe-9499-488a-bd5e-2ea8387b0310 on n-h2-846219-10 Jul 20 11:14:42.066502 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-cd6f932a-dfe2-44ff-b267-8b08a287eb06 req-d1358c55-5a5d-4035-b087-d80a6fe5667b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062925 Jul 20 11:14:42.067738 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2394/4811] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:42.073107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:42.074080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:42.087115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.092962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.094086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.094723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.212847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:42.222624 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ddc066a8-7903-4e38-b2a2-c2380b213537 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1513 microversion: 2.1 time: 0.272733 Jul 20 11:14:42.232995 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2418/4812] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:41 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:42.232995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:42.232995 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:42.241475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.242023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.245267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.246140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.483453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:42.486029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:42.499128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:42.509530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:42.509636 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6afe82c8-f184-4157-a396-ba803af2eda0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1565 microversion: 2.1 time: 0.437438 Jul 20 11:14:42.510672 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2395/4813] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:42 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1565 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:42.523419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f5366f1d-b688-4d67-92d5-c5d16d35c572 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1596 microversion: 2.20 time: 0.283897 Jul 20 11:14:42.524622 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2419/4814] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:14:42 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1596 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:14:42.542384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:42.543291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:42.552924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.553696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.554680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.555368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.712888 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d6a4e83-7a64-4203-9759-860632e7b20f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.174471 Jul 20 11:14:42.714568 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2396/4815] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 11:14:42 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:14:42.877835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0f2e3f71-626e-4608-b7a9-aa7dc65e2343 req-b43727b7-3fa1-4625-9cb1-343540308889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "name": "network-vif-plugged", "status": "completed", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:42.894592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0f2e3f71-626e-4608-b7a9-aa7dc65e2343 req-b43727b7-3fa1-4625-9cb1-343540308889 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.895048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0f2e3f71-626e-4608-b7a9-aa7dc65e2343 req-b43727b7-3fa1-4625-9cb1-343540308889 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.926199 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0f2e3f71-626e-4608-b7a9-aa7dc65e2343 req-b43727b7-3fa1-4625-9cb1-343540308889 service nova] Creating event network-vif-plugged:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:14:42.941097 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0f2e3f71-626e-4608-b7a9-aa7dc65e2343 req-b43727b7-3fa1-4625-9cb1-343540308889 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066998 Jul 20 11:14:42.947510 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2420/4816] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:42.960180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:42.960805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:42.972441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:42.974100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.974571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:42.975524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:42.976001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:43.020323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:43.020957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:43.031548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:43.032006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:43.032816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:43.033249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:43.616374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:43.624970 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f63129a-c53c-41ff-8d2a-ed2512c452a0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 0.668532 Jul 20 11:14:43.637132 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2397/4817] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:42 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:43.637248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:43.640084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:43.642785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:43.653501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:43.655829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:43.659300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:43.659444 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cadc4d4f-20dd-4b4d-a0de-44580589f9ae tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1315 microversion: 2.1 time: 0.643181 Jul 20 11:14:43.659945 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2421/4818] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:43 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:43.660385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:44.326601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:44.364488 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fdb11f8a-ba66-4d7e-9385-202f9af53b1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1513 microversion: 2.1 time: 0.729103 Jul 20 11:14:44.369434 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2398/4819] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:43 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1513 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:44.651793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:44.652438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:44.674605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:44.675062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:44.676563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:44.677399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:44.678054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:44.678531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:44.687674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:44.692726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:44.693780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:44.694432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:45.059074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:45.143192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:45.781429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:45.793001 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff5995a1-fa47-440f-bc43-214c198afb19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1315 microversion: 2.1 time: 1.120524 Jul 20 11:14:45.793872 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2399/4820] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:44 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:45.804060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:45.804692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:45.825570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:45.828237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:45.829244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:45.831320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.008682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:46.024058 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-318d06ea-6cab-43d2-b585-bce18437e320 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1370 microversion: 2.1 time: 1.384069 Jul 20 11:14:46.033875 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2422/4821] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:44 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1370 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:46.346845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:46.362332 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f86ceb88-5a8d-4ba8-8f22-f7aa5786adb5 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1506 microversion: 2.1 time: 0.562024 Jul 20 11:14:46.377907 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2400/4822] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:45 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:46.382462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '.version_select at 0x7f2c50d84670>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:46.383558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:46.396705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.402889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.404759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.405225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.583606 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8de9ecea-44ed-4f60-8729-76e3b7b55424 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.206208 Jul 20 11:14:46.593296 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2423/4823] 10.222.0.79 () {58 vars in 1295 bytes} [Wed Jul 20 11:14:46 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158/os-instance-actions => generated 611 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:46.605139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:46.614733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:46.634147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.637513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.640169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.643241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.692745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9ea6cd3c-e981-4e2e-921a-0eec5052e80b req-5d12323d-75bb-4dd5-a6a2-1b1fe430e0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:46.720570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:14:46.728846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9ea6cd3c-e981-4e2e-921a-0eec5052e80b req-5d12323d-75bb-4dd5-a6a2-1b1fe430e0a2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.728846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9ea6cd3c-e981-4e2e-921a-0eec5052e80b req-5d12323d-75bb-4dd5-a6a2-1b1fe430e0a2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.824776 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9ea6cd3c-e981-4e2e-921a-0eec5052e80b req-5d12323d-75bb-4dd5-a6a2-1b1fe430e0a2 service nova] Creating event network-changed:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:14:46.853249 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9ea6cd3c-e981-4e2e-921a-0eec5052e80b req-5d12323d-75bb-4dd5-a6a2-1b1fe430e0a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164079 Jul 20 11:14:46.854008 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2424/4824] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:14:46.865982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:46.900673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:46.931571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.932226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.933333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:46.941225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:46.999448 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6961ddaf-3759-4563-a76d-4355930b02c7 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 204 len: 0 microversion: 2.1 time: 0.393797 Jul 20 11:14:47.003102 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2401/4825] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:14:46 2022] DELETE /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:14:47.022530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:47.031952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:47.052037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:47.053338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:47.054150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:47.054600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:47.432627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:47.443416 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-604634f1-1970-48bd-8df7-db3814fb2798 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1315 microversion: 2.1 time: 0.582536 Jul 20 11:14:47.446906 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2425/4826] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:46 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:47.454803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:47.460253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:47.475502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:47.476125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:47.477416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:47.477416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:47.527715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:47.544027 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e2ae60d-4cf8-48f1-b3a2-8fbf7c761dc9 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1512 microversion: 2.1 time: 0.533731 Jul 20 11:14:47.546248 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2402/4827] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:47 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1512 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:47.708436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:47.717883 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-129d96cd-2e5f-4a5d-93db-2e1d84b3e86c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1564 microversion: 2.1 time: 0.269699 Jul 20 11:14:47.718468 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2426/4828] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:47 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1564 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:47.738660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:47.738660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:47.768551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:47.769236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:47.770449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:47.771054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:47.908380 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77a3f428-b320-4b39-8f59-78c209602879 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175288 Jul 20 11:14:47.916618 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2403/4829] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:14:47 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:48.228474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:48.229106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:48.239353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:48.239907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:48.240612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:48.241070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:48.304934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b6b30c57-1aa3-45f2-afc3-808272711a2a req-57827be9-5a8c-40b6-9de4-799070d8f0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:48.344581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b6b30c57-1aa3-45f2-afc3-808272711a2a req-57827be9-5a8c-40b6-9de4-799070d8f0c6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:48.345887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b6b30c57-1aa3-45f2-afc3-808272711a2a req-57827be9-5a8c-40b6-9de4-799070d8f0c6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:48.374955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b6b30c57-1aa3-45f2-afc3-808272711a2a req-57827be9-5a8c-40b6-9de4-799070d8f0c6 service nova] Creating event network-changed:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h2-846219-10 Jul 20 11:14:48.381629 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b6b30c57-1aa3-45f2-afc3-808272711a2a req-57827be9-5a8c-40b6-9de4-799070d8f0c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081461 Jul 20 11:14:48.383494 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2404/4830] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:48.464845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:48.465660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:48.507197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:48.514079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:48.515808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:48.516733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:48.584619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:49.703139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:49.711203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da0f0aaf-a662-420c-bc00-dc7d4269a0c7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1565 microversion: 2.1 time: 1.486493 Jul 20 11:14:49.720326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2427/4831] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:48 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1565 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:49.736274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:49.736929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:49.768370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:49.769080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:49.770146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:49.773084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:50.099506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:50.112463 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3198fb92-4066-4275-9273-b7dac7ab3a33 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1315 microversion: 2.1 time: 1.652471 Jul 20 11:14:50.115905 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2405/4832] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:48 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1315 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:14:50.494039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:50.503587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de1b13b2-49fb-4f28-b5ac-1d4e5bd60a16 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1512 microversion: 2.1 time: 0.782014 Jul 20 11:14:50.515753 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2428/4833] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:49 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1512 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:50.899344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b1a44d95-bfa3-413f-8ce1-a2e7b0e372ff req-754f2524-df6e-4fe4-b9bc-5e917182e634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162791fe-9499-488a-bd5e-2ea8387b0310", "name": "network-vif-plugged", "status": "completed", "tag": "48f105a3-9010-42d4-9eac-9c1c637238fa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:50.923337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b1a44d95-bfa3-413f-8ce1-a2e7b0e372ff req-754f2524-df6e-4fe4-b9bc-5e917182e634 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:50.923862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b1a44d95-bfa3-413f-8ce1-a2e7b0e372ff req-754f2524-df6e-4fe4-b9bc-5e917182e634 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:50.946906 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b1a44d95-bfa3-413f-8ce1-a2e7b0e372ff req-754f2524-df6e-4fe4-b9bc-5e917182e634 service nova] Creating event network-vif-plugged:48f105a3-9010-42d4-9eac-9c1c637238fa for instance 162791fe-9499-488a-bd5e-2ea8387b0310 on n-h2-846219-10 Jul 20 11:14:50.959232 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b1a44d95-bfa3-413f-8ce1-a2e7b0e372ff req-754f2524-df6e-4fe4-b9bc-5e917182e634 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063923 Jul 20 11:14:50.960542 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2406/4834] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:51.134092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:51.134641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:51.150366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:51.151143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:51.152297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:51.152920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:51.522343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:51.523051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:51.542075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:51.544410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:51.548070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:51.548589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:52.022818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:52.040104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d9604b7-d4e5-466e-8b88-34fa2a0f558e tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1470 microversion: 2.1 time: 0.522028 Jul 20 11:14:52.041124 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2407/4835] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:51 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1470 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:52.066647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a43f77e5-766c-40af-92b5-08ccda22bfc5 req-61466741-3e7c-496d-8795-7f3969fe31d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffee4d5-4441-41b9-bc95-b2c97eb66158", "name": "network-vif-deleted", "tag": "c6ccd780-a70d-4de1-aff6-232855e697da"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:52.083334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a43f77e5-766c-40af-92b5-08ccda22bfc5 req-61466741-3e7c-496d-8795-7f3969fe31d3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:52.084185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a43f77e5-766c-40af-92b5-08ccda22bfc5 req-61466741-3e7c-496d-8795-7f3969fe31d3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:52.107705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a43f77e5-766c-40af-92b5-08ccda22bfc5 req-61466741-3e7c-496d-8795-7f3969fe31d3 service nova] Creating event network-vif-deleted:c6ccd780-a70d-4de1-aff6-232855e697da for instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 on n-h2-846219-10 Jul 20 11:14:52.117176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:52.126368 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a43f77e5-766c-40af-92b5-08ccda22bfc5 req-61466741-3e7c-496d-8795-7f3969fe31d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054046 Jul 20 11:14:52.128919 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2408/4836] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:14:52.135620 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-48248f55-bde2-4ccf-bb86-3acc6d4f334a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1315 microversion: 2.1 time: 1.003077 Jul 20 11:14:52.147353 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2429/4837] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:51 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:53.060888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:53.061987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:53.071668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.077222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.078629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.088792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.135257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.136186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.136902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lazy-loading 'fault' on Instance uuid 1ffee4d5-4441-41b9-bc95-b2c97eb66158 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:14:53.164167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:53.166253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:53.177603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.178235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.179199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.179781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.245838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87bc84fc12934106a340e48293e5d66c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6166dba2eca24302b42939e682fada7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:53.255943 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83d4f4f4-815d-4f38-a0b9-4d3c925ef394 tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 200 len: 1307 microversion: 2.1 time: 0.201569 Jul 20 11:14:53.258205 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2409/4838] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:53 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:53.410321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:53.421104 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b160cbd1-ebc0-4be9-b64f-4c84d5ba9c3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1503 microversion: 2.1 time: 0.264789 Jul 20 11:14:53.422256 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2430/4839] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:53 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:53.438611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:53.439384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:53.449705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.454584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.455635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.458129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.541516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eba88268-cdac-4373-9cb5-ca0bbb562d8c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310/action" status: 202 len: 0 microversion: 2.1 time: 0.106853 Jul 20 11:14:53.546253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2410/4840] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:14:53 2022] POST /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:14:53.554266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:53.555122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:53.576663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.577255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.581413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:53.581831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:53.612489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:14:53.827514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:53.838306 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad8cd0a7-993d-4a22-a49c-e0f32b9d13aa tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1508 microversion: 2.1 time: 0.290172 Jul 20 11:14:53.843559 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2431/4841] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:53 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:54.143900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-dc560b9a-c574-4580-a57d-1bfc0cb7ec87 req-e27a2a28-458d-44aa-8540-da0a44e323cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:54.155457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-dc560b9a-c574-4580-a57d-1bfc0cb7ec87 req-e27a2a28-458d-44aa-8540-da0a44e323cf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:54.175520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-dc560b9a-c574-4580-a57d-1bfc0cb7ec87 req-e27a2a28-458d-44aa-8540-da0a44e323cf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:54.189320 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-dc560b9a-c574-4580-a57d-1bfc0cb7ec87 req-e27a2a28-458d-44aa-8540-da0a44e323cf service nova] Creating event network-changed:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:14:54.194762 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-dc560b9a-c574-4580-a57d-1bfc0cb7ec87 req-e27a2a28-458d-44aa-8540-da0a44e323cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055281 Jul 20 11:14:54.195743 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2411/4842] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:14:54.273459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:54.274082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] [instance: 1ffee4d5-4441-41b9-bc95-b2c97eb66158] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:54.294553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:54.295638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:54.296566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:54.297022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:54.324803 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] HTTP exception thrown: Instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 could not be found. Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Request method failure captured: Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 HTTP/1.1 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-N_xPX8aNq2dKmApQKpMWVUqfuGybR-4mM0QFralSfr5RWadLBtZFPA4f7QmpmHLYFe9qMIdX9AfpY0KsRfPG1Mw20A_3xw2r1AaMkSZox8S4Pdul3g2Hwk1yKJ3hTPHwbAtKpLPy-iJPaErqVPwi7B_USrQKbFbPqL9Pu1jDkKnvk Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 6166dba2eca24302b42939e682fada7d Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-InstanceActionsTestJSON-911923047 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6166dba2eca24302b42939e682fada7d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6166dba2eca24302b42939e682fada7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6166dba2eca24302b42939e682fada7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6166dba2eca24302b42939e682fada7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-InstanceActionsTestJSON-911923047 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 6166dba2eca24302b42939e682fada7d Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-InstanceActionsTestJSON-911923047 Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-InstanceActionsTestJSON-911923047-project Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 87bc84fc12934106a340e48293e5d66c Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-InstanceActionsTestJSON-911923047-project Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 could not be found. Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1ffee4d5-4441-41b9-bc95-b2c97eb66158'} Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 could not be found. Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 could not be found. Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:14:54.328861 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 could not be found. Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] Returning 404 to user: Instance 1ffee4d5-4441-41b9-bc95-b2c97eb66158 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:14:54.332205 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf24e841-130e-484b-b99b-337ebb0ace1b tempest-InstanceActionsTestJSON-911923047 tempest-InstanceActionsTestJSON-911923047-project] 10.222.0.79 "GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158" status: 404 len: 111 microversion: 2.1 time: 0.062314 Jul 20 11:14:54.332880 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2432/4843] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:54 2022] GET /compute/v2.1/servers/1ffee4d5-4441-41b9-bc95-b2c97eb66158 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:14:54.859399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:54.860501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:54.869240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:54.869931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:54.870932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:54.873404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:55.180623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:55.195947 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3d2bdc47-911b-45a0-9983-8369e197b9bc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1488 microversion: 2.1 time: 0.342128 Jul 20 11:14:55.198580 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2412/4844] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:54 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1488 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:55.218886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:14:55.219755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:55.226201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:55.226852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:55.228050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:55.228686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:55.255320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lazy-loading 'flavor' on Instance uuid 162791fe-9499-488a-bd5e-2ea8387b0310 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:14:55.644071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-56a64fe2-d6b2-495a-9d2e-c3dfe1abcd01 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310/action" status: 202 len: 0 microversion: 2.1 time: 0.430394 Jul 20 11:14:55.658677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:55.659650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:55.663865 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2433/4845] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:14:55 2022] POST /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:14:55.667678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:55.668387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:55.671019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:55.671828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:55.962646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:55.974906 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0415cbbe-2e2c-4d8c-ab0f-855b90de2501 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1494 microversion: 2.1 time: 0.323676 Jul 20 11:14:55.987158 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2413/4846] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:55 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1494 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:56.996449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:56.999115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:57.007304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:57.007963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:57.009239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:57.009943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:57.337170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:57.346302 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e58c690c-1f08-4342-adc8-1dd112993398 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1515 microversion: 2.1 time: 0.356587 Jul 20 11:14:57.349235 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2434/4847] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:56 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:14:58.365388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:14:58.366081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:14:58.378254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:58.381332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:58.382300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:14:58.383691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:14:59.156602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:14:59.192922 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d56e6fbe-1b2f-4fff-abc2-63bf9500506a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.822516 Jul 20 11:14:59.196129 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2414/4848] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:14:58 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:00.214566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:00.216596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:00.235665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:00.248743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:00.249825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:00.250446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:00.701484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:00.738635 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb5b8e60-5c34-4a71-8740-a2efbe29231e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.528080 Jul 20 11:15:00.742416 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2435/4849] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:00 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:01.764869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:01.766621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:01.788361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:01.790433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:01.793382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:01.795997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:02.304846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:02.330780 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec5224bc-25da-413d-9fce-a0d02a0b4b48 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.573128 Jul 20 11:15:02.346120 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2415/4850] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:01 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:03.353110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:03.353739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:03.390142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:03.393827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:03.396380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:03.399599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:03.804430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:03.826069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-25618e91-9a23-42d3-8097-4bd969d9cb59 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.476421 Jul 20 11:15:03.827441 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2436/4851] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:03 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:04.576257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-93c024ac-bc79-4c99-82e8-a6fb95aa5853 req-13073a81-2b52-4736-949b-7845a76c1a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162791fe-9499-488a-bd5e-2ea8387b0310", "name": "network-vif-plugged", "status": "completed", "tag": "48f105a3-9010-42d4-9eac-9c1c637238fa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:04.595622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-93c024ac-bc79-4c99-82e8-a6fb95aa5853 req-13073a81-2b52-4736-949b-7845a76c1a74 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:04.598755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-93c024ac-bc79-4c99-82e8-a6fb95aa5853 req-13073a81-2b52-4736-949b-7845a76c1a74 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:04.663224 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-93c024ac-bc79-4c99-82e8-a6fb95aa5853 req-13073a81-2b52-4736-949b-7845a76c1a74 service nova] Creating event network-vif-plugged:48f105a3-9010-42d4-9eac-9c1c637238fa for instance 162791fe-9499-488a-bd5e-2ea8387b0310 on n-h2-846219-10 Jul 20 11:15:04.691478 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-93c024ac-bc79-4c99-82e8-a6fb95aa5853 req-13073a81-2b52-4736-949b-7845a76c1a74 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119913 Jul 20 11:15:04.705513 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2416/4852] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:04.845210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:04.845938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:04.863093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:04.863614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:04.881396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:04.881913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:05.321027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:05.332723 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2db4452-f24d-446b-a0d9-b9311e7c8476 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.492545 Jul 20 11:15:05.344443 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2437/4853] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:04 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:06.355624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:06.357502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:06.371704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:06.381127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:06.382373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:06.384967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:07.326813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:07.360651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74f9c25d-ed94-4111-abc2-3b8d55b4ec7b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 1.007672 Jul 20 11:15:07.367312 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2417/4854] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:06 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:08.397389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:08.398527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:08.406470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=62 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:08.409651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:08.415017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:08.416206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:08.417919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:08.890407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:08.902314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0843e98c-bbeb-4cbd-aa8a-f18a28c0fd8d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.521538 Jul 20 11:15:08.914702 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2438/4855] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:08 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:09.922374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:09.923609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:09.953046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:09.953504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:09.960231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:09.962761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:10.559742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:10.573569 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-40ea3747-48f4-4184-8687-45336d0addb6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.655744 Jul 20 11:15:10.580102 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2418/4856] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:09 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:11.145351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:11.147109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:11.166556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:11.166556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:11.173236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:11.173724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:11.266515 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc85944e-ebe3-4b22-b5c0-a7a225ec4782 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action" status: 200 len: 24535 microversion: 2.1 time: 0.124783 Jul 20 11:15:11.267867 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2439/4857] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:15:11 2022] POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action => generated 24535 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:15:11.600965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:11.602014 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:11.613923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:11.614383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:11.630880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:11.631382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:12.397942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:12.406305 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6a8c965a-8c89-498a-bbb3-50cdbc716e86 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.809925 Jul 20 11:15:12.406903 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2419/4858] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:11 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:13.425124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:13.425826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:13.454128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:13.454579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:13.458388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:13.459104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:14.138115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:14.146835 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e3d19cd-bfc6-4668-80af-aac4bb5393e6 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.726505 Jul 20 11:15:14.151477 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2440/4859] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:13 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:15.170866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:15.171545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:15.179250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:15.187311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:15.194696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:15.201383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:15.202170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:15.976898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:16.005005 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5175c4f8-4478-47b8-8ad5-dd5e906eb984 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.841196 Jul 20 11:15:16.007583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2420/4860] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:15 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:17.025643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:17.026168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:17.046937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:17.047431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:17.058872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:17.063765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:17.403779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:17.412713 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5c5d14da-018f-4ba0-8abb-ccd6e3d7cb3c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.391327 Jul 20 11:15:17.419991 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2441/4861] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:17 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:17.817465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1674884516", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "34141bce-0a86-4b52-89b1-a3ebc0ea32df"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:17.968640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] validate_networks() for [('34141bce-0a86-4b52-89b1-a3ebc0ea32df', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:15:18.437383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:18.438179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:18.464150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:18.466119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:18.474098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:18.474867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:18.938707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:18.952228 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af989f75-4be1-4571-805c-f63a3162b3fb tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.519891 Jul 20 11:15:18.961532 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2442/4862] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:18 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:19.795783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:15:19.796511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:15:19.797619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:15:19.798579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:15:19.799781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:15:19.814968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:19.815778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:19.817361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:19.818441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:19.835229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:19.861803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Getting quotas for project 9ed8a1ad24f34c789b67415a6bf14ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:15:19.880779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Getting quotas for user 94736b6355ea4bec996516644e9acd2b and project 9ed8a1ad24f34c789b67415a6bf14ce8. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:15:19.904060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Going to run 3 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:15:19.906388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:15:19.960832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=9892ad5f-bd75-43d1-8d6e-62aa24a50775,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:15:19.997912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:20.018518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:20.035733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=ea087778-3001-43bd-b04a-b068ca889d79,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:15:20.081009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:20.084778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:20.088680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:20.093022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:20.257544 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-374b7839-1d11-4388-8bb6-40a25daa3ad6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.820374 Jul 20 11:15:20.263946 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2421/4863] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:15:20.276399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:20.285682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:20.289750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:20.419474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:20.447236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:20.454628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:20.456888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:20.546539 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4891519e-9a23-491b-9cb5-ae54110291d4 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.280670 Jul 20 11:15:20.558711 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2422/4864] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 11:15:20 2022] GET /compute/v2.1/servers => generated 1018 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:20.566764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e93f7f3f-58e9-4164-9324-37be5a60aaf5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:20.567644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e93f7f3f-58e9-4164-9324-37be5a60aaf5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:20.744305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e93f7f3f-58e9-4164-9324-37be5a60aaf5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:20.756377 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e93f7f3f-58e9-4164-9324-37be5a60aaf5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1223 microversion: 2.1 time: 0.195755 Jul 20 11:15:20.761123 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2423/4865] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:20 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:20.812389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:20.826852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-991ff064-99d4-4081-a476-f734567f6e34 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.856443 Jul 20 11:15:20.832558 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2443/4866] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:19 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:21.779838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ecf4010-bc5b-487e-8797-3a15b043e6e3 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:21.781454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0ecf4010-bc5b-487e-8797-3a15b043e6e3 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:21.853973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:21.855776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:21.868642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:21.892009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:21.892875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:21.893321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:22.013722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0ecf4010-bc5b-487e-8797-3a15b043e6e3 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:22.029145 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0ecf4010-bc5b-487e-8797-3a15b043e6e3 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1223 microversion: 2.1 time: 0.254459 Jul 20 11:15:22.029817 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2424/4867] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:21 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1223 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:22.423358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:22.423995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:22.438392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:22.438976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:22.439952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:22.455768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:22.711586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:22.730336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-651d41b0-5fbc-409b-9e65-58478ee7dc7d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1510 microversion: 2.1 time: 0.882304 Jul 20 11:15:22.735151 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2444/4868] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:21 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1510 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:23.048604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:23.049963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:23.065372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:23.066120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:23.067135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:23.067800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:23.360049 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7710de19-23fe-41a1-8b96-3d788f001a45 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1836 microversion: 2.1 time: 0.942602 Jul 20 11:15:23.362048 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2425/4869] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:22 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1836 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:23.378910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:23.384759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:23.401640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:23.402290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:23.403348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:23.403970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:23.521675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:23.532885 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65cc4c19-3521-4be9-97c9-7ca91e35304a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1275 microversion: 2.1 time: 0.489701 Jul 20 11:15:23.547036 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2445/4870] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:23 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1275 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:23.756878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:23.757509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:23.766704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:23.767198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:23.768070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:23.768526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:23.779259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:24.284709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:24.300458 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3fcfbdb9-abde-4e17-afdd-27dd38ae9398 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1683 microversion: 2.1 time: 0.925673 Jul 20 11:15:24.301357 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2426/4871] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:23 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1683 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:24.473253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:24.514294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bca23eb1-cc4a-4b51-a864-2df661618ed4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1507 microversion: 2.1 time: 0.739548 Jul 20 11:15:24.516146 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2446/4872] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:23 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1507 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:24.565091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:24.565652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:24.586032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:24.586513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:24.589819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:24.609457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:24.759339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:24.780342 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58f1174a-2209-425b-8ede-f11f542580c0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1281 microversion: 2.1 time: 0.218477 Jul 20 11:15:24.780603 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2447/4873] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:24 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:24.805831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:24.806352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:24.813913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:24.814950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:24.828565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:24.829033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:24.829832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:24.830280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:24.832159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:24.832627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:24.833436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:24.837866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:24.877165 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-92da1ab6-bbf0-4e5f-935f-a3e27e5054bc tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/ips" status: 200 len: 151 microversion: 2.20 time: 0.378512 Jul 20 11:15:24.878883 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2427/4874] 10.222.0.79 () {60 vars in 1288 bytes} [Wed Jul 20 11:15:24 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/ips => generated 151 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:15:24.945636 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e6913b5e-642e-4cc5-b4cd-82038062224d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action" status: 200 len: 32603 microversion: 2.1 time: 0.163593 Jul 20 11:15:24.946352 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2448/4875] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:15:24 2022] POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action => generated 32603 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:15:25.090135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:25.091629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:25.106592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:25.114125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:25.115442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:25.117725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:25.537036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:25.538364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:25.599150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:25.599681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:25.607307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:25.607917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:25.759918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '552adc8717314c8f8f4e11dba5ae311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fea2384da042039114e384472becf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:25.762831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] flavor_id is None. Assuming migration. {{(pid=125886) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 11:15:25.763820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125886) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:15:26.865736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:26.881250 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e5bfe717-355b-4d65-96de-9cecd61fef16 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1507 microversion: 2.1 time: 1.346936 Jul 20 11:15:26.888538 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2449/4876] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:25 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1507 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:26.900287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:26.905752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:26.937024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:26.937494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:26.938296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:26.944418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:27.085406 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-840504ae-ed5e-4a82-b543-72d4f510a988 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action" status: 202 len: 0 microversion: 2.1 time: 1.996924 Jul 20 11:15:27.086815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2428/4877] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:15:25 2022] POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action => generated 0 bytes in 2003 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:15:27.114481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2830c2ee-b037-4d70-b422-4ad0632d0463 req-e0f36d85-dfef-4ec2-a201-717b653cc825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162791fe-9499-488a-bd5e-2ea8387b0310", "name": "network-vif-unplugged", "status": "completed", "tag": "48f105a3-9010-42d4-9eac-9c1c637238fa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:27.160988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2830c2ee-b037-4d70-b422-4ad0632d0463 req-e0f36d85-dfef-4ec2-a201-717b653cc825 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:27.167509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2830c2ee-b037-4d70-b422-4ad0632d0463 req-e0f36d85-dfef-4ec2-a201-717b653cc825 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:27.208364 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2830c2ee-b037-4d70-b422-4ad0632d0463 req-e0f36d85-dfef-4ec2-a201-717b653cc825 service nova] Creating event network-vif-unplugged:48f105a3-9010-42d4-9eac-9c1c637238fa for instance 162791fe-9499-488a-bd5e-2ea8387b0310 on n-h2-846219-10 Jul 20 11:15:27.212707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:27.224876 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2830c2ee-b037-4d70-b422-4ad0632d0463 req-e0f36d85-dfef-4ec2-a201-717b653cc825 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134841 Jul 20 11:15:27.228611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2429/4878] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:27.250572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:27.251927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:27.272245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:27.273175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:27.274360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:27.277410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:27.288100 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31a00cb3-5ec7-4928-a4f8-90637d8a2845 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1281 microversion: 2.1 time: 0.394675 Jul 20 11:15:27.291612 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2450/4879] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:26 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1281 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:27.797868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:27.813750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7fa18acf-df19-4650-acc6-92ff7864715d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1692 microversion: 2.1 time: 0.579628 Jul 20 11:15:27.814396 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2430/4880] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:27 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1692 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:27.910483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:27.911727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:27.928016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:27.928685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:27.929499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:27.929942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:28.199195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bc9a7d5-054a-42df-bc1a-c8412a6e572f"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:28.203453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:28.211922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:28.215927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:28.219348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:28.220005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:28.601875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:28.618975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c36ae76f-fe10-4847-847b-6c0fc209bea2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1507 microversion: 2.1 time: 0.721464 Jul 20 11:15:28.640182 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2451/4881] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:27 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1507 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:28.645997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:28.646964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:28.660736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:28.665813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:28.667359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:28.668090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:29.120686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:29.143543 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cf08faa0-6095-4e4b-93f4-b9bb086b4570 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939905 Jul 20 11:15:29.147140 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e9d0d3c-a010-4b49-acda-882a3b7b1e01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1281 microversion: 2.1 time: 0.501693 Jul 20 11:15:29.162849 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2431/4882] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:15:28 2022] POST /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 194 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:15:29.165890 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2452/4883] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:28 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1281 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:29.204019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:29.208411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:29.212453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:29.218461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:29.244062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:29.244530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:29.245326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:29.251886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:29.260155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:29.261352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:29.267055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:29.274326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:29.448610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lazy-loading 'flavor' on Instance uuid 44a2eb47-de84-4d6d-a543-40b203d24fa7 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:15:30.165705 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b704ac01-500a-418d-bade-0ca0b033fd54 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/action" status: 202 len: 0 microversion: 2.20 time: 1.000309 Jul 20 11:15:30.167523 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2432/4884] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 11:15:29 2022] POST /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/action => generated 0 bytes in 1004 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:15:30.184903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:30.186465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:30.201770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:30.203999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:30.208510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:30.212727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:30.513997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:31.181748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:31.190430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f08ed70c-81db-4351-a7f7-464a6150692a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1692 microversion: 2.1 time: 2.020324 Jul 20 11:15:31.203600 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2453/4885] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:29 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1692 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:31.208628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:31.209245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:31.220341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:31.221018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:31.221962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:31.222552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:31.896708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:31.907082 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9ee6abdd-9791-495d-aaa1-27eba46950a1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 200 len: 1450 microversion: 2.1 time: 1.729136 Jul 20 11:15:31.908310 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2433/4886] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:30 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 1450 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:31.925339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:31.926160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:31.948456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:31.955745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:31.963269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:31.970057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:32.060660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:32.621719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:32.630806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:32.632645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:32.634158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0bc54687-4754-477a-aa73-875d8dc6b1eb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 1.429327 Jul 20 11:15:32.635206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2454/4887] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:31 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:32.640112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b0215b2a-bc1c-4fb7-823a-642f3d2f1be9 req-63bb086e-bfed-4661-afcb-c53db608dd51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea087778-3001-43bd-b04a-b068ca889d79", "tag": "bf55c3e9-ebcc-46a2-ad08-326ea16400ca"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:32.649402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b0215b2a-bc1c-4fb7-823a-642f3d2f1be9 req-63bb086e-bfed-4661-afcb-c53db608dd51 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:32.650068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b0215b2a-bc1c-4fb7-823a-642f3d2f1be9 req-63bb086e-bfed-4661-afcb-c53db608dd51 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:32.662199 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b0215b2a-bc1c-4fb7-823a-642f3d2f1be9 req-63bb086e-bfed-4661-afcb-c53db608dd51 service nova] Creating event network-changed:bf55c3e9-ebcc-46a2-ad08-326ea16400ca for instance ea087778-3001-43bd-b04a-b068ca889d79 on n-h2-846219-10 Jul 20 11:15:32.672239 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b0215b2a-bc1c-4fb7-823a-642f3d2f1be9 req-63bb086e-bfed-4661-afcb-c53db608dd51 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035344 Jul 20 11:15:32.673501 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2455/4888] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:32.692162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:32.694216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:32.706692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:32.709165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:32.710426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:32.711407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:33.357724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:33.368688 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6ec5401-43ac-47af-b016-6456708ecfd5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1323 microversion: 2.1 time: 1.458877 Jul 20 11:15:33.369606 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2434/4889] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:31 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1323 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:33.383201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:33.384935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:33.404851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:33.405773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:33.406814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:33.408837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:33.526945 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:33.560976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fc2f042-5ae0-485c-9038-23060033cbd9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.883105 Jul 20 11:15:33.577565 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2456/4890] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:32 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:33.601821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:33.604121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:33.616534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:33.631233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:33.632216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:33.632677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:34.634056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:34.642900 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-18ef0806-e893-430e-b9a6-75d374f5d481 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1692 microversion: 2.1 time: 1.271940 Jul 20 11:15:34.647741 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2435/4891] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:33 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1692 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:34.664982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:34.665944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:34.693007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:34.693475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:34.694279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:34.694730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:34.828019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:34.851399 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31848c7e-d31b-434f-85e5-537c92dab49c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 1.243939 Jul 20 11:15:34.852104 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2457/4892] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:33 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:34.861111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:34.861920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:34.888467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:34.888991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:34.894296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:34.895743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:35.899089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:35.911801 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-533dce4e-4e53-4da5-b703-f73b17036171 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1323 microversion: 2.1 time: 1.057290 Jul 20 11:15:35.922311 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2458/4893] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:34 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1323 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:35.922311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-19de4e4d-b9c5-453b-b436-d209ef600321 req-8d334365-dd16-4bb6-9a6e-06d43a381fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5601956-6ec4-4e3d-a210-ec8e5f44fcf8", "tag": "39593d04-98d0-4b4e-bd29-3668ec0b9c7c"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:35.935719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:35.941252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-19de4e4d-b9c5-453b-b436-d209ef600321 req-8d334365-dd16-4bb6-9a6e-06d43a381fb0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:35.941703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-19de4e4d-b9c5-453b-b436-d209ef600321 req-8d334365-dd16-4bb6-9a6e-06d43a381fb0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:35.951357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:35.956706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:35.959728 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-078c3095-6043-4fcc-99ed-c33dd44a4d50 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 1.307735 Jul 20 11:15:35.963848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2436/4894] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:34 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:35.973219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:35.973891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:35.978205 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-19de4e4d-b9c5-453b-b436-d209ef600321 req-8d334365-dd16-4bb6-9a6e-06d43a381fb0 service nova] Creating event network-changed:39593d04-98d0-4b4e-bd29-3668ec0b9c7c for instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 on n-h2-846219-10 Jul 20 11:15:35.993279 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-19de4e4d-b9c5-453b-b436-d209ef600321 req-8d334365-dd16-4bb6-9a6e-06d43a381fb0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079262 Jul 20 11:15:35.995392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:35.995870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:35.997007 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2459/4895] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:36.001464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.003130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.007344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-6a56dcb0-ea6e-419c-882f-4cc1625e3444 req-fccfbdef-f1e0-4c8b-8e65-e4c0bc9ae4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9892ad5f-bd75-43d1-8d6e-62aa24a50775", "tag": "a14a9179-2fcd-4e25-b1f1-7aa37b9802fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:36.030940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6a56dcb0-ea6e-419c-882f-4cc1625e3444 req-fccfbdef-f1e0-4c8b-8e65-e4c0bc9ae4bf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.033736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-6a56dcb0-ea6e-419c-882f-4cc1625e3444 req-fccfbdef-f1e0-4c8b-8e65-e4c0bc9ae4bf service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.060646 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-6a56dcb0-ea6e-419c-882f-4cc1625e3444 req-fccfbdef-f1e0-4c8b-8e65-e4c0bc9ae4bf service nova] Creating event network-changed:a14a9179-2fcd-4e25-b1f1-7aa37b9802fa for instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 on n-h2-846219-10 Jul 20 11:15:36.067995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-6a56dcb0-ea6e-419c-882f-4cc1625e3444 req-fccfbdef-f1e0-4c8b-8e65-e4c0bc9ae4bf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065965 Jul 20 11:15:36.070016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:36.076453 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2460/4896] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:36.085949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:36.087435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:36.102690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.104048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.105039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.106499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.483941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:36.500741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:36.510665 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-688c39a3-4e45-4332-b705-6c145b28cdf2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.545595 Jul 20 11:15:36.511311 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2437/4897] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:35 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:36.516226 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-035e0082-0a15-4792-8b6e-417c3bda5fd5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1692 microversion: 2.1 time: 0.438109 Jul 20 11:15:36.516957 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2461/4898] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:36 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1692 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:36.531615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:36.532582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:36.541227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ef41b12f-6410-464e-9dfa-7469e8e6fc97 req-1a50aa0f-ad57-46c7-9f32-c8733762eac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea087778-3001-43bd-b04a-b068ca889d79", "name": "network-vif-plugged", "status": "completed", "tag": "bf55c3e9-ebcc-46a2-ad08-326ea16400ca"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:36.545278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.551955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.553133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.553809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.568252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ef41b12f-6410-464e-9dfa-7469e8e6fc97 req-1a50aa0f-ad57-46c7-9f32-c8733762eac2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.572854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ef41b12f-6410-464e-9dfa-7469e8e6fc97 req-1a50aa0f-ad57-46c7-9f32-c8733762eac2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.603532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ef41b12f-6410-464e-9dfa-7469e8e6fc97 req-1a50aa0f-ad57-46c7-9f32-c8733762eac2 service nova] Creating event network-vif-plugged:bf55c3e9-ebcc-46a2-ad08-326ea16400ca for instance ea087778-3001-43bd-b04a-b068ca889d79 on n-h2-846219-10 Jul 20 11:15:36.609923 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ef41b12f-6410-464e-9dfa-7469e8e6fc97 req-1a50aa0f-ad57-46c7-9f32-c8733762eac2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083122 Jul 20 11:15:36.616873 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2438/4899] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:36.872735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:36.883203 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef939b64-5a93-40a2-801a-d427e0319099 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.356025 Jul 20 11:15:36.884575 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2462/4900] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:36 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:36.911791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72b53145-d08f-4e5c-ae50-dd1c7b210526 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:36.921591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72b53145-d08f-4e5c-ae50-dd1c7b210526 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.922617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72b53145-d08f-4e5c-ae50-dd1c7b210526 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.940081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:36.940698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:36.961973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.965491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:36.968878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72b53145-d08f-4e5c-ae50-dd1c7b210526 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Going to try to stop instance {{(pid=125886) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:15:36.973201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:36.981667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:37.077630 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72b53145-d08f-4e5c-ae50-dd1c7b210526 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.178027 Jul 20 11:15:37.080611 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2439/4901] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:15:36 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:15:37.118571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:37.128384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:37.143764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:37.150237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:37.153831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:37.164046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:37.974168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:37.989901 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-adea856b-02d6-4fa7-841e-1814527367f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1323 microversion: 2.1 time: 1.062463 Jul 20 11:15:37.999045 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2463/4902] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:36 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1323 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:37.999449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:38.000139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:38.009127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:38.009591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:38.010447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:38.010892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:38.223948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:38.245777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:38.254363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:38.257990 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a42762a0-0077-4091-8588-12a9e19f18e1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 1.172895 Jul 20 11:15:38.258866 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2440/4903] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:37 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:38.275201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:38.276240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:38.293933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:38.294566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:38.296186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:38.299967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:38.734774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:38.744277 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0d7c4ff-6d94-463f-a7e1-185c4dea9d74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.749873 Jul 20 11:15:38.750137 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2464/4904] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:37 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:38.801265 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:38.817075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e4681ea-3127-420e-9796-6b8102690a8f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.550358 Jul 20 11:15:38.820335 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2441/4905] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:38 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:39.016632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:39.018084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:39.031808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=54 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:39.035461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.036176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.039602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.040395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.051430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:39.282629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:39.283946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:39.300160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.300910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.302163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.302783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.478712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:39.489637 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27e35de2-1eae-47e2-8954-d7ee152d4543 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1323 microversion: 2.1 time: 0.476744 Jul 20 11:15:39.498927 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2465/4906] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:39 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:39.604193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:39.619890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:39.623820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:39.625614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8365da05-66d6-4102-b2b1-f01cf79c3749 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 0.349587 Jul 20 11:15:39.626481 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2442/4907] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:39 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:39.767143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:39.767803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:39.775508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.775962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.776987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.777481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.844107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:39.845159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:39.866696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.869537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:39.871499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:39.876249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:40.233656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:40.249078 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08c1af7d-3903-4261-a8f0-1d7988b52e24 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.486597 Jul 20 11:15:40.264119 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2466/4908] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:39 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:40.289072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:40.301334 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1753a325-8ea4-4a4e-af93-0ab820e08050 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.462285 Jul 20 11:15:40.314885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2443/4909] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:39 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:40.336003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b89e615d-bd8d-4c72-ac61-24ca70022ce2 req-d6fd5510-585d-4619-916b-ae2f77cf44b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5601956-6ec4-4e3d-a210-ec8e5f44fcf8", "name": "network-vif-plugged", "status": "completed", "tag": "39593d04-98d0-4b4e-bd29-3668ec0b9c7c"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:40.354903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b89e615d-bd8d-4c72-ac61-24ca70022ce2 req-d6fd5510-585d-4619-916b-ae2f77cf44b0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:40.357605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b89e615d-bd8d-4c72-ac61-24ca70022ce2 req-d6fd5510-585d-4619-916b-ae2f77cf44b0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:40.383316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b89e615d-bd8d-4c72-ac61-24ca70022ce2 req-d6fd5510-585d-4619-916b-ae2f77cf44b0 service nova] Creating event network-vif-plugged:39593d04-98d0-4b4e-bd29-3668ec0b9c7c for instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 on n-h2-846219-10 Jul 20 11:15:40.392676 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b89e615d-bd8d-4c72-ac61-24ca70022ce2 req-d6fd5510-585d-4619-916b-ae2f77cf44b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064664 Jul 20 11:15:40.394262 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2467/4910] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:40.520544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:40.521305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:40.530116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:40.532640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:40.532640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:40.532640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:40.645549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:40.647027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:40.662544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:40.663406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:40.664905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:40.665917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:40.724295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:40.733287 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11b6d3f7-d82b-42ef-8f7f-0288ce94fe95 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1323 microversion: 2.1 time: 0.218343 Jul 20 11:15:40.734139 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2444/4911] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:40 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:40.878682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:40.890699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:40.891834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:40.893027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a310539-3a26-4e25-8a91-05e690731f6a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 0.251907 Jul 20 11:15:40.893894 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2468/4912] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:40 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:41.270674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:41.271604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:41.296042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.297812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.298888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.300096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.321959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:41.323846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:41.337925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.338642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.343676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.344359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.595851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:41.607909 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d78196e-9c8a-4cf3-a81f-d929a4b9dccc tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.341201 Jul 20 11:15:41.609192 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2445/4913] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:41 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:41.625307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:41.635528 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fce1b4ff-2dcd-4f13-80f9-ae5558ec72d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.317308 Jul 20 11:15:41.646366 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2469/4914] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:41 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:41.754950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:41.755611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:41.774833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.776116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.779317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.780513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.918758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:41.919920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:41.938819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.939319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:41.946781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:41.947278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:42.147603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:42.174748 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad6cda0b-f402-46f7-94f0-ba5167575710 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1323 microversion: 2.1 time: 0.423515 Jul 20 11:15:42.174990 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2446/4915] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:41 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:42.248283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:42.260321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:42.263040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:42.265551 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-138646d1-4695-41cd-b8e6-233a028e4668 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 0.355017 Jul 20 11:15:42.268592 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2470/4916] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:41 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:42.636880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:42.638122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:42.655836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:42.657604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:42.660798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:42.661254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:42.668577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:42.669048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:42.678284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:42.681824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:42.686916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:42.687710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:42.927764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:42.950394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:42.950651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e0ccd9a-47d0-4d8e-8711-a271c6712254 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.324687 Jul 20 11:15:42.953169 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2447/4917] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:42 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:42.964434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13deffac-bf7b-4040-8d1d-025ec4735668 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.312887 Jul 20 11:15:42.978697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2471/4918] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:42 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:43.192072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:43.192855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:43.200879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.201722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.202879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.203580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.287830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:43.288738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:43.295865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.296253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.297024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.297677 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.525523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:43.534898 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-553e832a-57ec-48b1-9cb3-6ba0d2c1229a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 200 len: 1514 microversion: 2.1 time: 0.347281 Jul 20 11:15:43.535614 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2448/4919] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:43 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 1514 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:43.564574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:43.565066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:43.571963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.572596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.573615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.575044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.577292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:43.586742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:43.588769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:43.590950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9e984a79-438c-45d0-af82-ebe385ffe6fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 0.307129 Jul 20 11:15:43.602980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2472/4920] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:43 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:43.799518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:43.807920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1bdf0ea8-5b5e-4f90-9f52-1437169c33f6 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79" status: 200 len: 1514 microversion: 2.1 time: 0.248755 Jul 20 11:15:43.822998 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2449/4921] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:43 2022] GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:43.826642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:43.827260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:43.835426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.836115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.837047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.838132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.969350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:43.969965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:43.978955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.979448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:43.984522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:43.984905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:44.022990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:44.039487 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ab8583f-8db3-4edd-82fd-940d6d002c68 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 200 len: 1323 microversion: 2.1 time: 0.214252 Jul 20 11:15:44.040263 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2473/4922] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:43 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:44.045846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:44.055532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:44.067028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:44.067515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:44.068307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:44.068750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:44.310943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:44.323702 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c457554b-3693-4ff1-8d87-56f09e4ad7bd tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.358779 Jul 20 11:15:44.328373 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2450/4923] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:43 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:44.382773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:44.397942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e2f9125-95ec-4607-922f-2f2dbbe4a222 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.356431 Jul 20 11:15:44.398817 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2474/4924] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:44 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:44.610220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:44.611391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:44.618872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a62e158e-bde5-4357-a1d9-e3638c16fb4e req-afffa4e7-1ed9-4a9d-941e-10aa02f2af7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9892ad5f-bd75-43d1-8d6e-62aa24a50775", "name": "network-vif-plugged", "status": "completed", "tag": "a14a9179-2fcd-4e25-b1f1-7aa37b9802fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:44.626834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:44.627326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:44.628112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:44.628658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:44.635152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a62e158e-bde5-4357-a1d9-e3638c16fb4e req-afffa4e7-1ed9-4a9d-941e-10aa02f2af7b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:44.635956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a62e158e-bde5-4357-a1d9-e3638c16fb4e req-afffa4e7-1ed9-4a9d-941e-10aa02f2af7b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:44.662314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a62e158e-bde5-4357-a1d9-e3638c16fb4e req-afffa4e7-1ed9-4a9d-941e-10aa02f2af7b service nova] Creating event network-vif-plugged:a14a9179-2fcd-4e25-b1f1-7aa37b9802fa for instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 on n-h2-846219-10 Jul 20 11:15:44.677179 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a62e158e-bde5-4357-a1d9-e3638c16fb4e req-afffa4e7-1ed9-4a9d-941e-10aa02f2af7b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065525 Jul 20 11:15:44.677821 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2475/4925] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:45.060279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:45.063495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:45.070576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:45.071038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:45.072035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:45.072746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:45.155789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:45.174537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:45.178598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:45.184414 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8661b146-e880-4b2f-8057-96c4d07f4d0a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 0.579082 Jul 20 11:15:45.199681 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2451/4926] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:44 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:45.310571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:45.318959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b5cf010-c059-4478-89c0-bd74645f2b01 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 200 len: 1323 microversion: 2.1 time: 0.265083 Jul 20 11:15:45.320542 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2476/4927] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:45 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 1323 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:45.342356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:45.344497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:45.347566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:45.353985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:45.354568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:45.355619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:45.356405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:45.417950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:45.418976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:45.429324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:45.430148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:45.431087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:45.431704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:45.588416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:45.597654 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-de7feaac-d06d-4563-b791-05eace72bd26 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.259409 Jul 20 11:15:45.609413 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2452/4928] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:45 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:45.637459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:45.647291 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e0a9966-5641-4606-bc62-a83cf5df965f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.234478 Jul 20 11:15:45.661044 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2477/4929] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:45 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:46.203159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:46.203975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:46.217316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:46.218935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:46.221252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:46.224383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:46.274422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:46.353378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:46.359906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:46.380296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:46.380750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:46.381530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:46.381967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:46.677638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:46.690077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:46.692405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:46.693896 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-519f2892-5f11-4e1c-b844-4d4c537747a5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 0.495717 Jul 20 11:15:46.695075 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2453/4930] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:46 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:46.702127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:46.703034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:46.729059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:46.731352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:46.732749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:46.733734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.431935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:47.479652 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8f79f209-7c78-4fea-ac30-7008aa27ff71 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 200 len: 1514 microversion: 2.1 time: 1.143394 Jul 20 11:15:47.481955 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2478/4931] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:46 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 1514 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:47.487792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:47.488663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:47.496693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.497436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.498676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.499793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.525323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:47.546977 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf2629b7-7417-426c-ac8f-4faa757d80d1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1679 microversion: 2.1 time: 0.850502 Jul 20 11:15:47.549983 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2454/4932] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:46 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1679 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:47.561744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:47.584120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:47.619607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.620286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.624256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.624915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.660862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:15:47.864400 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e4261a3-a6a6-4f5b-9cdf-9676b86f8559 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 204 len: 0 microversion: 2.1 time: 0.311331 Jul 20 11:15:47.868547 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2455/4933] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:15:47 2022] DELETE /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:15:47.877370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:47.883115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:47.894412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.895123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.896282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.896877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.912981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:47.922808 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d6215a1-7517-4aba-a141-25596e115e1e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.439487 Jul 20 11:15:47.923441 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2479/4934] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:47 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:47.932571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:47.934017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:47.940806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.941689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.942552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:47.942997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:47.978712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lazy-loading 'flavor' on Instance uuid 6f25e0a0-6ca1-4371-aa81-988613b56eb3 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:15:48.172522 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-66f8f8ce-2bc1-44cc-9fdc-1e8400cee20f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/action" status: 200 len: 32 microversion: 2.1 time: 0.247777 Jul 20 11:15:48.173125 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2480/4935] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:15:47 2022] POST /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:15:48.188018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:48.188738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:48.200270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.200765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.201564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.202006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.208073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:48.239347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:48.252807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:48.256621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:48.260073 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a515ebb-e81a-46ea-b62b-db1e02dc72d1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1742 microversion: 2.20 time: 0.387325 Jul 20 11:15:48.260661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2456/4936] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:47 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1742 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:48.275656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:48.277256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:48.292880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.293935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.294989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.295678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.704267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:48.720816 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-030d3f95-7e52-4c5e-b2fd-29ed418e29c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 200 len: 1520 microversion: 2.1 time: 0.544835 Jul 20 11:15:48.722319 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2481/4937] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:48 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:48.727232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:48.727807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:48.735342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.735797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.736573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.737252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.750190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:48.770847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-881a098f-07f0-42bb-9fab-cbba805e53d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.509037 Jul 20 11:15:48.771477 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2457/4938] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:48 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:48.940221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:48.941211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:48.951704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.954189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:48.965918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:48.966767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.114402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:49.130368 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3224d73-cbd6-4b26-b124-1206ba958296 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1656 microversion: 2.1 time: 0.406828 Jul 20 11:15:49.131590 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2482/4939] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:48 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1656 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:49.149077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7bcf5dff-802d-4064-acd2-9d4773bcccb1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:49.177960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7bcf5dff-802d-4064-acd2-9d4773bcccb1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.178653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7bcf5dff-802d-4064-acd2-9d4773bcccb1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.217213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7bcf5dff-802d-4064-acd2-9d4773bcccb1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Going to try to start instance {{(pid=125885) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 11:15:49.280783 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7bcf5dff-802d-4064-acd2-9d4773bcccb1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.135464 Jul 20 11:15:49.286222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2483/4940] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:15:49 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:15:49.295751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:49.297645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:49.309905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.310153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.314938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.315436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.332503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:49.347689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0c5b5a2d-5be7-41c5-a5c4-f5671434c9d8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.411535 Jul 20 11:15:49.348506 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2458/4941] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:48 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:15:49.353509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:49.354159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:49.363222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.363688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.364479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.364914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.762941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:49.773105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:49.775128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:49.776619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-067e1bf4-5282-4ba2-b64b-fc9ddaf5c434 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1742 microversion: 2.20 time: 0.487941 Jul 20 11:15:49.777951 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2484/4942] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:49 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1742 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:49.787639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:49.788668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:49.801979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.802726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.803791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.804428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.912489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:49.925370 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ed1c1031-aa29-44b8-969d-fba689dde234 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1665 microversion: 2.1 time: 0.575493 Jul 20 11:15:49.937935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2459/4943] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:49 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1665 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:49.945152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:49.946677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:49.956484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.957385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:49.959128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:49.959806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:50.610962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:50.625529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9afa9a73-3bae-4b04-a69b-b02b47a5f81a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 200 len: 1520 microversion: 2.1 time: 0.841760 Jul 20 11:15:50.636899 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2485/4944] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:49 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 1520 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:50.641836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:50.642775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:50.652581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:50.660129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:50.661728 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:50.662324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:51.142402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:51.153192 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f260ade5-9186-462e-a9ba-00d00f6e40d6 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 1.213790 Jul 20 11:15:51.153892 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2460/4945] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:49 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:51.172208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c73209a2-3c2e-402b-b59c-ab4a1901bfb3 req-b402ce31-3485-4f07-9fbb-9aa0c584d7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "name": "network-vif-plugged", "status": "completed", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:51.202563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c73209a2-3c2e-402b-b59c-ab4a1901bfb3 req-b402ce31-3485-4f07-9fbb-9aa0c584d7b1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:51.207496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c73209a2-3c2e-402b-b59c-ab4a1901bfb3 req-b402ce31-3485-4f07-9fbb-9aa0c584d7b1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:51.247778 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c73209a2-3c2e-402b-b59c-ab4a1901bfb3 req-b402ce31-3485-4f07-9fbb-9aa0c584d7b1 service nova] Creating event network-vif-plugged:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:15:51.273447 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c73209a2-3c2e-402b-b59c-ab4a1901bfb3 req-b402ce31-3485-4f07-9fbb-9aa0c584d7b1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112479 Jul 20 11:15:51.282391 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2461/4946] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:51.299279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:51.300021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:51.337957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:51.340005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:51.341095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:51.341554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:51.882098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:51.895524 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d568aa7c-d79d-41c9-ae28-f628b7c47115 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 1.254008 Jul 20 11:15:51.897059 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2486/4947] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:50 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:51.935380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:51.938142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:51.975635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:51.976130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:51.977851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:51.978323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:53.126560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:53.153045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:53.216409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:53.218944 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-42b6b35c-1bb1-4884-b2a5-652969376224 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 1.935125 Jul 20 11:15:53.227104 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2462/4948] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:51 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:53.268024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:53.289044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:53.314475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:53.314931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:53.315766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:53.316214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:53.936958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:53.957110 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ebf0dce-ce44-4e4c-b021-7c6fd0dd0ae4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1665 microversion: 2.1 time: 2.055907 Jul 20 11:15:53.961427 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2487/4949] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:51 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1665 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:53.972962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:53.975412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:53.992081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:54.008592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:54.011462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:54.016021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:54.241698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:54.256845 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9ae2de9-e2ab-4417-8975-e98937304203 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 200 len: 1520 microversion: 2.1 time: 1.028188 Jul 20 11:15:54.269791 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2463/4950] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:53 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 1520 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:54.275623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:54.276253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:54.297986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:54.298590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:54.299411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:54.309193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:54.894922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:54.912195 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-42c6b956-e3c4-4ce0-86fb-397f5f27a1cf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.945710 Jul 20 11:15:54.914722 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2488/4951] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:53 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:54.946403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-18debf41-d147-42d7-82df-50aefe3dcc26 req-49329cfd-557b-4631-b4d3-37ce77bebda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9892ad5f-bd75-43d1-8d6e-62aa24a50775", "name": "network-vif-unplugged", "status": "completed", "tag": "a14a9179-2fcd-4e25-b1f1-7aa37b9802fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:54.973539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:54.982817 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d740308c-cab6-46e7-a1ee-46432ce419b3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.711780 Jul 20 11:15:54.983458 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2464/4952] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:54 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:54.992926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-18debf41-d147-42d7-82df-50aefe3dcc26 req-49329cfd-557b-4631-b4d3-37ce77bebda7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:54.992926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-18debf41-d147-42d7-82df-50aefe3dcc26 req-49329cfd-557b-4631-b4d3-37ce77bebda7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.022270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-18debf41-d147-42d7-82df-50aefe3dcc26 req-49329cfd-557b-4631-b4d3-37ce77bebda7 service nova] Creating event network-vif-unplugged:a14a9179-2fcd-4e25-b1f1-7aa37b9802fa for instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 on n-h2-846219-10 Jul 20 11:15:55.024803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:55.025430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:55.033657 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-18debf41-d147-42d7-82df-50aefe3dcc26 req-49329cfd-557b-4631-b4d3-37ce77bebda7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113777 Jul 20 11:15:55.035483 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2489/4953] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:55.052062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bcefe8f0-6568-44ff-ab43-831c1a0238c9 req-a8c60f8f-8daf-4689-bb2b-1d3525448041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9892ad5f-bd75-43d1-8d6e-62aa24a50775", "name": "network-vif-deleted", "tag": "a14a9179-2fcd-4e25-b1f1-7aa37b9802fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:15:55.062906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.068408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.069223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.069767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.071309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bcefe8f0-6568-44ff-ab43-831c1a0238c9 req-a8c60f8f-8daf-4689-bb2b-1d3525448041 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.075539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bcefe8f0-6568-44ff-ab43-831c1a0238c9 req-a8c60f8f-8daf-4689-bb2b-1d3525448041 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.108145 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bcefe8f0-6568-44ff-ab43-831c1a0238c9 req-a8c60f8f-8daf-4689-bb2b-1d3525448041 service nova] Creating event network-vif-deleted:a14a9179-2fcd-4e25-b1f1-7aa37b9802fa for instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 on n-h2-846219-10 Jul 20 11:15:55.122622 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bcefe8f0-6568-44ff-ab43-831c1a0238c9 req-a8c60f8f-8daf-4689-bb2b-1d3525448041 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085672 Jul 20 11:15:55.126531 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2490/4954] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:55.132913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:55.135674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:55.180432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.182347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.185277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.185608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.490785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:55.506190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:55.508510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:55.511914 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-abda0d7b-a615-47b4-b016-7bc5d76939d7 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.497734 Jul 20 11:15:55.535852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2465/4955] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:55 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:55.554638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:55.555887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:55.571226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.574766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.577796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.580034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.604136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] HTTP exception thrown: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 HTTP/1.1 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9892ad5f-bd75-43d1-8d6e-62aa24a50775'} Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:55.610140 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:15:55.616910 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:55.619029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 404 to user: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:15:55.620826 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eea9b84e-995d-4834-9be7-9acb3cc0d7c9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 404 len: 111 microversion: 2.1 time: 0.082487 Jul 20 11:15:55.621895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:55.622353 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2466/4956] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:55 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:15:55.635077 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d736512f-c203-4558-912f-5017a5c5ae56 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1665 microversion: 2.1 time: 0.506243 Jul 20 11:15:55.635724 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2491/4957] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:55 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1665 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:55.658133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:55.674647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:55.675950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:55.695871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.696344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.700434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.701069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.935544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:55.936439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:55.957422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.962152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:55.966178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:55.968845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.009614 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2882a4f-6551-4eda-beb0-0d0dd94f1bc5 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.379666 Jul 20 11:15:56.018717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2467/4958] 10.222.0.79 () {58 vars in 1229 bytes} [Wed Jul 20 11:15:55 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:15:56.029564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:56.035064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:56.053644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.056415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.059936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.060524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.467458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:56.482995 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0d767c2-2c25-4cae-9681-350a28c540da tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.556658 Jul 20 11:15:56.486294 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2492/4959] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:55 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:56.500237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b5f9b67-9891-4572-8a4d-3883a6ee2eb1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b5f9b67-9891-4572-8a4d-3883a6ee2eb1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: action_args: {} Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 11:15:56.512128 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:15:56.516560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b5f9b67-9891-4572-8a4d-3883a6ee2eb1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:15:56.518044 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b5f9b67-9891-4572-8a4d-3883a6ee2eb1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.029712 Jul 20 11:15:56.518446 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2493/4960] 10.222.0.79 () {58 vars in 1181 bytes} [Wed Jul 20 11:15:56 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:15:56.536433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:56.555844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:56.556632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:56.601759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.602240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.603048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.603533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.614273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:56.625663 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e68308ed-0c9f-41db-a1ed-dc730353fb7b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.605707 Jul 20 11:15:56.635570 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2468/4961] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:56 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:56.645273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:56.645894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:56.663263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.666885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.668385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.669129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.693499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:15:56.775030 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-852bdd27-b41e-4981-b164-25d1863e7275 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.248738 Jul 20 11:15:56.791721 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2494/4962] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 11:15:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:56.809474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:56.810898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:56.820775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.821693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:56.822658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:56.823285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.113150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.127954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.135204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.137576 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-da59b189-d2c9-48fb-9645-6bad1d068f13 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.500063 Jul 20 11:15:57.150399 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2469/4963] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:56 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:57.164932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.176631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.180568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.servers [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Removing options 'limit' from query {{(pid=125886) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 20 11:15:57.184719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:57.196354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.200195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.201786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.202998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.271808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:57.281107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.289990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:15:57.291804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-39e607cc-765b-4809-b338-a6daf61b3de0 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.495672 Jul 20 11:15:57.298184 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2495/4964] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:56 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:57.314794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.315514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:57.391101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.395706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.397983 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-72c6c7df-e614-45f1-8696-ec73f8f3cf1e tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.246164 Jul 20 11:15:57.398605 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2470/4965] 10.222.0.79 () {58 vars in 1143 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:15:57.399263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.399901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.425449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-790019dc-e2da-419f-8cc0-ff2beb1ba810 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-790019dc-e2da-419f-8cc0-ff2beb1ba810 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: action_args: {} Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi '-1' Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 11:15:57.428528 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 20 11:15:57.433672 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.435768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-790019dc-e2da-419f-8cc0-ff2beb1ba810 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:15:57.436796 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-790019dc-e2da-419f-8cc0-ff2beb1ba810 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.015501 Jul 20 11:15:57.439536 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2471/4966] 10.222.0.79 () {58 vars in 1141 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:15:57.449120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e8acee0-53ed-4f83-a992-4c9dfa738ad9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e8acee0-53ed-4f83-a992-4c9dfa738ad9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: action_args: {} Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi 'testing' Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 20 11:15:57.451779 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e8acee0-53ed-4f83-a992-4c9dfa738ad9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:15:57.457852 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4e8acee0-53ed-4f83-a992-4c9dfa738ad9 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.008746 Jul 20 11:15:57.460993 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2472/4967] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:15:57.478958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b441259f-ae9c-4828-ae8e-7f87cbd825f1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.489578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b441259f-ae9c-4828-ae8e-7f87cbd825f1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.497136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b441259f-ae9c-4828-ae8e-7f87cbd825f1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:57.525787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.servers [None req-b441259f-ae9c-4828-ae8e-7f87cbd825f1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Flavor 'non_existing_flavor' could not be found {{(pid=125886) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 20 11:15:57.528505 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b441259f-ae9c-4828-ae8e-7f87cbd825f1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061723 Jul 20 11:15:57.537137 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2473/4968] 10.222.0.79 () {58 vars in 1177 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:15:57.554937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.556103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:57.583732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.584378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.585349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.585948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.783505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.802949 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cb5812b1-8743-4a77-94f3-4c6b26e98d04 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.492054 Jul 20 11:15:57.819712 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2496/4969] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:57.829227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:57.834754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:57.835977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:57.845441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.846175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:57.847645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:57.848251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.038301 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-895e4e87-aa7f-476e-9710-0f42e317f9d2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.216294 Jul 20 11:15:58.048482 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2497/4970] 10.222.0.79 () {58 vars in 1173 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:15:58.059389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:58.062687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:58.071669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.072117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.074930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.074930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.085836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:58.120160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68f654ec-48c3-4fea-aa41-bd307c757eab tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.581039 Jul 20 11:15:58.120865 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2474/4971] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:57 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:58.138314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:58.138942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:58.178448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.179154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.187214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.187937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.468608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:58.483628 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2167d9e-4c6e-48ad-8023-a145c538ed8f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.361418 Jul 20 11:15:58.485108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2475/4972] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:58 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:58.496082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:58.507384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:58.515274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:58.530722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.532033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.533223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.533890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.542560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:58.588375 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3fc03d7b-7b55-40bc-b589-daf3778d3336 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.540742 Jul 20 11:15:58.588978 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2498/4973] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:58 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:58.607792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:58.611119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:58.624587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.625301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.626222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.626798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.668444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:15:58.777146 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7a6b8785-67ac-42c2-a857-11b62be8858a tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.281067 Jul 20 11:15:58.789023 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2476/4974] 10.222.0.79 () {58 vars in 1183 bytes} [Wed Jul 20 11:15:58 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:15:58.799061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:58.800186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:58.818793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.821571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:58.822569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:58.823228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.014291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.030903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.033970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.040788 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-49b02bc5-2424-42b4-b940-2b0ee9f03e47 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.447302 Jul 20 11:15:59.057504 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2499/4975] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:15:58 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:15:59.073332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:59.081982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.085532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125885) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:15:59.103384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.103666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.104537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.105016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.138062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.146782 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7606f911-1e6c-4cd6-9662-a4b54480e8e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.356261 Jul 20 11:15:59.158843 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2477/4976] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:58 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:59.166405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:59.167872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:59.176286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.177051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.178135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.178782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.240760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.multi_cell_list [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125885) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:15:59.431751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.440103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.440386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.451023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:15:59.465307 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f8cabeaf-e608-4b06-b563-8bb0a912e685 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.302985 Jul 20 11:15:59.476951 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2478/4977] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:59 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:59.489318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:59.490261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:15:59.498413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.499323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.500404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:15:59.501073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:15:59.971361 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0eabbbd-b153-46e4-a764-35b9c0e92cf2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.909959 Jul 20 11:15:59.983273 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2500/4978] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 11:15:59 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:15:59.983273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:15:59.983273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:00.013353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.013828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.027498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.028242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.115989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.150676 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe046d10-e527-484e-a5b9-305bab55fd7c tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.671928 Jul 20 11:16:00.156636 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2479/4979] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:59 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:00.181508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5f51194e-cc47-4261-8a05-fbc29902e3f8 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:00.190597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5f51194e-cc47-4261-8a05-fbc29902e3f8 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.195785 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5f51194e-cc47-4261-8a05-fbc29902e3f8 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.033298 Jul 20 11:16:00.199822 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2480/4980] 10.222.0.79 () {58 vars in 1177 bytes} [Wed Jul 20 11:16:00 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:16:00.229504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:00.232944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:00.252266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.257894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.259007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.264414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.572050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.584966 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad52061b-985a-4679-9b9f-6e59d6a7c29e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1697 microversion: 2.1 time: 0.611467 Jul 20 11:16:00.600042 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2501/4981] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:15:59 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1697 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:00.606358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:00.607286 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:00.614553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.615439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.616378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.616970 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.641888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.652673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.655955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lazy-loading 'flavor' on Instance uuid fd01dea7-6154-40bc-92c8-c4534543d8b0 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:16:00.663620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.665520 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-883a09a9-42e0-4127-9c47-3f444eca7d02 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.464442 Jul 20 11:16:00.677851 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2481/4982] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:00 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:00.683133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:00.687379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:00.699815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Searching by: {'deleted': False, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8'} {{(pid=125886) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 11:16:00.706074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.706808 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.707987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.708659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.773024 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ccba2c2a-31bc-4a80-9a94-a1a28d83c130 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.171263 Jul 20 11:16:00.775220 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2502/4983] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:16:00 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:16:00.777560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.multi_cell_list [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125886) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 11:16:00.786789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:00.787544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:00.809559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.810021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.810842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.811428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.860139 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-895928e6-420e-4969-9a1c-3d29d22dfb52 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.178113 Jul 20 11:16:00.869108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2482/4984] 10.222.0.79 () {58 vars in 1124 bytes} [Wed Jul 20 11:16:00 2022] GET /compute/v2.1/servers => generated 683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:00.875027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:00.875927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:00.882812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.883541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:00.884553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:00.885891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.146695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:01.157698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3d78ece0-8a32-4671-ad7d-15d6cf2c631c tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.381048 Jul 20 11:16:01.172162 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2503/4985] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:00 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:01.185239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:01.186999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:01.206363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.207101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.210739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.211249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.241010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:01.243523 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] HTTP exception thrown: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 HTTP/1.1 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9892ad5f-bd75-43d1-8d6e-62aa24a50775'} Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:01.245318 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 404 to user: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:01.249433 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bcadc527-e626-458d-a3d8-a1adcd396cd1 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 404 len: 111 microversion: 2.1 time: 0.073693 Jul 20 11:16:01.250959 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2504/4986] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:01 2022] DELETE /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:01.256405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:01.257090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:01.264464 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b0808116-4449-4879-a942-b505aa8f1457 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1677 microversion: 2.1 time: 0.393558 Jul 20 11:16:01.273866 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2483/4987] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:00 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1677 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:01.274177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.274698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.286018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.286333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.372913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:01.607027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:01.608114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:01.609011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-88347c30-85be-4e67-acb2-e032d538d3c7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79" status: 204 len: 0 microversion: 2.1 time: 0.349117 Jul 20 11:16:01.609768 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2505/4988] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:01 2022] DELETE /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:01.626694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.627826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.629269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.630695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.636024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:01.642141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:01.673459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.677027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.681056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.684429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.804648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:01.946558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f7dca48-bfb9-49b2-abbf-1d700ad9e9b2 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 204 len: 0 microversion: 2.1 time: 0.329709 Jul 20 11:16:01.950503 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2506/4989] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:01 2022] DELETE /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:01.958986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:01.960061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:01.971203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.973474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:01.976647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:01.977578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.058668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:02.075200 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4ef26a1c-2ba0-4852-9932-ce9ff12668db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1696 microversion: 2.1 time: 0.473813 Jul 20 11:16:02.085344 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2484/4990] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:01 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1696 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:02.092455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:02.093349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: 9892ad5f-bd75-43d1-8d6e-62aa24a50775] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:02.104130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.107650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.108971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.109739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.135037 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] HTTP exception thrown: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 HTTP/1.1 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9892ad5f-bd75-43d1-8d6e-62aa24a50775'} Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:02.137688 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:02.141971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 404 to user: Instance 9892ad5f-bd75-43d1-8d6e-62aa24a50775 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:02.143487 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-389da512-43a8-4db7-89ad-c8de410acde0 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775" status: 404 len: 111 microversion: 2.1 time: 0.056649 Jul 20 11:16:02.144476 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2485/4991] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:02 2022] GET /compute/v2.1/servers/9892ad5f-bd75-43d1-8d6e-62aa24a50775 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:02.150643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d1a95788-e67b-4d6d-a9dd-a1d3cbbc8d5f req-49298b43-5bd2-4897-8745-f857feb1c679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "name": "network-vif-unplugged", "status": "completed", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:02.187374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d1a95788-e67b-4d6d-a9dd-a1d3cbbc8d5f req-49298b43-5bd2-4897-8745-f857feb1c679 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.188148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d1a95788-e67b-4d6d-a9dd-a1d3cbbc8d5f req-49298b43-5bd2-4897-8745-f857feb1c679 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.202616 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d1a95788-e67b-4d6d-a9dd-a1d3cbbc8d5f req-49298b43-5bd2-4897-8745-f857feb1c679 service nova] Creating event network-vif-unplugged:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h1-846219-10 Jul 20 11:16:02.209542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-d1a95788-e67b-4d6d-a9dd-a1d3cbbc8d5f req-49298b43-5bd2-4897-8745-f857feb1c679 service nova] Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:16:02.223599 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d1a95788-e67b-4d6d-a9dd-a1d3cbbc8d5f req-49298b43-5bd2-4897-8745-f857feb1c679 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076600 Jul 20 11:16:02.225304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2486/4992] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:02.230702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:02.231754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:02.239090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.239931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.240947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.241626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.741690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:02.760563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:02.773298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:02.774730 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e3a563a5-327b-4e85-8d66-addd309f0ba2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.822591 Jul 20 11:16:02.777466 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2507/4993] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:01 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:02.791039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:02.791706 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:02.832561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.833304 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.838720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:02.839459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:02.945536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:02.957941 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7b7bd1ee-f2d8-4240-be56-42d96104dda7 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79" status: 200 len: 1520 microversion: 2.1 time: 0.731166 Jul 20 11:16:02.970864 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2487/4994] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:02 2022] GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 => generated 1520 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:02.981880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:02.991280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:03.021019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.021468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.024680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.025101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.365298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:03.381652 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7db01f52-c7b5-4af7-a4dc-b567352288cd tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.603018 Jul 20 11:16:03.387780 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2508/4995] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:02 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:03.398445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:03.401041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:03.416388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:03.421319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.423468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.425952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.426575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.464539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:03.478231 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-775a6e4e-55d8-4f1a-9335-8ce0ceb46b44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1660 microversion: 2.1 time: 0.504330 Jul 20 11:16:03.481265 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2488/4996] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:02 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1660 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:03.506502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:03.507421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:03.520492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.521440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.522497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.531293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.790410 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-517370a6-df2d-4bfa-a1b3-f4442f2af340 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action" status: 202 len: 0 microversion: 2.1 time: 0.288270 Jul 20 11:16:03.793437 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2489/4997] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:16:03 2022] POST /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:16:03.793911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:03.805245 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-74cb83e8-03c8-4882-b406-d5cc58335c7e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1696 microversion: 2.1 time: 0.416090 Jul 20 11:16:03.812631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:03.821045 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2509/4998] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:03 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1696 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:03.823977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:03.834179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:03.834584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.836806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:03.837410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.838594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.839759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.856769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.857493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:03.858448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:03.859887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:04.157176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:04.170377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:04.175408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:04.182598 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b51a1c60-7792-42fb-bca9-458a6d4d26f6 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.386884 Jul 20 11:16:04.184954 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2490/4999] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:03 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:04.197174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:04.199908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:04.218049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:04.219042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:04.220322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:04.224111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:04.247249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:04.441799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:04.450968 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-02b3f7c9-23ee-498d-b609-4c1752ea4dce tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1666 microversion: 2.1 time: 0.628450 Jul 20 11:16:04.458710 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2510/5000] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:03 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1666 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:04.480874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-26a959df-b56c-49c0-9dd6-bb72a2a9ab64 req-6da16d19-6279-470b-9693-ad58459d3a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:04.499814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-26a959df-b56c-49c0-9dd6-bb72a2a9ab64 req-6da16d19-6279-470b-9693-ad58459d3a00 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:04.500630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-26a959df-b56c-49c0-9dd6-bb72a2a9ab64 req-6da16d19-6279-470b-9693-ad58459d3a00 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:04.529678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:04.532856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-26a959df-b56c-49c0-9dd6-bb72a2a9ab64 req-6da16d19-6279-470b-9693-ad58459d3a00 service nova] Creating event network-changed:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h1-846219-10 Jul 20 11:16:04.548225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-26a959df-b56c-49c0-9dd6-bb72a2a9ab64 req-6da16d19-6279-470b-9693-ad58459d3a00 service nova] Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:16:04.581011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-26a959df-b56c-49c0-9dd6-bb72a2a9ab64 req-6da16d19-6279-470b-9693-ad58459d3a00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116971 Jul 20 11:16:04.590784 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2511/5001] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:04.596565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:04.598214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:04.610489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:04.618778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:04.619871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:04.620627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:06.697853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:06.732117 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6c0414ad-11ee-4c5b-bf08-a2cd74bb8181 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79" status: 200 len: 1520 microversion: 2.1 time: 2.539432 Jul 20 11:16:06.733061 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2491/5002] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:04 2022] GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 => generated 1520 bytes in 2547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:06.737967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:06.744242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:06.762078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:06.763738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:06.768994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:06.769657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:06.927704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:06.943017 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-60bd1f80-51f9-4dec-a992-98d830628234 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 2.350530 Jul 20 11:16:06.943994 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2512/5003] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:04 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 2352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:06.952440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:06.953061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:06.974608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:06.975413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:06.976457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:06.977059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:07.397525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:07.445512 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19a50abd-8dc1-40d4-a4b4-5a25cfed86a0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1696 microversion: 2.1 time: 0.707716 Jul 20 11:16:07.449157 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2492/5004] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:06 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1696 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:07.461414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:07.476652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:07.506441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:07.507573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:07.509346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:07.510118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:08.133573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:08.147490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:08.149054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:08.150275 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-090121ac-8ef8-492a-be54-12d022cefaa1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 1.205219 Jul 20 11:16:08.174210 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2513/5005] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:06 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:08.186601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:08.187553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:08.207542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:08.208287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:08.209246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:08.209847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:08.598128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94736b6355ea4bec996516644e9acd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8a1ad24f34c789b67415a6bf14ce8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:08.616066 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c72bb370-b5d3-4dfe-9b8b-dce9568aa838 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79" status: 200 len: 1478 microversion: 2.1 time: 0.435435 Jul 20 11:16:08.620655 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2514/5006] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:08 2022] GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 => generated 1478 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:08.634371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:08.639740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:08.697188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:08.697585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:08.707505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:08.708083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:08.782026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:08.798098 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ea7bca71-1d02-4349-9e7a-30352b2801b1 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1666 microversion: 2.1 time: 1.347122 Jul 20 11:16:08.800237 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2493/5007] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:07 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1666 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:08.818956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:08.839595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:08.862543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:08.863001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:08.863819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:08.864260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:09.152810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:09.348486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:09.376559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d4a64d1b-b09b-4d94-8ef6-d20f5fac36bf tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.754481 Jul 20 11:16:09.384389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2515/5008] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:08 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:09.393350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1a3d5302-e636-40f5-be5a-1c9a4f5d7a8a req-690c62e0-c680-4830-8097-87447bb9aff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea087778-3001-43bd-b04a-b068ca889d79", "name": "network-vif-deleted", "tag": "bf55c3e9-ebcc-46a2-ad08-326ea16400ca"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:09.415231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1a3d5302-e636-40f5-be5a-1c9a4f5d7a8a req-690c62e0-c680-4830-8097-87447bb9aff5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:09.416758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1a3d5302-e636-40f5-be5a-1c9a4f5d7a8a req-690c62e0-c680-4830-8097-87447bb9aff5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:09.442567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:09.444919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1a3d5302-e636-40f5-be5a-1c9a4f5d7a8a req-690c62e0-c680-4830-8097-87447bb9aff5 service nova] Creating event network-vif-deleted:bf55c3e9-ebcc-46a2-ad08-326ea16400ca for instance ea087778-3001-43bd-b04a-b068ca889d79 on n-h2-846219-10 Jul 20 11:16:09.470489 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1a3d5302-e636-40f5-be5a-1c9a4f5d7a8a req-690c62e0-c680-4830-8097-87447bb9aff5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070880 Jul 20 11:16:09.471198 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2516/5009] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:09.482396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:09.483104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:09.512297 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:09.512820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:09.513617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:09.514063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.345200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:10.372865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:10.381602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:10.383125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:10.384519 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27236749-ba4d-4955-a775-1b5dfd73dc8a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.907787 Jul 20 11:16:10.385106 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2517/5010] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:09 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:10.398828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c3cdd36-b330-409b-9137-a647b09dfd97 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1694 microversion: 2.1 time: 1.587699 Jul 20 11:16:10.403425 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2494/5011] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:08 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1694 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:10.419539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:10.420154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: ea087778-3001-43bd-b04a-b068ca889d79] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:10.431702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:10.432707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:10.453007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:10.453472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.454320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:10.454757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.461933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:10.462461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.463559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:10.464552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.559238 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] HTTP exception thrown: Instance ea087778-3001-43bd-b04a-b068ca889d79 could not be found. Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 HTTP/1.1 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance ea087778-3001-43bd-b04a-b068ca889d79 could not be found. Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'ea087778-3001-43bd-b04a-b068ca889d79'} Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea087778-3001-43bd-b04a-b068ca889d79 could not be found. Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea087778-3001-43bd-b04a-b068ca889d79 could not be found. Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:10.561121 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea087778-3001-43bd-b04a-b068ca889d79 could not be found. Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 404 to user: Instance ea087778-3001-43bd-b04a-b068ca889d79 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f398053b-8c14-40ae-b59a-a4f7b0d7d816 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79" status: 404 len: 111 microversion: 2.1 time: 0.175854 Jul 20 11:16:10.565452 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2518/5012] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:10 2022] GET /compute/v2.1/servers/ea087778-3001-43bd-b04a-b068ca889d79 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:10.568603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:10.570052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:10.582143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:10.582520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.587868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:10.588405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:10.740591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:11.001534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:11.022622 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5a249016-5ebd-4b23-bc0e-c203ef1e5ec8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1666 microversion: 2.1 time: 0.614459 Jul 20 11:16:11.025409 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2495/5013] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:10 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1666 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:11.044695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:11.046654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] [instance: d5601956-6ec4-4e3d-a210-ec8e5f44fcf8] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:11.071452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:11.083935 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:11.085292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:11.086279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:11.087760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:11.113366 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-14c36316-f500-44ee-8318-d867abe56cd5 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.549112 Jul 20 11:16:11.126317 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2519/5014] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:10 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:11.147776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] HTTP exception thrown: Instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 could not be found. Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Request method failure captured: Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 HTTP/1.1 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-PF_lPtvKVx9H1wcrD7FsGr2nxggIDrgaUgu_ImJJY8wnM8l9xjwBjO0KotlOo8-YsNIBdk5vfO4w5LV8xNxvHCq_NvipKfjvq9Q9DW4KszUh3YJqx0ci4dPSx5rSZ8LM8mVx9FpfQj2dBOpZYuHLj9SYRrKY62v9MewkMQzyCT1Vw Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9ed8a1ad24f34c789b67415a6bf14ce8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9ed8a1ad24f34c789b67415a6bf14ce8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 9ed8a1ad24f34c789b67415a6bf14ce8 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-162799953 Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 94736b6355ea4bec996516644e9acd2b Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ListServersNegativeTestJSON-162799953-project Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 could not be found. Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'd5601956-6ec4-4e3d-a210-ec8e5f44fcf8'} Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 could not be found. Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 could not be found. Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:11.155523 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 could not be found. Jul 20 11:16:11.159961 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:11.168456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] Returning 404 to user: Instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:11.173295 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74c9b436-9651-4ba3-aa11-acee2bee5e40 tempest-ListServersNegativeTestJSON-162799953 tempest-ListServersNegativeTestJSON-162799953-project] 10.222.0.79 "GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8" status: 404 len: 111 microversion: 2.1 time: 0.143726 Jul 20 11:16:11.176906 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2496/5015] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:11 2022] GET /compute/v2.1/servers/d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:11.408143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:11.409584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:11.418827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:11.419837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:11.426475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:11.428030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:11.434156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:11.435372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:11.437148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:11.437324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:11.443055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:11.450933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:12.246973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:12.258158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:12.270701 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05d37a96-4493-4d80-b4c4-0846ee78c770 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1691 microversion: 2.1 time: 0.855496 Jul 20 11:16:12.286437 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2497/5016] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:11 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1691 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:12.289252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:12.291086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:12.293064 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6a3f203-7aa2-4de6-a1a7-a6e9e2e90ef5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.890171 Jul 20 11:16:12.295577 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2520/5017] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:11 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:12.303308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7431c35b-d144-4237-b200-3e923c5d228d req-7b607abf-d0af-4330-b3b3-a0b5fb427ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5601956-6ec4-4e3d-a210-ec8e5f44fcf8", "name": "network-vif-deleted", "tag": "39593d04-98d0-4b4e-bd29-3668ec0b9c7c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:12.310423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:12.311047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:12.322269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:12.327664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:12.328164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7431c35b-d144-4237-b200-3e923c5d228d req-7b607abf-d0af-4330-b3b3-a0b5fb427ce1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:12.328543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:12.328656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7431c35b-d144-4237-b200-3e923c5d228d req-7b607abf-d0af-4330-b3b3-a0b5fb427ce1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:12.329018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:12.381667 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7431c35b-d144-4237-b200-3e923c5d228d req-7b607abf-d0af-4330-b3b3-a0b5fb427ce1 service nova] Creating event network-vif-deleted:39593d04-98d0-4b4e-bd29-3668ec0b9c7c for instance d5601956-6ec4-4e3d-a210-ec8e5f44fcf8 on n-h2-846219-10 Jul 20 11:16:12.399651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7431c35b-d144-4237-b200-3e923c5d228d req-7b607abf-d0af-4330-b3b3-a0b5fb427ce1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111733 Jul 20 11:16:12.400309 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2498/5018] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:12.416813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:12.418008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:12.433742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:12.440129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:12.441201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:12.441754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.034884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:13.051723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:13.056932 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3c1ae91b-0cf7-4394-a13c-6abf228f3032 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.654914 Jul 20 11:16:13.066607 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2499/5019] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:12 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:13.066607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:13.076129 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b0df102-6604-481f-aaa5-38b664ce6d83 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.778770 Jul 20 11:16:13.077377 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2521/5020] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:12 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:13.091121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:13.095399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:13.098472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:13.102574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.105217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.106245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.106924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.114863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.116710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.117536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.117998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.286787 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e8384e0a-ef80-4e6a-8ff2-0664036c2ee8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action" status: 204 len: 0 microversion: 2.1 time: 0.226035 Jul 20 11:16:13.294370 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2500/5021] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:16:13 2022] POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:13.334393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:13.335439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:13.356020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.360596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.362615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.365176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.741555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:13.755643 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8eae85d4-4ec2-41a7-9236-60a9e4605372 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1669 microversion: 2.1 time: 0.662151 Jul 20 11:16:13.756822 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2522/5022] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:13 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1669 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:13.776073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:13.784593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:13.804894 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.805952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:13.808208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:13.810686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:14.148678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:14.160153 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-75f59837-eddb-4095-8aaf-6d25ef67c369 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1691 microversion: 2.1 time: 0.838315 Jul 20 11:16:14.167739 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2501/5023] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:13 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1691 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:14.173001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:14.178557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:14.192323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:14.194777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:14.195590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:14.199752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:14.200602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:14.278256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:14.293022 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.api [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Working on deleting snapshot 71e0d401-5ffa-464b-9775-0bfac0d2080d from shelved instance... Jul 20 11:16:14.347987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:14.374110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:14.389832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:14.391974 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-836eb94d-ebdc-415b-94ce-1a3414b628fe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.633114 Jul 20 11:16:14.401223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2523/5024] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:13 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:14.432937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:14.435965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:14.484695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:14.485493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:14.486426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:14.486999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:15.152588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:15.173599 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f6679a0-5790-4c96-9c9a-b32243d7d7c2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.766202 Jul 20 11:16:15.176617 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2524/5025] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:14 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:15.192898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4f100be8-d228-4816-bd1f-e8063f7b0a63 req-1d0bec87-baae-4a2d-a492-1306d1d894f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "name": "network-vif-plugged", "status": "completed", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:15.217504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4f100be8-d228-4816-bd1f-e8063f7b0a63 req-1d0bec87-baae-4a2d-a492-1306d1d894f2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:15.221946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4f100be8-d228-4816-bd1f-e8063f7b0a63 req-1d0bec87-baae-4a2d-a492-1306d1d894f2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:15.273186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4f100be8-d228-4816-bd1f-e8063f7b0a63 req-1d0bec87-baae-4a2d-a492-1306d1d894f2 service nova] Creating event network-vif-plugged:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h1-846219-10 Jul 20 11:16:15.291569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-4f100be8-d228-4816-bd1f-e8063f7b0a63 req-1d0bec87-baae-4a2d-a492-1306d1d894f2 service nova] Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:16:15.342125 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4f100be8-d228-4816-bd1f-e8063f7b0a63 req-1d0bec87-baae-4a2d-a492-1306d1d894f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159582 Jul 20 11:16:15.351708 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2525/5026] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:15.384111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:15.387480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:15.410325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:15.410325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:15.418988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:15.420202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:15.921568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Doing local delete in cell 49960821-bda1-4b33-831a-e91b6414edd4(cell1) {{(pid=125886) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 20 11:16:15.925455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:15.927987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:15.928691 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.api [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 20 11:16:15.937701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] deallocate_for_instance() {{(pid=125886) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 20 11:16:16.732640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:16.791197 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-87c1d480-04fd-4507-a95d-6283d993fcd7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1691 microversion: 2.1 time: 1.433974 Jul 20 11:16:16.793874 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2526/5027] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:15 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1691 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:16.824866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:16.826220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:16.844470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:16.845103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:16.846974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:16.849277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:17.496240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:17.505872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:17.507934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:17.509341 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-07216630-f0e3-4519-8b00-41b4517b95f3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1737 microversion: 2.20 time: 0.714474 Jul 20 11:16:17.521039 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2527/5028] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:16 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1737 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:17.529566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:17.530896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:17.539042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:17.539815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:17.540775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:17.541387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.211957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Updating instance_info_cache with network_info: [] {{(pid=125886) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 20 11:16:18.214968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:18.236975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-491c3b54-8efc-43f1-83e7-22d8d639a83d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.715132 Jul 20 11:16:18.238030 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2528/5029] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:17 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:18.242672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:18.243318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:18.261051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.261636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.262424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.263062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.757635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=11,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:18.841410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:18.846959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:18.847798 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8028e68e-ee08-4785-a723-86e0b6cd59f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "DELETE /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 204 len: 0 microversion: 2.1 time: 4.678438 Jul 20 11:16:18.849221 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2502/5030] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:14 2022] DELETE /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 0 bytes in 4680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:18.858932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2321a2a6-7691-4062-ae94-338a5d55093f req-b7029379-fca3-4a11-ad46-8d006fe1afb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162791fe-9499-488a-bd5e-2ea8387b0310", "name": "network-vif-deleted", "tag": "48f105a3-9010-42d4-9eac-9c1c637238fa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:18.862387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-54a63766-7936-435f-ba64-aede17599365 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1691 microversion: 2.1 time: 0.621996 Jul 20 11:16:18.865118 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2529/5031] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:18 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1691 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:18.879537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:18.880380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:18.881008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2321a2a6-7691-4062-ae94-338a5d55093f req-b7029379-fca3-4a11-ad46-8d006fe1afb8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.882115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2321a2a6-7691-4062-ae94-338a5d55093f req-b7029379-fca3-4a11-ad46-8d006fe1afb8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.897773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.898306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.899198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.902564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.compute.server_external_events [req-2321a2a6-7691-4062-ae94-338a5d55093f req-b7029379-fca3-4a11-ad46-8d006fe1afb8 service nova] Unable to find a host for instance 162791fe-9499-488a-bd5e-2ea8387b0310. Dropping event network-vif-deleted {{(pid=125886) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 11:16:18.903153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.914547 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2321a2a6-7691-4062-ae94-338a5d55093f req-b7029379-fca3-4a11-ad46-8d006fe1afb8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.062937 Jul 20 11:16:18.917533 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2503/5032] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 11:16:18.923806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:18.924746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 162791fe-9499-488a-bd5e-2ea8387b0310] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:18.936819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.938248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.939278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.940203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.957524 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] HTTP exception thrown: Instance 162791fe-9499-488a-bd5e-2ea8387b0310 could not be found. Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Request method failure captured: Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 HTTP/1.1 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-HeInRY8jaXVre14IaJ8jR0RlW9tdCDElkwKI6IzDfFwVeVOoDWGyw177v8nv0VXSEzQ8ypidVH2oZuea9CHg3CTLRYK0VtA1FsIarWqTWu4oOFGDy0OjuCxSu-3wU1w2c9K7FmV40j0pMbHumX7yxs7e_ssTQbHRi83JjARo0dN4E Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bef632298d2416b8bd9b6ebcd073a61", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 85fdcf2c53c648548248e606e639b974 Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 162791fe-9499-488a-bd5e-2ea8387b0310 could not be found. Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '162791fe-9499-488a-bd5e-2ea8387b0310'} Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162791fe-9499-488a-bd5e-2ea8387b0310 could not be found. Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162791fe-9499-488a-bd5e-2ea8387b0310 could not be found. Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:18.959774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162791fe-9499-488a-bd5e-2ea8387b0310 could not be found. Jul 20 11:16:18.963842 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:18.966668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Returning 404 to user: Instance 162791fe-9499-488a-bd5e-2ea8387b0310 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:18.967894 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be4aa548-6613-4371-a829-6899a33337f2 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310" status: 404 len: 111 microversion: 2.1 time: 0.048969 Jul 20 11:16:18.969158 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2504/5033] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:18 2022] GET /compute/v2.1/servers/162791fe-9499-488a-bd5e-2ea8387b0310 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:18.977258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:18.978049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:18.986167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.987114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:18.989885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:18.990560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:19.025654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:19.150613 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d90ffb0-873f-4e1d-9599-46603be05438 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 204 len: 0 microversion: 2.1 time: 0.175918 Jul 20 11:16:19.157160 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2505/5034] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:18 2022] DELETE /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:19.171725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:19.172939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:19.189164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:19.189694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:19.192083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:19.193761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:19.286607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:19.296788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:19.298769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:19.304755 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7e8a7684-96d5-4d7f-9e41-381894f6f535 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1719 microversion: 2.20 time: 0.438238 Jul 20 11:16:19.319118 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2530/5035] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:18 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1719 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:19.325947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:19.370723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:19.384775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:19.391024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:19.391968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:19.402260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:19.404063 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e4c858b-df66-4295-9d8b-889775c400de tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1465 microversion: 2.1 time: 0.245288 Jul 20 11:16:19.404884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:19.418397 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2506/5036] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:19 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:19.608058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:19.618453 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9c0b61c-2d0a-4129-8269-e3fc9b2e07f1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.296347 Jul 20 11:16:19.619129 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2531/5037] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:19 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:19.899475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:19.900437 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:19.912311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:19.925370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:19.927010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:19.927659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.118191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:20.140197 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b906d47-13ce-4787-8761-166cd90fdadf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1683 microversion: 2.1 time: 0.254872 Jul 20 11:16:20.163690 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2507/5038] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:19 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1683 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:20.327121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:20.327861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:20.342835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.343324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.350534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.351802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.423285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:20.423285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:20.433931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.436024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.436024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.436024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.612459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:20.622975 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-099d6f47-056b-4be1-82ca-aeac983f1597 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1465 microversion: 2.1 time: 0.204054 Jul 20 11:16:20.647567 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2508/5039] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:20 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:20.647567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-52273206-4752-47c0-a361-6d81dc02bece req-a83cb25b-08a1-41f8-b39d-7cc4f342a95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "name": "network-vif-unplugged", "status": "completed", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:20.663579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-52273206-4752-47c0-a361-6d81dc02bece req-a83cb25b-08a1-41f8-b39d-7cc4f342a95d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.664592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-52273206-4752-47c0-a361-6d81dc02bece req-a83cb25b-08a1-41f8-b39d-7cc4f342a95d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.690269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:20.691486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-52273206-4752-47c0-a361-6d81dc02bece req-a83cb25b-08a1-41f8-b39d-7cc4f342a95d service nova] Creating event network-vif-unplugged:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:16:20.708748 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-52273206-4752-47c0-a361-6d81dc02bece req-a83cb25b-08a1-41f8-b39d-7cc4f342a95d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062806 Jul 20 11:16:20.711566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2509/5040] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:20.711940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:20.716479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:20.720171 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fbada8e3-8e3a-4648-8701-16dba204c777 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1719 microversion: 2.20 time: 0.397218 Jul 20 11:16:20.728357 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2532/5041] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:20 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1719 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:20.728540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:20.729219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:20.742322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.742779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.743594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:20.744028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:20.997747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:21.010315 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0ea4605c-98c4-4938-88fd-31998f8290de tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.295260 Jul 20 11:16:21.011986 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2510/5042] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:20 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:21.654065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:21.654808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:21.667495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:21.669539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:21.670422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:21.673316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:21.738079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:21.738940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:21.749446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:21.767751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:21.771180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:21.771643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:22.024337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:22.038234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8ab848ee-48fa-4481-963d-7e5de47b36a8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1465 microversion: 2.1 time: 0.388374 Jul 20 11:16:22.038831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2533/5043] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:21 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1465 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:22.051754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:22.053330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:22.067267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:22.067856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:22.069178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:22.071863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:22.118621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:22.130063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:22.131762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:22.132974 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3eae035c-49ee-4d1a-9cb9-b1cef5e20b85 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1719 microversion: 2.20 time: 0.399057 Jul 20 11:16:22.133985 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2511/5044] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:21 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1719 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:22.329859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:22.343486 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e93c925f-d116-48f4-a42b-38cf5e062181 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.303242 Jul 20 11:16:22.344832 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2534/5045] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:22 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:23.057764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:23.058736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:23.077614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:23.078069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:23.078854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:23.079317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:23.153369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:23.153987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:23.177544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:23.179783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:23.184521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:23.186136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:23.469748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:23.480752 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f6b63df-fbc8-4469-9f64-f99788ea767a tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1465 microversion: 2.1 time: 0.428156 Jul 20 11:16:23.481346 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2512/5046] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:23 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1465 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:23.502533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:23.504894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:23.521737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:23.523842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:23.525796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:23.529055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:24.055751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:24.077418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:24.079032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:24.080287 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-924e6954-ba7f-4906-8339-6920b437d767 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1722 microversion: 2.20 time: 0.932579 Jul 20 11:16:24.095542 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2535/5047] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:23 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1722 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:24.116508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "830b536a-c278-4f53-985b-00761b4d49d8"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:24.117691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:24.144047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:24.144505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:24.145305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:24.145751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:24.269182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:24.285006 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62b212bc-8a37-4651-9dde-04ce78023792 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1735 microversion: 2.1 time: 0.792639 Jul 20 11:16:24.295624 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2513/5048] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:23 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1735 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:24.499829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:24.500522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:24.519000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:24.519495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:24.523056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:24.525198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:24.764751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:24.791753 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1569bcd5-7604-4955-918c-47523b720fee tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 200 len: 1465 microversion: 2.1 time: 0.281168 Jul 20 11:16:24.796330 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2514/5049] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:24 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 1465 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:16:24.818795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-eb3e1606-a877-40ae-b885-131de786794a req-84f2f125-01c6-4196-88b1-d30363bcc639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e25c28b-dbea-4da4-aeaa-18b20b349002", "name": "network-vif-deleted", "tag": "29205aeb-da2c-42ef-8452-da1846fdf2e7"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:24.852206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eb3e1606-a877-40ae-b885-131de786794a req-84f2f125-01c6-4196-88b1-d30363bcc639 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:24.861232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eb3e1606-a877-40ae-b885-131de786794a req-84f2f125-01c6-4196-88b1-d30363bcc639 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:24.915041 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-eb3e1606-a877-40ae-b885-131de786794a req-84f2f125-01c6-4196-88b1-d30363bcc639 service nova] Creating event network-vif-deleted:29205aeb-da2c-42ef-8452-da1846fdf2e7 for instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 on n-h2-846219-10 Jul 20 11:16:24.942928 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-eb3e1606-a877-40ae-b885-131de786794a req-84f2f125-01c6-4196-88b1-d30363bcc639 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142737 Jul 20 11:16:24.955224 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2515/5050] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:25.053942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19a079bb-bbbb-4111-9cac-de7cc4eff9ed tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.956822 Jul 20 11:16:25.059153 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2536/5051] 10.222.0.79 () {62 vars in 1363 bytes} [Wed Jul 20 11:16:24 2022] POST /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-volume_attachments => generated 188 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:16:25.305165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:25.306448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:25.322920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:25.326168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:25.327130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:25.327655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:25.518040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-237765844", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": "none"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:25.666283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:16:25.668675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:16:25.669319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:16:25.670682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:16:25.671298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:16:25.723063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:25.724954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:25.728282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:25.730095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:25.825946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Getting quotas for project 8c4629e497eb46f480b61ca0937cc594. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:16:25.854718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Getting quotas for user 14c8b4b6adfa469486e92995cf67c9d6 and project 8c4629e497eb46f480b61ca0937cc594. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:16:25.895965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:16:25.898611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:16:26.007501 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7ed5c3fe-9956-4e46-aa39-35df54331443 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.868379 Jul 20 11:16:26.014320 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2516/5052] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 11:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:16:26.037334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:26.037854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:26.047754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:26.048430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:26.049399 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:26.050002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:26.625402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:26.645069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5904185-3244-46a4-b3ec-3b3fff9adce2 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1715 microversion: 2.1 time: 1.345132 Jul 20 11:16:26.674215 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2537/5053] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:25 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1715 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:16:26.697406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:26.701042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 3e25c28b-dbea-4da4-aeaa-18b20b349002] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:26.723292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:26.738932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:26.744534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:26.746062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:26.761516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:UPDATE=9,nova_cell1:DELETE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:26.789951 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] HTTP exception thrown: Instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 could not be found. Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Request method failure captured: Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 HTTP/1.1 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-HeInRY8jaXVre14IaJ8jR0RlW9tdCDElkwKI6IzDfFwVeVOoDWGyw177v8nv0VXSEzQ8ypidVH2oZuea9CHg3CTLRYK0VtA1FsIarWqTWu4oOFGDy0OjuCxSu-3wU1w2c9K7FmV40j0pMbHumX7yxs7e_ssTQbHRi83JjARo0dN4E Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bef632298d2416b8bd9b6ebcd073a61", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 85fdcf2c53c648548248e606e639b974 Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 could not be found. Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3e25c28b-dbea-4da4-aeaa-18b20b349002'} Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 could not be found. Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 could not be found. Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:26.796249 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 could not be found. Jul 20 11:16:26.800898 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:26.804954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Returning 404 to user: Instance 3e25c28b-dbea-4da4-aeaa-18b20b349002 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:26.806901 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eadc4590-aa8d-4976-bbf6-4163213ad849 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002" status: 404 len: 111 microversion: 2.1 time: 0.130725 Jul 20 11:16:26.807506 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3fccb51c-0794-4728-a2aa-f838f8d41e87 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-volume_attachments/830b536a-c278-4f53-985b-00761b4d49d8" status: 202 len: 0 microversion: 2.20 time: 0.789312 Jul 20 11:16:26.808351 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2538/5054] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:26 2022] GET /compute/v2.1/servers/3e25c28b-dbea-4da4-aeaa-18b20b349002 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:26.814544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2517/5055] 10.222.0.79 () {60 vars in 1456 bytes} [Wed Jul 20 11:16:26 2022] DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-volume_attachments/830b536a-c278-4f53-985b-00761b4d49d8 => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:26.827802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d79c04a-4079-4d3f-9da2-7893e80131db tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:26.828814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:26.829893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d79c04a-4079-4d3f-9da2-7893e80131db tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:26.830630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:26.861105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:26.863776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:26.869049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:26.873252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:26.972325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d79c04a-4079-4d3f-9da2-7893e80131db tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:26.987122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d79c04a-4079-4d3f-9da2-7893e80131db tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:26.987338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:26.991002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d79c04a-4079-4d3f-9da2-7893e80131db tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:26.992991 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d79c04a-4079-4d3f-9da2-7893e80131db tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1277 microversion: 2.54 time: 0.179219 Jul 20 11:16:26.999222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2539/5056] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:26 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:27.012150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:27.012730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:27.049972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.050429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.055590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.055909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.254433 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5ef3780-d496-427d-83bf-2f34c8e73f5f tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "DELETE /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 204 len: 0 microversion: 2.1 time: 0.438134 Jul 20 11:16:27.256321 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2518/5057] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:26 2022] DELETE /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:27.266754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:27.267769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:27.289742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.295015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.299154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.301094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.353973 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a102b6cd-56b6-4fd9-88fe-8734aeae3588 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "POST /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/action" status: 202 len: 0 microversion: 2.20 time: 0.355225 Jul 20 11:16:27.359795 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2540/5058] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 11:16:26 2022] POST /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:27.373126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:27.373765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:27.380646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.383330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.384144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.384595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.593568 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Cannot 'detach_volume' instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 while it is in vm_state rescued Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments/8bc9a7d5-054a-42df-bc1a-c8412a6e572f HTTP/1.1 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'detach_volume' instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 while it is in vm_state rescued Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'server_id': '6f25e0a0-6ca1-4371-aa81-988613b56eb3', 'id': '8bc9a7d5-054a-42df-bc1a-c8412a6e572f'} Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 while it is in vm_state rescued Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:27.596885 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:27.601115 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:27.601115 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:27.601115 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:27.601115 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:27.601115 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 while it is in vm_state rescued Jul 20 11:16:27.601115 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:27.606833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 409 to user: Cannot 'detach_volume' instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 while it is in vm_state rescued {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:27.610241 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1281b02-95b9-4889-95cc-f453d969c8ff tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments/8bc9a7d5-054a-42df-bc1a-c8412a6e572f" status: 409 len: 152 microversion: 2.1 time: 0.350748 Jul 20 11:16:27.615935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2519/5059] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:16:27 2022] DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments/8bc9a7d5-054a-42df-bc1a-c8412a6e572f => generated 152 bytes in 359 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:16:27.627012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:27.627761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:27.640997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.643701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:27.646792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:27.647486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.130642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:28.154084 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fdd34df1-6a16-4bb8-8f0a-76c5d633386e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1507 microversion: 2.1 time: 0.793109 Jul 20 11:16:28.154690 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2541/5060] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:27 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1507 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:28.193079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:28.193638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:28.226874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:28.239570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.240577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:28.241035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.461561 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a4a912a4-779c-4c64-b833-9e84d2638111 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/action" status: 202 len: 0 microversion: 2.1 time: 0.275943 Jul 20 11:16:28.462423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:28.465738 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2542/5061] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:16:28 2022] POST /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:16:28.480070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:28.489192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:28.489902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:28.490641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:28.495339 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d029bb7-61f6-44a8-8626-a317300d5ef0 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1670 microversion: 2.20 time: 0.873885 Jul 20 11:16:28.499587 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2520/5062] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:27 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1670 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:28.508163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:28.508579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.509370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:28.512590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:28.514028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.520827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:28.545490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:28.546487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.550310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:28.553514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:28.637779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:29.196935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:29.225444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:29.234015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:29.235685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e57843b6-c078-41c5-8b3c-0c3b23e416f8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1281 microversion: 2.54 time: 0.768413 Jul 20 11:16:29.252811 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2543/5063] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:28 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1281 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:29.276971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:29.278064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:29.298917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:29.304942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:29.308687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:29.309426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:30.145655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:30.167229 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-605cfba0-1f05-4e68-95b0-d68119232a07 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1507 microversion: 2.1 time: 0.911917 Jul 20 11:16:30.181690 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2544/5064] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:29 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1507 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:30.187303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:30.187923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:30.204453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:30.227742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:30.232490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:30.232905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:30.314990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:30.363427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c2a7e4ef-9410-400f-93e4-f2811bafcdd1 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1723 microversion: 2.1 time: 1.859017 Jul 20 11:16:30.369385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2521/5065] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:28 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1723 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:30.403878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:30.409046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:30.431260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:30.433066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:30.434130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:30.434894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:30.967039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:30.980731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:30.988088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:30.989597 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5b3eac45-71b0-4465-968e-9dbb2b99041d tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1335 microversion: 2.54 time: 0.617613 Jul 20 11:16:30.996986 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2522/5066] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:30 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1335 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:31.074691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:31.090809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:31.099480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:31.101674 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f491911-7618-46b6-b9d9-fad5d781477a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.917838 Jul 20 11:16:31.115260 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2545/5067] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:30 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:31.189283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:31.193969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:31.234136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:31.234828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:31.243949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:31.246723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:31.388033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:31.389348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:31.404302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:31.405519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:31.408697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:31.411384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:31.662216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:31.671279 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-539b6d59-614b-4121-ae7d-a0272ace01ec tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 200 len: 1465 microversion: 2.1 time: 0.486549 Jul 20 11:16:31.682797 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2523/5068] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:31 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 1465 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:31.688153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d8c3258b-5961-4fa1-bb0f-f34a29768504 req-4c9e54b6-0226-4c52-b23d-0f42666a4060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397813f8-965b-4015-bc61-9f008d0f4024", "name": "network-vif-deleted", "tag": "72f313fa-f8d2-4aff-87f7-e3fc276e6908"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:31.703784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d8c3258b-5961-4fa1-bb0f-f34a29768504 req-4c9e54b6-0226-4c52-b23d-0f42666a4060 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:31.708138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d8c3258b-5961-4fa1-bb0f-f34a29768504 req-4c9e54b6-0226-4c52-b23d-0f42666a4060 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:31.726771 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d8c3258b-5961-4fa1-bb0f-f34a29768504 req-4c9e54b6-0226-4c52-b23d-0f42666a4060 service nova] Creating event network-vif-deleted:72f313fa-f8d2-4aff-87f7-e3fc276e6908 for instance 397813f8-965b-4015-bc61-9f008d0f4024 on n-h2-846219-10 Jul 20 11:16:31.739104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d8c3258b-5961-4fa1-bb0f-f34a29768504 req-4c9e54b6-0226-4c52-b23d-0f42666a4060 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054575 Jul 20 11:16:31.741573 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2524/5069] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:31.955845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:31.992822 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8061a01c-e060-4163-8a4d-1125ca6f5556 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1723 microversion: 2.1 time: 0.613357 Jul 20 11:16:31.994202 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2546/5070] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:31 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1723 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:16:32.015329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:32.016048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:32.033779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.034212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.037438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.039009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.133562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:32.134708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:32.151705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:32.152261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.154307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.157951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.159817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.179627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:32.181272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:32.183065 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f1521781-f32c-4d61-9d28-9ba55b61c0cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1335 microversion: 2.54 time: 0.172363 Jul 20 11:16:32.183693 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2525/5071] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:32 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1335 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:32.505378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:32.518162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:32.523334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:32.524848 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-da9138b7-8db2-4142-b622-d3222d07fb29 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.405868 Jul 20 11:16:32.561078 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2547/5072] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:32 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:32.690019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:32.692044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 397813f8-965b-4015-bc61-9f008d0f4024] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:32.701880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.702567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.703751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.705132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.752058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] HTTP exception thrown: Instance 397813f8-965b-4015-bc61-9f008d0f4024 could not be found. Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Request method failure captured: Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 HTTP/1.1 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-HeInRY8jaXVre14IaJ8jR0RlW9tdCDElkwKI6IzDfFwVeVOoDWGyw177v8nv0VXSEzQ8ypidVH2oZuea9CHg3CTLRYK0VtA1FsIarWqTWu4oOFGDy0OjuCxSu-3wU1w2c9K7FmV40j0pMbHumX7yxs7e_ssTQbHRi83JjARo0dN4E Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bef632298d2416b8bd9b6ebcd073a61", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 85fdcf2c53c648548248e606e639b974 Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 397813f8-965b-4015-bc61-9f008d0f4024 could not be found. Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '397813f8-965b-4015-bc61-9f008d0f4024'} Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397813f8-965b-4015-bc61-9f008d0f4024 could not be found. Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397813f8-965b-4015-bc61-9f008d0f4024 could not be found. Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:32.762434 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397813f8-965b-4015-bc61-9f008d0f4024 could not be found. Jul 20 11:16:32.767312 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:16:32.770008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Returning 404 to user: Instance 397813f8-965b-4015-bc61-9f008d0f4024 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:32.771225 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-47fa6d17-8ffa-4e7a-b73f-460daba42a42 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024" status: 404 len: 111 microversion: 2.1 time: 0.086082 Jul 20 11:16:32.776042 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2526/5073] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:32 2022] GET /compute/v2.1/servers/397813f8-965b-4015-bc61-9f008d0f4024 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:32.785708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:32.786204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:32.804478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.818130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.822251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:32.824192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:32.882943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:33.002494 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9e0ef5d-6e27-43f9-86a1-909e5907377d tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "DELETE /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 204 len: 0 microversion: 2.1 time: 0.219989 Jul 20 11:16:33.008323 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2548/5074] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:32 2022] DELETE /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:33.015801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:33.016152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:33.017180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:33.017870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:33.026622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.027078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.027891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.028331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.045115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.046130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.047421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.048290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.375781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.385252 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2cca207-f248-485c-9d64-18bef0b86942 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1723 microversion: 2.1 time: 0.378037 Jul 20 11:16:33.390045 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2527/5075] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:33 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:33.401701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:33.402416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:33.445534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.445968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.464080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.464831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.469212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.473116 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1ab3a38d-08f0-4811-8ebb-6f4c00802dd8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1494 microversion: 2.1 time: 0.463086 Jul 20 11:16:33.475439 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2549/5076] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:33 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1494 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:33.545896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:33.547598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:33.560440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:33.582064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.582526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.583350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.583793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.629346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.656624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.659848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.661557 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f8464809-0e43-4992-8395-993aa9dada58 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1356 microversion: 2.54 time: 0.270339 Jul 20 11:16:33.668768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2528/5077] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:33 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:33.693840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cf691f4f-99cb-4676-8a25-418e136311d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Action: 'create', calling method: .version_select at 0x7f2c3edc09d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-720670781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGlByL3KYXJUOi/lPrWwlsRk0DNpE/UCiyPbDf9t/aa5Eki0RO6EwEGCeNZQQeYUvB5/tSZKFKOkqlGzKY950pCwVm+OHv3Bzglv4yaoTBVOqSAnRQoaowjdjBcFXhRrg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:33.753337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-cf691f4f-99cb-4676-8a25-418e136311d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Getting quotas for project 8c4629e497eb46f480b61ca0937cc594. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:16:33.763547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-cf691f4f-99cb-4676-8a25-418e136311d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Getting quotas for user 14c8b4b6adfa469486e92995cf67c9d6 and project 8c4629e497eb46f480b61ca0937cc594. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:16:33.834869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cf691f4f-99cb-4676-8a25-418e136311d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.149987 Jul 20 11:16:33.835534 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2529/5078] 10.222.0.79 () {62 vars in 1199 bytes} [Wed Jul 20 11:16:33 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 11:16:33.857418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-720670781", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:33.866721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.875744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:33.878608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.880731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:33.882373 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e26f8596-1714-4a1d-83d8-226cf0714e10 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.340324 Jul 20 11:16:33.883919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2550/5079] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:33 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:33.898641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:33.901597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.902932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:33.903947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:33.904996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.043118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:16:34.043658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:16:34.044413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:16:34.044785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:16:34.047992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:16:34.186791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:34.202102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.203787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.204881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.207540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.260275 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f1e16115-2b6d-45ec-874a-7a772d74c0cb tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "POST /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4/action" status: 202 len: 1138 microversion: 2.54 time: 0.414102 Jul 20 11:16:34.272727 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2530/5080] 10.222.0.79 () {62 vars in 1319 bytes} [Wed Jul 20 11:16:33 2022] POST /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4/action => generated 1138 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 20 11:16:34.278245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:34.278918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:34.291097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.292440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.301984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.302694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.407009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:34.407741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:34.433127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.433585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.434727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.435266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.583181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:34.595324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:34.596862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:34.598240 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db403ee2-b93b-4ab7-97dd-5d29bdcb9ffd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.325037 Jul 20 11:16:34.599353 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2551/5081] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:34 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:34.614963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:34.615861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:34.625077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.625538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:34.631635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:34.632128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:35.426556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:35.437409 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fedbcc82-037f-420b-82bc-836c75fc2d9f tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1723 microversion: 2.1 time: 1.035373 Jul 20 11:16:35.443128 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2531/5082] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:34 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1723 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:35.457874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:35.458603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:35.471748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:35.479951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:35.481203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:35.481896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:35.511855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:35.678910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:35.693351 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0007246e-08f0-4158-afa7-10e431a76884 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1494 microversion: 2.1 time: 1.092515 Jul 20 11:16:35.696444 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2552/5083] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:34 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1494 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:35.710979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:35.711646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:35.733518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:35.734183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:35.735498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:35.736107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:35.772795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:36.270293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:36.285128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:36.287833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:36.293325 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0cdaad74-3e6b-4ba7-97ab-630578edb2d0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.595142 Jul 20 11:16:36.297828 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2553/5084] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:35 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:36.383085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:36.401179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:36.405011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:36.410824 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef0235db-35e1-467d-84a0-264b7c45bf8f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.966123 Jul 20 11:16:36.417660 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2532/5085] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:35 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:36.460315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:36.461030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:36.477084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:36.477542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:36.478506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:36.479217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:36.727528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:36.727528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:36.740969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:36.749178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:36.750141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:36.750593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:36.980088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:37.069317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:37.083117 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-74e854df-c559-4340-95c2-f74b628ab99d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1729 microversion: 2.1 time: 0.626201 Jul 20 11:16:37.086202 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2554/5086] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:36 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1729 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:37.105292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:37.106120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:37.142256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:37.144856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:37.152387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:37.152884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:38.180911 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6f25e281-6d61-4b78-b691-ebd1254d0096 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.082350 Jul 20 11:16:38.181662 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2555/5087] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:16:37 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-interface => generated 284 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:38.186640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:38.187633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:38.203922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:38.204755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:38.205867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:38.206538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:38.356966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.373519 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b0c0b00b-b41d-421d-b304-bacb0423c362 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1494 microversion: 2.1 time: 1.663853 Jul 20 11:16:38.374874 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2533/5088] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:36 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1494 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:38.390590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:38.391758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:38.399890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:38.403937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:38.405220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:38.405909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:38.486770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.500769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.502803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.511675 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d96e67af-79c3-4914-91f0-7f3dff0aebf2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.328482 Jul 20 11:16:38.543671 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2556/5089] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:38 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:38.856701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.871206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.876266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:38.887407 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8ac56c94-a98c-47c2-88d8-f40727e5b9cb tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.501823 Jul 20 11:16:38.889015 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2534/5090] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:38 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:38.941608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e1a32ff4-6b4f-4112-a2c6-5e7f04d93fc6 req-0d15157a-690d-4137-b34e-65cb9a110553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78237c0d-be5c-4750-a39c-4cd616af234d", "name": "network-vif-deleted", "tag": "46f148af-bcb0-4131-99c9-1b47fc996945"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:38.957235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e1a32ff4-6b4f-4112-a2c6-5e7f04d93fc6 req-0d15157a-690d-4137-b34e-65cb9a110553 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:38.975654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e1a32ff4-6b4f-4112-a2c6-5e7f04d93fc6 req-0d15157a-690d-4137-b34e-65cb9a110553 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.005959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e1a32ff4-6b4f-4112-a2c6-5e7f04d93fc6 req-0d15157a-690d-4137-b34e-65cb9a110553 service nova] Creating event network-vif-deleted:46f148af-bcb0-4131-99c9-1b47fc996945 for instance 78237c0d-be5c-4750-a39c-4cd616af234d on n-h2-846219-10 Jul 20 11:16:39.012504 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e1a32ff4-6b4f-4112-a2c6-5e7f04d93fc6 req-0d15157a-690d-4137-b34e-65cb9a110553 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074664 Jul 20 11:16:39.013664 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2557/5091] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:39.414615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:39.415439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:39.425783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.428963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.429907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.433313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.506577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.507218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.508327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lazy-loading 'fault' on Instance uuid 78237c0d-be5c-4750-a39c-4cd616af234d {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:16:39.550760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:39.551690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:39.578498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.586642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.588847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.589547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.612968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:39.625293 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e518ad9-22c5-4101-b13f-5644053bed0b tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 200 len: 1304 microversion: 2.1 time: 0.215684 Jul 20 11:16:39.626696 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2535/5092] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:39 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:39.689220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:39.700763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:39.703086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:39.705300 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cdac196d-f08a-4162-a617-e375fbe28c84 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.167085 Jul 20 11:16:39.714623 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2558/5093] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:39 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:39.929621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:39.930456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:39.944762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.947751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:39.948946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:39.952012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.292837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:40.307920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:40.316788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:40.325985 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7c78cad-8333-416f-8e3a-7186f712cce3 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.420582 Jul 20 11:16:40.357108 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2536/5094] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:39 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:40.643199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:40.644893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: 78237c0d-be5c-4750-a39c-4cd616af234d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:40.653389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:40.656698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.657795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:40.660473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.696155 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] HTTP exception thrown: Instance 78237c0d-be5c-4750-a39c-4cd616af234d could not be found. Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Request method failure captured: Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d HTTP/1.1 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-HeInRY8jaXVre14IaJ8jR0RlW9tdCDElkwKI6IzDfFwVeVOoDWGyw177v8nv0VXSEzQ8ypidVH2oZuea9CHg3CTLRYK0VtA1FsIarWqTWu4oOFGDy0OjuCxSu-3wU1w2c9K7FmV40j0pMbHumX7yxs7e_ssTQbHRi83JjARo0dN4E Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bef632298d2416b8bd9b6ebcd073a61", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 85fdcf2c53c648548248e606e639b974 Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 78237c0d-be5c-4750-a39c-4cd616af234d could not be found. Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '78237c0d-be5c-4750-a39c-4cd616af234d'} Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78237c0d-be5c-4750-a39c-4cd616af234d could not be found. Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78237c0d-be5c-4750-a39c-4cd616af234d could not be found. Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:40.700925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78237c0d-be5c-4750-a39c-4cd616af234d could not be found. Jul 20 11:16:40.705609 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:40.707299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Returning 404 to user: Instance 78237c0d-be5c-4750-a39c-4cd616af234d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:40.708501 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55dd2f0f-6933-4f37-acf1-0993f09c54b8 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d" status: 404 len: 111 microversion: 2.1 time: 0.069177 Jul 20 11:16:40.709258 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2559/5095] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:40 2022] GET /compute/v2.1/servers/78237c0d-be5c-4750-a39c-4cd616af234d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:40.720628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:40.721807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:40.736393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:40.737141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.738499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:40.739901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:40.740721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:40.741337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.770512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:40.771285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.772246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:40.772846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:40.776190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:40.799572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:16:40.995250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.015445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.036654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.036654 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d3cd2fce-3d0f-4806-b005-560c6c0d7616 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.297603 Jul 20 11:16:41.036654 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2560/5096] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:40 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:41.051071 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a05c18f-f6ac-4306-875f-bc2e735411ed tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 204 len: 0 microversion: 2.1 time: 0.335638 Jul 20 11:16:41.051718 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2537/5097] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:16:40 2022] DELETE /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:16:41.069564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:41.070620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:41.097679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:41.098289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:41.099163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:41.099638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:41.351334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:41.352039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:41.384013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:41.385345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:41.387512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:41.391089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:41.422215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.431218 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c9ac948b-dccd-4dd6-a4c3-6478a2c2fa19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1675 microversion: 2.1 time: 0.373099 Jul 20 11:16:41.435902 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2561/5098] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:41 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1675 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:41.755770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.784226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.787528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:41.799550 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4dc76e8-cda0-4d61-b839-ef1c23bb8783 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.449293 Jul 20 11:16:41.808049 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2538/5099] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:41 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:42.055144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:42.055887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:42.081890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:42.082357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:42.085524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:42.086152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:42.190747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:42.239351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:42.241312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:42.245793 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7aae6426-0c6e-4ac3-8677-813fd2168fe8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.195521 Jul 20 11:16:42.257611 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2562/5100] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:42 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:42.467270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:42.473964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:42.506279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:42.506999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:42.507987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:42.508582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:42.762051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:42.803689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4fe50278-19be-40be-a1f5-38c09bf3e940 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1675 microversion: 2.1 time: 0.347338 Jul 20 11:16:42.809052 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2539/5101] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:42 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1675 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:42.827247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:42.828501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:42.835432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:42.836220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:42.837179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:42.850303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:43.035192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e773f980-d2d9-43a9-9ec2-11fb04a5a1be req-21cf60b5-75a0-412b-b2eb-9c366a6b13ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:43.060117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e773f980-d2d9-43a9-9ec2-11fb04a5a1be req-21cf60b5-75a0-412b-b2eb-9c366a6b13ac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:43.060432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e773f980-d2d9-43a9-9ec2-11fb04a5a1be req-21cf60b5-75a0-412b-b2eb-9c366a6b13ac service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:43.161160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e773f980-d2d9-43a9-9ec2-11fb04a5a1be req-21cf60b5-75a0-412b-b2eb-9c366a6b13ac service nova] Creating event network-changed:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:16:43.186280 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e773f980-d2d9-43a9-9ec2-11fb04a5a1be req-21cf60b5-75a0-412b-b2eb-9c366a6b13ac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155277 Jul 20 11:16:43.186898 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2540/5102] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:16:43.267272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:43.268407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:43.296193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:43.296799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:43.297609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:43.298045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:43.789473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:44.130160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.142612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.156524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.180047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.181252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.181385 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f94803af-45b2-4c8d-bc17-206776fc5172 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.919174 Jul 20 11:16:44.194329 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2541/5103] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:43 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:44.194449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.194449 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a7f15a5e-7023-4c55-a5c2-16a9593c87b1 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 1.369586 Jul 20 11:16:44.194449 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2563/5104] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:42 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:44.195819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:44.212292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:44.239038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:44.242652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:44.243512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:44.247005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:44.686470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:44.714374 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d2345fb-afa7-438a-a513-4035996f874e tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1675 microversion: 2.1 time: 0.526959 Jul 20 11:16:44.724958 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2542/5105] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:44 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1675 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:45.203827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:45.207055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:45.209941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:45.210838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:45.225226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.225685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:45.226474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.230421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:45.255097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.256568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:45.261943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.270363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:45.809157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:45.839207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:45.847751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:45.849909 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c7b41b45-d037-4009-81f5-d9a507cd2ce0 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.652566 Jul 20 11:16:45.850821 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2564/5106] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:45 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:45.866235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3debdf67-973f-491e-b0b2-b9b07f0fdb5d req-79d9f884-b8d0-438b-bb90-b1ad1523b98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:45.877753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3debdf67-973f-491e-b0b2-b9b07f0fdb5d req-79d9f884-b8d0-438b-bb90-b1ad1523b98a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.878547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3debdf67-973f-491e-b0b2-b9b07f0fdb5d req-79d9f884-b8d0-438b-bb90-b1ad1523b98a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:45.893419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3debdf67-973f-491e-b0b2-b9b07f0fdb5d req-79d9f884-b8d0-438b-bb90-b1ad1523b98a service nova] Creating event network-changed:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:16:45.900361 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3debdf67-973f-491e-b0b2-b9b07f0fdb5d req-79d9f884-b8d0-438b-bb90-b1ad1523b98a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047788 Jul 20 11:16:45.908107 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2565/5107] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:45.914691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:45.915757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:45.934469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.935382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:45.936376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:45.938476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:46.377278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:46.397741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:46.408622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:46.412849 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-892b8766-fc2c-4ead-94e7-c4463a06df5f tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 1.206670 Jul 20 11:16:46.421055 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2543/5108] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:45 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:46.871111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:46.872025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:46.902546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:46.906096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:46.907159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:46.914196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:47.131461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:47.159153 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-afcc9c14-c82e-45f2-b09f-41d0da1717e4 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1675 microversion: 2.1 time: 1.249366 Jul 20 11:16:47.160464 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2566/5109] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:45 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1675 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:16:47.173469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:47.195643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:47.204173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:47.212028 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e4b303dd-cdca-4dc8-abd5-126346304ca8 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.346352 Jul 20 11:16:47.213793 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2544/5110] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:46 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:47.440051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:47.441510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:47.453957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:47.461392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:47.466381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:47.468131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.178051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:48.179195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:48.230967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.231480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.237765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.238601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.620745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:48.650002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:48.658672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:48.664705 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d51d9a90-ce91-4433-8bb8-2c336d602b60 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 1.226981 Jul 20 11:16:48.667462 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2567/5111] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:47 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:48.680890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:48.689226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:48.709853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.713554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.717781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.719453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.768992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:48.781348 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f6aecfe-5cbe-4ebb-aa7e-4430f4442c74 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1608 microversion: 2.1 time: 0.607120 Jul 20 11:16:48.788162 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2545/5112] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:48 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1608 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:16:48.799878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:48.810062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:48.837647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.843310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.844510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.846653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.961971 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-add86063-13a3-43d4-bf3f-abeba475ea24 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action" status: 200 len: 24574 microversion: 2.1 time: 0.172166 Jul 20 11:16:48.963330 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2546/5113] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:16:48 2022] POST /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715/action => generated 24574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:16:48.969425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a766e310-ff30-49d1-8aa8-8acea686aadd req-0c8c0066-8a2a-4241-8bb2-2c037cdc044f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd01dea7-6154-40bc-92c8-c4534543d8b0", "name": "network-vif-deleted", "tag": "c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:16:48.995147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a766e310-ff30-49d1-8aa8-8acea686aadd req-0c8c0066-8a2a-4241-8bb2-2c037cdc044f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:48.996060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a766e310-ff30-49d1-8aa8-8acea686aadd req-0c8c0066-8a2a-4241-8bb2-2c037cdc044f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:48.999059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:49.021392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:49.030836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:49.033314 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a766e310-ff30-49d1-8aa8-8acea686aadd req-0c8c0066-8a2a-4241-8bb2-2c037cdc044f service nova] Creating event network-vif-deleted:c2fb2ebc-374e-4a9f-b6b5-df6f3c2bd539 for instance fd01dea7-6154-40bc-92c8-c4534543d8b0 on n-h2-846219-10 Jul 20 11:16:49.035307 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0b93b509-27ef-4ae3-84ea-dca5dba380ea tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.364263 Jul 20 11:16:49.037636 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2568/5114] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:48 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:49.051348 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a766e310-ff30-49d1-8aa8-8acea686aadd req-0c8c0066-8a2a-4241-8bb2-2c037cdc044f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085678 Jul 20 11:16:49.052354 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2547/5115] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:16:49.685746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:49.687138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:49.704441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:49.715292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:49.716539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:49.717226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:49.804624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:49.805947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:49.854048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:49.854522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:49.860295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:49.868038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:50.108227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:50.109085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:50.109832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lazy-loading 'fault' on Instance uuid fd01dea7-6154-40bc-92c8-c4534543d8b0 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:16:50.139003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:16:50.496570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85fdcf2c53c648548248e606e639b974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bef632298d2416b8bd9b6ebcd073a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.511204 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2398f2b7-405a-46b5-82f3-9204bb236ca9 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 200 len: 1329 microversion: 2.1 time: 0.709155 Jul 20 11:16:50.513826 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2548/5116] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:49 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 1329 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:16:50.525832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:50.546652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:50.578167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:50.580948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:50.582670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:50.584621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:50.676005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.685727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.688697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.692757 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-293bd31f-6ba7-4ea8-aca3-680e5fffab82 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 1.009525 Jul 20 11:16:50.693868 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2569/5117] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:49 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:50.797881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.809685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.812065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:50.814196 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35e4086d-599f-4b10-bc59-8acd9d827408 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.298729 Jul 20 11:16:50.824942 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2549/5118] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:50 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:51.535502 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:51.536697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] [instance: fd01dea7-6154-40bc-92c8-c4534543d8b0] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:51.551246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:51.552054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:51.555650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:51.557689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:51.590154 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] HTTP exception thrown: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 could not be found. Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Request method failure captured: Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 HTTP/1.1 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-HeInRY8jaXVre14IaJ8jR0RlW9tdCDElkwKI6IzDfFwVeVOoDWGyw177v8nv0VXSEzQ8ypidVH2oZuea9CHg3CTLRYK0VtA1FsIarWqTWu4oOFGDy0OjuCxSu-3wU1w2c9K7FmV40j0pMbHumX7yxs7e_ssTQbHRi83JjARo0dN4E Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8bef632298d2416b8bd9b6ebcd073a61", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8bef632298d2416b8bd9b6ebcd073a61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8bef632298d2416b8bd9b6ebcd073a61 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerActionsTestJSON-1609183068 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 85fdcf2c53c648548248e606e639b974 Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerActionsTestJSON-1609183068-project Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 could not be found. Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'fd01dea7-6154-40bc-92c8-c4534543d8b0'} Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 could not be found. Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 could not be found. Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:16:51.595257 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 could not be found. Jul 20 11:16:51.602500 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:16:51.606940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Returning 404 to user: Instance fd01dea7-6154-40bc-92c8-c4534543d8b0 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:16:51.609043 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-15bf79f6-ee63-43d1-8de0-1f4eafce9f44 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0" status: 404 len: 111 microversion: 2.1 time: 0.078430 Jul 20 11:16:51.610497 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2570/5119] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:16:51 2022] GET /compute/v2.1/servers/fd01dea7-6154-40bc-92c8-c4534543d8b0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:16:51.627988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3691a5c-47ad-4964-9a91-9eedf3ba5d19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] Calling method '.version_select at 0x7f2c3eea2e50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:51.656536 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3691a5c-47ad-4964-9a91-9eedf3ba5d19 tempest-ServerActionsTestJSON-1609183068 tempest-ServerActionsTestJSON-1609183068-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475532711" status: 202 len: 0 microversion: 2.1 time: 0.041062 Jul 20 11:16:51.658247 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2550/5120] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 11:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475532711 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:16:51.716380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:51.717478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:51.749717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:51.750435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:51.751409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:51.753466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:51.847838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:51.849327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:51.865295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:51.879389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:51.882286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:51.885359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:52.190118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:52.228130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:52.230591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:52.232675 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b7041457-3287-47ca-a1ef-36b507c05306 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.390528 Jul 20 11:16:52.248711 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2551/5121] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:51 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:52.387785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:52.399495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:52.405043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:52.406454 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3393c9f-154c-4455-8992-d74a303687e8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.698367 Jul 20 11:16:52.411856 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2571/5122] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:51 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:53.252159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:53.253472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:53.276729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:53.278811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:53.279903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:53.282534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:53.427156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:53.427896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:53.446764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:53.447753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:53.465322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:53.466407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:53.543737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:53.561067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:53.568218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:53.571654 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9854a31a-bbdd-4095-b998-eab8742c4542 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.323586 Jul 20 11:16:53.575393 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2552/5123] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:53 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:54.223319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:54.237963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:54.246159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:54.266412 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-927c53e0-bfbe-4efd-997c-6730ad59c8ef tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.843444 Jul 20 11:16:54.281733 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2572/5124] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:53 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:54.594525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:54.596439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:54.611100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:54.612072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:54.613948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:54.616626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:54.927039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:54.947949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:54.953693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:54.956357 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4465395a-7f0f-4e60-ae84-88c95dfeba81 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.365995 Jul 20 11:16:54.959545 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2553/5125] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:54 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:55.289675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:55.290299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:55.313182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:55.315779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:55.316840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:55.323605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:55.982861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:55.983542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:55.996385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:56.001557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:56.003303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:56.004257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:57.014511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:57.030363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:57.034419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:57.035961 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-523fd81a-7a7c-48d6-8455-2dbb245c54e4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 1.057975 Jul 20 11:16:57.037180 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2554/5126] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:55 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:57.075781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:57.088646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:57.092954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:57.094533 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-107f5b7f-6752-436e-8d15-8a701b5ec176 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 1.808892 Jul 20 11:16:57.095729 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2573/5127] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:55 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:58.060013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:58.060875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:58.077326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:58.077769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:58.084507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:58.085194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:58.114487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:58.115124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:58.127958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:58.132679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:58.133703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:58.138913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:58.300794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:58.315738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:58.319826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:58.321560 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1310b510-35dd-4cae-8c02-d5befc1f2d79 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.269701 Jul 20 11:16:58.326000 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2555/5128] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:58 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:16:58.552418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:58.569731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:58.571263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:58.582487 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b0f07499-4d49-4935-b0f6-0e49cbba1cd5 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.463150 Jul 20 11:16:58.584753 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2574/5129] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:58 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:16:59.343943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:59.345163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:59.363348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:59.364738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:59.366090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:59.366766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:59.604507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:16:59.616420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:16:59.631823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:59.631823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:59.631823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:16:59.631823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:16:59.734114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:59.750525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:59.752367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:16:59.753597 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-12ff00b8-8f5e-4c8d-b854-f96adfbed0b2 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.413815 Jul 20 11:16:59.754174 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2556/5130] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:59 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:00.084111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:00.102301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:00.109327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:00.114359 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-748353f3-70d8-45e8-9d3c-03af328ac2d8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.513691 Jul 20 11:17:00.117138 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2575/5131] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:16:59 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:00.777005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:00.777620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:00.794884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:00.795370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:00.796175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:00.796597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:00.964188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:00.984744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:00.986696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:00.988131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-348f8d66-f21d-44df-8434-6e8aa64d8786 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.215822 Jul 20 11:17:00.989074 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2557/5132] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:00 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:01.060300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-83b4d80c-8418-446b-b298-a2aa0a1fd6d1 req-50f5e43c-c956-4cc0-a659-6ae2f0cc3747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "name": "network-vif-plugged", "status": "completed", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:01.085074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-83b4d80c-8418-446b-b298-a2aa0a1fd6d1 req-50f5e43c-c956-4cc0-a659-6ae2f0cc3747 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:01.086664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-83b4d80c-8418-446b-b298-a2aa0a1fd6d1 req-50f5e43c-c956-4cc0-a659-6ae2f0cc3747 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:01.117417 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-83b4d80c-8418-446b-b298-a2aa0a1fd6d1 req-50f5e43c-c956-4cc0-a659-6ae2f0cc3747 service nova] Creating event network-vif-plugged:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:17:01.134054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:01.135580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:01.144305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:01.144761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:01.146698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-83b4d80c-8418-446b-b298-a2aa0a1fd6d1 req-50f5e43c-c956-4cc0-a659-6ae2f0cc3747 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090507 Jul 20 11:17:01.147344 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2576/5133] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:01.148152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:01.148597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:01.746629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:01.761248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:01.763018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:01.764285 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-128b0b11-2dac-4c46-94f0-1a62846449b8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.634174 Jul 20 11:17:01.764876 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2558/5134] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:01 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:02.009863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:02.010619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:02.028126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:02.028478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:02.029288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:02.029732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:02.177608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:02.187156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:02.195505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:02.197704 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c736e7f0-b5a0-497c-bb51-900fcecd7fb7 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.193373 Jul 20 11:17:02.203040 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2577/5135] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:02 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:02.785617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:02.786292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:02.817289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:02.817748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:02.818529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:02.818966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:03.224272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:03.225187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:03.237644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:03.238192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:03.240028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:03.244175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:03.458213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:03.511743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:03.520047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:03.529144 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83231d0a-92ab-417a-b596-731e6bafe530 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1728 microversion: 2.20 time: 0.749821 Jul 20 11:17:03.529765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2559/5136] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:02 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1728 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:03.575940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:03.586282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=100 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:03.599487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:03.601424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:03.607727 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e017cb30-b95e-49db-806f-e35c57ef3420 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.387916 Jul 20 11:17:03.608557 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2578/5137] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:03 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:04.555301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:04.558178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:04.568385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:04.580762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:04.581602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:04.583665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:04.584568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:04.627794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:04.629119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:04.639875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=58 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:04.651214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:04.652059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:04.653113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:04.653785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:05.085828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:05.108318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:05.116047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:05.120186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0dc5bd32-ca63-4e94-adcf-7b579dcc7aef tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.494808 Jul 20 11:17:05.123546 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2579/5138] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:04 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:05.200153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:05.209700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:05.215625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:05.217101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-338af74f-b57d-4a11-954e-b014f3b45c2e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1715 microversion: 2.20 time: 0.673763 Jul 20 11:17:05.224179 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2560/5139] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:04 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1715 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:05.846896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1252501010", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": "none"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:05.936820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:17:05.937385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:17:05.938113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:17:05.938794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:17:05.939439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:17:05.950306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:05.951091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:05.952030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:05.953043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:05.977822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Getting quotas for project f95ecb90d22c47ada1285e812ebce624. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:17:05.990062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Getting quotas for user 6c29de656e1c4eebb07e4be89a92c428 and project f95ecb90d22c47ada1285e812ebce624. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:17:06.005898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:17:06.008577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:17:06.109352 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4ad36632-4921-4a7b-99ff-eb95a2669db0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.499352 Jul 20 11:17:06.110721 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2580/5140] 10.222.0.79 () {62 vars in 1187 bytes} [Wed Jul 20 11:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 11:17:06.121830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0b93e17-5fa1-429d-b187-0fb539fb544a tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:06.122510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f0b93e17-5fa1-429d-b187-0fb539fb544a tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:06.143040 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:06.143964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:06.167446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:06.167925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:06.168737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:06.169186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:06.273010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0b93e17-5fa1-429d-b187-0fb539fb544a tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:06.281910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0b93e17-5fa1-429d-b187-0fb539fb544a tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:06.283504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f0b93e17-5fa1-429d-b187-0fb539fb544a tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:06.285286 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f0b93e17-5fa1-429d-b187-0fb539fb544a tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1281 microversion: 2.47 time: 0.168133 Jul 20 11:17:06.296344 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2561/5141] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:06 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:06.365252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:06.383281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:06.385621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:06.389741 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6928b9d0-f4a8-40ea-bc9c-f372aab7c2ae tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1407 microversion: 2.54 time: 0.251497 Jul 20 11:17:06.393519 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2581/5142] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:06 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:07.304348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:07.305553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:07.349499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:07.349970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:07.351259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:07.352051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:07.412302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:07.412935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:07.424191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:07.429172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:07.430796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:07.435753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:07.482512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:07.498078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:07.505625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:07.506866 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09ceadbd-efcd-4867-bb90-c15851618116 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1285 microversion: 2.47 time: 0.206684 Jul 20 11:17:07.519466 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2562/5143] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:07 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1285 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:07.539720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:07.550469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:07.552476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:07.553804 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d4e511c8-9be8-4a58-bd7c-bb0c750e80c3 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1413 microversion: 2.54 time: 0.145497 Jul 20 11:17:07.554767 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2582/5144] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:07 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:08.528450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:08.529659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:08.539098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:08.539807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:08.541046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:08.541498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:08.573939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:08.574573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:08.583843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:08.584513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:08.586407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:08.595932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:08.634973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:08.644553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:08.654571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:08.659190 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-103914d9-6a23-48a6-aa94-655ca4b2c4ff tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1333 microversion: 2.47 time: 0.132245 Jul 20 11:17:08.659920 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2563/5145] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:08 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1333 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:08.706746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:08.717749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:08.719354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:08.720836 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1914544a-028c-414a-ae67-a09a2ad00884 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1413 microversion: 2.54 time: 0.151541 Jul 20 11:17:08.721778 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2583/5146] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:08 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:09.682590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:09.683264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:09.698194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:09.698709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:09.699537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:09.703961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:09.742984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:09.744680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:09.761705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:09.762330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:09.763954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:09.770831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:09.833189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:09.847821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:09.850252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:09.851644 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6e924a6f-6f01-4af3-8c92-73d475356d48 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1339 microversion: 2.47 time: 0.173769 Jul 20 11:17:09.864077 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2564/5147] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:09 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1339 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:09.967527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:09.978864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:09.987073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:09.988333 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3163c041-591f-4171-8733-3521a560789e tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1398 microversion: 2.54 time: 0.249679 Jul 20 11:17:09.996724 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2584/5148] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:09 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1398 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:10.021124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d924cfd-dc88-4d69-8195-c1d9e83d0bdd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '.version_select at 0x7f2c3eea2430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:10.063789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d924cfd-dc88-4d69-8195-c1d9e83d0bdd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-720670781" status: 204 len: 0 microversion: 2.54 time: 0.048924 Jul 20 11:17:10.070097 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2565/5149] 10.222.0.79 () {60 vars in 1315 bytes} [Wed Jul 20 11:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-720670781 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:17:10.081843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:10.084020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:10.104979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:10.105697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:10.107455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:10.107875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:10.179507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:10.477708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c9d7bea-33c6-4ecb-8e14-dee4087788cd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 204 len: 0 microversion: 2.54 time: 0.399225 Jul 20 11:17:10.482925 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2585/5150] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:17:10 2022] DELETE /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 11:17:10.491903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:10.492691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:10.508214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:10.508695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:10.521221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:10.521698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:10.669719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:10.714422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:10.724837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:10.727535 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a3372f1d-0ad3-4466-bba0-282bf614c8bd tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1404 microversion: 2.54 time: 0.243329 Jul 20 11:17:10.728900 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2566/5151] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:10 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:10.881326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:10.882824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:10.894259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:10.895274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:10.896363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:10.896954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:11.022047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:11.033532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:11.035078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:11.036675 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2c59903c-43e0-4bfc-a0e7-48b4fb9e6fd0 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1339 microversion: 2.47 time: 0.163190 Jul 20 11:17:11.038012 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2586/5152] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:10 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:11.747484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:11.748750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:11.759236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:11.760384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:11.762435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:11.763065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:11.767859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:11.769271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:11.779864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:11.787526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:11.788768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:11.789227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:11.864246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:11.874121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:11.875680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:11.877026 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-299a28cf-ac24-4561-a3ad-7836ea841898 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1404 microversion: 2.54 time: 0.134452 Jul 20 11:17:11.877599 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2567/5153] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:11 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:12.018854 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f830a17-38a0-4af9-9977-28b93f41cb74 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1836 microversion: 2.1 time: 0.263127 Jul 20 11:17:12.019490 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2587/5154] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:11 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1836 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:12.059605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:12.060111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:12.073686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.074328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.076864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.081592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.120465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:12.216701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:12.232612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:12.236913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:12.238246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9f1456b7-deb4-48ac-aeb3-21bc1c7f9309 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1360 microversion: 2.47 time: 0.183391 Jul 20 11:17:12.238824 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2568/5155] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:12 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:12.258484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-335725038"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:12.261221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:12.268992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.269865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.271151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.271837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.782427 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-60fe7d06-ceb7-4721-8933-a42b44503d39 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "POST /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499/action" status: 202 len: 52 microversion: 2.47 time: 0.527874 Jul 20 11:17:12.791392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2588/5156] 10.222.0.79 () {62 vars in 1318 bytes} [Wed Jul 20 11:17:12 2022] POST /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499/action => generated 52 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 20 11:17:12.801401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:12.802092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:12.816723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.817522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.818735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.820639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.881531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:12.906329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:12.907540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:12.947351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.949868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:12.952177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:12.952724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.020241 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-430dd97c-74f2-4276-a693-72ba1f0385d6 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "DELETE /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 204 len: 0 microversion: 2.47 time: 0.222785 Jul 20 11:17:13.021195 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2569/5157] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:17:12 2022] DELETE /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:17:13.029201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:13.029824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:13.042470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:13.043795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.045438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:13.045886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.177907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lazy-loading 'services' on Instance uuid 6f25e0a0-6ca1-4371-aa81-988613b56eb3 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:17:13.201072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:13.225768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:13.234294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14c8b4b6adfa469486e92995cf67c9d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4629e497eb46f480b61ca0937cc594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:13.235659 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92f0b4a0-eb24-45cd-aafc-5ce28ee9dfe4 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 200 len: 1404 microversion: 2.54 time: 0.342984 Jul 20 11:17:13.236250 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2589/5158] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:12 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 1404 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 11:17:13.245292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:13.249408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:13.265878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:13.265878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.269375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:13.269992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.410117 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1dd7986-2bf7-4388-8748-9fff087659ca tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments/8bc9a7d5-054a-42df-bc1a-c8412a6e572f" status: 202 len: 0 microversion: 2.1 time: 0.386210 Jul 20 11:17:13.411613 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2570/5159] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:17:13 2022] DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments/8bc9a7d5-054a-42df-bc1a-c8412a6e572f => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:17:13.420512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:13.421921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:13.429138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:13.429993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.431290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:13.431919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:13.479689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4088f302-45b3-4349-965b-33366451b5ac tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063346 Jul 20 11:17:13.484459 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2571/5160] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:13 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:17:13.532616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:13.550225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:13.551786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:13.552987 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9051af48-c550-44e1-91ff-2d200a9095a8 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1366 microversion: 2.47 time: 0.315806 Jul 20 11:17:13.555321 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2590/5161] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:13 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:13.578759 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:17:13.578759 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:17:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:17:14.255303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:14.255951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] [instance: c8ceee63-4819-45b5-a94c-cebb64da7ff4] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:14.284778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.285319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.286863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.287515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.328502 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] HTTP exception thrown: Instance c8ceee63-4819-45b5-a94c-cebb64da7ff4 could not be found. Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Request method failure captured: Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 HTTP/1.1 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-QIWXCLSWRWA7pblEoxqzf41CnAo7P5sIWWS20o0wIqYW4NNPCOuL-d9JHOOkIWJ0U_DnGBuTd5Sm7ArW3KtqNANlRKJu1H1ImnKBLO7FREjlU8SK3EsbFRFP_4oN_Ku7QspTFIoh_OU6hYaR2f3Ozdyz3yBfOmj61HnvPcIAnUff8 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.54 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8c4629e497eb46f480b61ca0937cc594 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerShowV254Test-244081607 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8c4629e497eb46f480b61ca0937cc594", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c4629e497eb46f480b61ca0937cc594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8c4629e497eb46f480b61ca0937cc594"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8c4629e497eb46f480b61ca0937cc594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerShowV254Test-244081607 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8c4629e497eb46f480b61ca0937cc594 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerShowV254Test-244081607 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerShowV254Test-244081607-project Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 14c8b4b6adfa469486e92995cf67c9d6 Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerShowV254Test-244081607-project Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c8ceee63-4819-45b5-a94c-cebb64da7ff4 could not be found. Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c8ceee63-4819-45b5-a94c-cebb64da7ff4'} Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ceee63-4819-45b5-a94c-cebb64da7ff4 could not be found. Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ceee63-4819-45b5-a94c-cebb64da7ff4 could not be found. Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:14.342490 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ceee63-4819-45b5-a94c-cebb64da7ff4 could not be found. Jul 20 11:17:14.346915 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:14.354904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] Returning 404 to user: Instance c8ceee63-4819-45b5-a94c-cebb64da7ff4 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:14.356217 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c859cd7-7734-4142-a41a-cf3c3accdf40 tempest-ServerShowV254Test-244081607 tempest-ServerShowV254Test-244081607-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4" status: 404 len: 111 microversion: 2.54 time: 0.105513 Jul 20 11:17:14.357046 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2572/5162] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:14 2022] GET /compute/v2.1/servers/c8ceee63-4819-45b5-a94c-cebb64da7ff4 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 11:17:14.425144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:14.426337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:14.444469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fdc828c9-e1db-4dd5-bf7f-85bc31fdc328 req-90dbd69c-2ba8-413a-a6da-025317249656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:14.451500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.452138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.453352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.455477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.471620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fdc828c9-e1db-4dd5-bf7f-85bc31fdc328 req-90dbd69c-2ba8-413a-a6da-025317249656 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.475991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fdc828c9-e1db-4dd5-bf7f-85bc31fdc328 req-90dbd69c-2ba8-413a-a6da-025317249656 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.526368 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fdc828c9-e1db-4dd5-bf7f-85bc31fdc328 req-90dbd69c-2ba8-413a-a6da-025317249656 service nova] Creating event network-changed:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h1-846219-10 Jul 20 11:17:14.539645 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fdc828c9-e1db-4dd5-bf7f-85bc31fdc328 req-90dbd69c-2ba8-413a-a6da-025317249656 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095818 Jul 20 11:17:14.545276 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2573/5163] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:17:14.565056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:14.577213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:14.580310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:14.613588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.614158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.628457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.628457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.760745 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ac3d1b5-bb2b-4f11-aa0c-7de08f75657a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212866 Jul 20 11:17:14.776622 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2574/5164] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:14 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:14.778291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:14.784742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:14.797976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:14.816434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.825981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.826948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.827535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.896800 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c98426c4-72de-4756-bda4-6f48a6a393ff tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 204 len: 0 microversion: 2.1 time: 0.475817 Jul 20 11:17:14.898698 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2591/5165] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:17:14 2022] DELETE /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:17:14.912184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:14.912895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:14.929702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.931824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:14.932659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:14.933098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:15.083585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:15.095678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:15.100436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:15.108578 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0811f416-5efe-48d5-a0a2-fb7670079537 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1366 microversion: 2.47 time: 0.330362 Jul 20 11:17:15.109774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2575/5166] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:14 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:15.323537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:15.333671 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6fdf65fb-01e8-475f-9d5b-2f6087aa024f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1689 microversion: 2.1 time: 0.429534 Jul 20 11:17:15.343225 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2592/5167] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:14 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1689 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:15.782792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:15.783955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:15.809791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:15.814156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:15.820278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:15.820894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:15.926828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dd20e195-04a4-4609-9e0e-7d26ee71a7e0 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147449 Jul 20 11:17:15.927575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2576/5168] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:15 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:16.128456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:16.129273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:16.133698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:16.136016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:16.170712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:16.180051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:16.182692 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:16.190229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:16.358457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:16.359459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:16.370454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:16.375276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:16.378952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:16.381812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:16.383201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:16.454895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:16.469510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:16.472259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c29de656e1c4eebb07e4be89a92c428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95ecb90d22c47ada1285e812ebce624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:16.473709 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1569c20-7b69-4a54-b4e2-e67e78b64604 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 200 len: 1366 microversion: 2.47 time: 0.350957 Jul 20 11:17:16.474310 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2593/5169] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:16 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:16.710176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:16.737417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1df18898-d180-4095-9f56-d4a1e0726fcf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1689 microversion: 2.1 time: 0.382670 Jul 20 11:17:16.742661 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2577/5170] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:16 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1689 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:16.940316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:16.944856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:16.977607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:16.981546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:16.982551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:16.985395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:17.073108 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d8cbaba8-d03e-4016-abe5-a3999c57854a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137496 Jul 20 11:17:17.076047 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2594/5171] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:16 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:17.497696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:17.498316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] [instance: 47b3a9fa-7882-4dc4-a682-a9e0387e0499] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:17.509510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:17.510075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:17.510870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:17.511356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:17.551201 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] HTTP exception thrown: Instance 47b3a9fa-7882-4dc4-a682-a9e0387e0499 could not be found. Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Request method failure captured: Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 HTTP/1.1 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Qxi7uru8en_pVBCl6zzvX3LHkF6TaCuNqLf0_LzClE8wzqyyc6iHoQutvU1duLABppIo3kLNkxcw-w6h6XHp2fs8vMPpBkumpw3opsBJUNCq1KcBANuzfKa2pk6BOX04e1l3uHae5SVdXInlCThW033de3oVZSZLLN6oXLgProQls Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.47 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f95ecb90d22c47ada1285e812ebce624 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersAaction247Test-65047367 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f95ecb90d22c47ada1285e812ebce624", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f95ecb90d22c47ada1285e812ebce624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f95ecb90d22c47ada1285e812ebce624"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f95ecb90d22c47ada1285e812ebce624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersAaction247Test-65047367 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f95ecb90d22c47ada1285e812ebce624 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersAaction247Test-65047367 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersAaction247Test-65047367-project Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 6c29de656e1c4eebb07e4be89a92c428 Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersAaction247Test-65047367-project Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 47b3a9fa-7882-4dc4-a682-a9e0387e0499 could not be found. Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '47b3a9fa-7882-4dc4-a682-a9e0387e0499'} Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b3a9fa-7882-4dc4-a682-a9e0387e0499 could not be found. Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b3a9fa-7882-4dc4-a682-a9e0387e0499 could not be found. Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:17.554350 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b3a9fa-7882-4dc4-a682-a9e0387e0499 could not be found. Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] Returning 404 to user: Instance 47b3a9fa-7882-4dc4-a682-a9e0387e0499 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c05c047d-b2e8-4f19-9f1f-858c3d0cc350 tempest-ServersAaction247Test-65047367 tempest-ServersAaction247Test-65047367-project] 10.222.0.79 "GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499" status: 404 len: 111 microversion: 2.47 time: 0.065949 Jul 20 11:17:17.561617 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2578/5172] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:17 2022] GET /compute/v2.1/servers/47b3a9fa-7882-4dc4-a682-a9e0387e0499 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:17:17.757243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:17.757946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:17.777950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:17.780251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:17.781742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:17.784309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:18.087697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:18.089335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:18.099107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:18.101602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:18.107534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:18.108402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:18.128754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:18.145656 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1689 microversion: 2.1 time: 0.390725 Jul 20 11:17:18.146610 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2595/5173] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:17 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1689 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:18.167131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c2640bfa-73dc-4f8b-9ad8-d25dfb4f4a3a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083707 Jul 20 11:17:18.167760 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2579/5174] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:18 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:18.256638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:18.258089 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-646fe315-73c0-403d-81f4-f99694d61d96 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.011110 Jul 20 11:17:18.258691 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2596/5175] 10.222.0.79 () {56 vars in 885 bytes} [Wed Jul 20 11:17:18 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 20 11:17:19.069363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-67d186b4-8bf4-46b5-a1fd-ab6310176beb req-fd18740e-e5ad-4e94-9dab-24d07e2ea2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088bace7-5d87-4ee8-b22e-b7d04f7d1715", "name": "network-vif-deleted", "tag": "cba36f1e-9a85-462c-a1a4-97a8856d537e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:19.112033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-67d186b4-8bf4-46b5-a1fd-ab6310176beb req-fd18740e-e5ad-4e94-9dab-24d07e2ea2a1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:19.112500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-67d186b4-8bf4-46b5-a1fd-ab6310176beb req-fd18740e-e5ad-4e94-9dab-24d07e2ea2a1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:19.144445 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-67d186b4-8bf4-46b5-a1fd-ab6310176beb req-fd18740e-e5ad-4e94-9dab-24d07e2ea2a1 service nova] Creating event network-vif-deleted:cba36f1e-9a85-462c-a1a4-97a8856d537e for instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 on n-h1-846219-10 Jul 20 11:17:19.164535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:19.167318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:19.188762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:19.189938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:19.191793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-67d186b4-8bf4-46b5-a1fd-ab6310176beb req-fd18740e-e5ad-4e94-9dab-24d07e2ea2a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329412 Jul 20 11:17:19.192434 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2580/5176] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:19.193356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:19.194225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:19.211339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:19.212932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:19.230304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:19.231374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:19.232441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:19.233633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:19.280665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:19.281117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:19.288650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lazy-loading 'fault' on Instance uuid 088bace7-5d87-4ee8-b22e-b7d04f7d1715 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:17:19.322345 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0b0d1d4b-8c17-4fe0-988b-0b4c837c8e0d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126063 Jul 20 11:17:19.326731 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2581/5177] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:19 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:19.427522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:19.445173 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-86a518f5-c1e3-4e50-95f6-9c9732efa8a5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 200 len: 1357 microversion: 2.1 time: 0.285576 Jul 20 11:17:19.447157 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2597/5178] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:19 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:20.344936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:20.347317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:20.363774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:20.366430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:20.368123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:20.369866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:20.466157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:20.467572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 088bace7-5d87-4ee8-b22e-b7d04f7d1715] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:20.490649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:20.491006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:20.491750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:20.492249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:20.506682 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fdc38b22-a38c-4c1e-906a-d95f94ad5ad9 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174064 Jul 20 11:17:20.522765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2582/5179] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:20 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:20.605235 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] HTTP exception thrown: Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 could not be found. Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Request method failure captured: Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 HTTP/1.1 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-NsHgD1X9xCH8UswZQ8XuqtrhrxB-IRut7fm28RDiSMw1Pzd_sQ25idIpkeMBx8-UzBC0PftqhOFe4sVzXqymorzT0o6MkFlvC4cYzqx2lJYHP4RNbE-KBjwfr_Y-bgrkHdhfqgDjhndhBbUQm8CCziWKwDog3STtrzu-O8-1UpCHw Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8a593b39b87146aeaeb5f515181fd374", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 73af3e843b3c4c1a8d933b29cfc20508 Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 could not be found. Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '088bace7-5d87-4ee8-b22e-b7d04f7d1715'} Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 could not be found. Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 could not be found. Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:20.613104 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 could not be found. Jul 20 11:17:20.617670 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:20.620075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Returning 404 to user: Instance 088bace7-5d87-4ee8-b22e-b7d04f7d1715 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:20.622507 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bfd27d53-4b48-4f7d-9750-ca038510f3d9 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715" status: 404 len: 111 microversion: 2.1 time: 0.161402 Jul 20 11:17:20.623781 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2598/5180] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:20 2022] GET /compute/v2.1/servers/088bace7-5d87-4ee8-b22e-b7d04f7d1715 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:17:21.530394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:21.532302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:21.548781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:21.549233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:21.550062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:21.559329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:21.623952 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8fb21995-5017-4771-ad46-d39cbc021624 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096924 Jul 20 11:17:21.624962 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2583/5181] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:21 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:22.636570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:22.637515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:22.658004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:22.658428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:22.663767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:22.664401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:22.766803 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5a586a8-55d2-4016-be5f-a83389d34c3d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134977 Jul 20 11:17:22.777556 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2599/5182] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:22 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:23.779529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:23.780538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:23.793730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:23.794189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:23.794976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:23.802963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:23.908317 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f203184a-00d0-45c6-9399-056510368737 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133979 Jul 20 11:17:23.909680 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2584/5183] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:17:23 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:17:24.094389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:24.096210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:24.110470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.111838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.114134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.122453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.173745 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Cannot 'reboot' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action HTTP/1.1 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 28 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: {"reboot": {"type": "HARD"}} Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: exception: Cannot 'reboot' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '9e02e9ad-0e6d-4fa1-baff-10ce30573f34', 'body': {'reboot': {'type': 'HARD'}}} Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:17:24.186565 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.190603 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.193019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 409 to user: Cannot 'reboot' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:24.194089 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7dc57df-9d57-4f59-9ccf-b0862ffa080a tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action" status: 409 len: 145 microversion: 2.1 time: 0.106205 Jul 20 11:17:24.195121 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2600/5184] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:17:24 2022] POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action => generated 145 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:17:24.206888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:24.208810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:24.225442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.226007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.226885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.227995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.274844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:24.285246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Cannot 'rebuild' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action HTTP/1.1 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 65 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: exception: Cannot 'rebuild' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9e02e9ad-0e6d-4fa1-baff-10ce30573f34', 'body': {'rebuild': {'imageRef': '478de60b-94fe-4326-bea5-987154e218b6'}}} Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:17:24.296439 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued Jul 20 11:17:24.300326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:24.303116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 409 to user: Cannot 'rebuild' instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 while it is in vm_state rescued {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:24.304247 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aeb0ea73-f031-4716-b387-fa18156f4809 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action" status: 409 len: 146 microversion: 2.1 time: 0.101784 Jul 20 11:17:24.307061 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2585/5185] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:17:24 2022] POST /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34/action => generated 146 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:17:24.318094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:24.319292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:24.330120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.330586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.331705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.332153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.433159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:24.691889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-62e63ec6-dcf6-45b2-9351-1a6c65957317 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 204 len: 0 microversion: 2.1 time: 0.377678 Jul 20 11:17:24.695683 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2601/5186] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:17:24 2022] DELETE /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:17:24.701521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:24.702578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:24.726570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.727232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:24.728354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:24.728854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:26.177906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:26.226891 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2d200a41-d341-4700-bad1-723a19fe8299 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1689 microversion: 2.1 time: 1.529022 Jul 20 11:17:26.235301 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2586/5187] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:24 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1689 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:27.250794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:27.253581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:27.285050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:27.286526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:27.287833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:27.288535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:27.730200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-659358275", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:27.873638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:17:28.145373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:28.163407 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b7a61f9d-d541-46ab-9c84-3a30930dbf9b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1689 microversion: 2.1 time: 0.916698 Jul 20 11:17:28.182736 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2602/5188] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:27 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1689 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:28.374888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9955faa5-af0d-41bc-b5f8-24d7aaf03348 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '.version_select at 0x7f2c3e762ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:28.421798 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9955faa5-af0d-41bc-b5f8-24d7aaf03348 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2065056248" status: 202 len: 0 microversion: 2.1 time: 0.051422 Jul 20 11:17:28.434226 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2603/5189] 10.222.0.79 () {58 vars in 1283 bytes} [Wed Jul 20 11:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2065056248 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:17:28.462907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-16ede5a9-473d-4a03-9f76-d7d2f4ac464f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: .version_select at 0x7f2c3e769a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1231430905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENl7YTurpNe6W2bKZpyUrlC9S6gn9WxJEnJcb0Z7Ny9omdkiRtIHwvuygHK435eyRg9ono+WQuxc9Xz8asmkmC0gB6y7z2fRWY37RrBS3iDHNVys+f+K/PVCsmoBQpN8A=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:28.504159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-16ede5a9-473d-4a03-9f76-d7d2f4ac464f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:17:28.514623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-16ede5a9-473d-4a03-9f76-d7d2f4ac464f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:17:28.578512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-16ede5a9-473d-4a03-9f76-d7d2f4ac464f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.123821 Jul 20 11:17:28.579563 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2604/5190] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:17:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:29.060534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:17:29.061395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:17:29.062977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:17:29.064375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:17:29.065761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:17:29.094382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:29.096145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:29.096969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:29.097868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:29.139815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Getting quotas for project 313442f50afe42b89e3074aea10c9434. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:17:29.151298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Getting quotas for user 516392a088074993a1637cbea691525f and project 313442f50afe42b89e3074aea10c9434. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:17:29.188091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:17:29.189080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:29.190296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:29.190860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:17:29.199891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:29.200687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:29.201768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:29.203881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:29.259623 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-025f93a7-ddc5-4265-9753-6c2a6a43c981 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534359 Jul 20 11:17:29.268285 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2587/5191] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:17:29.279864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7e967b55-fee3-4c20-88a7-c7c6a9c965ff tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:29.280918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7e967b55-fee3-4c20-88a7-c7c6a9c965ff tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:30.389410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7e967b55-fee3-4c20-88a7-c7c6a9c965ff tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:30.405661 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7e967b55-fee3-4c20-88a7-c7c6a9c965ff tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1214 microversion: 2.1 time: 1.129761 Jul 20 11:17:30.410577 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2588/5192] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:29 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1214 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:30.749041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:30.763474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7ba142b-3d16-4faf-a90d-4a452f826d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1689 microversion: 2.1 time: 1.583351 Jul 20 11:17:30.769099 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2605/5193] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:29 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1689 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:31.341068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3c9decd7-fc19-438b-81b1-72f11b9d73a8 req-45994ecc-38bd-48f1-b4ea-0765e3d7a6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "name": "network-vif-unplugged", "status": "completed", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:31.363263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c9decd7-fc19-438b-81b1-72f11b9d73a8 req-45994ecc-38bd-48f1-b4ea-0765e3d7a6c6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:31.363747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c9decd7-fc19-438b-81b1-72f11b9d73a8 req-45994ecc-38bd-48f1-b4ea-0765e3d7a6c6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:31.397555 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3c9decd7-fc19-438b-81b1-72f11b9d73a8 req-45994ecc-38bd-48f1-b4ea-0765e3d7a6c6 service nova] Creating event network-vif-unplugged:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:17:31.415486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3c9decd7-fc19-438b-81b1-72f11b9d73a8 req-45994ecc-38bd-48f1-b4ea-0765e3d7a6c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.381577 Jul 20 11:17:31.416290 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2589/5194] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:31.440425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:31.443222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:31.515441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:31.516182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:31.518715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:31.520961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:31.786549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:31.787419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:31.821674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:31.823029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:31.827359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:31.828034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:31.831956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:31.863708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb494216-c2f0-455b-9c4b-cd5a02b94e7f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1266 microversion: 2.1 time: 0.432762 Jul 20 11:17:31.865039 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2606/5195] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:31 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1266 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:32.113424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:32.125040 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2bb76ab0-4295-4655-9cdc-7a755ee0aab7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1622 microversion: 2.1 time: 0.343410 Jul 20 11:17:32.129155 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2590/5196] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:31 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1622 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:17:32.882327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:32.883023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:32.886133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:32.892759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:32.893701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:32.894688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:32.895394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:33.101316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:33.107775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1e1f689f-2f28-46e2-b91a-e94e42ed6d5c req-b6ebbd14-a5a7-47ae-8257-e194d9b0dcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f25e0a0-6ca1-4371-aa81-988613b56eb3", "name": "network-vif-deleted", "tag": "35d3a1b7-3afb-4a90-be85-749a77d2c296"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:33.123619 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c78cbac0-0543-41ff-b9a5-2697a40db5e7 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1272 microversion: 2.1 time: 0.245222 Jul 20 11:17:33.139533 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2607/5197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:32 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:33.148141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1e1f689f-2f28-46e2-b91a-e94e42ed6d5c req-b6ebbd14-a5a7-47ae-8257-e194d9b0dcec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:33.151847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1e1f689f-2f28-46e2-b91a-e94e42ed6d5c req-b6ebbd14-a5a7-47ae-8257-e194d9b0dcec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:33.153565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:33.182810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:33.202414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:33.204385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:33.206326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:33.207579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:33.215232 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1e1f689f-2f28-46e2-b91a-e94e42ed6d5c req-b6ebbd14-a5a7-47ae-8257-e194d9b0dcec service nova] Creating event network-vif-deleted:35d3a1b7-3afb-4a90-be85-749a77d2c296 for instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 on n-h2-846219-10 Jul 20 11:17:33.253136 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1e1f689f-2f28-46e2-b91a-e94e42ed6d5c req-b6ebbd14-a5a7-47ae-8257-e194d9b0dcec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153471 Jul 20 11:17:33.259142 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2591/5198] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:33.440524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:33.452765 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efcbd0db-ced0-4570-8634-aeba56a56c75 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 200 len: 1330 microversion: 2.1 time: 0.309466 Jul 20 11:17:33.454075 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2608/5199] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:33 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 1330 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:34.143490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:34.144306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:34.179111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:34.179483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:34.180895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:34.181252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:34.436108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:34.448776 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b218e43b-9168-46f5-912e-809cea591413 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1272 microversion: 2.1 time: 0.309374 Jul 20 11:17:34.454197 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2592/5200] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:34 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:34.470293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:34.471125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 6f25e0a0-6ca1-4371-aa81-988613b56eb3] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:34.481529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:34.482484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:34.496948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:34.497634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:34.521973 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 could not be found. Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 HTTP/1.1 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 could not be found. Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '6f25e0a0-6ca1-4371-aa81-988613b56eb3'} Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 could not be found. Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 could not be found. Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:34.530345 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 could not be found. Jul 20 11:17:34.534413 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:34.537330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 404 to user: Instance 6f25e0a0-6ca1-4371-aa81-988613b56eb3 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:34.539116 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c566a4c2-0d0b-48b1-98e5-2a5425391d76 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3" status: 404 len: 111 microversion: 2.1 time: 0.072705 Jul 20 11:17:34.557814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56afe28c-5a14-4466-a1e5-71c90fbc7bf7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '.version_select at 0x7f2c3f43f8b0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:34.561754 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2609/5201] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:34 2022] GET /compute/v2.1/servers/6f25e0a0-6ca1-4371-aa81-988613b56eb3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:17:34.598843 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56afe28c-5a14-4466-a1e5-71c90fbc7bf7 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593615059" status: 202 len: 0 microversion: 2.1 time: 0.046153 Jul 20 11:17:34.601315 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2593/5202] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 11:17:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1593615059 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:17:35.470441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:35.471087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:35.478483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:35.489885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:35.490700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:35.491179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:35.703560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:35.705980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:35.719469 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51a2628c-b0c8-4fb2-82b4-d62a3ac6e1bb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1272 microversion: 2.1 time: 0.248649 Jul 20 11:17:35.720557 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2610/5203] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:35 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:36.738842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:36.739646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:36.760384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:36.764015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:36.764546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:36.768599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:36.768599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:37.755073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:37.768266 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9817241b-2c67-4143-b85e-94b40eb9f4fd tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 1.035140 Jul 20 11:17:37.784505 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2594/5204] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:36 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:37.982646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:37.983849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:38.005109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.005263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.006051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.006487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.076157 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b89cb3b6-8571-40c8-b641-7f1206a5c74b tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.099245 Jul 20 11:17:38.077056 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2611/5205] 10.222.0.79 () {60 vars in 1342 bytes} [Wed Jul 20 11:17:37 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:38.178945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:38.179488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:38.196930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.197617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.198419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.198864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.331017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:38.697546 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef75e9ad-cd69-4c76-828c-cad66624ec8d tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 204 len: 0 microversion: 2.20 time: 0.522387 Jul 20 11:17:38.700389 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2595/5206] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:17:38 2022] DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:17:38.708392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:38.709020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:38.711117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:38.732991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.733471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.736231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.736726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.787537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:38.790527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:38.816030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.816527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:38.818752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:38.819238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:39.114666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:40.193454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:40.210654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:40.217604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:40.219566 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a0fa6d1-983f-41c6-87be-4d1956310afe tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1721 microversion: 2.20 time: 1.515035 Jul 20 11:17:40.224379 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2612/5207] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:38 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1721 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:40.247299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:40.262062 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-00d4b8b8-38cc-46f2-af26-7b78212c232d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 1.479094 Jul 20 11:17:40.262678 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2596/5208] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:38 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:41.244429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:41.245130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:41.277580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:41.277580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:41.277580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:41.277580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:41.280678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:41.281424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:41.284788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:41.311988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:41.312447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:41.313231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:41.329568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:41.696410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:41.709647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:41.730762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10d795e205ec46efa3393368a9567374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08962304189a4134a48f4fc532a13400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:41.735940 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-859362e1-77b8-482d-b5ae-06e158034b3a tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 200 len: 1655 microversion: 2.20 time: 0.495653 Jul 20 11:17:41.737860 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2613/5209] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:41 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 1655 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 11:17:42.226417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a9f2181f-9337-4ffa-8c22-f7da742cd77c req-5b4cefb6-9662-462b-b35c-57fbbefc72fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a2eb47-de84-4d6d-a543-40b203d24fa7", "name": "network-vif-deleted", "tag": "e5886a3d-37c1-4d74-8bc3-fb290f9c48b1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:42.281092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a9f2181f-9337-4ffa-8c22-f7da742cd77c req-5b4cefb6-9662-462b-b35c-57fbbefc72fa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:42.281831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a9f2181f-9337-4ffa-8c22-f7da742cd77c req-5b4cefb6-9662-462b-b35c-57fbbefc72fa service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:42.339788 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a9f2181f-9337-4ffa-8c22-f7da742cd77c req-5b4cefb6-9662-462b-b35c-57fbbefc72fa service nova] Creating event network-vif-deleted:e5886a3d-37c1-4d74-8bc3-fb290f9c48b1 for instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 on n-h2-846219-10 Jul 20 11:17:42.364207 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a9f2181f-9337-4ffa-8c22-f7da742cd77c req-5b4cefb6-9662-462b-b35c-57fbbefc72fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142019 Jul 20 11:17:42.370034 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2614/5210] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:17:42.760178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:42.761234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:42.777930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:42.780878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:42.783933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:42.785086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:42.826553 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] HTTP exception thrown: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Request method failure captured: Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 HTTP/1.1 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-KBgOqPITi6XWd2W0DLp7SvK9xJf0kJlcN_aLAsxbQr6nUh9T3rvUucwksCDdK9qfUdAhrx8UyeXMUraDGrp-OxauWDgycodHVLC5eAShRopFt2IaauTo1D4GZi8Y01sYEJiRq9vIqbrUP6PH50Cdg_hT5ZkfuN3I9QpwUnkwwHvmY Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08962304189a4134a48f4fc532a13400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08962304189a4134a48f4fc532a13400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 10d795e205ec46efa3393368a9567374 Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '44a2eb47-de84-4d6d-a543-40b203d24fa7'} Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:42.832001 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:42.838031 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:42.841927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Returning 404 to user: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:42.844178 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-306d55ba-9e0e-4534-aac8-9d6bbe6dac7e tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 404 len: 111 microversion: 2.20 time: 0.091380 Jul 20 11:17:42.846625 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2615/5211] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:42 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:17:42.858316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-961ffe61-47ce-4ff4-ac90-f2df44aef9b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '.version_select at 0x7f2c3e74ef70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:42.898463 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-961ffe61-47ce-4ff4-ac90-f2df44aef9b2 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059712358" status: 204 len: 0 microversion: 2.20 time: 0.047126 Jul 20 11:17:42.902244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2616/5212] 10.222.0.79 () {60 vars in 1261 bytes} [Wed Jul 20 11:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059712358 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 11:17:43.224862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:43.236004 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-71a66f2e-5be6-44b6-9f68-96dff3704f29 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 1.960238 Jul 20 11:17:43.251670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2597/5213] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:41 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:44.094977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d0fc9257-6f87-41b5-8d5e-d7cdd8c1f012 req-43e0ab93-b97e-4e1d-8079-6772f28ab265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84318835-5d0e-47f5-bcb7-b61de58c91b5", "tag": "a802d313-16e1-4586-b685-c30bbacd2dd4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:44.135601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d0fc9257-6f87-41b5-8d5e-d7cdd8c1f012 req-43e0ab93-b97e-4e1d-8079-6772f28ab265 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:44.136114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d0fc9257-6f87-41b5-8d5e-d7cdd8c1f012 req-43e0ab93-b97e-4e1d-8079-6772f28ab265 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:44.205011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d0fc9257-6f87-41b5-8d5e-d7cdd8c1f012 req-43e0ab93-b97e-4e1d-8079-6772f28ab265 service nova] Creating event network-changed:a802d313-16e1-4586-b685-c30bbacd2dd4 for instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 on n-h2-846219-10 Jul 20 11:17:44.231947 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d0fc9257-6f87-41b5-8d5e-d7cdd8c1f012 req-43e0ab93-b97e-4e1d-8079-6772f28ab265 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134897 Jul 20 11:17:44.233256 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2617/5214] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:44.265112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:44.265797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:44.287349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:44.290085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:44.295955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:44.298566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:46.230352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:46.257442 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3bf7d242-00a5-4e2d-880a-8ed861fd9362 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 1.994164 Jul 20 11:17:46.263771 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2598/5215] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:44 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:47.278725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:47.279475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:47.300651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:47.301112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:47.301907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:47.302347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:47.815365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:47.815859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:47.837572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:47.837803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:47.849393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:47.850256 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:47.988549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:48.087396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:48.103422 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1dbd4f80-ff9a-40a3-a319-812f3ddf077d tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 0.830355 Jul 20 11:17:48.112767 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2618/5216] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:47 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:48.269891 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb4ed40e-b166-4c05-b3c6-5fd6c404e45b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 204 len: 0 microversion: 2.1 time: 0.453585 Jul 20 11:17:48.279254 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2599/5217] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:17:47 2022] DELETE /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 11:17:48.298012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:48.304927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:48.338504 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:48.342177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:48.343037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:48.343525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:48.505446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-924221767", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "0a7ec6d8-c0b5-4cd7-babb-97076edee850"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:48.632437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] validate_networks() for [('0a7ec6d8-c0b5-4cd7-babb-97076edee850', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:17:49.567756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:49.584307 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11413e5e-626b-46b3-80df-fe4cb1ccde5d tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1508 microversion: 2.1 time: 1.298970 Jul 20 11:17:49.586875 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2600/5218] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:48 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1508 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:49.599120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:49.600657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:49.637254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:49.640015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:49.643380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:49.651062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:50.724411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:50.742405 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94e20938-09ae-4b19-bed4-05576d745eb5 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 1.153423 Jul 20 11:17:50.743212 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2601/5219] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:49 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:50.748823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:50.754420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:50.769780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:50.778071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:50.780733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:50.785579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.070291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:52.097178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:17:52.105521 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7fa757ab-3743-4508-b557-22a9c2d93527 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1508 microversion: 2.1 time: 1.360061 Jul 20 11:17:52.118493 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2602/5220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:50 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1508 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:52.149701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:52.150219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:52.151599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:17:52.153268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:17:52.154385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:17:52.157312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:17:52.158826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:17:52.183760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.184220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.185521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.185521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.192748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.193969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.198819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.199584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.240260 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] HTTP exception thrown: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Request method failure captured: Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 HTTP/1.1 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-KBgOqPITi6XWd2W0DLp7SvK9xJf0kJlcN_aLAsxbQr6nUh9T3rvUucwksCDdK9qfUdAhrx8UyeXMUraDGrp-OxauWDgycodHVLC5eAShRopFt2IaauTo1D4GZi8Y01sYEJiRq9vIqbrUP6PH50Cdg_hT5ZkfuN3I9QpwUnkwwHvmY Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08962304189a4134a48f4fc532a13400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08962304189a4134a48f4fc532a13400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 10d795e205ec46efa3393368a9567374 Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '44a2eb47-de84-4d6d-a543-40b203d24fa7'} Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:52.246090 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Returning 404 to user: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6bde68e4-8b18-4047-bad6-74f1713fd930 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 404 len: 111 microversion: 2.20 time: 0.127364 Jul 20 11:17:52.250679 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2603/5221] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:17:52 2022] DELETE /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:17:52.262809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:52.265673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:52.291263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Getting quotas for project 992c1273a69747bbbaafc13bd860e626. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:17:52.295706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.298546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.299482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.299941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.302566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Getting quotas for user e33a3559e4d74e5cbff303dbd351aefa and project 992c1273a69747bbbaafc13bd860e626. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:17:52.341256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:17:52.345006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:17:52.510914 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd21291d-4054-49b1-b401-8e0fa1d7ded3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.396456 Jul 20 11:17:52.513375 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2619/5222] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:17:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:17:52.530964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:52.535441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: 44a2eb47-de84-4d6d-a543-40b203d24fa7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:52.552506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.553259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.554335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:52.555330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:52.579038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] HTTP exception thrown: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Request method failure captured: Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 HTTP/1.1 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-KBgOqPITi6XWd2W0DLp7SvK9xJf0kJlcN_aLAsxbQr6nUh9T3rvUucwksCDdK9qfUdAhrx8UyeXMUraDGrp-OxauWDgycodHVLC5eAShRopFt2IaauTo1D4GZi8Y01sYEJiRq9vIqbrUP6PH50Cdg_hT5ZkfuN3I9QpwUnkwwHvmY Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08962304189a4134a48f4fc532a13400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08962304189a4134a48f4fc532a13400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 10d795e205ec46efa3393368a9567374 Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '44a2eb47-de84-4d6d-a543-40b203d24fa7'} Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.581672 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. Jul 20 11:17:52.586151 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:17:52.589988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Returning 404 to user: Instance 44a2eb47-de84-4d6d-a543-40b203d24fa7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:52.592341 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12fe5685-65d8-4a8a-a753-b0258c0b80c8 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7" status: 404 len: 111 microversion: 2.20 time: 0.071973 Jul 20 11:17:52.593691 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2620/5223] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:52 2022] GET /compute/v2.1/servers/44a2eb47-de84-4d6d-a543-40b203d24fa7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:17:52.602413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-71e029a5-8830-43fe-a650-4d00a798401d tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:52.604085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-71e029a5-8830-43fe-a650-4d00a798401d tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:52.698441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:52.709998 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-db7b8a16-df4e-44ff-a131-d3d388e1db4b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 0.457263 Jul 20 11:17:52.752306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-71e029a5-8830-43fe-a650-4d00a798401d tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:52.754249 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2604/5224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:52 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:52.762308 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-71e029a5-8830-43fe-a650-4d00a798401d tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1216 microversion: 2.1 time: 0.167281 Jul 20 11:17:52.764513 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2621/5225] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:52 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:53.136533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:53.137157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:53.163414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:53.163870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:53.172126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:53.173351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:53.736533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:53.737161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:53.749185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:53.749991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:53.751134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:53.752082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:53.851061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:53.863581 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68f04c65-a0ff-4e33-96e5-264625403c88 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1508 microversion: 2.1 time: 0.732483 Jul 20 11:17:53.867018 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2605/5226] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:53 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1508 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:53.873144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:53.879042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:53.904318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:53.905056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:53.910998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:53.915028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:54.101096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:54.112120 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-64f82c9f-f729-4747-b974-3d42826cceb7 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1212 microversion: 2.1 time: 0.243116 Jul 20 11:17:54.112732 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2606/5227] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:53 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1212 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:54.314334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:54.323883 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea5bad75-6b0b-4c39-bd07-da041a64e14b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 0.591731 Jul 20 11:17:54.332869 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2622/5228] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:53 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:54.517065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-872a6c63-195e-4716-9ead-e430e71049af req-01b58516-c938-43db-b5aa-d3725d902c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e02e9ad-0e6d-4fa1-baff-10ce30573f34", "name": "network-vif-deleted", "tag": "1d735cda-27da-461c-8955-9e268908d36f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:54.542878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-872a6c63-195e-4716-9ead-e430e71049af req-01b58516-c938-43db-b5aa-d3725d902c32 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:54.549975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-872a6c63-195e-4716-9ead-e430e71049af req-01b58516-c938-43db-b5aa-d3725d902c32 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:54.591850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-872a6c63-195e-4716-9ead-e430e71049af req-01b58516-c938-43db-b5aa-d3725d902c32 service nova] Creating event network-vif-deleted:1d735cda-27da-461c-8955-9e268908d36f for instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 on n-h2-846219-10 Jul 20 11:17:54.602340 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-872a6c63-195e-4716-9ead-e430e71049af req-01b58516-c938-43db-b5aa-d3725d902c32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098466 Jul 20 11:17:54.604247 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2607/5229] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:17:54.881470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:54.882274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:54.914879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:54.920459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:54.921592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:54.923373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:55.044078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:55.055669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:55.059467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lazy-loading 'fault' on Instance uuid 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:17:55.133411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:55.134145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:55.155364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:55.157672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:55.168052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:55.171581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:55.180421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:55.200666 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-738df4ba-801e-47a2-8ddf-4c22684a020e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 200 len: 1311 microversion: 2.1 time: 0.322896 Jul 20 11:17:55.203792 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2623/5230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:54 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:55.349670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:55.353209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:55.390592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:55.394061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:55.401003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:55.440955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:55.534922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:55.557060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6728dd8c-7de3-415d-88ed-1ef5a7b57057 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1274 microversion: 2.1 time: 0.431160 Jul 20 11:17:55.565832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2608/5231] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:55 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1274 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:55.836474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:55.852927 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bd12f80e-f410-4236-bd7c-acd421dcce23 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 0.506726 Jul 20 11:17:55.861424 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2624/5232] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:55 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:56.223947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:56.224600 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 9e02e9ad-0e6d-4fa1-baff-10ce30573f34] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:56.250887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.251391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.261553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.262042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.312267 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 could not be found. Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 HTTP/1.1 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 could not be found. Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '9e02e9ad-0e6d-4fa1-baff-10ce30573f34'} Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 could not be found. Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 could not be found. Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:56.323271 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 could not be found. Jul 20 11:17:56.327436 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:56.329454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 404 to user: Instance 9e02e9ad-0e6d-4fa1-baff-10ce30573f34 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:56.332765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f292bd5a-fb90-4926-aaed-47f2f29b787e tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34" status: 404 len: 111 microversion: 2.1 time: 0.115070 Jul 20 11:17:56.336803 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2609/5233] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:56 2022] GET /compute/v2.1/servers/9e02e9ad-0e6d-4fa1-baff-10ce30573f34 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:17:56.346688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:56.347856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:56.368860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.369948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.372585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.374232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.471763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:17:56.583535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:56.584866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:56.601103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.604629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.605774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.606937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.728368 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-144ee84d-0b82-4bd9-8988-b40552bf1e4b tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 204 len: 0 microversion: 2.1 time: 0.386267 Jul 20 11:17:56.734181 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2625/5234] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:17:56 2022] DELETE /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:17:56.744157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:56.745323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:56.753723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.754659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.756074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:56.756781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:56.991736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:57.009726 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-13479c1d-53a3-4594-b08b-67feb15ca2a2 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1274 microversion: 2.1 time: 0.430116 Jul 20 11:17:57.016880 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2610/5235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:56 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1274 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:57.026867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:57.028832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:57.048204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:57.050184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:57.052021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:57.053657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:57.435385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:57.455456 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-422f5d0f-32e5-42f1-ad7d-1301cea59cb4 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 0.709121 Jul 20 11:17:57.456673 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2626/5236] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:56 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:57.732423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:57.751512 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b211cbf-581b-47a4-9e92-59f0a4672c1b tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 0.733091 Jul 20 11:17:57.754130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2611/5237] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:57 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:58.035521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:58.036461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:58.044142 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.045084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:58.046057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.046665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:58.150144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:58.162907 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe1b77ba-d1e0-4c80-ad46-ab7ee146fc17 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1274 microversion: 2.1 time: 0.131839 Jul 20 11:17:58.164530 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2627/5238] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:58 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:58.478597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:58.479880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:58.494904 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.495414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:58.500578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.503060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:58.587745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-142a035c-a9aa-4d2c-ac39-5c17841c41be req-1b2a6ddf-f9fe-42f8-b1a8-12f75cdaf4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84318835-5d0e-47f5-bcb7-b61de58c91b5", "name": "network-vif-plugged", "status": "completed", "tag": "a802d313-16e1-4586-b685-c30bbacd2dd4"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:17:58.628923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-142a035c-a9aa-4d2c-ac39-5c17841c41be req-1b2a6ddf-f9fe-42f8-b1a8-12f75cdaf4c8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.632036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-142a035c-a9aa-4d2c-ac39-5c17841c41be req-1b2a6ddf-f9fe-42f8-b1a8-12f75cdaf4c8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:58.685039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-142a035c-a9aa-4d2c-ac39-5c17841c41be req-1b2a6ddf-f9fe-42f8-b1a8-12f75cdaf4c8 service nova] Creating event network-vif-plugged:a802d313-16e1-4586-b685-c30bbacd2dd4 for instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 on n-h2-846219-10 Jul 20 11:17:58.709581 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-142a035c-a9aa-4d2c-ac39-5c17841c41be req-1b2a6ddf-f9fe-42f8-b1a8-12f75cdaf4c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123311 Jul 20 11:17:58.714886 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2628/5239] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:17:58.776878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:58.777756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:58.811731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.813009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:58.816023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:58.822982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.518606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:59.536919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bbe59793-1ce9-4567-bee1-4df23ca87de9 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 0.768991 Jul 20 11:17:59.541748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2629/5240] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:58 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:59.562909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:59.566996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:59.576740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:17:59.589724 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3410378b-588d-4810-9ca5-3ca7cf26f4ed tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1521 microversion: 2.1 time: 1.115590 Jul 20 11:17:59.591544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2612/5241] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:58 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1521 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:17:59.595978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:59.596499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.600730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:59.602020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.853858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:59.854621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:59.866657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:59.869733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.870767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:59.871703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.938897 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] HTTP exception thrown: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Request method failure captured: Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 HTTP/1.1 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-KBgOqPITi6XWd2W0DLp7SvK9xJf0kJlcN_aLAsxbQr6nUh9T3rvUucwksCDdK9qfUdAhrx8UyeXMUraDGrp-OxauWDgycodHVLC5eAShRopFt2IaauTo1D4GZi8Y01sYEJiRq9vIqbrUP6PH50Cdg_hT5ZkfuN3I9QpwUnkwwHvmY Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08962304189a4134a48f4fc532a13400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08962304189a4134a48f4fc532a13400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 10d795e205ec46efa3393368a9567374 Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'bb1f20dc-f27d-4e5b-97fb-35a4393cd592'} Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:17:59.940715 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:17:59.945493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Returning 404 to user: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:17:59.947000 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c646ed1c-aacd-4f07-be04-4025ecd52937 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 404 len: 111 microversion: 2.20 time: 0.098068 Jul 20 11:17:59.948012 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2613/5242] 10.222.0.79 () {60 vars in 1279 bytes} [Wed Jul 20 11:17:59 2022] DELETE /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 11:17:59.956231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:17:59.957036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] [instance: bb1f20dc-f27d-4e5b-97fb-35a4393cd592] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:17:59.972073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:59.972531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.973422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:17:59.973961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:17:59.998648 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] HTTP exception thrown: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Request method failure captured: Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 HTTP/1.1 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-KBgOqPITi6XWd2W0DLp7SvK9xJf0kJlcN_aLAsxbQr6nUh9T3rvUucwksCDdK9qfUdAhrx8UyeXMUraDGrp-OxauWDgycodHVLC5eAShRopFt2IaauTo1D4GZi8Y01sYEJiRq9vIqbrUP6PH50Cdg_hT5ZkfuN3I9QpwUnkwwHvmY Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08962304189a4134a48f4fc532a13400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08962304189a4134a48f4fc532a13400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08962304189a4134a48f4fc532a13400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 08962304189a4134a48f4fc532a13400 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-81177344 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 10d795e205ec46efa3393368a9567374 Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeShelveTestJSON-81177344-project Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'bb1f20dc-f27d-4e5b-97fb-35a4393cd592'} Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:00.000443 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. Jul 20 11:18:00.004319 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:00.006604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] Returning 404 to user: Instance bb1f20dc-f27d-4e5b-97fb-35a4393cd592 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:00.007847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86f1a28f-1e4b-4d50-80a3-113ee9216970 tempest-AttachVolumeShelveTestJSON-81177344 tempest-AttachVolumeShelveTestJSON-81177344-project] 10.222.0.79 "GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592" status: 404 len: 111 microversion: 2.20 time: 0.055930 Jul 20 11:18:00.009370 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2614/5243] 10.222.0.79 () {60 vars in 1276 bytes} [Wed Jul 20 11:17:59 2022] GET /compute/v2.1/servers/bb1f20dc-f27d-4e5b-97fb-35a4393cd592 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 11:18:00.557901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:00.558741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:00.572039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:00.572603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:00.573594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:00.575662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:00.763233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:00.774665 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-260babbe-aed4-4af0-9be5-3e95b0a3baef tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1316 microversion: 2.1 time: 1.231799 Jul 20 11:18:00.775294 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2630/5244] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:17:59 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1316 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:00.780417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:00.781327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:00.795986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:00.796690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:00.797679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:00.798287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:00.840212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:01.048565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12c89deab734e6884cf37d0e2a9be44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048e92acb38c455c94e0eedd7bf079ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:01.058561 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2704bfe-6a31-4c10-b391-d1e29a685183 tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 200 len: 1479 microversion: 2.1 time: 0.281934 Jul 20 11:18:01.063116 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2631/5245] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:00 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 1479 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:01.075185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4869d400-2c67-46ff-8575-e5fb051ef934 req-a20558b5-badb-4816-ab35-15bdf075b01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c392af3-eb42-4caa-bd4f-dc80b5e2da96", "name": "network-vif-deleted", "tag": "ede41fad-540c-4b5f-93ea-d2b0ba899348"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:01.121035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4869d400-2c67-46ff-8575-e5fb051ef934 req-a20558b5-badb-4816-ab35-15bdf075b01a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:01.121838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4869d400-2c67-46ff-8575-e5fb051ef934 req-a20558b5-badb-4816-ab35-15bdf075b01a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:01.149362 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4869d400-2c67-46ff-8575-e5fb051ef934 req-a20558b5-badb-4816-ab35-15bdf075b01a service nova] Creating event network-vif-deleted:ede41fad-540c-4b5f-93ea-d2b0ba899348 for instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 on n-h2-846219-10 Jul 20 11:18:01.170514 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4869d400-2c67-46ff-8575-e5fb051ef934 req-a20558b5-badb-4816-ab35-15bdf075b01a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104336 Jul 20 11:18:01.173825 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2632/5246] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:01.792621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:01.793404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:01.815612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:01.816071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:01.825041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:01.825505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:02.095635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:02.112070 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f6fe3db-a118-443a-b6da-2be4e6fda224 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1314 microversion: 2.1 time: 1.558573 Jul 20 11:18:02.114400 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2615/5247] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:00 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1314 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:02.127445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-270502648", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "01246dbe-1d7b-4eba-8af6-859b1ad7e263"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1231430905", "security_groups": [{"name": "tempest-secgroup-smoke-889429797"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:02.224089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:02.278046 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:02.288466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0542b939-a9c9-4550-9dbc-5df514cc709e tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1316 microversion: 2.1 time: 0.500522 Jul 20 11:18:02.289154 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2633/5248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:01 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:02.297754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:02.300219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] [instance: 4c392af3-eb42-4caa-bd4f-dc80b5e2da96] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:02.311416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:02.311872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:02.312651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:02.313090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:02.333072 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] HTTP exception thrown: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 could not be found. Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Request method failure captured: Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 HTTP/1.1 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-MJsEqH8_CA1XxjpLELJaSOi3ESdn5zoaYTSHcZBpoLCFKOnZlmmEAarRspRdJYGqVh9nGF5V12beSVgSonk_Ql_DxGPn4EfcSMz51JvA38Yztwd1vqwuKJy7WqsVvQs_-VPuncIoocE8r82w6CQ0j8hM7nx_XFTUmCkWaWZzM3EU8 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_048e92acb38c455c94e0eedd7bf079ae", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/048e92acb38c455c94e0eedd7bf079ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 048e92acb38c455c94e0eedd7bf079ae Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-744971049 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e12c89deab734e6884cf37d0e2a9be44 Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerRescueNegativeTestJSON-744971049-project Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 could not be found. Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '4c392af3-eb42-4caa-bd4f-dc80b5e2da96'} Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 could not be found. Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 could not be found. Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:02.334934 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 could not be found. Jul 20 11:18:02.340494 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:02.345396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] Returning 404 to user: Instance 4c392af3-eb42-4caa-bd4f-dc80b5e2da96 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:02.346348 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7608da63-2f75-4e76-a7e2-a4d4b64ebffb tempest-ServerRescueNegativeTestJSON-744971049 tempest-ServerRescueNegativeTestJSON-744971049-project] 10.222.0.79 "GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96" status: 404 len: 111 microversion: 2.1 time: 0.055963 Jul 20 11:18:02.346932 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2634/5249] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:02 2022] GET /compute/v2.1/servers/4c392af3-eb42-4caa-bd4f-dc80b5e2da96 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:02.417598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-63266175-6998-47c5-9d44-59ec2f800128 req-5e6fae83-9240-458e-af29-1a0b982a8e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1868fec9-d092-4ab8-a561-b61f56e3e9b6", "tag": "f4f25e64-2cb2-4613-9deb-8cd1ed6851d8"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:02.442583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-63266175-6998-47c5-9d44-59ec2f800128 req-5e6fae83-9240-458e-af29-1a0b982a8e10 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:02.443143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-63266175-6998-47c5-9d44-59ec2f800128 req-5e6fae83-9240-458e-af29-1a0b982a8e10 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:02.484893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-63266175-6998-47c5-9d44-59ec2f800128 req-5e6fae83-9240-458e-af29-1a0b982a8e10 service nova] Creating event network-changed:f4f25e64-2cb2-4613-9deb-8cd1ed6851d8 for instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 on n-h2-846219-10 Jul 20 11:18:02.490332 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-63266175-6998-47c5-9d44-59ec2f800128 req-5e6fae83-9240-458e-af29-1a0b982a8e10 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077007 Jul 20 11:18:02.498054 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2635/5250] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:03.003809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] validate_networks() for [('01246dbe-1d7b-4eba-8af6-859b1ad7e263', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:18:03.128251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:03.135277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:03.136886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:03.144530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:03.146465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:03.147281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:03.149428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:03.150299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:03.879524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:03.904924 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-34128eea-e16d-491f-83d3-cfffad07f990 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1463 microversion: 2.1 time: 0.770758 Jul 20 11:18:03.905818 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2636/5251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:03 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1463 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:03.945428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:03.946702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:03.964326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:03.964779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:03.989812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:03.997768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:04.674211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:04.684369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f23a62bd-aab7-45d6-8a79-2fa2ccbbfa91 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1316 microversion: 2.1 time: 0.752530 Jul 20 11:18:04.703634 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2637/5252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:03 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1316 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:04.724902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:04.726923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:04.748312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:04.750530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:04.756918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:04.760084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:04.839161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:18:05.486085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-84941afa-46ea-4606-b8e8-1ad0f5b2f0cb tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "DELETE /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 204 len: 0 microversion: 2.1 time: 0.781037 Jul 20 11:18:05.489749 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2638/5253] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:18:04 2022] DELETE /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:18:05.500194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:05.501368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:05.511343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:05.512123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:05.512921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:05.513567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:05.708944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:18:05.710338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:18:05.711390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:18:05.712090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:18:05.713322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:18:05.727973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:05.728953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:05.730008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:05.730865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:05.755677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:18:05.774451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:18:05.799416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:18:05.803568 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:18:05.886572 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76edd53d-7f01-4045-a7ca-aa9a0c2e6b10 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.770401 Jul 20 11:18:05.897382 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2616/5254] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:18:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 3782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:18:05.904995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:05.906389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:05.914923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:05.915603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:05.929772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:05.930216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:06.377598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:06.387689 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a05196f0-2c42-4178-b19a-2c924df45d9f tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1469 microversion: 2.1 time: 0.892210 Jul 20 11:18:06.402149 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2639/5255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:05 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1469 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:06.407358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ffde0cd5-72be-442c-b72a-88252ea6e4d3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:06.408210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ffde0cd5-72be-442c-b72a-88252ea6e4d3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:07.283551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ffde0cd5-72be-442c-b72a-88252ea6e4d3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:07.291889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ffde0cd5-72be-442c-b72a-88252ea6e4d3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1266 microversion: 2.1 time: 0.888393 Jul 20 11:18:07.303910 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2640/5256] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:06 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1266 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:07.411107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:07.411815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:07.424942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:07.425859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:07.426319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:07.428516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:07.428957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:07.434622 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52cf9486-2ae9-4208-a5f9-35b3a956bfbc tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1316 microversion: 2.1 time: 1.535049 Jul 20 11:18:07.442237 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2617/5257] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:05 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1316 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:08.117735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:08.128378 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a084a20b-4b9c-4294-9faf-019eb6a2b5a4 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1469 microversion: 2.1 time: 0.722613 Jul 20 11:18:08.131385 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2641/5258] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:07 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1469 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:08.309318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:08.309945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:08.313786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:08.326135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:08.326593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:08.327700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:08.328401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:08.460339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:08.461837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:08.475553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:08.477579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:08.487195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:08.487916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:08.575030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:08.598308 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99b21706-22e7-4b22-b66f-67c04811f6e7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1324 microversion: 2.1 time: 0.292613 Jul 20 11:18:08.609317 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2618/5259] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:08 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:09.126472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-eac2d5af-b4ec-42fb-8724-df10794f4754 req-9cc9f77d-0405-4bb4-9602-cfed1ccbebce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1868fec9-d092-4ab8-a561-b61f56e3e9b6", "name": "network-vif-plugged", "status": "completed", "tag": "f4f25e64-2cb2-4613-9deb-8cd1ed6851d8"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:09.152033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eac2d5af-b4ec-42fb-8724-df10794f4754 req-9cc9f77d-0405-4bb4-9602-cfed1ccbebce service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:09.152033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eac2d5af-b4ec-42fb-8724-df10794f4754 req-9cc9f77d-0405-4bb4-9602-cfed1ccbebce service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:09.180099 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-eac2d5af-b4ec-42fb-8724-df10794f4754 req-9cc9f77d-0405-4bb4-9602-cfed1ccbebce service nova] Creating event network-vif-plugged:f4f25e64-2cb2-4613-9deb-8cd1ed6851d8 for instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 on n-h2-846219-10 Jul 20 11:18:09.192858 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-eac2d5af-b4ec-42fb-8724-df10794f4754 req-9cc9f77d-0405-4bb4-9602-cfed1ccbebce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072242 Jul 20 11:18:09.193967 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2619/5260] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:18:09.203198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:09.206053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:09.223659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:09.224255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:09.225128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:09.225650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:09.611786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:09.625648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec192042-a9d1-4479-b225-e8454b292d3b tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1316 microversion: 2.1 time: 1.170364 Jul 20 11:18:09.626840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2642/5261] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:08 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1316 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:09.632178 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:09.633740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:09.641606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:09.642295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:09.643311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:09.643924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:10.268882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:10.283198 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fded2ba4-09a5-471b-87be-a8bfabb1a9b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.654077 Jul 20 11:18:10.287396 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2643/5262] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:09 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:10.312512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516392a088074993a1637cbea691525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313442f50afe42b89e3074aea10c9434', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:10.329473 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8c1112da-ae40-4100-bb4d-d30300c619db tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 200 len: 1469 microversion: 2.1 time: 1.134165 Jul 20 11:18:10.331637 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2620/5263] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:09 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 1469 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:10.645213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:10.645980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:10.670019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:10.670816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:10.672139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:10.672861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:10.773486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9600d685-8088-4909-b79f-b7d4a8f73e17 req-d41fd358-8ee4-4e30-b225-ba3250864782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84318835-5d0e-47f5-bcb7-b61de58c91b5", "name": "network-vif-deleted", "tag": "a802d313-16e1-4586-b685-c30bbacd2dd4"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:10.804733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9600d685-8088-4909-b79f-b7d4a8f73e17 req-d41fd358-8ee4-4e30-b225-ba3250864782 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:10.810080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9600d685-8088-4909-b79f-b7d4a8f73e17 req-d41fd358-8ee4-4e30-b225-ba3250864782 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:10.856835 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9600d685-8088-4909-b79f-b7d4a8f73e17 req-d41fd358-8ee4-4e30-b225-ba3250864782 service nova] Creating event network-vif-deleted:a802d313-16e1-4586-b685-c30bbacd2dd4 for instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 on n-h2-846219-10 Jul 20 11:18:10.876943 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9600d685-8088-4909-b79f-b7d4a8f73e17 req-d41fd358-8ee4-4e30-b225-ba3250864782 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110064 Jul 20 11:18:10.882010 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2621/5264] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:18:10.970782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-32fc15ae-8214-4c2c-9290-293a872dd69d req-7d746660-d59a-454c-9df9-8c9cacd98c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:10.996222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-32fc15ae-8214-4c2c-9290-293a872dd69d req-7d746660-d59a-454c-9df9-8c9cacd98c5a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:10.999667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-32fc15ae-8214-4c2c-9290-293a872dd69d req-7d746660-d59a-454c-9df9-8c9cacd98c5a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:11.045474 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-32fc15ae-8214-4c2c-9290-293a872dd69d req-7d746660-d59a-454c-9df9-8c9cacd98c5a service nova] Creating event network-changed:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:18:11.062850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-32fc15ae-8214-4c2c-9290-293a872dd69d req-7d746660-d59a-454c-9df9-8c9cacd98c5a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100584 Jul 20 11:18:11.064502 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2622/5265] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:11.309837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:11.312449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:11.328516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:11.329176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:11.329736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:11.330187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:12.145577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:12.159209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:12.160267 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ee36510e-edf6-498d-b921-19fa303e9ebc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.857994 Jul 20 11:18:12.172702 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8085c548-aae8-4da0-bb4d-0df03164a023 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1316 microversion: 2.1 time: 1.532159 Jul 20 11:18:12.174333 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2644/5266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:10 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1316 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:12.175131 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2623/5267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:11 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:12.183274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:12.191222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] [instance: 84318835-5d0e-47f5-bcb7-b61de58c91b5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:12.214281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:12.217704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:12.220498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:12.223489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:12.266240 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] HTTP exception thrown: Instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 could not be found. Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Request method failure captured: Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 HTTP/1.1 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-RClVo4WESBFB8eRAgolBTyOqXZx04XXkR42J4Ko3l1UP8A0TRRUbmWaGoNLzjGwhzA-Ewz57wfE8GzEp3gPKaqRxSQzLSgOHSeG-W2lFS82VBhSwOF-xNItK4m2ZomTcsnv6igyKDklwpx0wPyCmVQEbMn277dJOUmLocfxq5DuME Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 313442f50afe42b89e3074aea10c9434 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesNegativeTest-1973786303 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_313442f50afe42b89e3074aea10c9434", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/313442f50afe42b89e3074aea10c9434"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/313442f50afe42b89e3074aea10c9434"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/313442f50afe42b89e3074aea10c9434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesNegativeTest-1973786303 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 313442f50afe42b89e3074aea10c9434 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesNegativeTest-1973786303 Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesNegativeTest-1973786303-project Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 516392a088074993a1637cbea691525f Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesNegativeTest-1973786303-project Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 could not be found. Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '84318835-5d0e-47f5-bcb7-b61de58c91b5'} Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 could not be found. Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 could not be found. Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:12.268882 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 could not be found. Jul 20 11:18:12.273781 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:12.275354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] Returning 404 to user: Instance 84318835-5d0e-47f5-bcb7-b61de58c91b5 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:12.276656 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f45e24d8-3e28-4c21-b287-7703233b1315 tempest-VolumesNegativeTest-1973786303 tempest-VolumesNegativeTest-1973786303-project] 10.222.0.79 "GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5" status: 404 len: 111 microversion: 2.1 time: 0.098668 Jul 20 11:18:12.278425 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2645/5268] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:12 2022] GET /compute/v2.1/servers/84318835-5d0e-47f5-bcb7-b61de58c91b5 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:13.186017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:13.189259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:13.192372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:13.193001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:13.209381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:13.210557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:13.218722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:13.218986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:13.219546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:13.220165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:13.221971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:13.222896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.064848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:14.072616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:14.093103 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1bc2e515-cd2d-4caf-9e2d-fceefd690fd1 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1505 microversion: 2.1 time: 0.905012 Jul 20 11:18:14.105491 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d8d921c7-7af4-44b0-b483-54f7785d71bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.919512 Jul 20 11:18:14.107327 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2646/5269] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:13 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1505 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:14.112456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:14.112959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:14.123424 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2624/5270] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:13 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:14.178675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.186829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.187703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.194177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.268592 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-40beb0ea-c91a-4ffa-97fc-a13d257d2a35 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6/ips" status: 200 len: 109 microversion: 2.1 time: 0.159942 Jul 20 11:18:14.281511 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2647/5271] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:18:14 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6/ips => generated 109 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:14.294703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:14.296182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:14.315138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.315650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.316448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.326347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.348223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:14.370554 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8cbbb475-0122-441d-bc2c-aa860f19c4f6 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6/ips" status: 200 len: 109 microversion: 2.1 time: 0.087601 Jul 20 11:18:14.383690 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2625/5272] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:18:14 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6/ips => generated 109 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:14.394910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:14.395446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:14.408090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.409237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.410193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.414455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.464931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-68213ee8-fd43-402e-8261-714a7b5a1dd5 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6/ips/tempest-ServerAddressesTestJSON-1259904751-network" status: 200 len: 94 microversion: 2.1 time: 0.073642 Jul 20 11:18:14.468840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2648/5273] 10.222.0.79 () {58 vars in 1400 bytes} [Wed Jul 20 11:18:14 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6/ips/tempest-ServerAddressesTestJSON-1259904751-network => generated 94 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:18:14.482059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:14.482870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:14.489782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.490527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.492485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.493294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.524333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:18:14.707953 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4cf8cd2-946d-4c92-852b-c69606bc52fd tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 204 len: 0 microversion: 2.1 time: 0.229084 Jul 20 11:18:14.708833 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2626/5274] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:18:14 2022] DELETE /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:18:14.717759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:14.719210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:14.745223 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.749781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:14.752247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:14.755195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:15.116948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:15.130729 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-84dd199d-da55-4f57-9e29-7734a79eb7d3 tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1511 microversion: 2.1 time: 0.413746 Jul 20 11:18:15.131382 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2649/5275] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:14 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:15.131973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:15.133110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:15.147586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:15.152462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:15.156402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:15.158378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:15.616882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:15.631035 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eb8f5c80-4800-4ecc-8c64-5611a2ec7a48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.504419 Jul 20 11:18:15.634039 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2627/5276] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:15 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:16.148984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:16.150466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:16.167656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:16.168117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:16.168904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:16.180884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:16.659928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:16.660620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:16.666561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:16.670692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:16.688957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:16.697979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:16.719141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:16.721572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:16.724580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:16.726978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:16.738291 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6301d8b-05c3-4737-b89d-313095f7556c tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1511 microversion: 2.1 time: 0.586723 Jul 20 11:18:16.742466 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2650/5277] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:16 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:17.006034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:17.023603 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b175f307-fa90-413b-a329-72d0c695d4cd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.375248 Jul 20 11:18:17.032958 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2628/5278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:16 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:17.545446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a4ddb357-62e3-4f1f-80d7-b3f907dcacc8 req-3aece10b-10c0-446e-9785-e24937dbf752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1868fec9-d092-4ab8-a561-b61f56e3e9b6", "name": "network-vif-deleted", "tag": "f4f25e64-2cb2-4613-9deb-8cd1ed6851d8"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:17.553696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:17.564580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a4ddb357-62e3-4f1f-80d7-b3f907dcacc8 req-3aece10b-10c0-446e-9785-e24937dbf752 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:17.565303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a4ddb357-62e3-4f1f-80d7-b3f907dcacc8 req-3aece10b-10c0-446e-9785-e24937dbf752 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:17.582877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a4ddb357-62e3-4f1f-80d7-b3f907dcacc8 req-3aece10b-10c0-446e-9785-e24937dbf752 service nova] Creating event network-vif-deleted:f4f25e64-2cb2-4613-9deb-8cd1ed6851d8 for instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 on n-h2-846219-10 Jul 20 11:18:17.590797 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a4ddb357-62e3-4f1f-80d7-b3f907dcacc8 req-3aece10b-10c0-446e-9785-e24937dbf752 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053442 Jul 20 11:18:17.592039 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2651/5279] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:17.764030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:17.765797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:17.790577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:17.792030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:17.795867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:17.797446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:17.865069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:17.865530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:17.865992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lazy-loading 'fault' on Instance uuid 1868fec9-d092-4ab8-a561-b61f56e3e9b6 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:18:17.921885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a3559e4d74e5cbff303dbd351aefa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992c1273a69747bbbaafc13bd860e626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:17.932362 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9469e08b-c854-42bf-87f3-31404f389cee tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 200 len: 1306 microversion: 2.1 time: 0.175158 Jul 20 11:18:17.932864 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2629/5280] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:17 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 1306 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:18.046241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:18.047317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:18.066001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:18.067027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:18.068296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:18.069671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:18.391136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:18.407997 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b778f173-e97a-44ff-9ac7-1d040bdbfcf5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.370065 Jul 20 11:18:18.408848 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2652/5281] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:18 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:18.611926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d54dc7ad-e81a-4202-9eca-0050e6be4084 req-9f6c2d3d-74a8-44a1-bdc5-b3047f7f6a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "name": "network-vif-plugged", "status": "completed", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:18.626980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d54dc7ad-e81a-4202-9eca-0050e6be4084 req-9f6c2d3d-74a8-44a1-bdc5-b3047f7f6a0c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:18.629277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d54dc7ad-e81a-4202-9eca-0050e6be4084 req-9f6c2d3d-74a8-44a1-bdc5-b3047f7f6a0c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:18.654527 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d54dc7ad-e81a-4202-9eca-0050e6be4084 req-9f6c2d3d-74a8-44a1-bdc5-b3047f7f6a0c service nova] Creating event network-vif-plugged:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:18:18.672915 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d54dc7ad-e81a-4202-9eca-0050e6be4084 req-9f6c2d3d-74a8-44a1-bdc5-b3047f7f6a0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064507 Jul 20 11:18:18.674358 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2630/5282] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:18.952308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:18.953606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] [instance: 1868fec9-d092-4ab8-a561-b61f56e3e9b6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:18.962109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:18.962698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:18.963648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:18.964370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:18.982063 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] HTTP exception thrown: Instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 could not be found. Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Request method failure captured: Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 HTTP/1.1 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Rb18AHXGphUNvTqRXkj-iL7CbjlRpgSBIu6XZ7FyOUcUOMB7bL_V1xS8fruIfXALUeRO820fBmXO8O5bw-l7e1iZWYmrNcV5eh8XbwsBdZK_sJ6L9TryTMGmw1KQubVULeH93eWh4CSfhpZ9gsVcKAijakNoBL1ynzoX2gbdDPaBs Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 992c1273a69747bbbaafc13bd860e626 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerAddressesTestJSON-209919408 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_992c1273a69747bbbaafc13bd860e626", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/992c1273a69747bbbaafc13bd860e626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/992c1273a69747bbbaafc13bd860e626"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/992c1273a69747bbbaafc13bd860e626"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerAddressesTestJSON-209919408 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 992c1273a69747bbbaafc13bd860e626 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerAddressesTestJSON-209919408 Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerAddressesTestJSON-209919408-project Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: e33a3559e4d74e5cbff303dbd351aefa Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerAddressesTestJSON-209919408-project Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 could not be found. Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1868fec9-d092-4ab8-a561-b61f56e3e9b6'} Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 could not be found. Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 could not be found. Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:18.984952 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 could not be found. Jul 20 11:18:18.989900 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:18.992556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] Returning 404 to user: Instance 1868fec9-d092-4ab8-a561-b61f56e3e9b6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:18.995263 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c3eb4c07-9a81-474d-ad98-4d3b02595fce tempest-ServerAddressesTestJSON-209919408 tempest-ServerAddressesTestJSON-209919408-project] 10.222.0.79 "GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6" status: 404 len: 111 microversion: 2.1 time: 0.049265 Jul 20 11:18:18.996022 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2653/5283] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:18 2022] GET /compute/v2.1/servers/1868fec9-d092-4ab8-a561-b61f56e3e9b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:19.427428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:19.429297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:19.442484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:19.443251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:19.444359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:19.445468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:19.759527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:19.767324 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffb21254-618f-4aa9-a7ed-8d3151d84c41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1391 microversion: 2.1 time: 0.345403 Jul 20 11:18:19.770841 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2631/5284] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:19 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1391 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:20.785169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:20.785924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:20.807380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:20.809777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:20.811476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:20.814275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:21.240273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:21.250598 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bd789b35-77bb-4fe2-9590-366b38db2bbc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1562 microversion: 2.1 time: 0.469819 Jul 20 11:18:21.252603 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2654/5285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:20 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1562 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:21.271704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:21.274982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:21.293688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:21.300887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:21.306382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:21.309972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:21.342777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9f680c7-6ecd-4984-8ef2-d9d04ffef133 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Action: 'create', calling method: .version_select at 0x7f2c4dcc2dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1632453193"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:21.654316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:21.672491 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab56a057-39ef-4cb3-896e-88c6df2ccb91 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1562 microversion: 2.1 time: 0.400742 Jul 20 11:18:21.672491 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2655/5286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:21 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1562 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:22.287127 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9f680c7-6ecd-4984-8ef2-d9d04ffef133 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.180951 Jul 20 11:18:22.287814 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2632/5287] 10.222.0.79 () {60 vars in 1154 bytes} [Wed Jul 20 11:18:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1182 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 11:18:22.302800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1933a883-5b48-46a1-99fd-6995b73bc384 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e746ca0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:22.458067 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1933a883-5b48-46a1-99fd-6995b73bc384 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 345 microversion: 2.1 time: 0.162726 Jul 20 11:18:22.459399 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2656/5288] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:22 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:23.480295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07ef871a-fe0c-4d44-9150-8aa0c772a33f tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3f36ec10>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:23.614026 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07ef871a-fe0c-4d44-9150-8aa0c772a33f tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 345 microversion: 2.1 time: 0.147521 Jul 20 11:18:23.614971 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2633/5289] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:23 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:24.032911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1e66ced-3680-4d99-a4ee-dd1fd1b475de tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e791940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:24.197087 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1e66ced-3680-4d99-a4ee-dd1fd1b475de tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1330e7c3-35e2-416b-8e11-03ce424d9fcb" status: 200 len: 350 microversion: 2.1 time: 0.188981 Jul 20 11:18:24.197993 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2657/5290] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:24 2022] GET /compute/v2.1/os-volumes/1330e7c3-35e2-416b-8e11-03ce424d9fcb => generated 350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:24.630919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a8d9bb7-d35a-451b-a5d1-40e0a8d9b8e4 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3ede1550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:24.795710 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a8d9bb7-d35a-451b-a5d1-40e0a8d9b8e4 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 346 microversion: 2.1 time: 0.170464 Jul 20 11:18:24.803467 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2634/5291] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:24 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:24.809179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1eb8b2c-bd3a-40d2-a09e-33e3261f87cb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Action: 'create', calling method: .version_select at 0x7f2c3e746670>, body: {"snapshot": {"volume_id": "406e422f-ef6b-43c0-bd89-151c429a2898", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1339314726"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:25.462660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1eb8b2c-bd3a-40d2-a09e-33e3261f87cb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.658376 Jul 20 11:18:25.464761 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2658/5292] 10.222.0.79 () {60 vars in 1161 bytes} [Wed Jul 20 11:18:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:18:25.478944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d8e71135-7d2d-4aa0-abad-638af683c1ff tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e544d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:25.540141 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d8e71135-7d2d-4aa0-abad-638af683c1ff tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.068442 Jul 20 11:18:25.549529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2635/5293] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:25 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:25.551049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d36bf301-d427-41ba-bdf0-fc5dd5b65f54 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e7a5160>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:25.592877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d36bf301-d427-41ba-bdf0-fc5dd5b65f54 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.045499 Jul 20 11:18:25.606617 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2659/5294] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 11:18:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:25.607347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-550f4005-19f6-40ad-a094-a8a58b055cd0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3f44bb80>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:25.720986 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-550f4005-19f6-40ad-a094-a8a58b055cd0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.119669 Jul 20 11:18:25.727427 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2636/5295] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:25 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:26.734735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dd3bdc69-1610-4982-8a3b-da209812e843 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e752f70>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:26.805865 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dd3bdc69-1610-4982-8a3b-da209812e843 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.075327 Jul 20 11:18:26.806714 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2660/5296] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:26 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:27.816774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c779d15e-0f42-4dca-83da-a08767be1124 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e56b3a0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:27.872948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:27.874225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:27.896798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:27.901523 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c779d15e-0f42-4dca-83da-a08767be1124 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.088566 Jul 20 11:18:27.902904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2637/5297] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:27 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:27.908111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d1016031-7625-45a9-94c0-7db0b4dcbccb req-666b0100-8e95-4051-9502-e22202415b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:27.917634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:27.922086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:27.924433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:27.926078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d1016031-7625-45a9-94c0-7db0b4dcbccb req-666b0100-8e95-4051-9502-e22202415b63 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:27.930659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d1016031-7625-45a9-94c0-7db0b4dcbccb req-666b0100-8e95-4051-9502-e22202415b63 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:27.950205 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d1016031-7625-45a9-94c0-7db0b4dcbccb req-666b0100-8e95-4051-9502-e22202415b63 service nova] Creating event network-changed:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:18:27.956522 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d1016031-7625-45a9-94c0-7db0b4dcbccb req-666b0100-8e95-4051-9502-e22202415b63 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052050 Jul 20 11:18:27.957574 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2638/5298] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:28.550493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:28.559314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e4b3eb4f-1133-4484-b70d-5a6e74edad06 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1562 microversion: 2.1 time: 0.693081 Jul 20 11:18:28.572436 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2661/5299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:27 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1562 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:28.915601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-273b4392-8e22-4967-9235-72c6a4dcc310 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e56be50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:28.981426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9302bef9-c807-49fb-ae5d-14162084a9a2 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e7463a0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:29.015309 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-273b4392-8e22-4967-9235-72c6a4dcc310 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.104873 Jul 20 11:18:29.015915 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2639/5300] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:28 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:29.121073 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9302bef9-c807-49fb-ae5d-14162084a9a2 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a9ee4123-13aa-422f-a9e9-371060332721" status: 200 len: 351 microversion: 2.1 time: 0.143468 Jul 20 11:18:29.121660 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2662/5301] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:28 2022] GET /compute/v2.1/os-volumes/a9ee4123-13aa-422f-a9e9-371060332721 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:18:30.027916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bfd91f0-fdbb-4d67-815e-cb44ea03953d tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e544430>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:30.123884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6bfd91f0-fdbb-4d67-815e-cb44ea03953d tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.100419 Jul 20 11:18:30.125147 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2640/5302] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:30 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:31.136917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-70902418-1a85-43e2-9e71-62d40e2f121f tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e791d30>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:31.309031 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-70902418-1a85-43e2-9e71-62d40e2f121f tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 288 microversion: 2.1 time: 0.176363 Jul 20 11:18:31.320259 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2663/5303] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:31 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 288 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:31.323242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d3790eb8-b0ea-4a84-8c01-4f80e262f3c5 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3f44dd30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:31.438367 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d3790eb8-b0ea-4a84-8c01-4f80e262f3c5 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 202 len: 0 microversion: 2.1 time: 0.121559 Jul 20 11:18:31.443487 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2641/5304] 10.222.0.79 () {58 vars in 1253 bytes} [Wed Jul 20 11:18:31 2022] DELETE /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:18:31.449359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8a48ad4-f74a-4b46-86ac-569c9c578149 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e7fce50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:31.490695 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8a48ad4-f74a-4b46-86ac-569c9c578149 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.045393 Jul 20 11:18:31.491374 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2664/5305] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:31 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:32.348142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de96318f-77c9-4694-bc27-c551334f98fb tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e3aadc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:32.436950 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-de96318f-77c9-4694-bc27-c551334f98fb tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/2dcd5aa6-6002-40a5-bbc9-3b47425ce5e8" status: 200 len: 350 microversion: 2.1 time: 0.094550 Jul 20 11:18:32.443655 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2642/5306] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:32 2022] GET /compute/v2.1/os-volumes/2dcd5aa6-6002-40a5-bbc9-3b47425ce5e8 => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:32.450371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55fc592f-1f53-4c75-be71-04d93119146a tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e7f6c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:32.509269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11329a4a-edad-4295-b7bd-724f77a83077 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e56bca0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:32.563261 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55fc592f-1f53-4c75-be71-04d93119146a tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.117724 Jul 20 11:18:32.564140 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2665/5307] 10.222.0.79 () {58 vars in 1133 bytes} [Wed Jul 20 11:18:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:32.582902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff8043a6-d94a-4e30-a154-4ea9ea74256c tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e7f5ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:32.596796 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11329a4a-edad-4295-b7bd-724f77a83077 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 200 len: 287 microversion: 2.1 time: 0.096036 Jul 20 11:18:32.597691 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2643/5308] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:32 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:32.705772 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff8043a6-d94a-4e30-a154-4ea9ea74256c tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127416 Jul 20 11:18:32.711822 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2666/5309] 10.222.0.79 () {58 vars in 1148 bytes} [Wed Jul 20 11:18:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:32.719886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d310c19d-1d80-46bc-a78d-91367df130b3 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3f2a61f0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:32.829384 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d310c19d-1d80-46bc-a78d-91367df130b3 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.114067 Jul 20 11:18:32.830327 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2644/5310] 10.222.0.79 () {58 vars in 1133 bytes} [Wed Jul 20 11:18:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:32.843715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6ad3f1e4-7635-4387-b43e-079c58c6ce4a tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e6c09d0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.009734 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6ad3f1e4-7635-4387-b43e-079c58c6ce4a tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.170618 Jul 20 11:18:33.010334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2667/5311] 10.222.0.79 () {58 vars in 1166 bytes} [Wed Jul 20 11:18:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:33.024852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ef4069a0-a843-4c76-98c1-35494cdf7b4e tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3f44da60>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.205982 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ef4069a0-a843-4c76-98c1-35494cdf7b4e tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.186583 Jul 20 11:18:33.206585 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2645/5312] 10.222.0.79 () {58 vars in 1169 bytes} [Wed Jul 20 11:18:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:33.247967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e23fec1f-6d86-47c8-a025-e165f6fa0e51 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e917e50>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.405508 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e23fec1f-6d86-47c8-a025-e165f6fa0e51 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.162969 Jul 20 11:18:33.406092 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2668/5313] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 11:18:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:33.419293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d4d82c6-8347-4599-b0e3-173349dfe1d1 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3f2a6dc0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.532163 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d4d82c6-8347-4599-b0e3-173349dfe1d1 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.118249 Jul 20 11:18:33.532825 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2646/5314] 10.222.0.79 () {58 vars in 1187 bytes} [Wed Jul 20 11:18:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:33.546919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e1e9545-f6fe-468d-b562-1687a582e4f0 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] Calling method '.version_select at 0x7f2c3e917040>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.609755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11786af4-d9ca-4fed-8256-3291ae80e5a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e4100d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.649748 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-11786af4-d9ca-4fed-8256-3291ae80e5a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] HTTP exception thrown: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11786af4-d9ca-4fed-8256-3291ae80e5a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Request method failure captured: Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb HTTP/1.1 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-R8eXH3-9JJ6j-WWkA0sQWGahbi63zV-pEuprjyJVQRVBb2XrfSNMdGxkCabzfJWc-VpN39xOIY80YtMwwj1zIVAxo9OQmvyaj-6ndggYbJ0pWOtGV0h2NesVt3GA0o9r-jHbvxSU1dwYjwCbZrFzyavm6d4Ev_OnvOmR2mV9ODoN0 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8fb713eac0f4fa48a48263f275b0bf1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4e687d2a980346c38fcb6a0ab145c392 Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: exception: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '8415dbf6-a4a6-43e8-b974-4717c48a00eb'} Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. (HTTP 404) (Request-ID: req-d7c9b164-c6c3-4c46-9cce-258700e9188a) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:33.665326 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. Jul 20 11:18:33.670533 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:33.675660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11786af4-d9ca-4fed-8256-3291ae80e5a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Returning 404 to user: Snapshot 8415dbf6-a4a6-43e8-b974-4717c48a00eb could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:33.676873 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11786af4-d9ca-4fed-8256-3291ae80e5a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb" status: 404 len: 111 microversion: 2.1 time: 0.071250 Jul 20 11:18:33.677493 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2647/5315] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:18:33 2022] GET /compute/v2.1/os-snapshots/8415dbf6-a4a6-43e8-b974-4717c48a00eb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:33.688237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5dba3f1f-6321-4cfd-82a6-cc275da0791d tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3f2a6ee0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.728390 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e1e9545-f6fe-468d-b562-1687a582e4f0 tempest-VolumesTestJSON-547257333 tempest-VolumesTestJSON-547257333-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.186815 Jul 20 11:18:33.732540 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2669/5316] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 11:18:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:33.841221 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5dba3f1f-6321-4cfd-82a6-cc275da0791d tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 202 len: 0 microversion: 2.1 time: 0.158668 Jul 20 11:18:33.843455 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2648/5317] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:18:33 2022] DELETE /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:18:33.853467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-168eb2e4-9b4d-4d64-a3cc-923aa8e1221b tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e7a51f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:33.973466 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-168eb2e4-9b4d-4d64-a3cc-923aa8e1221b tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 345 microversion: 2.1 time: 0.126007 Jul 20 11:18:33.974131 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2670/5318] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:33 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:34.987103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0efb63d3-39f4-4bbc-a300-7c635da9f371 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3f368e50>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:35.106103 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0efb63d3-39f4-4bbc-a300-7c635da9f371 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 345 microversion: 2.1 time: 0.123465 Jul 20 11:18:35.107411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2649/5319] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:34 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:36.121168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c6d4e9aa-f0e6-421d-bc19-6c31d5346053 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e8d4dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:36.219881 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c6d4e9aa-f0e6-421d-bc19-6c31d5346053 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 345 microversion: 2.1 time: 0.104291 Jul 20 11:18:36.220988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2671/5320] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:36 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:37.234940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc8e10bf-80ec-42a0-b85e-f59ebf4468a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3f3689d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:37.426389 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc8e10bf-80ec-42a0-b85e-f59ebf4468a6 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 200 len: 345 microversion: 2.1 time: 0.196718 Jul 20 11:18:37.426973 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2650/5321] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:37 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:38.457385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca44cb9b-4d9e-4bd9-827c-fbf7cad94d89 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e977940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:38.541173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:38.558558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=29 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:38.617787 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-ca44cb9b-4d9e-4bd9-827c-fbf7cad94d89 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] HTTP exception thrown: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca44cb9b-4d9e-4bd9-827c-fbf7cad94d89 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Request method failure captured: Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 HTTP/1.1 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-R8eXH3-9JJ6j-WWkA0sQWGahbi63zV-pEuprjyJVQRVBb2XrfSNMdGxkCabzfJWc-VpN39xOIY80YtMwwj1zIVAxo9OQmvyaj-6ndggYbJ0pWOtGV0h2NesVt3GA0o9r-jHbvxSU1dwYjwCbZrFzyavm6d4Ev_OnvOmR2mV9ODoN0 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8fb713eac0f4fa48a48263f275b0bf1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4e687d2a980346c38fcb6a0ab145c392 Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: exception: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '406e422f-ef6b-43c0-bd89-151c429a2898'} Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. (HTTP 404) (Request-ID: req-85ca2937-b306-4921-9ea2-61c952e6f170) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:38.620073 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca44cb9b-4d9e-4bd9-827c-fbf7cad94d89 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Returning 404 to user: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:38.624840 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca44cb9b-4d9e-4bd9-827c-fbf7cad94d89 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 404 len: 109 microversion: 2.1 time: 0.184877 Jul 20 11:18:38.633770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:38.636703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:38.643790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e1a95ef-8ab1-4fa7-9f06-9968733e08a0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e5dc790>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:38.646422 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2672/5322] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:38 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:38.732847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0e1a95ef-8ab1-4fa7-9f06-9968733e08a0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] HTTP exception thrown: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e1a95ef-8ab1-4fa7-9f06-9968733e08a0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Request method failure captured: Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 HTTP/1.1 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-R8eXH3-9JJ6j-WWkA0sQWGahbi63zV-pEuprjyJVQRVBb2XrfSNMdGxkCabzfJWc-VpN39xOIY80YtMwwj1zIVAxo9OQmvyaj-6ndggYbJ0pWOtGV0h2NesVt3GA0o9r-jHbvxSU1dwYjwCbZrFzyavm6d4Ev_OnvOmR2mV9ODoN0 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8fb713eac0f4fa48a48263f275b0bf1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 4e687d2a980346c38fcb6a0ab145c392 Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: exception: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '406e422f-ef6b-43c0-bd89-151c429a2898'} Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. (HTTP 404) (Request-ID: req-1f35bc5a-ea91-4782-83d2-5bd8aa34f244) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:38.736286 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.741257 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.747351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0e1a95ef-8ab1-4fa7-9f06-9968733e08a0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Returning 404 to user: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:38.747612 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0e1a95ef-8ab1-4fa7-9f06-9968733e08a0 tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 404 len: 109 microversion: 2.1 time: 0.114545 Jul 20 11:18:38.752006 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2651/5323] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:18:38 2022] DELETE /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:38.765165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41af80fd-fbfd-446b-af3d-9746118340eb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Calling method '.version_select at 0x7f2c3e979ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:38.848065 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-41af80fd-fbfd-446b-af3d-9746118340eb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] HTTP exception thrown: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41af80fd-fbfd-446b-af3d-9746118340eb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Request method failure captured: Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 HTTP/1.1 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-R8eXH3-9JJ6j-WWkA0sQWGahbi63zV-pEuprjyJVQRVBb2XrfSNMdGxkCabzfJWc-VpN39xOIY80YtMwwj1zIVAxo9OQmvyaj-6ndggYbJ0pWOtGV0h2NesVt3GA0o9r-jHbvxSU1dwYjwCbZrFzyavm6d4Ev_OnvOmR2mV9ODoN0 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f8fb713eac0f4fa48a48263f275b0bf1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f8fb713eac0f4fa48a48263f275b0bf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: f8fb713eac0f4fa48a48263f275b0bf1 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1752813824 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 4e687d2a980346c38fcb6a0ab145c392 Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1752813824-project Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: exception: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '406e422f-ef6b-43c0-bd89-151c429a2898'} Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. (HTTP 404) (Request-ID: req-58f256e9-8fd3-4182-b7ec-df7c9e634f49) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:38.850921 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. Jul 20 11:18:38.854822 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:38.862237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41af80fd-fbfd-446b-af3d-9746118340eb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] Returning 404 to user: Volume 406e422f-ef6b-43c0-bd89-151c429a2898 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:38.863716 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41af80fd-fbfd-446b-af3d-9746118340eb tempest-VolumesSnapshotsTestJSON-1752813824 tempest-VolumesSnapshotsTestJSON-1752813824-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898" status: 404 len: 109 microversion: 2.1 time: 0.109491 Jul 20 11:18:38.864859 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2673/5324] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:38 2022] GET /compute/v2.1/os-volumes/406e422f-ef6b-43c0-bd89-151c429a2898 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:45.284275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3f76a5d0-eb62-4fb7-993c-054062d3105a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: .version_select at 0x7f2c3f2a64c0>, body: {"keypair": {"name": "tempest-keypair-1081620165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy7heTi3j2jzAS6iHQyxh/jjWU/qp67XMYGRRzpIpgy8ZqeydEoIEuozYGimGPWLk0z/yEvpczdAAtadg2D7zomJ0td7AFCrUlo7BYAZkBSRM1vl6V9ZjsuOJr08tCFnA=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:45.321946 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3f76a5d0-eb62-4fb7-993c-054062d3105a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for project b8987df57b4c4c71a5070180fc86d794. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:18:45.334317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3f76a5d0-eb62-4fb7-993c-054062d3105a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for user eca571756cd648a8a8383195dc697b19 and project b8987df57b4c4c71a5070180fc86d794. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:18:45.380573 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3f76a5d0-eb62-4fb7-993c-054062d3105a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.337706 Jul 20 11:18:45.389714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2652/5325] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:18:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:18:45.493925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:45.498553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:45.527144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:45.527696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:45.528671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:45.529117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:45.638061 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8c9f1fd-7fa5-47f5-9e76-c82981357f2a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action" status: 200 len: 24568 microversion: 2.1 time: 0.152289 Jul 20 11:18:45.638923 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2674/5326] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:18:45 2022] POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action => generated 24568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:18:47.984635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-203952738", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e8c001d-1fc0-406c-96c4-dbbcc7fedf10"}], "security_groups": [{"name": "tempest-securitygroup--1694287346"}], "key_name": "tempest-keypair-1081620165", "user_data": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:48.285772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] validate_networks() for [('2e8c001d-1fc0-406c-96c4-dbbcc7fedf10', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:18:49.170221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:18:49.171456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:18:49.173002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:18:49.173652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:18:49.174300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:18:49.202529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:49.203915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:49.205031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:49.205683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:49.230933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for project b8987df57b4c4c71a5070180fc86d794. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:18:49.245681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for user eca571756cd648a8a8383195dc697b19 and project b8987df57b4c4c71a5070180fc86d794. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:18:49.262854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:18:49.266241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:18:49.362992 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c6c4037-699e-434b-9b0f-480fb86ae566 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.383526 Jul 20 11:18:49.368746 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2653/5327] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:18:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:18:49.380627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cc9df851-78dd-4fee-8ed1-c9b23730fc57 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:49.382023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cc9df851-78dd-4fee-8ed1-c9b23730fc57 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:49.590137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cc9df851-78dd-4fee-8ed1-c9b23730fc57 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:49.597690 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cc9df851-78dd-4fee-8ed1-c9b23730fc57 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1237 microversion: 2.1 time: 0.223567 Jul 20 11:18:49.601992 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2675/5328] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:49 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1237 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:50.620307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:50.621770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:50.654466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:50.659950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:50.665166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:50.667923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:50.903292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:50.914992 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9400e75f-c0d0-4a69-8808-8299737f4ec9 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1241 microversion: 2.1 time: 0.300680 Jul 20 11:18:50.925912 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2654/5329] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:50 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1241 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:51.943158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:51.945095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:51.970705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:51.971536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:51.999408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:51.999977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:52.004429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:52.004972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:52.011328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:52.014907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:52.015971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:52.019655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:52.191233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:52.207299 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-25b05ff6-c982-4a90-bdc9-2a67788b394f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1295 microversion: 2.1 time: 0.267870 Jul 20 11:18:52.221747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2676/5330] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:51 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1295 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:52.526648 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb677aa8-8c0b-4624-bb38-b10dd993919c tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1834 microversion: 2.1 time: 0.560408 Jul 20 11:18:52.552671 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2655/5331] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:51 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1834 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:52.914947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:52.915885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:52.933107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:52.933642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:52.934452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:52.937620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.231400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:53.234215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:53.266752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:53.268971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.272611 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:53.274034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.307022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:53.331985 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1c876bb4-b52a-4965-b599-0f289a210528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1681 microversion: 2.1 time: 0.772168 Jul 20 11:18:53.347389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2677/5332] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:52 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1681 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:53.482041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:53.493793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-790bcc48-a5ce-4dac-9028-dce1f4cea3ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1295 microversion: 2.1 time: 0.269585 Jul 20 11:18:53.506226 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2656/5333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:53 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1295 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:53.556055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:53.558265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:53.567897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:53.568654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.569719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:53.570407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.634997 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0db57ca5-a05a-4579-abe9-34278ff2d10f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action" status: 200 len: 32641 microversion: 2.1 time: 0.082896 Jul 20 11:18:53.643666 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2678/5334] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:18:53 2022] POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action => generated 32641 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:18:53.872628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:53.873214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:53.887789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:53.890763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.891699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:53.892160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:53.969747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '552adc8717314c8f8f4e11dba5ae311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1fea2384da042039114e384472becf8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:53.970379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] flavor_id is None. Assuming migration. {{(pid=125886) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 20 11:18:53.970827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125886) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:18:54.168793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cd82221d-d85e-4a7b-9986-e7a5a00ec33f tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action" status: 202 len: 0 microversion: 2.1 time: 0.302589 Jul 20 11:18:54.170168 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2657/5335] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:18:53 2022] POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:18:54.180956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:54.181686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:54.198348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:54.201991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:54.203035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:54.213081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:54.496170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:54.516201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:54.516807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:54.517040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce3cfcff-990e-485b-9b4e-36ce0d29f422 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1690 microversion: 2.1 time: 0.341273 Jul 20 11:18:54.518284 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2679/5336] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:54 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:54.536269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:54.537992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:54.539139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:54.539875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:54.813640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:54.824196 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df5531c9-17c0-4712-bdf8-093eea100d34 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1363 microversion: 2.1 time: 0.314159 Jul 20 11:18:54.827109 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2658/5337] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:54 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:55.217400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b83ce386-5da3-4d05-8d59-499dc127758d tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Action: 'create', calling method: .version_select at 0x7f2c3e8dfd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-540056271", "metadata": {"Type": "work"}}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b83ce386-5da3-4d05-8d59-499dc127758d tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Request method failure captured: Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 121 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Se-yKeBUBQN1ZLN72r9A9V0qNNiX59QP06d3PTvpqxGZCEMgqq-7voAxtjRnAQDFlzmTao6bnG0-Rk4s5WP2ou2zZ0n926DLKkcSujKZ3q93hiOcEDdegLw2P8m87aO0jy4DsYHFNO2Yy74yoy_AH2N_JNwwQ5yDqrO6rvRRMKB5s Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b161830d1f4849ecb812294ad4209fec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9d6005a2ef7f420f99a6c4c9bff11f8d Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-540056271", "metadata": {"Type": "work"}}} Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-540056271', 'metadata': {'Type': 'work'}}}} Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:18:55.221243 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b83ce386-5da3-4d05-8d59-499dc127758d tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:55.226062 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b83ce386-5da3-4d05-8d59-499dc127758d tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.293180 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1dd6c7f-3867-485b-adeb-7f60128f82f9 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Action: 'create', calling method: .version_select at 0x7f2c3e210e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1482010001", "metadata": {"Type": "work"}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1dd6c7f-3867-485b-adeb-7f60128f82f9 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Request method failure captured: Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 120 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Se-yKeBUBQN1ZLN72r9A9V0qNNiX59QP06d3PTvpqxGZCEMgqq-7voAxtjRnAQDFlzmTao6bnG0-Rk4s5WP2ou2zZ0n926DLKkcSujKZ3q93hiOcEDdegLw2P8m87aO0jy4DsYHFNO2Yy74yoy_AH2N_JNwwQ5yDqrO6rvRRMKB5s Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b161830d1f4849ecb812294ad4209fec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9d6005a2ef7f420f99a6c4c9bff11f8d Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1482010001", "metadata": {"Type": "work"}}} Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1482010001', 'metadata': {'Type': 'work'}}}} Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi '0' Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:55.238116 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.250360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c1dd6c7f-3867-485b-adeb-7f60128f82f9 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:55.253938 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2680/5338] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 11:18:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:18:55.254112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c1dd6c7f-3867-485b-adeb-7f60128f82f9 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010541 Jul 20 11:18:55.254112 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2659/5339] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 11:18:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:18:55.254427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b04cd4fc-f009-4f93-8102-03f08306f3de tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Action: 'create', calling method: .version_select at 0x7f2c3e752940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-278556952", "metadata": {"Type": "work"}}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b04cd4fc-f009-4f93-8102-03f08306f3de tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Request method failure captured: Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 118 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Se-yKeBUBQN1ZLN72r9A9V0qNNiX59QP06d3PTvpqxGZCEMgqq-7voAxtjRnAQDFlzmTao6bnG0-Rk4s5WP2ou2zZ0n926DLKkcSujKZ3q93hiOcEDdegLw2P8m87aO0jy4DsYHFNO2Yy74yoy_AH2N_JNwwQ5yDqrO6rvRRMKB5s Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b161830d1f4849ecb812294ad4209fec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9d6005a2ef7f420f99a6c4c9bff11f8d Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-278556952", "metadata": {"Type": "work"}}} Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-278556952', 'metadata': {'Type': 'work'}}}} Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise error Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi '' Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 11:18:55.258403 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b04cd4fc-f009-4f93-8102-03f08306f3de tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b04cd4fc-f009-4f93-8102-03f08306f3de tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011577 Jul 20 11:18:55.265452 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2681/5340] 10.222.0.79 () {60 vars in 1155 bytes} [Wed Jul 20 11:18:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:18:55.273612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc9a4986-8cfe-4969-85c3-87d8ef46baec tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Calling method '.version_select at 0x7f2c3e544280>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:55.329929 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-cc9a4986-8cfe-4969-85c3-87d8ef46baec tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] HTTP exception thrown: Volume tempest-invalid-1470499102 could not be found. Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc9a4986-8cfe-4969-85c3-87d8ef46baec tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Request method failure captured: Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1470499102 HTTP/1.1 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-Se-yKeBUBQN1ZLN72r9A9V0qNNiX59QP06d3PTvpqxGZCEMgqq-7voAxtjRnAQDFlzmTao6bnG0-Rk4s5WP2ou2zZ0n926DLKkcSujKZ3q93hiOcEDdegLw2P8m87aO0jy4DsYHFNO2Yy74yoy_AH2N_JNwwQ5yDqrO6rvRRMKB5s Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b161830d1f4849ecb812294ad4209fec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 9d6005a2ef7f420f99a6c4c9bff11f8d Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: method: Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: exception: Volume tempest-invalid-1470499102 could not be found. Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'tempest-invalid-1470499102'} Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1470499102 could not be found. (HTTP 404) (Request-ID: req-9e3fb20f-2372-49ea-9dc7-584f1ddc4dcd) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:55.333887 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1470499102 could not be found. Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1470499102 could not be found. Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1470499102 could not be found. Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc9a4986-8cfe-4969-85c3-87d8ef46baec tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Returning 404 to user: Volume tempest-invalid-1470499102 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cc9a4986-8cfe-4969-85c3-87d8ef46baec tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1470499102" status: 404 len: 99 microversion: 2.1 time: 0.068121 Jul 20 11:18:55.339011 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2660/5341] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:18:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1470499102 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 11:18:55.352021 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b5f4f0c3-83ad-49af-b13a-a3798281b573 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005752 Jul 20 11:18:55.352827 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2682/5342] 10.222.0.79 () {58 vars in 1139 bytes} [Wed Jul 20 11:18:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 11:18:55.363679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-425b7ae0-9f75-4c29-8477-1a5fbffa941c tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005320 Jul 20 11:18:55.364284 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2661/5343] 10.222.0.79 () {58 vars in 1136 bytes} [Wed Jul 20 11:18:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 11:18:55.375956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7c64a7d-b3e8-4ad9-96c6-94f609922643 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Calling method '.version_select at 0x7f2c3e7918b0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:55.440456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f414713c-3087-4097-af6f-a7f586121055 req-06f6d558-aa6b-4562-bcf1-dd5fd2391884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21382d6-2ea0-482b-b9d8-e49488ef0d35", "tag": "7a7337c0-8cd2-4d3a-9f2c-9670b34b557b"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:18:55.457610 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d7c64a7d-b3e8-4ad9-96c6-94f609922643 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] HTTP exception thrown: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7c64a7d-b3e8-4ad9-96c6-94f609922643 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Request method failure captured: Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/os-volumes/cf9cf408-ec78-45d5-9399-7715f1ed0e01 HTTP/1.1 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Se-yKeBUBQN1ZLN72r9A9V0qNNiX59QP06d3PTvpqxGZCEMgqq-7voAxtjRnAQDFlzmTao6bnG0-Rk4s5WP2ou2zZ0n926DLKkcSujKZ3q93hiOcEDdegLw2P8m87aO0jy4DsYHFNO2Yy74yoy_AH2N_JNwwQ5yDqrO6rvRRMKB5s Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b161830d1f4849ecb812294ad4209fec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9d6005a2ef7f420f99a6c4c9bff11f8d Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: exception: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'cf9cf408-ec78-45d5-9399-7715f1ed0e01'} Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. (HTTP 404) (Request-ID: req-1f67a715-8f56-4995-9627-69957aabdf05) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:55.465729 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. Jul 20 11:18:55.469977 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.482961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d7c64a7d-b3e8-4ad9-96c6-94f609922643 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Returning 404 to user: Volume cf9cf408-ec78-45d5-9399-7715f1ed0e01 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:55.488336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d7c64a7d-b3e8-4ad9-96c6-94f609922643 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/cf9cf408-ec78-45d5-9399-7715f1ed0e01" status: 404 len: 109 microversion: 2.1 time: 0.117011 Jul 20 11:18:55.494070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2683/5344] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:18:55 2022] DELETE /compute/v2.1/os-volumes/cf9cf408-ec78-45d5-9399-7715f1ed0e01 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:55.507146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f414713c-3087-4097-af6f-a7f586121055 req-06f6d558-aa6b-4562-bcf1-dd5fd2391884 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:55.509535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f414713c-3087-4097-af6f-a7f586121055 req-06f6d558-aa6b-4562-bcf1-dd5fd2391884 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:55.512491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9dd3b85b-6f1c-479e-b721-034818b446b5 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Calling method '.version_select at 0x7f2c3e7f6940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:55.567242 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f414713c-3087-4097-af6f-a7f586121055 req-06f6d558-aa6b-4562-bcf1-dd5fd2391884 service nova] Creating event network-changed:7a7337c0-8cd2-4d3a-9f2c-9670b34b557b for instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 on n-h2-846219-10 Jul 20 11:18:55.570721 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9dd3b85b-6f1c-479e-b721-034818b446b5 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] HTTP exception thrown: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9dd3b85b-6f1c-479e-b721-034818b446b5 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Request method failure captured: Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/os-volumes/164a171a-d86a-4b87-9066-9228d1e2462e HTTP/1.1 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-Se-yKeBUBQN1ZLN72r9A9V0qNNiX59QP06d3PTvpqxGZCEMgqq-7voAxtjRnAQDFlzmTao6bnG0-Rk4s5WP2ou2zZ0n926DLKkcSujKZ3q93hiOcEDdegLw2P8m87aO0jy4DsYHFNO2Yy74yoy_AH2N_JNwwQ5yDqrO6rvRRMKB5s Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b161830d1f4849ecb812294ad4209fec", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b161830d1f4849ecb812294ad4209fec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b161830d1f4849ecb812294ad4209fec Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesNegativeTest-739713707 Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 9d6005a2ef7f420f99a6c4c9bff11f8d Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesNegativeTest-739713707-project Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: method: Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: exception: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '164a171a-d86a-4b87-9066-9228d1e2462e'} Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. (HTTP 404) (Request-ID: req-767e7395-a655-4c87-a4e8-eab80ec66071) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 11:18:55.573476 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9dd3b85b-6f1c-479e-b721-034818b446b5 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] Returning 404 to user: Volume 164a171a-d86a-4b87-9066-9228d1e2462e could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9dd3b85b-6f1c-479e-b721-034818b446b5 tempest-VolumesNegativeTest-739713707 tempest-VolumesNegativeTest-739713707-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/164a171a-d86a-4b87-9066-9228d1e2462e" status: 404 len: 109 microversion: 2.1 time: 0.074784 Jul 20 11:18:55.580617 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2684/5345] 10.222.0.79 () {58 vars in 1244 bytes} [Wed Jul 20 11:18:55 2022] GET /compute/v2.1/os-volumes/164a171a-d86a-4b87-9066-9228d1e2462e => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:18:55.588201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:55.594709 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f414713c-3087-4097-af6f-a7f586121055 req-06f6d558-aa6b-4562-bcf1-dd5fd2391884 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158817 Jul 20 11:18:55.595282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:55.595921 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2662/5346] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:18:55.626669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:55.627217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:55.628060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:55.628511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:55.846835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:55.848104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:55.858327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:55.858956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:55.860490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:55.861097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:56.115087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:56.129745 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a3ac582-f8b1-42f4-b7df-04ab2565235a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1690 microversion: 2.1 time: 0.549991 Jul 20 11:18:56.130670 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2685/5347] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:55 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1690 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:56.265890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:56.275900 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8cb52c65-af84-4465-b6ea-e32266f0a318 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1363 microversion: 2.1 time: 0.434453 Jul 20 11:18:56.276728 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2663/5348] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:55 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:57.148413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:57.149036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:57.166554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:57.167475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:57.169434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:57.173713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:57.303782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:57.305096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:57.326460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:57.327632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:57.330121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:57.332146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:57.413052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:57.425267 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0582397b-4c57-4dc7-8592-24b9a1deaf44 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1690 microversion: 2.1 time: 0.280673 Jul 20 11:18:57.426169 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2686/5349] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:57 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1690 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:57.681825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:57.701436 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cdb82cb0-3252-47ec-b3bf-53514e6d0da3 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1363 microversion: 2.1 time: 0.410500 Jul 20 11:18:57.719984 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2664/5350] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:57 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:18:58.454070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:58.454777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:58.475486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:58.476094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:58.479574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:58.481135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:58.730999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:18:58.734625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:18:58.765680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:58.766032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:58.773101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:18:58.773964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:18:58.995657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:59.014601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c176d2a1-22b6-4ed0-82a6-eb1f4e896a74 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1690 microversion: 2.1 time: 0.562097 Jul 20 11:18:59.016132 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2687/5351] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:58 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1690 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:18:59.220113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:59.258087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:18:59.534773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:18:59.546417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-306dba47-db02-44c6-953d-dc4d0ea01218 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1363 microversion: 2.1 time: 0.823284 Jul 20 11:18:59.547031 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2665/5352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:18:58 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1363 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:00.033138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:00.034642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:00.041761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:00.044547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:00.045245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:00.046212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:00.046819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:00.327787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:00.347727 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6a7f7e54-cf68-48bb-aca7-b58165022fcb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.318336 Jul 20 11:19:00.349264 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2688/5353] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:00 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:00.565134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:00.566002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:00.579154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:00.581075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:00.582224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:00.582942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:00.828507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:00.830310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-325a7e1e-23ae-41e5-8e97-a184299f184c req-4c16dd22-14f2-412a-912e-23da99d8ad12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21382d6-2ea0-482b-b9d8-e49488ef0d35", "name": "network-vif-plugged", "status": "completed", "tag": "7a7337c0-8cd2-4d3a-9f2c-9670b34b557b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:00.855927 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68fd635a-d85b-43d0-8c8c-b1886c179e37 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1363 microversion: 2.1 time: 0.295444 Jul 20 11:19:00.856530 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2666/5354] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:00 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:00.863237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-325a7e1e-23ae-41e5-8e97-a184299f184c req-4c16dd22-14f2-412a-912e-23da99d8ad12 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:00.867646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-325a7e1e-23ae-41e5-8e97-a184299f184c req-4c16dd22-14f2-412a-912e-23da99d8ad12 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:00.895255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-325a7e1e-23ae-41e5-8e97-a184299f184c req-4c16dd22-14f2-412a-912e-23da99d8ad12 service nova] Creating event network-vif-plugged:7a7337c0-8cd2-4d3a-9f2c-9670b34b557b for instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 on n-h2-846219-10 Jul 20 11:19:00.906153 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-325a7e1e-23ae-41e5-8e97-a184299f184c req-4c16dd22-14f2-412a-912e-23da99d8ad12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093686 Jul 20 11:19:00.906153 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2689/5355] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:01.367491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:01.372037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:01.405724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:01.406190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:01.407406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:01.408099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:01.746173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:01.765138 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f59a76b-05e7-4727-9fee-dc09dc769d92 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.400013 Jul 20 11:19:01.766136 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2667/5356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:01 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:01.874788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:01.875562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:01.890975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:01.891471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:01.904327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:01.905330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:02.199212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:02.216225 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5d337367-b23e-4421-87b6-9145aa4b290a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1363 microversion: 2.1 time: 0.346384 Jul 20 11:19:02.217122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2690/5357] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:01 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:02.789668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:02.791258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:02.816617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:02.817939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:02.820234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:02.820741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:03.000967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:03.013604 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbc1bfb8-c8b4-4683-b323-7414224ae793 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.234287 Jul 20 11:19:03.014559 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2668/5358] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:02 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:03.235516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:03.236979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:03.248255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:03.249091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:03.250173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:03.253886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:03.476636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:03.488660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4579c4bb-8261-479d-aa9f-00e48c1b47f1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1549 microversion: 2.1 time: 0.257780 Jul 20 11:19:03.489103 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2691/5359] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:03 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:03.507304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:03.508444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:03.515526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:03.516260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:03.517279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:03.517996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:03.628511 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fe9b98e-0c5d-4516-920e-cb78cc74bd78 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125681 Jul 20 11:19:03.636012 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2669/5360] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:19:03 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:04.033520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:04.034887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:04.044798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:04.046131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:04.047688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:04.048492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:04.353021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:04.361978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-036a2bf6-2d3c-45de-a500-79a7308d2f9e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.333614 Jul 20 11:19:04.362576 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2692/5361] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:04 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:05.386982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:05.387781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:05.410646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:05.411123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:05.412038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:05.412471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:05.475958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5b442943-0910-4b8f-92db-f03e875bc951 req-4dcfe468-5403-4114-9769-106de2700c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c21382d6-2ea0-482b-b9d8-e49488ef0d35", "tag": "7a7337c0-8cd2-4d3a-9f2c-9670b34b557b"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:05.509864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5b442943-0910-4b8f-92db-f03e875bc951 req-4dcfe468-5403-4114-9769-106de2700c68 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:05.512775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5b442943-0910-4b8f-92db-f03e875bc951 req-4dcfe468-5403-4114-9769-106de2700c68 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:05.559884 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5b442943-0910-4b8f-92db-f03e875bc951 req-4dcfe468-5403-4114-9769-106de2700c68 service nova] Creating event network-changed:7a7337c0-8cd2-4d3a-9f2c-9670b34b557b for instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 on n-h2-846219-10 Jul 20 11:19:05.577853 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5b442943-0910-4b8f-92db-f03e875bc951 req-4dcfe468-5403-4114-9769-106de2700c68 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491827 Jul 20 11:19:05.580559 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2670/5362] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:05.763964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-532083579", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "8cd76d8f-e0d1-432d-bc32-e1300df699dc"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:05.855834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] validate_networks() for [('8cd76d8f-e0d1-432d-bc32-e1300df699dc', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:19:06.103333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:06.121880 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e02f7c7b-465a-42f1-aa75-8c385e9dbc2f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.744725 Jul 20 11:19:06.124087 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2693/5363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:05 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:07.081670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:19:07.082232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:19:07.083045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:19:07.083592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:19:07.084769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:19:07.105725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:07.107675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:07.108930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:07.109727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:07.142365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:07.143864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:07.160143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:07.165183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:07.168061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:07.172200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:07.190214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Getting quotas for project 19895d976ac54263b83b7a11a861985c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:19:07.210479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Getting quotas for user 169d07ab916842e08d891df053448daf and project 19895d976ac54263b83b7a11a861985c. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:19:07.236162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:19:07.238834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:19:07.315669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dad94073-836d-4d2f-87d7-af5a9cf30bc8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554874 Jul 20 11:19:07.315862 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2671/5364] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:19:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:19:07.337733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-372b6293-3155-44e4-a4e3-c775a4d5f086 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:07.338459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-372b6293-3155-44e4-a4e3-c775a4d5f086 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:07.485958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-372b6293-3155-44e4-a4e3-c775a4d5f086 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:07.495964 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-372b6293-3155-44e4-a4e3-c775a4d5f086 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1213 microversion: 2.1 time: 0.162432 Jul 20 11:19:07.496934 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2672/5365] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:07 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:07.519091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:07.539515 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-16a49386-f2e7-497f-ad56-12d367ae1acb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.401588 Jul 20 11:19:07.541217 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2694/5366] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:07 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:08.514745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:08.515564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:08.531005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:08.533605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:08.535645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:08.537392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:08.560220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:08.561855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:08.569552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:08.584396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:08.586190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:08.586695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:08.642663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=83 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:08.660425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:08.673239 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f45f87ef-e74e-4677-99ca-99b4bb0a24df tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1273 microversion: 2.1 time: 0.163678 Jul 20 11:19:08.674628 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2673/5367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:08 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:09.344844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:09.360265 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5340f07a-9a89-42d1-acca-8c8e6667963c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.804857 Jul 20 11:19:09.362207 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2695/5368] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:08 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:09.694233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:09.695263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:09.702529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:09.710227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:09.710679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:09.711506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:09.711951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:09.807803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:09.812233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:09.821829 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d55f7981-baa7-4a60-ac2e-a17fb3d9d934 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1271 microversion: 2.1 time: 0.134311 Jul 20 11:19:09.823590 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2674/5369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:09 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:10.381137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:10.383211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:10.392080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=37 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:10.395526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:10.396280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:10.397848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:10.398504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:10.658180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:10.667385 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-721cd2fb-f04a-48b3-aa65-366ea4114238 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.292681 Jul 20 11:19:10.676041 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2696/5370] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:10 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:10.844664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:10.845569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:10.857758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:10.858467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:10.859557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:10.860180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:11.172873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:11.192035 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c08e3ab-262e-4567-840a-0830e93a7da3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1313 microversion: 2.1 time: 0.354548 Jul 20 11:19:11.193884 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2675/5371] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:10 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:11.343074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-513c01f2-eaeb-4012-ba71-49bca421ccd1 req-5c41f6f9-7993-419a-ad56-b7d3b0176496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cda128-6610-4d67-873d-6cbc951066d9", "tag": "2c4fb943-2b90-477c-ab45-d2d85c285803"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:11.353154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-513c01f2-eaeb-4012-ba71-49bca421ccd1 req-5c41f6f9-7993-419a-ad56-b7d3b0176496 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:11.354042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-513c01f2-eaeb-4012-ba71-49bca421ccd1 req-5c41f6f9-7993-419a-ad56-b7d3b0176496 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:11.383312 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-513c01f2-eaeb-4012-ba71-49bca421ccd1 req-5c41f6f9-7993-419a-ad56-b7d3b0176496 service nova] Creating event network-changed:2c4fb943-2b90-477c-ab45-d2d85c285803 for instance e3cda128-6610-4d67-873d-6cbc951066d9 on n-h2-846219-10 Jul 20 11:19:11.391096 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-513c01f2-eaeb-4012-ba71-49bca421ccd1 req-5c41f6f9-7993-419a-ad56-b7d3b0176496 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052224 Jul 20 11:19:11.392432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2697/5372] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:11.691152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:11.691961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:11.699546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:11.700222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:11.701482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:11.702153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:11.948622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:11.960730 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65433b67-2767-413a-8fcb-cd28b0e4a9e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.272954 Jul 20 11:19:11.971822 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2676/5373] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:11 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:12.212387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:12.213110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:12.220548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:12.221230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:12.222183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:12.222788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:12.377606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:12.387757 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f61b4afa-38ac-4cc6-9940-d0fb26387e81 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1313 microversion: 2.1 time: 0.181413 Jul 20 11:19:12.398584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2698/5374] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:12 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:12.980551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:12.982518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:12.998112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:12.998915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:13.000435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:13.000882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:13.332961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:13.347409 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3aad1c19-eb83-4566-af53-aea049f7e49e tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.372931 Jul 20 11:19:13.359385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2677/5375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:12 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:13.405018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:13.405701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:13.418340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:13.422153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:13.423684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:13.427546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:13.680859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:13.690518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a093e46-a2cc-4656-9178-9f0cef471c1b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1313 microversion: 2.1 time: 0.289434 Jul 20 11:19:13.705028 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2699/5376] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:13 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:14.367893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:14.369117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:14.378195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:14.379398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:14.405465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:14.405963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:14.713200 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:14.714404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:14.719696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:14.725634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:14.732319 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4212d46-7d4c-403f-96da-5a10f099686d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.369740 Jul 20 11:19:14.733079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:14.733230 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2678/5377] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:14 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:14.734115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:14.734577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:14.935252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:14.944583 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eba1c962-90e1-459b-86d9-cc612e6b031c tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1313 microversion: 2.1 time: 0.235766 Jul 20 11:19:14.948918 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2700/5378] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:14 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:15.752839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:15.754220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:15.764149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:15.764987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:15.766310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:15.767485 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:15.963678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:15.964357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:15.975374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:15.976036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:15.979654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:15.980371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:16.022588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:16.031396 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-da8d3543-142e-4b20-8fe2-de9ab81afe18 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.284460 Jul 20 11:19:16.032479 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2679/5379] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:15 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:16.200153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:16.211340 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1b34d91-1e55-492c-976b-79d3bbc5ef17 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1313 microversion: 2.1 time: 0.252043 Jul 20 11:19:16.211460 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2701/5380] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:15 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:16.984319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-713e2a9c-5b48-4861-baf4-c40b732571ec req-18fe7bc6-4dd9-4504-bb30-5e5e8d72b8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cda128-6610-4d67-873d-6cbc951066d9", "name": "network-vif-plugged", "status": "completed", "tag": "2c4fb943-2b90-477c-ab45-d2d85c285803"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:17.014655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-713e2a9c-5b48-4861-baf4-c40b732571ec req-18fe7bc6-4dd9-4504-bb30-5e5e8d72b8c3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:17.015880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-713e2a9c-5b48-4861-baf4-c40b732571ec req-18fe7bc6-4dd9-4504-bb30-5e5e8d72b8c3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:17.034288 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-713e2a9c-5b48-4861-baf4-c40b732571ec req-18fe7bc6-4dd9-4504-bb30-5e5e8d72b8c3 service nova] Creating event network-vif-plugged:2c4fb943-2b90-477c-ab45-d2d85c285803 for instance e3cda128-6610-4d67-873d-6cbc951066d9 on n-h2-846219-10 Jul 20 11:19:17.040623 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-713e2a9c-5b48-4861-baf4-c40b732571ec req-18fe7bc6-4dd9-4504-bb30-5e5e8d72b8c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060037 Jul 20 11:19:17.041605 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2680/5381] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:17.058778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:17.059982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:17.070773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:17.084624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:17.086081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:17.086709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:17.229161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:17.230172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:17.242471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:17.244626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:17.249471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:17.250961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:17.254281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:17.492070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=8 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:17.554474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:17.568651 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0bd5f6b2-2b26-4d2b-963d-db0831bb5fdf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1695 microversion: 2.1 time: 0.513591 Jul 20 11:19:17.569702 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2702/5382] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:17 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1695 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:17.736621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:17.745569 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cdff3746-eb2e-4cb4-a923-2e870ab6353b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1313 microversion: 2.1 time: 0.521273 Jul 20 11:19:17.746164 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2681/5383] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:17 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:18.091133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bb7d0b25-c39a-499f-ab98-ebcd79133a2e req-370bf3e5-107e-462a-b5a4-b924e91e4b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "name": "network-vif-unplugged", "status": "completed", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:18.106658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bb7d0b25-c39a-499f-ab98-ebcd79133a2e req-370bf3e5-107e-462a-b5a4-b924e91e4b03 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:18.111103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bb7d0b25-c39a-499f-ab98-ebcd79133a2e req-370bf3e5-107e-462a-b5a4-b924e91e4b03 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:18.136389 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bb7d0b25-c39a-499f-ab98-ebcd79133a2e req-370bf3e5-107e-462a-b5a4-b924e91e4b03 service nova] Creating event network-vif-unplugged:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h1-846219-10 Jul 20 11:19:18.149427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-bb7d0b25-c39a-499f-ab98-ebcd79133a2e req-370bf3e5-107e-462a-b5a4-b924e91e4b03 service nova] Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:19:18.171558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bb7d0b25-c39a-499f-ab98-ebcd79133a2e req-370bf3e5-107e-462a-b5a4-b924e91e4b03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084597 Jul 20 11:19:18.173195 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2703/5384] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:18.587387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:18.589108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:18.604118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:18.604562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:18.606482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:18.606903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:18.769949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:18.771464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:18.790582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:18.791506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:18.794065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:18.794814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:19.368776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:19.386989 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3eda451e-c0ad-404f-a49b-14473b5a64e6 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1694 microversion: 2.1 time: 0.804012 Jul 20 11:19:19.387883 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2682/5385] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:18 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1694 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:19.917713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:19.942006 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-13493c33-312c-4ba5-b3d3-93ff4a7db2c5 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1496 microversion: 2.1 time: 1.182638 Jul 20 11:19:19.942973 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2704/5386] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:18 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1496 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:20.197456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5293f422-324f-47fc-95c0-df539fa20d3e req-3c7fb691-476a-49df-a5c9-71170e4bb5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:20.232488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5293f422-324f-47fc-95c0-df539fa20d3e req-3c7fb691-476a-49df-a5c9-71170e4bb5b4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.232944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5293f422-324f-47fc-95c0-df539fa20d3e req-3c7fb691-476a-49df-a5c9-71170e4bb5b4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.273385 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5293f422-324f-47fc-95c0-df539fa20d3e req-3c7fb691-476a-49df-a5c9-71170e4bb5b4 service nova] Creating event network-changed:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h1-846219-10 Jul 20 11:19:20.289474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-5293f422-324f-47fc-95c0-df539fa20d3e req-3c7fb691-476a-49df-a5c9-71170e4bb5b4 service nova] Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:19:20.317510 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5293f422-324f-47fc-95c0-df539fa20d3e req-3c7fb691-476a-49df-a5c9-71170e4bb5b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117229 Jul 20 11:19:20.319107 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2683/5387] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:20.408449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:20.409213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:20.419107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.419607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.420407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.420846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.717134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Calling method '.version_select at 0x7f2c3e7f6ee0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:20.718511 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:19:20.718511 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:19:20.720828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.721806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.781084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.781746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.802484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:20.807097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.814506 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8a224dea-5d1b-49ce-bbfc-feee2a1c2986 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1692 microversion: 2.1 time: 0.411348 Jul 20 11:19:20.815100 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2684/5388] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:20 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:20.815411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.827932 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4290ddfd-0b45-4d00-abb6-2c1412a9e7ac tempest-PortsAdminExtendedAttrsTestJSON-2122722310 tempest-PortsAdminExtendedAttrsTestJSON-2122722310-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.605081 Jul 20 11:19:20.829352 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2705/5389] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 11:19:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:20.838283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:20.839385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:20.847844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.848299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.849086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:20.850590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:20.880221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:19:20.977180 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-de195154-f5e3-4003-98cc-b8e6d4fe80dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 204 len: 0 microversion: 2.1 time: 0.151459 Jul 20 11:19:20.978333 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2685/5390] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:19:20 2022] DELETE /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:19:20.994858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:21.006785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:21.019064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:21.019963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:21.024043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:21.026420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:21.523760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:21.535843 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6a137cdc-2fa8-4741-a30f-88035a5bc249 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1502 microversion: 2.1 time: 0.550601 Jul 20 11:19:21.537404 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2706/5391] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:20 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1502 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:21.833870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:21.834879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:21.843190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:21.843918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:21.844799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:21.845244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:22.328323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:22.340544 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-584e8071-dcfe-4501-9135-c21bdb485596 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1692 microversion: 2.1 time: 0.511510 Jul 20 11:19:22.341704 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2686/5392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:21 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1692 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:22.555836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:22.557140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:22.566663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:22.567394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:22.569237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:22.569908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:22.781243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:22.791292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7d64038-1d67-4d80-bd99-728076a3bbab tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1502 microversion: 2.1 time: 0.240763 Jul 20 11:19:22.792069 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2707/5393] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:22 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:23.357891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:23.359375 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:23.371220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.371687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.372470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.372915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.637085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:23.648060 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d0f7019-e11d-45e2-9d79-8cf4bf6d5676 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1689 microversion: 2.1 time: 0.293592 Jul 20 11:19:23.661453 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2687/5394] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:23 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1689 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:23.669462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:23.670055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:23.677613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.678177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.679056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.679598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.811831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:23.812554 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:23.823704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.823704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.825541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.826111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.858530 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-29c8684d-0666-4efb-9bad-6d9322fe5299 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action" status: 202 len: 0 microversion: 2.1 time: 0.193619 Jul 20 11:19:23.860370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2708/5395] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:19:23 2022] POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:19:23.878986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:23.882047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:23.890310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.890776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.892241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:23.892693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:23.928181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:23.938188 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dc7dbd7a-260f-4770-9ac9-e451d2d1aa78 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 200 len: 1460 microversion: 2.1 time: 0.132431 Jul 20 11:19:23.949038 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2688/5396] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:23 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 1460 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:24.088138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-21569a32-2898-4bbd-a925-4da47df9042f req-13294f78-d16c-4ca6-8b11-9ef300c8e083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cda128-6610-4d67-873d-6cbc951066d9", "name": "network-vif-deleted", "tag": "2c4fb943-2b90-477c-ab45-d2d85c285803"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:24.109222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-21569a32-2898-4bbd-a925-4da47df9042f req-13294f78-d16c-4ca6-8b11-9ef300c8e083 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:24.110071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-21569a32-2898-4bbd-a925-4da47df9042f req-13294f78-d16c-4ca6-8b11-9ef300c8e083 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:24.128397 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-21569a32-2898-4bbd-a925-4da47df9042f req-13294f78-d16c-4ca6-8b11-9ef300c8e083 service nova] Creating event network-vif-deleted:2c4fb943-2b90-477c-ab45-d2d85c285803 for instance e3cda128-6610-4d67-873d-6cbc951066d9 on n-h2-846219-10 Jul 20 11:19:24.134610 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-21569a32-2898-4bbd-a925-4da47df9042f req-13294f78-d16c-4ca6-8b11-9ef300c8e083 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075770 Jul 20 11:19:24.135750 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2689/5397] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:24.664822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:24.677919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-787f3f45-6c3a-4861-98a9-6ec2877828d4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.810984 Jul 20 11:19:24.681972 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2709/5398] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:23 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:24.960547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:24.962691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: e3cda128-6610-4d67-873d-6cbc951066d9] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:24.982195 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:24.987036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:24.988282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:24.989080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:25.008765 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] HTTP exception thrown: Instance e3cda128-6610-4d67-873d-6cbc951066d9 could not be found. Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Request method failure captured: Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 HTTP/1.1 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-SmW1E2f6CLYV4-tWvuXZbSsfPWBJULyVyMkZj7o0bOarPgfc8UeKxPXBE04vbDm3Vo_7BfBuaXwgHLFWN5uGezUKyqqY8PSOKbYhSiiStyI7COjSPcYEeUcUzuXOeugxuUdd_0mgN_V2kPeJ1iDJ9mukwKMyQwECi_bxuBjJACJZw Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 19895d976ac54263b83b7a11a861985c Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesActionsTest-1646655876 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19895d976ac54263b83b7a11a861985c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19895d976ac54263b83b7a11a861985c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19895d976ac54263b83b7a11a861985c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19895d976ac54263b83b7a11a861985c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesActionsTest-1646655876 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 19895d976ac54263b83b7a11a861985c Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesActionsTest-1646655876 Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesActionsTest-1646655876-project Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 169d07ab916842e08d891df053448daf Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesActionsTest-1646655876-project Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e3cda128-6610-4d67-873d-6cbc951066d9 could not be found. Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e3cda128-6610-4d67-873d-6cbc951066d9'} Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cda128-6610-4d67-873d-6cbc951066d9 could not be found. Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cda128-6610-4d67-873d-6cbc951066d9 could not be found. Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:19:25.011564 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cda128-6610-4d67-873d-6cbc951066d9 could not be found. Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Returning 404 to user: Instance e3cda128-6610-4d67-873d-6cbc951066d9 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:19:25.016370 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-00ee378e-06a4-42c3-8c04-51a2d8c7d7dc tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9" status: 404 len: 111 microversion: 2.1 time: 0.060127 Jul 20 11:19:25.026739 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2690/5399] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:24 2022] GET /compute/v2.1/servers/e3cda128-6610-4d67-873d-6cbc951066d9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:19:25.242870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-149896278", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "8cd76d8f-e0d1-432d-bc32-e1300df699dc"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:25.364657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] validate_networks() for [('8cd76d8f-e0d1-432d-bc32-e1300df699dc', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:19:25.706381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:25.707366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:25.724692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:25.725708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:25.727687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:25.729368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:26.057116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:26.071575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-caf267b7-6e00-4fc3-b16b-2a67a58162ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.379777 Jul 20 11:19:26.083349 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2691/5400] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:25 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:26.247586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:19:26.249114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:19:26.249809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:19:26.256414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:19:26.257499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:19:26.292507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:26.293156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:26.297555 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:26.298257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:26.338118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Getting quotas for project 19895d976ac54263b83b7a11a861985c. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:19:26.368617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Getting quotas for user 169d07ab916842e08d891df053448daf and project 19895d976ac54263b83b7a11a861985c. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:19:26.409078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:19:26.412199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:19:26.565452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef04a414-954c-42d6-8049-8ebb470434f4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326997 Jul 20 11:19:26.573975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2710/5401] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:19:26.585737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-31f69e6a-e105-45c9-acf3-ba1da6c14b50 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:26.586723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-31f69e6a-e105-45c9-acf3-ba1da6c14b50 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:26.679455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-31f69e6a-e105-45c9-acf3-ba1da6c14b50 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:26.692608 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-31f69e6a-e105-45c9-acf3-ba1da6c14b50 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1213 microversion: 2.1 time: 0.108325 Jul 20 11:19:26.694272 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2692/5402] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:26 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:27.033778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f2c2b132-20ef-4d45-bcc5-46168051cff9 req-8d0affb2-de66-41bf-b4f1-ac200ff77251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "name": "network-vif-plugged", "status": "completed", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:27.060430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f2c2b132-20ef-4d45-bcc5-46168051cff9 req-8d0affb2-de66-41bf-b4f1-ac200ff77251 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:27.062358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f2c2b132-20ef-4d45-bcc5-46168051cff9 req-8d0affb2-de66-41bf-b4f1-ac200ff77251 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:27.092333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:27.095585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:27.120678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:27.124629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:27.125246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f2c2b132-20ef-4d45-bcc5-46168051cff9 req-8d0affb2-de66-41bf-b4f1-ac200ff77251 service nova] Creating event network-vif-plugged:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h1-846219-10 Jul 20 11:19:27.129962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:27.131731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:27.137098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:27.151511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-f2c2b132-20ef-4d45-bcc5-46168051cff9 req-8d0affb2-de66-41bf-b4f1-ac200ff77251 service nova] Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:19:27.158189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:27.180938 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f2c2b132-20ef-4d45-bcc5-46168051cff9 req-8d0affb2-de66-41bf-b4f1-ac200ff77251 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152687 Jul 20 11:19:27.183018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2711/5403] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:27.440615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:27.452628 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aed3254e-cf4a-469d-8dc5-17a83ce5fe9a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.365532 Jul 20 11:19:27.454200 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2693/5404] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:27 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:27.713097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:27.713959 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:27.731665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:27.732880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:27.735472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:27.737565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:27.840102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:27.853030 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-32ee0d97-25c9-45bb-8aa9-2b990478d43b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1265 microversion: 2.1 time: 0.146045 Jul 20 11:19:27.854010 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2712/5405] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:27 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:28.480553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:28.483795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:28.499731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:28.502329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:28.504793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:28.507690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:28.870385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:28.871767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:28.879919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:28.880961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:28.882128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:28.882900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:28.967076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:28.977786 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76d829ae-b00b-4aab-ab23-0cc9bf7e9740 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.508358 Jul 20 11:19:28.979982 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2694/5406] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:28 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:28.990750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:28.998756 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5c1e3a75-a5f1-44ca-9d81-aebeb98c00a9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1271 microversion: 2.1 time: 0.132352 Jul 20 11:19:29.009171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2713/5407] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:28 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:29.682481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4eaaf244-1d44-4dc6-a1ce-480e040fead0 req-ac6d76c4-4a11-417f-9585-fa16d70917ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "name": "network-vif-unplugged", "status": "completed", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:29.691820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4eaaf244-1d44-4dc6-a1ce-480e040fead0 req-ac6d76c4-4a11-417f-9585-fa16d70917ba service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:29.692274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4eaaf244-1d44-4dc6-a1ce-480e040fead0 req-ac6d76c4-4a11-417f-9585-fa16d70917ba service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:29.707679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4eaaf244-1d44-4dc6-a1ce-480e040fead0 req-ac6d76c4-4a11-417f-9585-fa16d70917ba service nova] Creating event network-vif-unplugged:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:19:29.714369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-4eaaf244-1d44-4dc6-a1ce-480e040fead0 req-ac6d76c4-4a11-417f-9585-fa16d70917ba service nova] Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:19:29.728581 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4eaaf244-1d44-4dc6-a1ce-480e040fead0 req-ac6d76c4-4a11-417f-9585-fa16d70917ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049623 Jul 20 11:19:29.729224 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2695/5408] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:19:29.999636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:30.002848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:30.025143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:30.026190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:30.035070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:30.037905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:30.039386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:30.048184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:30.050393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:30.051973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:30.054171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:30.054844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:30.760570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:30.769355 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-66246d9a-7409-4da1-9420-146405edf070 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.775724 Jul 20 11:19:30.770237 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2714/5409] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:29 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:30.777525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:30.798867 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4c19c9d6-71b5-49b2-aeb8-0d1ef7623b73 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1313 microversion: 2.1 time: 0.782657 Jul 20 11:19:30.800374 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2696/5410] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:30 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:31.241935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0c133e90-1266-4cf2-8c67-24707d8b2861 req-ce47163d-1184-46d2-a9fb-b174cf750121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f03866-d433-44c9-9114-6bd9f6fbfc3b", "tag": "e3c12705-74c4-418d-9ccf-88f045fe77cf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:31.273544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0c133e90-1266-4cf2-8c67-24707d8b2861 req-ce47163d-1184-46d2-a9fb-b174cf750121 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:31.273991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0c133e90-1266-4cf2-8c67-24707d8b2861 req-ce47163d-1184-46d2-a9fb-b174cf750121 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:31.314688 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0c133e90-1266-4cf2-8c67-24707d8b2861 req-ce47163d-1184-46d2-a9fb-b174cf750121 service nova] Creating event network-changed:e3c12705-74c4-418d-9ccf-88f045fe77cf for instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b on n-h2-846219-10 Jul 20 11:19:31.322872 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0c133e90-1266-4cf2-8c67-24707d8b2861 req-ce47163d-1184-46d2-a9fb-b174cf750121 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084745 Jul 20 11:19:31.324569 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2715/5411] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:31.760628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-32387dfd-9921-44e8-8219-480e981bcdfb req-a891f8d8-b427-4811-8c19-773ade4eeb93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:31.769045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-32387dfd-9921-44e8-8219-480e981bcdfb req-a891f8d8-b427-4811-8c19-773ade4eeb93 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:31.769782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-32387dfd-9921-44e8-8219-480e981bcdfb req-a891f8d8-b427-4811-8c19-773ade4eeb93 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:31.788107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:31.788818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:31.794302 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-32387dfd-9921-44e8-8219-480e981bcdfb req-a891f8d8-b427-4811-8c19-773ade4eeb93 service nova] Creating event network-changed:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:19:31.801624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:31.802942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:31.805624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:31.806258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:31.815104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-32387dfd-9921-44e8-8219-480e981bcdfb req-a891f8d8-b427-4811-8c19-773ade4eeb93 service nova] Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:19:31.843326 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-32387dfd-9921-44e8-8219-480e981bcdfb req-a891f8d8-b427-4811-8c19-773ade4eeb93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088399 Jul 20 11:19:31.846384 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2697/5412] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:31.858252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:31.859942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:31.867959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:31.868468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:31.870516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:31.871477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:32.303581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:32.312594 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6f8b4866-d9b1-4bcc-8425-6be8c6e16727 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.529510 Jul 20 11:19:32.313576 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2716/5413] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:31 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:32.354455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:32.374869 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-306a80c8-3a47-4290-a588-73882491c271 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1313 microversion: 2.1 time: 0.525764 Jul 20 11:19:32.375561 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2698/5414] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:31 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:33.331346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:33.332665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:33.341089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:33.341905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:33.342919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:33.343596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:33.394828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:33.395470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:33.404407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:33.405154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:33.406083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:33.406591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:33.778958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:33.787775 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03f46ca6-b6f5-4d34-a943-0e2001cce389 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.460105 Jul 20 11:19:33.788494 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2717/5415] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:33 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:33.823328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:33.835081 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68e00091-a1f9-466e-ada6-3324acf5024b tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1313 microversion: 2.1 time: 0.443607 Jul 20 11:19:33.835843 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2699/5416] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:33 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:34.813370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:34.814776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:34.828572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:34.830784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:34.833083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:34.834442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:34.869275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:34.870553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:34.889063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:34.891797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:34.894418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:34.895189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:35.321395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:35.331805 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e72ade7-3328-4615-bce8-ccd11fb617ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1688 microversion: 2.1 time: 0.529830 Jul 20 11:19:35.332682 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2718/5417] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:34 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1688 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:35.372604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:35.387532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-337a3e00-1c6a-4d2a-8a7d-180799c17338 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1313 microversion: 2.1 time: 0.535878 Jul 20 11:19:35.390251 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2700/5418] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:34 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:36.370279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:36.371703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:36.378940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:36.389962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:36.390812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:36.393107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:36.395359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:36.398294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:36.410098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:36.413712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:36.434196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:36.435163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:36.437282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:36.440208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:36.684496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:37.062338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:37.076932 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41fb60a6-790e-41ac-9488-7b7a68b3f3db tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1681 microversion: 2.1 time: 0.728816 Jul 20 11:19:37.085342 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2719/5419] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:36 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1681 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:37.118341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:37.126492 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-249b9f0f-25fe-4ce6-93eb-179bfe7ed9c7 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1313 microversion: 2.1 time: 0.722274 Jul 20 11:19:37.127101 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2701/5420] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:36 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1313 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:19:37.197674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d73d2869-07fe-4ed9-9dc1-006dd6c1b742 req-e1f8b21f-a6da-4327-a48b-a7020cbd197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f03866-d433-44c9-9114-6bd9f6fbfc3b", "name": "network-vif-plugged", "status": "completed", "tag": "e3c12705-74c4-418d-9ccf-88f045fe77cf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:37.209946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d73d2869-07fe-4ed9-9dc1-006dd6c1b742 req-e1f8b21f-a6da-4327-a48b-a7020cbd197b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:37.211122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d73d2869-07fe-4ed9-9dc1-006dd6c1b742 req-e1f8b21f-a6da-4327-a48b-a7020cbd197b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:37.226461 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d73d2869-07fe-4ed9-9dc1-006dd6c1b742 req-e1f8b21f-a6da-4327-a48b-a7020cbd197b service nova] Creating event network-vif-plugged:e3c12705-74c4-418d-9ccf-88f045fe77cf for instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b on n-h2-846219-10 Jul 20 11:19:37.232364 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d73d2869-07fe-4ed9-9dc1-006dd6c1b742 req-e1f8b21f-a6da-4327-a48b-a7020cbd197b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042262 Jul 20 11:19:37.233658 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2720/5421] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:38.148593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:38.149307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:38.161295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:38.162332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:38.164339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:38.166309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:38.491100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:38.520360 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dab02a4c-cd56-458e-8e57-1adf691bde21 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1313 microversion: 2.1 time: 0.379816 Jul 20 11:19:38.522624 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2702/5422] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:38 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:39.251767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-fe6d62ef-d29f-4a15-ae27-c28d7ee598c7 req-7e118cb1-7445-4934-8368-b941f2d6dc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "name": "network-vif-plugged", "status": "completed", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:39.261572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fe6d62ef-d29f-4a15-ae27-c28d7ee598c7 req-7e118cb1-7445-4934-8368-b941f2d6dc93 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:39.262393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-fe6d62ef-d29f-4a15-ae27-c28d7ee598c7 req-7e118cb1-7445-4934-8368-b941f2d6dc93 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:39.277175 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-fe6d62ef-d29f-4a15-ae27-c28d7ee598c7 req-7e118cb1-7445-4934-8368-b941f2d6dc93 service nova] Creating event network-vif-plugged:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:19:39.280186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-fe6d62ef-d29f-4a15-ae27-c28d7ee598c7 req-7e118cb1-7445-4934-8368-b941f2d6dc93 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032415 Jul 20 11:19:39.281116 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2721/5423] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:39.538950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:39.539806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:39.561149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:39.561868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:39.569191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:39.571432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:40.046950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:40.059714 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b7a8397d-cbb6-465f-a87b-cbb2fab7c589 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1497 microversion: 2.1 time: 0.524997 Jul 20 11:19:40.068758 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2703/5424] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:39 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1497 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:40.179479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:40.180589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:40.188747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:40.189461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:40.190610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:40.191328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:40.224880 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4eca89aa-2453-42df-b53d-1a5b13497775 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/ips" status: 200 len: 146 microversion: 2.1 time: 0.051261 Jul 20 11:19:40.233003 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2722/5425] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:19:40 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/ips => generated 146 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:40.642261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:40.643686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:40.649893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:40.652045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:40.652540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:40.654112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:40.654966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:40.686677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:19:40.806354 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-10b88423-b3b5-44d6-bd60-c34e66efe7d4 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 204 len: 0 microversion: 2.1 time: 0.165705 Jul 20 11:19:40.808445 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2704/5426] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:19:40 2022] DELETE /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:19:40.819800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:40.821141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:40.831547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:40.835579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:40.836312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:40.837283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:40.839365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:41.271425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:41.280083 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5b54ff98-8a74-410d-aeb1-d172ceb524b3 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1503 microversion: 2.1 time: 0.467482 Jul 20 11:19:41.280773 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2723/5427] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:40 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1503 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:42.299916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:42.301289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:42.316882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:42.320225 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:42.321613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:42.322047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:43.034987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:43.043945 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-34ffd0ad-9ff2-4aab-a75a-898fef45dcb9 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1503 microversion: 2.1 time: 0.749470 Jul 20 11:19:43.044822 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2705/5428] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:42 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1503 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:43.733701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82960b44-4fd2-4b06-b02d-0d6c4bc0a5b4"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:43.743151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:43.757924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:43.767589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-64ddd178-3f76-4243-9317-b6b68ad8cbcc req-ec996417-b278-453c-a8f2-8fefeebe6116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f03866-d433-44c9-9114-6bd9f6fbfc3b", "name": "network-vif-deleted", "tag": "e3c12705-74c4-418d-9ccf-88f045fe77cf"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:43.777424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:43.780110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:43.784245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:43.788104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-64ddd178-3f76-4243-9317-b6b68ad8cbcc req-ec996417-b278-453c-a8f2-8fefeebe6116 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:43.798400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-64ddd178-3f76-4243-9317-b6b68ad8cbcc req-ec996417-b278-453c-a8f2-8fefeebe6116 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:43.839335 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-64ddd178-3f76-4243-9317-b6b68ad8cbcc req-ec996417-b278-453c-a8f2-8fefeebe6116 service nova] Creating event network-vif-deleted:e3c12705-74c4-418d-9ccf-88f045fe77cf for instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b on n-h2-846219-10 Jul 20 11:19:43.850902 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-64ddd178-3f76-4243-9317-b6b68ad8cbcc req-ec996417-b278-453c-a8f2-8fefeebe6116 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088974 Jul 20 11:19:43.854752 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2706/5429] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:44.063126 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:44.063861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:44.070737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:44.071206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:44.072196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:44.072820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:44.112241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:44.112881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:44.113623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lazy-loading 'fault' on Instance uuid 42f03866-d433-44c9-9114-6bd9f6fbfc3b {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:19:44.346636 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2b017900-65be-41ec-8110-b336c826957a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617219 Jul 20 11:19:44.351590 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2724/5430] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:19:43 2022] POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:19:44.530207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '169d07ab916842e08d891df053448daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19895d976ac54263b83b7a11a861985c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:19:44.549236 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-18bb7fa6-9386-4831-8d0b-0e7a99e79e8f tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 200 len: 1303 microversion: 2.1 time: 0.490862 Jul 20 11:19:44.554346 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2707/5431] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:44 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 1303 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:19:45.577300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:45.577905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] [instance: 42f03866-d433-44c9-9114-6bd9f6fbfc3b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:45.586788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:45.587623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:45.588331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:45.589107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:45.606127 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] HTTP exception thrown: Instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b could not be found. Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Request method failure captured: Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b HTTP/1.1 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-SmW1E2f6CLYV4-tWvuXZbSsfPWBJULyVyMkZj7o0bOarPgfc8UeKxPXBE04vbDm3Vo_7BfBuaXwgHLFWN5uGezUKyqqY8PSOKbYhSiiStyI7COjSPcYEeUcUzuXOeugxuUdd_0mgN_V2kPeJ1iDJ9mukwKMyQwECi_bxuBjJACJZw Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 19895d976ac54263b83b7a11a861985c Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesActionsTest-1646655876 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_19895d976ac54263b83b7a11a861985c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19895d976ac54263b83b7a11a861985c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/19895d976ac54263b83b7a11a861985c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/19895d976ac54263b83b7a11a861985c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesActionsTest-1646655876 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 19895d976ac54263b83b7a11a861985c Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesActionsTest-1646655876 Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesActionsTest-1646655876-project Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 169d07ab916842e08d891df053448daf Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesActionsTest-1646655876-project Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b could not be found. Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '42f03866-d433-44c9-9114-6bd9f6fbfc3b'} Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b could not be found. Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b could not be found. Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:19:45.607775 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b could not be found. Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] Returning 404 to user: Instance 42f03866-d433-44c9-9114-6bd9f6fbfc3b could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:19:45.613111 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cccd031d-2e2f-423e-8a9a-82e1cc4fe9f8 tempest-VolumesActionsTest-1646655876 tempest-VolumesActionsTest-1646655876-project] 10.222.0.79 "GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b" status: 404 len: 111 microversion: 2.1 time: 0.046780 Jul 20 11:19:45.616612 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2725/5432] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:45 2022] GET /compute/v2.1/servers/42f03866-d433-44c9-9114-6bd9f6fbfc3b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:19:59.437152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6da273fc-a756-42b8-a5dc-49d23f33b673 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:19:59.451335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:59.452922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:59.475234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da273fc-a756-42b8-a5dc-49d23f33b673 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:59.477973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6da273fc-a756-42b8-a5dc-49d23f33b673 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:59.588141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6da273fc-a756-42b8-a5dc-49d23f33b673 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Going to try to stop instance {{(pid=125886) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:19:59.713575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6da273fc-a756-42b8-a5dc-49d23f33b673 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action" status: 202 len: 0 microversion: 2.1 time: 0.279209 Jul 20 11:19:59.718860 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2708/5433] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:19:59 2022] POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:19:59.727056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:19:59.727723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:19:59.735253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=5 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:59.736866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:19:59.741458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:59.742338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:19:59.743862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:19:59.745581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:00.116640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:00.127220 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ee4ca256-de75-4e74-9d3e-6f429c53c91e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.406846 Jul 20 11:20:00.137154 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2726/5434] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:19:59 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:20:01.155995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:01.156948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:01.176822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:01.177846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:01.178905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:01.180771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:01.434832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:20:01.436476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:01.449051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:01.449686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:01.450637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:01.451279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:01.545393 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6939068e-17bc-493c-983b-53508bf7825f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action" status: 200 len: 63147 microversion: 2.1 time: 0.116868 Jul 20 11:20:01.546919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2727/5435] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:20:01 2022] POST /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867/action => generated 63147 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:20:01.581215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:01.596677 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-324e8b5f-6958-4ddd-8f83-3225535795ac tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.446037 Jul 20 11:20:01.598638 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2709/5436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:01 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:02.618996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:02.621754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:02.636215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:02.638234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:02.639210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:02.640283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:03.018107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:03.035583 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d403246-8392-47b5-828d-1f0c7524f439 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.423234 Jul 20 11:20:03.036894 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2728/5437] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:02 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:04.053845 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:04.054464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:04.067993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:04.075543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:04.076391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:04.081401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:04.489643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:04.506599 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bb30effe-d191-4f45-8252-c0664ea62c60 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.454585 Jul 20 11:20:04.509757 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2710/5438] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:04 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:05.527886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:05.529156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:05.550694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:05.551817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:05.552836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:05.553452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:06.062477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:06.083325 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c61cd374-2da9-449e-84a4-d4bf3b2987ed tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.558149 Jul 20 11:20:06.084115 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2729/5439] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:05 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:07.101816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:07.102474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:07.114866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:07.115460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:07.118156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:07.118941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:07.366365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:07.393557 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-db3e0490-f7e4-4bdd-b5bd-0b13b8743151 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.296105 Jul 20 11:20:07.397969 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2711/5440] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:07 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:08.333693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:08.335406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:08.349943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:08.350684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:08.351693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:08.352307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:08.415967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:08.417546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:08.426062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:08.426780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:08.427812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:08.428427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:08.768505 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-82944f42-6a5b-4060-8210-54172297b145 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1834 microversion: 2.1 time: 0.897895 Jul 20 11:20:08.782927 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2730/5441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:07 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1834 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:08.924012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:08.940006 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6a0053ca-2b9e-4e76-8291-49ada235721c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.530027 Jul 20 11:20:08.945843 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2712/5442] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:08 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:09.960164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:09.961546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:09.979687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:09.980698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:09.981879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:09.982559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:10.215688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:10.218473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:10.228032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:10.239116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:10.240032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:10.240894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:10.297882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:20:10.325627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:10.343188 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea3c5d21-293b-4d70-a61e-2437dc43edb1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.387691 Jul 20 11:20:10.360334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2731/5443] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:09 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:10.366842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-5614fcb6-c6a3-46a1-8a40-86a66ccba490 req-1e54b01d-637b-4eae-8232-1fae837f4ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:20:10.397811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5614fcb6-c6a3-46a1-8a40-86a66ccba490 req-1e54b01d-637b-4eae-8232-1fae837f4ef6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:10.401880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5614fcb6-c6a3-46a1-8a40-86a66ccba490 req-1e54b01d-637b-4eae-8232-1fae837f4ef6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:10.431483 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-5614fcb6-c6a3-46a1-8a40-86a66ccba490 req-1e54b01d-637b-4eae-8232-1fae837f4ef6 service nova] Creating event network-changed:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:20:10.459416 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-5614fcb6-c6a3-46a1-8a40-86a66ccba490 req-1e54b01d-637b-4eae-8232-1fae837f4ef6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097412 Jul 20 11:20:10.461228 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2732/5444] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:20:10.537796 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b868d5a9-7a05-4836-99de-77d5f07a0e82 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 204 len: 0 microversion: 2.1 time: 0.326125 Jul 20 11:20:10.538460 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2713/5445] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:20:10 2022] DELETE /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:20:10.548113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:10.548946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:10.561312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:10.561937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:10.565707 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:10.566306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:11.381133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:11.382539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:11.398995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:11.403496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:11.404712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:11.405395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:11.951405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:11.959354 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3b5d1b49-f3e7-4190-a85b-7e312405292b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1687 microversion: 2.1 time: 1.415998 Jul 20 11:20:11.959955 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2733/5446] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:10 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1687 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:12.021821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:12.038783 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-62bc312c-6a24-483d-b499-e16dc60da5ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.664324 Jul 20 11:20:12.040692 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2714/5447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:11 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:20:12.976180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-550fb066-d6fc-4104-b09e-85765937744a req-a8f1ee11-a37b-430b-a206-178b64113b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867", "name": "network-vif-deleted", "tag": "e3efb445-f7c0-494a-abcb-828300b70ccf"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:20:12.986132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:12.988667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:12.991907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-550fb066-d6fc-4104-b09e-85765937744a req-a8f1ee11-a37b-430b-a206-178b64113b9d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:12.999890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-550fb066-d6fc-4104-b09e-85765937744a req-a8f1ee11-a37b-430b-a206-178b64113b9d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:13.029490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:13.034328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:13.035091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:13.036221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:13.054731 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-550fb066-d6fc-4104-b09e-85765937744a req-a8f1ee11-a37b-430b-a206-178b64113b9d service nova] Creating event network-vif-deleted:e3efb445-f7c0-494a-abcb-828300b70ccf for instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 on n-h2-846219-10 Jul 20 11:20:13.070043 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-550fb066-d6fc-4104-b09e-85765937744a req-a8f1ee11-a37b-430b-a206-178b64113b9d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098459 Jul 20 11:20:13.070864 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2734/5448] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:20:13.090956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:13.095748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:13.115749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:13.116212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:13.117010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:13.117464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:13.282944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:13.308107 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-01472755-c1d9-4da4-a224-efb4ac26543a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 200 len: 1351 microversion: 2.1 time: 0.334041 Jul 20 11:20:13.309538 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2715/5449] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:12 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 1351 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:13.545916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:13.558159 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2eb013b2-868a-4901-a93f-a2aaf18c22a8 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.473796 Jul 20 11:20:13.562111 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2735/5450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:13 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:14.331201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:14.333114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:14.346928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:14.348525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:14.350920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:14.356321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:14.419551 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] HTTP exception thrown: Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 could not be found. Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Request method failure captured: Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 HTTP/1.1 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-NsHgD1X9xCH8UswZQ8XuqtrhrxB-IRut7fm28RDiSMw1Pzd_sQ25idIpkeMBx8-UzBC0PftqhOFe4sVzXqymorzT0o6MkFlvC4cYzqx2lJYHP4RNbE-KBjwfr_Y-bgrkHdhfqgDjhndhBbUQm8CCziWKwDog3STtrzu-O8-1UpCHw Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8a593b39b87146aeaeb5f515181fd374", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 73af3e843b3c4c1a8d933b29cfc20508 Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 could not be found. Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867'} Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 could not be found. Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 could not be found. Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:20:14.436635 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 could not be found. Jul 20 11:20:14.444708 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:20:14.446167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Returning 404 to user: Instance 2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:20:14.451112 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04485a98-7bec-4c61-8963-ba94c98d90b1 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867" status: 404 len: 111 microversion: 2.1 time: 0.128890 Jul 20 11:20:14.452885 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2716/5451] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:14 2022] GET /compute/v2.1/servers/2eedd08b-52ab-4b3e-bdc5-4c4b8f37f867 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:20:14.578560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:14.581597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:14.593776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:14.594510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:14.595578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:14.596349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:15.946476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:15.957779 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d68e150a-1669-4655-8540-96bcf1cf107f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 1.382717 Jul 20 11:20:15.959116 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2736/5452] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:14 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:16.978264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:16.979755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:17.000253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:17.005141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:17.012145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:17.015976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:17.666447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:17.677979 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1dd8e7c8-c2be-4e1a-9e79-556d16cfb95c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.705859 Jul 20 11:20:17.695837 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2717/5453] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:16 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:18.699595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:18.700963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:18.712996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:18.713854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:18.714848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:18.715891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:19.210946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:19.224163 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eded0b0f-a8a0-4b6c-8653-d608b8e08d4a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.530347 Jul 20 11:20:19.225266 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2737/5454] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:18 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:20.243130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:20.244366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:20.261431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:20.262064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:20.262971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:20.263565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:20.710584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:20.730214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b4e2bcf-7449-417c-a022-a8ccc54aa308 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.491870 Jul 20 11:20:20.733095 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2718/5455] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:20 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:21.755671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:21.757099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:21.774951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:21.775442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:21.776305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:21.776987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:22.300102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:22.313963 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-683555db-236e-47bb-950c-f4c42ed48496 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.563079 Jul 20 11:20:22.314563 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2738/5456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:21 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:23.346667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:23.350782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:23.365175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:23.366224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:23.367947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:23.368790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:23.955469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:23.977800 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d4c3e268-db07-4050-bf36-03e6dac5ee0b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.649259 Jul 20 11:20:23.987544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2719/5457] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:23 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:25.001221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:25.002086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:25.017439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:25.018867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:25.040296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:25.042767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:25.667595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:25.677862 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bf422ee8-430d-4427-af1e-bef94ddb156a tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1724 microversion: 2.1 time: 0.685501 Jul 20 11:20:25.678458 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2739/5458] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:24 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1724 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:26.698664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:26.703701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:26.731860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:26.732261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:26.733112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:26.733558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:27.188011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:27.198330 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bee67cec-2d1d-4728-b2d8-cd0a31384b4b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1701 microversion: 2.1 time: 0.503672 Jul 20 11:20:27.217453 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2720/5459] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:26 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1701 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:27.224778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c390578f-e5b0-433a-a268-935c03aca8dd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:20:27.232784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c390578f-e5b0-433a-a268-935c03aca8dd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:27.233252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c390578f-e5b0-433a-a268-935c03aca8dd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:27.274334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c390578f-e5b0-433a-a268-935c03aca8dd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Going to try to start instance {{(pid=125885) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 11:20:27.346328 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c390578f-e5b0-433a-a268-935c03aca8dd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action" status: 202 len: 0 microversion: 2.1 time: 0.127267 Jul 20 11:20:27.350950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2740/5460] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:20:27 2022] POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:20:27.356103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:27.356721 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:27.371852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:27.372299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:27.373285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:27.373727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:27.418048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-865df1d3-66a0-4ed2-9490-516e5688d103 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '.version_select at 0x7f2c3f704dc0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:27.423990 n-d-846219-10 devstack@n-api.service[125885]: ERROR oslo.messaging._drivers.impl_rabbit [None req-865df1d3-66a0-4ed2-9490-516e5688d103 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [a013ddbf-3a73-4197-b042-914dd44d7757] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 11:20:27.577798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:27.590246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-893a79f8-71db-4821-80f0-d46d56097472 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1710 microversion: 2.1 time: 0.237385 Jul 20 11:20:27.591305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2721/5461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:27 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1710 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:28.437624 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [None req-865df1d3-66a0-4ed2-9490-516e5688d103 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [a013ddbf-3a73-4197-b042-914dd44d7757] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 48552. Jul 20 11:20:28.467685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-865df1d3-66a0-4ed2-9490-516e5688d103 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1231430905" status: 202 len: 0 microversion: 2.1 time: 1.059788 Jul 20 11:20:28.469748 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2741/5462] 10.222.0.79 () {58 vars in 1283 bytes} [Wed Jul 20 11:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1231430905 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:20:28.515599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-69356242-704c-48fd-b1aa-9403192941b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: .version_select at 0x7f2c3e1e73a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1554951403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRxozL+O2EGuLvT1Xfk1II4SGEVo24y8xtnBFMAAA64TnORgOFRJQb8IlYKnDvbyESNTfdc2795AG4ZAUkxkpxADsgnMz+dTwqRh8ci2UMSyzXEwcEdkY4+QzjIBNr0/Q=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:20:28.556784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-69356242-704c-48fd-b1aa-9403192941b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:20:28.571414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-69356242-704c-48fd-b1aa-9403192941b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:20:28.609245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:28.609991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:28.629169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:28.630375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:28.637679 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-69356242-704c-48fd-b1aa-9403192941b7 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.128687 Jul 20 11:20:28.638307 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2722/5463] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:20:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:20:28.638671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:28.639426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:29.371953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:29.391130 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0377d96-3b6a-4fe9-8363-956de3025413 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1710 microversion: 2.1 time: 0.785763 Jul 20 11:20:29.391832 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2742/5464] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:28 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1710 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:30.409743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:30.411361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:30.416244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:30.420570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:30.421255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:30.422311 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:30.422968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:30.428601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:30.946252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:30.955781 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d1ce3066-8294-42c9-a492-3ec1c713066b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1714 microversion: 2.1 time: 0.550731 Jul 20 11:20:30.971888 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2723/5465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:30 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1714 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:49.372608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-450507349", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "1b719765-2903-449b-bd5c-fc085e00552c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1554951403", "security_groups": [{"name": "tempest-secgroup-smoke-1229744289"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:20:49.403664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:49.406546 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:50.251934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] validate_networks() for [('1b719765-2903-449b-bd5c-fc085e00552c', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:20:52.626906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:20:52.629845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:20:52.630429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:20:52.632537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:20:52.633165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:20:52.656364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:52.657113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:52.658832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:52.660470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:52.686164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:20:52.695669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:20:52.751850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:20:52.761704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:20:52.915272 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4466b634-f8b2-49d4-a786-f7fbeb7dcd9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.547009 Jul 20 11:20:52.918181 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2743/5466] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:20:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 3551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:20:52.929584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-33272889-6f1e-44a6-a596-40cb46c288e5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:52.930964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-33272889-6f1e-44a6-a596-40cb46c288e5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:52.948933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:52.951454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:52.952726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=5 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:20:53.517167 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-33272889-6f1e-44a6-a596-40cb46c288e5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:53.530467 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-33272889-6f1e-44a6-a596-40cb46c288e5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1266 microversion: 2.1 time: 0.605423 Jul 20 11:20:53.544816 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2724/5467] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:52 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1266 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:54.553283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:54.554598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:54.569592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:54.571927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:54.573773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:54.575671 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:54.794218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:54.823387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dea0acaf-b2b3-490c-aa07-191555a0355b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1318 microversion: 2.1 time: 0.273073 Jul 20 11:20:54.828846 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2744/5468] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:54 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:55.865493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:55.866766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:55.883695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:55.884221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:55.885295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:55.887714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:56.046778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:56.065651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65abbb47-9529-4f5d-9494-4e6772d75d41 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1324 microversion: 2.1 time: 0.203871 Jul 20 11:20:56.075410 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2725/5469] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:55 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:57.084719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:57.085354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:57.092929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:57.106007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:57.107538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:57.107647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:57.449543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:57.461840 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6d3d1bab-b929-438e-b309-821e0ab60607 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.381606 Jul 20 11:20:57.463676 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2745/5470] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:57 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:58.481175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:58.482393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:58.492275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:58.497645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:58.498710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:58.501115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:58.913165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:20:58.928417 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-da459034-a1c5-4298-90f2-adcb119fa093 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.450924 Jul 20 11:20:58.940739 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2726/5471] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:58 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:20:59.948224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:20:59.949630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:20:59.960578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:59.962081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:20:59.963162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:20:59.964204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:00.364631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:00.382211 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31cf489f-5620-4a7e-97a3-4bea0d784624 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.438004 Jul 20 11:21:00.385098 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2746/5472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:20:59 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:00.819590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-16ecd89f-68ba-4e5e-a8f4-96295978fb63 req-b02380d5-aafa-4217-b007-8549ec20dd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:00.882825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-16ecd89f-68ba-4e5e-a8f4-96295978fb63 req-b02380d5-aafa-4217-b007-8549ec20dd82 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:00.883630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-16ecd89f-68ba-4e5e-a8f4-96295978fb63 req-b02380d5-aafa-4217-b007-8549ec20dd82 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:00.937274 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-16ecd89f-68ba-4e5e-a8f4-96295978fb63 req-b02380d5-aafa-4217-b007-8549ec20dd82 service nova] Creating event network-changed:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h2-846219-10 Jul 20 11:21:00.972381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-16ecd89f-68ba-4e5e-a8f4-96295978fb63 req-b02380d5-aafa-4217-b007-8549ec20dd82 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155977 Jul 20 11:21:00.978012 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2727/5473] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:21:01.402033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:01.402761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:01.421958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:01.422513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:01.423616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:01.424272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:01.701012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:01.719326 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-937a04e1-ecc4-4118-885a-1cb6dee68c07 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.319667 Jul 20 11:21:01.722842 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2747/5474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:01 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:02.741711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:02.742524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:02.761813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:02.764475 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:02.765847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:02.766514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:03.206937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:03.218669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e2a0033-9479-4307-97c5-8e907f30a3de tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.481919 Jul 20 11:21:03.219987 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2728/5475] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:02 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:03.510845 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:03.511631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:03.515776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:03.516565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:03.521911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:03.522823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:03.528603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:03.529044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:03.661665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lazy-loading 'services' on Instance uuid c21382d6-2ea0-482b-b9d8-e49488ef0d35 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:21:03.789003 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-15f86213-a070-4f5c-bf77-c2e407638b11 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-volume_attachments/82960b44-4fd2-4b06-b02d-0d6c4bc0a5b4" status: 202 len: 0 microversion: 2.1 time: 0.281950 Jul 20 11:21:03.792236 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2748/5476] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:21:03 2022] DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-volume_attachments/82960b44-4fd2-4b06-b02d-0d6c4bc0a5b4 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:21:04.235920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:04.237716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:04.239940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:04.246280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:04.246743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:04.247565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:04.248018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:04.598229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:04.611310 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d1e4370-2745-49dc-9ae0-5d2901712411 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.375705 Jul 20 11:21:04.612523 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2729/5477] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:04 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:05.632041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:05.632880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:05.651674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:05.652140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:05.656517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:05.657473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:06.095497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:06.122289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7785ccc6-ae6e-4e1a-9dc8-374577d60f87 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.496944 Jul 20 11:21:06.124728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2749/5478] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:05 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:07.145151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:07.146743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:07.175075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:07.175548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:07.192493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:07.192960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:07.646631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:07.657115 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-81f11255-4e13-44f5-b38c-eb1b2d05c425 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.518988 Jul 20 11:21:07.657718 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2730/5479] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:07 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:07.949473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-5dfe0b0a-11b7-48e6-9d19-fd1c8d09ea19 req-ce26fd36-0fd5-4761-a790-2ceaa60655db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "name": "network-vif-plugged", "status": "completed", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:07.970888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5dfe0b0a-11b7-48e6-9d19-fd1c8d09ea19 req-ce26fd36-0fd5-4761-a790-2ceaa60655db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:07.971665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5dfe0b0a-11b7-48e6-9d19-fd1c8d09ea19 req-ce26fd36-0fd5-4761-a790-2ceaa60655db service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:07.995367 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-5dfe0b0a-11b7-48e6-9d19-fd1c8d09ea19 req-ce26fd36-0fd5-4761-a790-2ceaa60655db service nova] Creating event network-vif-plugged:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h2-846219-10 Jul 20 11:21:08.010472 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-5dfe0b0a-11b7-48e6-9d19-fd1c8d09ea19 req-ce26fd36-0fd5-4761-a790-2ceaa60655db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065600 Jul 20 11:21:08.011779 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2750/5480] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:21:08.676830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:08.677461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:08.708087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:08.710180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:08.713621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:08.714198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:09.138322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:09.152213 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ab7efb1b-7ca3-4abc-994a-9908f0b624ca tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1392 microversion: 2.1 time: 0.481165 Jul 20 11:21:09.160743 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2731/5481] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:08 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1392 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:10.172350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:10.173256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:10.186151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:10.186950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:10.188139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:10.188927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:10.664475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:10.677751 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8af1c1c1-8cf1-4386-ba07-45166d4d3c9c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1564 microversion: 2.1 time: 0.508905 Jul 20 11:21:10.687414 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2751/5482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:10 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1564 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:10.695737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:10.696349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:10.714294 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:10.714882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:10.716062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:10.719825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:11.141402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:11.174358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb01b945-2fa7-4d21-99fc-04f214094d8d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1564 microversion: 2.1 time: 0.481882 Jul 20 11:21:11.187196 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2732/5483] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:10 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1564 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:11.825302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67d6b1ab-8d10-4c57-8964-6e0e7021ff67 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:11.849714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67d6b1ab-8d10-4c57-8964-6e0e7021ff67 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:11.850790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67d6b1ab-8d10-4c57-8964-6e0e7021ff67 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:11.890717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67d6b1ab-8d10-4c57-8964-6e0e7021ff67 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Going to try to stop instance {{(pid=125885) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 11:21:11.967223 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67d6b1ab-8d10-4c57-8964-6e0e7021ff67 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action" status: 202 len: 0 microversion: 2.1 time: 0.145608 Jul 20 11:21:11.968479 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2752/5484] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:21:11 2022] POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:21:11.977423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:11.978804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:11.989254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:11.990194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:11.991447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:11.992158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:12.440566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:12.456450 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-40142ebb-c436-4b11-94a8-e13b6aa1a186 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.477697 Jul 20 11:21:12.457714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2733/5485] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:11 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:21:13.486281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:13.487402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:13.504807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:13.506253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:13.507379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:13.507815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:13.974972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:13.988963 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9495a00b-985f-4ccb-b70e-809e5b88e3af tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.511715 Jul 20 11:21:13.990109 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2753/5486] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:13 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:15.006431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:15.007062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:15.021315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:15.022255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:15.024051 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:15.025784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:15.606522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:15.621017 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-161d7c10-dbc4-4da3-b9c5-9ecfd3b2d613 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.617587 Jul 20 11:21:15.622997 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2734/5487] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:15 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:16.639035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:16.640511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:16.654974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:16.659923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:16.660981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:16.661603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:17.055867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:17.066742 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d818165-c52e-48d5-8dd1-bc779929f6f2 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.432538 Jul 20 11:21:17.086638 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2754/5488] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:16 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:18.054623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:18.055844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:18.075006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:18.075798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:18.083372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:18.085940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d1f47d9d-e406-42bd-b2f9-df4f4639ae17 req-534caeac-890f-49ee-8995-b9259ebcf799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:18.090312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:18.105174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d1f47d9d-e406-42bd-b2f9-df4f4639ae17 req-534caeac-890f-49ee-8995-b9259ebcf799 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:18.105931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d1f47d9d-e406-42bd-b2f9-df4f4639ae17 req-534caeac-890f-49ee-8995-b9259ebcf799 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:18.149567 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d1f47d9d-e406-42bd-b2f9-df4f4639ae17 req-534caeac-890f-49ee-8995-b9259ebcf799 service nova] Creating event network-changed:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h2-846219-10 Jul 20 11:21:18.177807 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d1f47d9d-e406-42bd-b2f9-df4f4639ae17 req-534caeac-890f-49ee-8995-b9259ebcf799 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095410 Jul 20 11:21:18.187012 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2755/5489] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:21:18.215230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:18.218308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:18.244173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:18.245390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:18.246551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:18.247407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:18.658137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:18.672498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-efcbbb68-97e3-4c80-8bf8-79ac1ece1f02 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1564 microversion: 2.1 time: 0.625103 Jul 20 11:21:18.676603 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2735/5490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:18 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1564 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:18.904389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:18.918112 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4908e7c9-b256-433b-92de-dc0243db6ad1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.729749 Jul 20 11:21:18.918984 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2756/5491] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:18 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:19.949525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:19.950156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:19.965697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:19.969268 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:19.970298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:19.971008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:20.698128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:20.743056 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-00af8f59-e527-4fd4-b71c-fdd89303fd1e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.806799 Jul 20 11:21:20.744554 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2736/5492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:19 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:21.763368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:21.764293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:21.767049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:21.784893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:21.785497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:21.786339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:21.786792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:21.795440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:22.231723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:22.254743 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1871e915-5277-4a8f-9be7-79e34cf42a45 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1678 microversion: 2.1 time: 0.495316 Jul 20 11:21:22.259108 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2757/5493] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:21 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:23.278798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:23.284916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:23.311633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=29 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:23.327688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:23.329733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:23.333856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:23.336376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:23.431199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=69 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:23.889114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:23.903462 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-94a4cb5f-bf6c-42c7-aabf-05746a9d52f0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1655 microversion: 2.1 time: 0.633564 Jul 20 11:21:23.904904 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2737/5494] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:23 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1655 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:23.924227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b30833e-d359-4266-93b6-c9acdac648bd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:23.933916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b30833e-d359-4266-93b6-c9acdac648bd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:23.934627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b30833e-d359-4266-93b6-c9acdac648bd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:23.982213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b30833e-d359-4266-93b6-c9acdac648bd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Going to try to start instance {{(pid=125885) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 11:21:24.051870 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b30833e-d359-4266-93b6-c9acdac648bd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action" status: 202 len: 0 microversion: 2.1 time: 0.131951 Jul 20 11:21:24.061052 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2758/5495] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:21:23 2022] POST /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:21:24.066463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:24.068928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:24.087484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:24.088796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:24.092129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:24.092640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:24.955800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:24.967758 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c524d208-0920-4ffc-bee7-05b3f73045be tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1664 microversion: 2.1 time: 0.902790 Jul 20 11:21:24.969565 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2738/5496] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:24 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1664 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:25.985760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:25.987698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:26.001505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:26.002459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:26.003463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:26.004902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:26.762363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:26.788864 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0d254051-3809-496a-b004-3d1b93a0089e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1664 microversion: 2.1 time: 0.807454 Jul 20 11:21:26.793346 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2759/5497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:25 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1664 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:27.810029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:27.810763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:27.818478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:27.827842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:27.828824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:27.832207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:28.294382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:28.312197 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02bfb06c-38cf-4a29-aef0-d9e797b29aca tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1668 microversion: 2.1 time: 0.503781 Jul 20 11:21:28.315465 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2739/5498] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:27 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1668 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:33.448636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:33.449570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:33.465047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:33.465501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:33.467537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:33.468169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:33.562518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7ca0b8bb-86b5-41ab-9acd-fb7a5e7769f3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action" status: 200 len: 24568 microversion: 2.1 time: 0.116853 Jul 20 11:21:33.563969 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2760/5499] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:21:33 2022] POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action => generated 24568 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:21:44.435930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:44.437160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:44.440239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=5 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:44.443654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=17 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:44.457560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:44.458070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:44.471966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:44.473066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:44.931793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:44.942747 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f183a913-1916-4c94-8c50-da38008157a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1683 microversion: 2.1 time: 0.510294 Jul 20 11:21:44.945022 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2740/5500] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:44 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1683 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:45.157318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:45.159396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:45.162409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=7 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:45.166050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:21:45.187922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:45.187922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:45.188358 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:45.190198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:45.295921 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28635a04-0da2-478f-b22a-b7abf928c655 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action" status: 200 len: 32635 microversion: 2.1 time: 0.143998 Jul 20 11:21:45.296745 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2761/5501] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:21:45 2022] POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action => generated 32635 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:21:45.460162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:45.460773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:45.474897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:45.476743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:45.479591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:45.480332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:45.782070 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9919f5c3-2b54-4c74-af6f-fc046e79f6e4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1836 microversion: 2.1 time: 0.323993 Jul 20 11:21:45.787411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2741/5502] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:45 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1836 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:45.812456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:45.816590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:45.844416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:45.844934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:45.846314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:45.848999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:45.979491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lazy-loading 'flavor' on Instance uuid 1445e380-e225-4466-a052-55adae3f768f {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:21:46.014521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 1445e380-e225-4466-a052-55adae3f768f] Going to try to live migrate instance to another host {{(pid=125885) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 20 11:21:53.145584 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4fb95ab5-b940-4363-b877-8485cf61c271 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action" status: 202 len: 0 microversion: 2.1 time: 7.337883 Jul 20 11:21:53.151975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2762/5503] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:21:45 2022] POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action => generated 0 bytes in 7345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:21:53.155394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:53.158861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:53.171736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:53.172201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:53.173020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:53.177623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:53.588587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:53.602658 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c39787c-df23-4894-9544-eca6a3e016bb tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.451217 Jul 20 11:21:53.605636 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2742/5504] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:53 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:54.628378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:54.629109 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:54.647593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:54.648057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:54.648850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:54.649302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:55.051262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:55.065527 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c12329ea-c274-4aae-bf8d-b342e352283f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.445386 Jul 20 11:21:55.066747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2763/5505] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:54 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:56.092446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:56.093247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:56.116467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:56.117124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:56.118336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:56.121936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:56.457292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:56.471981 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0dc61b6e-f6f3-4bf3-98c1-b6f76be8217c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.390646 Jul 20 11:21:56.473013 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2743/5506] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:56 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:57.267503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-209fcfa5-0c6f-4351-a1e0-18047b11fe5c req-3cc19e9b-6731-4e42-9b1a-f9f84ba610b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "name": "network-vif-unplugged", "status": "completed", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:57.297424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-209fcfa5-0c6f-4351-a1e0-18047b11fe5c req-3cc19e9b-6731-4e42-9b1a-f9f84ba610b5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:57.298519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-209fcfa5-0c6f-4351-a1e0-18047b11fe5c req-3cc19e9b-6731-4e42-9b1a-f9f84ba610b5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:57.313352 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-209fcfa5-0c6f-4351-a1e0-18047b11fe5c req-3cc19e9b-6731-4e42-9b1a-f9f84ba610b5 service nova] Creating event network-vif-unplugged:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h2-846219-10 Jul 20 11:21:57.322284 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-209fcfa5-0c6f-4351-a1e0-18047b11fe5c req-3cc19e9b-6731-4e42-9b1a-f9f84ba610b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060357 Jul 20 11:21:57.323784 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2764/5507] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:21:57.491823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:57.492442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:57.507403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:57.507869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:57.508653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:57.513407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:57.715302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:57.738153 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cd459a1d-e846-4ecd-8c0b-3c5ae42784f5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.251727 Jul 20 11:21:57.739847 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2744/5508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:57 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:58.119650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1606077464", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "60f995c7-acec-46c9-afe4-bba1e0e54e32"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:58.218429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] validate_networks() for [('60f995c7-acec-46c9-afe4-bba1e0e54e32', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:21:58.757730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:58.761293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:58.772056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:58.772734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:58.773763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:58.774460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:58.790848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:21:58.791658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:21:58.792263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:21:58.792795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:21:58.793336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:21:58.811213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:58.811884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:58.813069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:58.814161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:58.837712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Getting quotas for project ce4ed319abae49b6b567a52f92734360. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:21:58.844313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Getting quotas for user 843d4fba750b4685bc973b5c3be9a5c3 and project ce4ed319abae49b6b567a52f92734360. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:21:58.882144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:21:58.885669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:21:58.966096 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-04ef0796-0001-427b-bd87-9e00e374e5f9 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851155 Jul 20 11:21:58.975141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:58.978749 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2765/5509] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:21:58.983027 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-38d0246f-74c2-4d8d-925b-3f1fc3d8a933 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.232113 Jul 20 11:21:58.983630 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2745/5510] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:58 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:58.989909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6fc74f09-ef51-4a06-b0e0-b007daa072b2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:21:58.990522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6fc74f09-ef51-4a06-b0e0-b007daa072b2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:21:59.060290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6fc74f09-ef51-4a06-b0e0-b007daa072b2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:21:59.068588 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6fc74f09-ef51-4a06-b0e0-b007daa072b2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1219 microversion: 2.1 time: 0.083941 Jul 20 11:21:59.069323 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2746/5511] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:58 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:21:59.359684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-924f3654-3184-4900-b8af-37a91a3c2898 req-6717bb4e-2b4f-413d-8b4c-0c492420e8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:21:59.386808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-924f3654-3184-4900-b8af-37a91a3c2898 req-6717bb4e-2b4f-413d-8b4c-0c492420e8fe service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:21:59.387452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-924f3654-3184-4900-b8af-37a91a3c2898 req-6717bb4e-2b4f-413d-8b4c-0c492420e8fe service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:21:59.402415 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-924f3654-3184-4900-b8af-37a91a3c2898 req-6717bb4e-2b4f-413d-8b4c-0c492420e8fe service nova] Creating event network-changed:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h2-846219-10 Jul 20 11:21:59.410518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-924f3654-3184-4900-b8af-37a91a3c2898 req-6717bb4e-2b4f-413d-8b4c-0c492420e8fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055995 Jul 20 11:21:59.411581 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2766/5512] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:00.008601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:00.009828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:00.021152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.025986 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.027135 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.029413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.087635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:00.088490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:00.112087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.114387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.116589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.117690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.380499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:00.389047 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3dfdbfa4-657a-44e5-a96a-eaf8519f73ef tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1271 microversion: 2.1 time: 0.307625 Jul 20 11:22:00.389645 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2767/5513] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:00 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:00.473119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:00.482366 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb99826c-d5fa-442e-808a-44ba5212e528 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.482013 Jul 20 11:22:00.493248 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2747/5514] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:21:59 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:00.585331 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:00.586902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:00.593841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.594556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.596486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.597134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.637387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f875e90-ad02-4921-bee3-b2765eac1591 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056462 Jul 20 11:22:00.638771 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2768/5515] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:22:00 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:22:00.706654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:00.707247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:00.714976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.716866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.721037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.721037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.765959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:22:00.914008 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ca537052-2f3e-4d84-9ee8-d4323339920c tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 204 len: 0 microversion: 2.1 time: 0.211315 Jul 20 11:22:00.915717 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2748/5516] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:22:00 2022] DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:22:00.924886 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:00.925971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:00.938594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.940140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:00.941074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:00.943503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:01.279853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:01.304820 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f54eac71-456b-436b-9be0-7f3a7eea3cd5 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1674 microversion: 2.1 time: 0.384808 Jul 20 11:22:01.310370 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2769/5517] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:00 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1674 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:01.410786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:01.411549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:01.422703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:01.423424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:01.424660 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:01.425303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:01.500318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:01.501627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:01.509659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:01.510237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:01.511420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:01.511819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:01.546370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:01.554873 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35afa5dc-96fe-49b2-b52d-265f21fbc0a0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1277 microversion: 2.1 time: 0.152636 Jul 20 11:22:01.555498 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2749/5518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:01 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:01.880076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:01.888741 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f565b0c6-3038-4942-bb30-84d7635c1dfa tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.392941 Jul 20 11:22:01.889469 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2770/5519] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:01 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:02.327645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:02.328266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:02.335379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:02.335836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:02.336619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:02.337063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:02.572967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:02.573657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:02.585522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:02.586431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:02.587395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:02.588130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:02.600907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:02.612451 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0936849a-170c-4b4b-af41-a3a4e31fdd49 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1674 microversion: 2.1 time: 0.288815 Jul 20 11:22:02.613720 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2750/5520] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:02 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1674 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:02.920194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:02.921843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:02.933360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:02.936720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:02.937994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:02.939272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:02.956958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:02.966047 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3192cb8d-44f1-463e-adc8-cea63261ba3d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.397619 Jul 20 11:22:02.970283 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2771/5521] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:02 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:03.630875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:03.632695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:03.655808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:03.660495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:03.665893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:03.666951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:03.700965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:03.718298 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-874c77a7-6d1f-4dfb-a773-169359c6f3df tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.815334 Jul 20 11:22:03.721698 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2751/5522] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:02 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:03.934944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:03.948405 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-81a8681b-0980-49f5-b9de-b09fefab7a66 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1606 microversion: 2.1 time: 0.321894 Jul 20 11:22:03.951419 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2772/5523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:03 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1606 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:03.987899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:03.988776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:03.996197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.021236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.027000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.027601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.443850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:04.452976 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3aa012f6-6106-4481-847b-bf5a45b30951 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.473359 Jul 20 11:22:04.453582 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2752/5524] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:03 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:04.513456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-3adb7048-f3d6-48f8-af3c-fdd4bcc2f0f0 req-385552ca-7ed2-4cd7-b160-cffc0885102e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0ffcff-5b5c-441a-8e9c-739ca98530cd", "tag": "83366efb-798a-4936-8a31-1bcb64b0b267"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:04.536549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3adb7048-f3d6-48f8-af3c-fdd4bcc2f0f0 req-385552ca-7ed2-4cd7-b160-cffc0885102e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.537288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-3adb7048-f3d6-48f8-af3c-fdd4bcc2f0f0 req-385552ca-7ed2-4cd7-b160-cffc0885102e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.560440 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-3adb7048-f3d6-48f8-af3c-fdd4bcc2f0f0 req-385552ca-7ed2-4cd7-b160-cffc0885102e service nova] Creating event network-changed:83366efb-798a-4936-8a31-1bcb64b0b267 for instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd on n-h2-846219-10 Jul 20 11:22:04.569378 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-3adb7048-f3d6-48f8-af3c-fdd4bcc2f0f0 req-385552ca-7ed2-4cd7-b160-cffc0885102e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061271 Jul 20 11:22:04.570393 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2773/5525] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:04.741282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:04.741902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:04.753168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.753698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.754417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.754868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.831285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b98e3b4f-f1fa-4f3f-95b9-fda1a2a82789 req-e997c5c7-5930-42e6-bd98-beee39802632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c21382d6-2ea0-482b-b9d8-e49488ef0d35", "name": "network-vif-deleted", "tag": "7a7337c0-8cd2-4d3a-9f2c-9670b34b557b"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:04.855404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b98e3b4f-f1fa-4f3f-95b9-fda1a2a82789 req-e997c5c7-5930-42e6-bd98-beee39802632 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.855860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b98e3b4f-f1fa-4f3f-95b9-fda1a2a82789 req-e997c5c7-5930-42e6-bd98-beee39802632 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.885838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b98e3b4f-f1fa-4f3f-95b9-fda1a2a82789 req-e997c5c7-5930-42e6-bd98-beee39802632 service nova] Creating event network-vif-deleted:7a7337c0-8cd2-4d3a-9f2c-9670b34b557b for instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 on n-h2-846219-10 Jul 20 11:22:04.899074 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b98e3b4f-f1fa-4f3f-95b9-fda1a2a82789 req-e997c5c7-5930-42e6-bd98-beee39802632 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075072 Jul 20 11:22:04.899969 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2774/5526] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:04.973993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:04.974657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:04.982819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.983576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:04.984532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:04.985149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:05.027258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:05.027986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:05.028650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lazy-loading 'fault' on Instance uuid c21382d6-2ea0-482b-b9d8-e49488ef0d35 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:22:05.400710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:05.417368 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e24916c-6fab-47d0-aac8-fdac9df8b2eb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 200 len: 1327 microversion: 2.1 time: 0.449292 Jul 20 11:22:05.433264 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2775/5527] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:04 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 1327 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:05.481312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:05.487050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:05.520605 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:05.521343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:05.522544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:05.523153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:05.641133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:05.654914 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74c7508b-3c5e-406e-964a-016066530fe3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.920056 Jul 20 11:22:05.671739 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2753/5528] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:04 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:06.117734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:06.127270 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce09cc03-509d-4f7c-b222-a72c4a6d831e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.660907 Jul 20 11:22:06.127878 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2776/5529] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:05 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:06.452150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:06.453613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:06.468496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:06.473228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:06.493978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:06.495022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:06.542044 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] HTTP exception thrown: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Request method failure captured: Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 HTTP/1.1 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-SURQblMd3z0zJq7luA_uAWfY1PYjwa-3jmmBuymfK5oIpVOoU5Nv_4HggHUxzZ8Z_X52UpMUTFMSHitlyrLoGhIdAKQhLeznODIri7eWFkPdw_C0f4wrAFNdFIjkyFuw7Clfxct_-XYqS3WZu2Ddnn0gKmz2SsKB20g3N_FlyoKBQ Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8987df57b4c4c71a5070180fc86d794", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: eca571756cd648a8a8383195dc697b19 Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c21382d6-2ea0-482b-b9d8-e49488ef0d35'} Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:22:06.550177 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Returning 404 to user: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:22:06.557648 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b35c8da-0484-47e9-a484-0c44e97bbde6 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 404 len: 111 microversion: 2.1 time: 0.109892 Jul 20 11:22:06.564654 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2754/5530] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:06 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:22:06.566994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9cf1306a-12d5-4299-a123-772a78552dbd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '.version_select at 0x7f2c3e9c5c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:06.616891 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9cf1306a-12d5-4299-a123-772a78552dbd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081620165" status: 202 len: 0 microversion: 2.1 time: 0.059664 Jul 20 11:22:06.619035 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2777/5531] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 11:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081620165 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:22:06.698240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:06.707718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:06.724490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:06.725173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:06.726214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:06.726842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:07.148413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:07.151505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:07.189557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:07.190475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:07.191834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:07.192503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:07.235768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:07.251788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-61eba79e-be6b-413a-817b-f8f166ce6f93 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.564747 Jul 20 11:22:07.252734 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2755/5532] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:06 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:07.869014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:07.886698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a8d62e9-fa59-47c2-809c-f40024ffbe35 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.746415 Jul 20 11:22:07.913806 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2778/5533] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:07 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:08.274026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:08.275755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:08.291078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:08.293411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:08.301003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:08.304958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:08.663545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0e78bde8-5b22-4943-b384-7816a9f2858d req-f4292ed6-f3cf-4315-b4a5-321128d83e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "name": "network-vif-unplugged", "status": "completed", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:08.683606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0e78bde8-5b22-4943-b384-7816a9f2858d req-f4292ed6-f3cf-4315-b4a5-321128d83e6f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:08.684187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0e78bde8-5b22-4943-b384-7816a9f2858d req-f4292ed6-f3cf-4315-b4a5-321128d83e6f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:08.719529 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0e78bde8-5b22-4943-b384-7816a9f2858d req-f4292ed6-f3cf-4315-b4a5-321128d83e6f service nova] Creating event network-vif-unplugged:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h2-846219-10 Jul 20 11:22:08.731746 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0e78bde8-5b22-4943-b384-7816a9f2858d req-f4292ed6-f3cf-4315-b4a5-321128d83e6f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073385 Jul 20 11:22:08.733108 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2779/5534] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:22:08.737379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:08.917390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:08.918635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:08.927204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:08.929628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:08.963214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:08.964825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:08.966828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:08.968274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:09.068305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:09.122825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:09.134631 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-800990fa-64bd-49e5-91a1-637200818207 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.868237 Jul 20 11:22:09.135550 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2756/5535] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:08 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:09.153091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eda07591-627a-4240-ace2-d82565557783 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: .version_select at 0x7f2c3e1580d0>, body: {"keypair": {"name": "tempest-keypair-261598709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAJHaGrAz7EJC6h52N90FqdHUOKlaQAwFbYcimG0Xm+uWHRx0EqehgKrTSvzPIOi296AbBt8lreS9HSK0HffWo4VE7OaBypHuRzAOLye1DJyhOoqlQbFuroIgCph+v1/w=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:09.196158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-eda07591-627a-4240-ace2-d82565557783 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for project b8987df57b4c4c71a5070180fc86d794. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:22:09.208910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-eda07591-627a-4240-ace2-d82565557783 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for user eca571756cd648a8a8383195dc697b19 and project b8987df57b4c4c71a5070180fc86d794. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:22:09.267683 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eda07591-627a-4240-ace2-d82565557783 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131247 Jul 20 11:22:09.270525 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2757/5536] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:22:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:09.354708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:09.361937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:09.374366 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8abe928a-4379-4b5a-a300-4640cad0f847 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.457811 Jul 20 11:22:09.376087 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2780/5537] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:08 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:10.178755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:10.180240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:10.210441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:10.211490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:10.212852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:10.213558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:10.391988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:10.393575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:10.409427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:10.418359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:10.419659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:10.420343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:10.581991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:10.595699 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cc590c27-f541-4b2e-b40f-abfc7c6c8457 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.443739 Jul 20 11:22:10.596953 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2758/5538] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:10 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:10.714116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:10.731488 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-72993c80-d660-4fc9-8f02-f448016b2f25 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.343996 Jul 20 11:22:10.732476 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2781/5539] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:10 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:11.525784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-638af4ab-8e9c-41f3-9815-264ddbb14dd4 req-3966e616-0f4c-43c1-82e0-9407c2e7f083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0ffcff-5b5c-441a-8e9c-739ca98530cd", "name": "network-vif-plugged", "status": "completed", "tag": "83366efb-798a-4936-8a31-1bcb64b0b267"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:11.540389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-638af4ab-8e9c-41f3-9815-264ddbb14dd4 req-3966e616-0f4c-43c1-82e0-9407c2e7f083 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:11.540853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-638af4ab-8e9c-41f3-9815-264ddbb14dd4 req-3966e616-0f4c-43c1-82e0-9407c2e7f083 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:11.559159 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-638af4ab-8e9c-41f3-9815-264ddbb14dd4 req-3966e616-0f4c-43c1-82e0-9407c2e7f083 service nova] Creating event network-vif-plugged:83366efb-798a-4936-8a31-1bcb64b0b267 for instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd on n-h2-846219-10 Jul 20 11:22:11.570025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-638af4ab-8e9c-41f3-9815-264ddbb14dd4 req-3966e616-0f4c-43c1-82e0-9407c2e7f083 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048086 Jul 20 11:22:11.571182 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2759/5540] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:11.622188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:11.623527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:11.643289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:11.644710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:11.647315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:11.660092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:11.753694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:11.755404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:11.799973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:11.801682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:11.806842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:11.810980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:12.312512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:12.329841 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0a1681a-a6ef-4d49-b67e-6884888d5005 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1693 microversion: 2.1 time: 0.710798 Jul 20 11:22:12.342368 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2782/5541] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:11 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1693 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:12.434592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:12.448680 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0714487d-5092-498c-b422-dcd01102641b tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1319 microversion: 2.1 time: 0.702262 Jul 20 11:22:12.450130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2760/5542] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:11 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:12.473617 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:22:12.473869 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:22:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:22:13.350415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:13.351136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:13.365497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:13.366267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:13.367337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:13.367979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:13.466685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:13.467968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:13.479292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:13.482987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:13.485921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:13.486503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:13.802110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:13.808291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:13.815792 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a436659a-6178-4f14-831a-50bdeb3f6be0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1508 microversion: 2.1 time: 0.353540 Jul 20 11:22:13.817179 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2761/5543] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:13 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:13.825879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1821374719", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e8c001d-1fc0-406c-96c4-dbbcc7fedf10"}], "security_groups": [{"name": "tempest-securitygroup--1127335151"}], "key_name": "tempest-keypair-261598709", "user_data": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:13.833487 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7733e09a-9485-4fb0-a25c-a85ee6798ea0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1683 microversion: 2.1 time: 0.488718 Jul 20 11:22:13.841280 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2783/5544] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:13 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1683 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:13.850874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:13.851809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:13.866885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:13.867715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:13.869069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:13.869739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:14.109384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] validate_networks() for [('2e8c001d-1fc0-406c-96c4-dbbcc7fedf10', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:22:14.254037 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9d16e5d9-eccc-4860-9f62-51daf6885ca4 tempest-TestNetworkAdvancedServerOps-1702957211 tempest-TestNetworkAdvancedServerOps-1702957211-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1836 microversion: 2.1 time: 0.407269 Jul 20 11:22:14.263547 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2784/5545] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:13 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1836 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:14.274646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:14.275586 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:14.292614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:14.295853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:14.296919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:14.297588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:15.213182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:15.222052 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-554ffc1a-01a6-4471-874a-3ade5fb2d75f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1683 microversion: 2.1 time: 0.951285 Jul 20 11:22:15.226040 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2785/5546] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:14 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1683 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:15.393682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:15.451794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:15.453176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:15.467859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:15.481953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:15.482859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:15.484011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:15.484751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:15.555724 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1b14386a-52eb-47a2-ba9e-289dabd393c5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action" status: 200 len: 38636 microversion: 2.1 time: 0.107791 Jul 20 11:22:15.557265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2786/5547] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:22:15 2022] POST /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f/action => generated 38636 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:22:15.820441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:22:15.820633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:22:15.821113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:22:15.821523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:22:15.822116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:22:15.845857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:15.857558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:15.859922 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:15.862482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:15.918748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for project b8987df57b4c4c71a5070180fc86d794. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:22:15.937966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Getting quotas for user eca571756cd648a8a8383195dc697b19 and project b8987df57b4c4c71a5070180fc86d794. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:22:15.956631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:22:15.959776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:22:16.035234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c851450e-16ec-4f67-9fed-c41ec7f804fb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.216622 Jul 20 11:22:16.036480 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2762/5548] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:22:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:22:16.048292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-490b03ad-f5b9-4ecf-a466-4c2b5e9e6d4e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:16.049228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-490b03ad-f5b9-4ecf-a466-4c2b5e9e6d4e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:16.168869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-490b03ad-f5b9-4ecf-a466-4c2b5e9e6d4e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:16.180047 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-490b03ad-f5b9-4ecf-a466-4c2b5e9e6d4e tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1237 microversion: 2.1 time: 0.136439 Jul 20 11:22:16.180916 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2787/5549] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:16 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1237 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:17.199059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:17.200448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:17.209615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:17.210453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:17.212289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:17.212983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:17.334155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:17.349305 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b5291b29-14bf-4480-94b8-5a60cc122325 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1289 microversion: 2.1 time: 0.155026 Jul 20 11:22:17.352852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2763/5550] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:17 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1289 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:18.370727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:18.371625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:18.387789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.397210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:18.402608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.403951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:18.477166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:18.480024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:18.492969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.493767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:18.494840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.497002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:18.568888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:22:18.584739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:18.598889 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1749f2d3-960c-4cbe-9f7a-b114cf708358 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1295 microversion: 2.1 time: 0.232395 Jul 20 11:22:18.610623 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2788/5551] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:18 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1295 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:18.615479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-abe83d7a-7e2b-47a5-9cbb-fdeb3f2b8307 req-c5a0fe3a-78ae-4829-9edf-105611560504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:18.634376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-abe83d7a-7e2b-47a5-9cbb-fdeb3f2b8307 req-c5a0fe3a-78ae-4829-9edf-105611560504 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.634828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-abe83d7a-7e2b-47a5-9cbb-fdeb3f2b8307 req-c5a0fe3a-78ae-4829-9edf-105611560504 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:18.668239 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-abe83d7a-7e2b-47a5-9cbb-fdeb3f2b8307 req-c5a0fe3a-78ae-4829-9edf-105611560504 service nova] Creating event network-changed:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h1-846219-10 Jul 20 11:22:18.694877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-abe83d7a-7e2b-47a5-9cbb-fdeb3f2b8307 req-c5a0fe3a-78ae-4829-9edf-105611560504 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078348 Jul 20 11:22:18.695577 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2789/5552] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:18.760422 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-59773dc8-bccf-4c0e-baf5-41f60de1b6a8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 204 len: 0 microversion: 2.1 time: 0.298139 Jul 20 11:22:18.765143 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2764/5553] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:22:18 2022] DELETE /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:22:18.775249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:18.775967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:18.796407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.796916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:18.798410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:18.798863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:19.153631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:19.165848 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1acc25f5-0912-47ed-9755-eb2f9f5195ad tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1689 microversion: 2.1 time: 0.394193 Jul 20 11:22:19.176104 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2790/5554] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:18 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1689 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:19.634708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:19.636205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:19.649533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:19.650360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:19.651567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:19.665322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:19.800498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:19.809831 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5510aaaa-9220-40c4-b41d-b869660e93d1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1295 microversion: 2.1 time: 0.179532 Jul 20 11:22:19.815721 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2765/5555] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:19 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1295 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:20.197125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:20.205374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:20.218050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:20.222351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:20.223805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:20.224749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:20.574527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:20.587187 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-94d686bb-a945-47ce-9bea-8ea3c906cece tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1689 microversion: 2.1 time: 0.406614 Jul 20 11:22:20.592682 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2791/5556] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:20 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1689 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:20.831968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:20.833264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:20.845492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:20.846551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:20.848921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:20.849169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:20.929242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:20.943923 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e216278a-2818-4a4c-ad42-c24ec6018473 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1295 microversion: 2.1 time: 0.113257 Jul 20 11:22:20.945213 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2766/5557] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:20 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1295 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:21.609303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:21.610072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:21.631018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:21.646371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:21.650878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:21.651656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:21.854107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:21.864131 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-044514f7-9fb5-4d8f-bdd1-368b714a4c48 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 200 len: 1621 microversion: 2.1 time: 0.258725 Jul 20 11:22:21.872097 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2792/5558] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:21 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 1621 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:21.964500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:21.965381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:21.981269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:21.981738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:21.982672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:21.983122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:22.368414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:22.378706 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a58329f2-765b-46a8-8f7e-481f493f5516 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.417514 Jul 20 11:22:22.383423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2793/5559] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:21 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:22.418968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b3c218ae-94c6-47e6-a5f5-f95f4a80093b req-a967feef-0fdd-4312-9f05-aef47df5b4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1445e380-e225-4466-a052-55adae3f768f", "name": "network-vif-deleted", "tag": "960a0253-5090-4fb6-aaad-ef1161524231"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:22.435854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b3c218ae-94c6-47e6-a5f5-f95f4a80093b req-a967feef-0fdd-4312-9f05-aef47df5b4e0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:22.440522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b3c218ae-94c6-47e6-a5f5-f95f4a80093b req-a967feef-0fdd-4312-9f05-aef47df5b4e0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:22.466354 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b3c218ae-94c6-47e6-a5f5-f95f4a80093b req-a967feef-0fdd-4312-9f05-aef47df5b4e0 service nova] Creating event network-vif-deleted:960a0253-5090-4fb6-aaad-ef1161524231 for instance 1445e380-e225-4466-a052-55adae3f768f on n-h1-846219-10 Jul 20 11:22:22.483231 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b3c218ae-94c6-47e6-a5f5-f95f4a80093b req-a967feef-0fdd-4312-9f05-aef47df5b4e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.530249 Jul 20 11:22:22.488411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2767/5560] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:22:22.883651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:22.884406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: 1445e380-e225-4466-a052-55adae3f768f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:22.907835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:22.908635 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:22.909664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:22.915924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:22.974242 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] HTTP exception thrown: Instance 1445e380-e225-4466-a052-55adae3f768f could not be found. Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Request method failure captured: Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f HTTP/1.1 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-NsHgD1X9xCH8UswZQ8XuqtrhrxB-IRut7fm28RDiSMw1Pzd_sQ25idIpkeMBx8-UzBC0PftqhOFe4sVzXqymorzT0o6MkFlvC4cYzqx2lJYHP4RNbE-KBjwfr_Y-bgrkHdhfqgDjhndhBbUQm8CCziWKwDog3STtrzu-O8-1UpCHw Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8a593b39b87146aeaeb5f515181fd374", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 73af3e843b3c4c1a8d933b29cfc20508 Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 1445e380-e225-4466-a052-55adae3f768f could not be found. Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1445e380-e225-4466-a052-55adae3f768f'} Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1445e380-e225-4466-a052-55adae3f768f could not be found. Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1445e380-e225-4466-a052-55adae3f768f could not be found. Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:22:22.978862 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1445e380-e225-4466-a052-55adae3f768f could not be found. Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Returning 404 to user: Instance 1445e380-e225-4466-a052-55adae3f768f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5209c3b7-aa0b-446a-b69e-e0104c3a8a71 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f" status: 404 len: 111 microversion: 2.1 time: 0.104405 Jul 20 11:22:22.985587 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2794/5561] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:22 2022] GET /compute/v2.1/servers/1445e380-e225-4466-a052-55adae3f768f => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:22:23.404433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:23.405479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:23.426508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:23.430383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:23.432882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:23.433553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:23.860295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:23.892204 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-28027c46-9877-49a0-8fa2-790b7603a872 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.493772 Jul 20 11:22:23.894212 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2768/5562] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:23 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:24.593595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1801821c-2fa7-4496-8a1d-209b620d805b req-b6b643df-bb1e-4f71-a95d-8f6d66522bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25730973-2075-4c57-9400-42d968bea5c2", "tag": "67ade7ec-0a1b-4280-a2bc-78279a74dc2a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:24.604754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1801821c-2fa7-4496-8a1d-209b620d805b req-b6b643df-bb1e-4f71-a95d-8f6d66522bd2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:24.604754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1801821c-2fa7-4496-8a1d-209b620d805b req-b6b643df-bb1e-4f71-a95d-8f6d66522bd2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:24.624977 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1801821c-2fa7-4496-8a1d-209b620d805b req-b6b643df-bb1e-4f71-a95d-8f6d66522bd2 service nova] Creating event network-changed:67ade7ec-0a1b-4280-a2bc-78279a74dc2a for instance 25730973-2075-4c57-9400-42d968bea5c2 on n-h2-846219-10 Jul 20 11:22:24.632872 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1801821c-2fa7-4496-8a1d-209b620d805b req-b6b643df-bb1e-4f71-a95d-8f6d66522bd2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043179 Jul 20 11:22:24.635487 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2795/5563] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:24.919488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:24.920782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:24.931029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:24.932026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:24.933825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:24.934517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:25.435838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:25.439632 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b9c219a7-df6f-4cd6-bac0-373793a1cede tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.528528 Jul 20 11:22:25.439950 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2769/5564] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:24 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:26.458913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:26.460012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:26.474466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:26.481484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:26.481960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:26.482793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:26.483269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:26.950520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:26.965425 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb720809-3f67-4e57-bc06-71c26b1dd787 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.510816 Jul 20 11:22:26.968144 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2796/5565] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:26 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:27.985258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:27.986664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:27.996041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:28.001045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:28.005657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:28.007105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:28.012237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:28.013443 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:28.381522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:28.389973 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b446699e-9ca7-4447-b491-4ebdb8fd7bba tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.410291 Jul 20 11:22:28.390567 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2770/5566] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:27 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:29.408537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:29.409327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:29.421852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:29.424175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:29.428090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:29.429171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:30.020040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b777e381-4b54-4318-a30f-6f964336bced req-b876ffb6-ca4b-49b3-95b5-d5f48033993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25730973-2075-4c57-9400-42d968bea5c2", "name": "network-vif-plugged", "status": "completed", "tag": "67ade7ec-0a1b-4280-a2bc-78279a74dc2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:30.054906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b777e381-4b54-4318-a30f-6f964336bced req-b876ffb6-ca4b-49b3-95b5-d5f48033993d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:30.060453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b777e381-4b54-4318-a30f-6f964336bced req-b876ffb6-ca4b-49b3-95b5-d5f48033993d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:30.089278 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b777e381-4b54-4318-a30f-6f964336bced req-b876ffb6-ca4b-49b3-95b5-d5f48033993d service nova] Creating event network-vif-plugged:67ade7ec-0a1b-4280-a2bc-78279a74dc2a for instance 25730973-2075-4c57-9400-42d968bea5c2 on n-h2-846219-10 Jul 20 11:22:30.111392 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b777e381-4b54-4318-a30f-6f964336bced req-b876ffb6-ca4b-49b3-95b5-d5f48033993d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095002 Jul 20 11:22:30.112290 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2771/5567] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:22:30.324537 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:30.353910 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db9dd9b1-750e-43d2-b528-eebe198d59e0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.949519 Jul 20 11:22:30.370201 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2797/5568] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:29 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:31.382033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:31.384615 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:31.412683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:31.413354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:31.416403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:31.418997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:32.184912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:32.217029 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7a61988-56fe-4ced-8b09-52c46c92ad6f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1363 microversion: 2.1 time: 0.844018 Jul 20 11:22:32.218297 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2772/5569] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:31 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1363 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:33.239428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:33.240140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:33.250574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:33.258716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:33.264392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:33.265050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:34.053982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:34.062598 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3203c648-9c14-44db-9a06-35cef62c4ea4 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1549 microversion: 2.1 time: 0.828599 Jul 20 11:22:34.063450 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2798/5570] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:33 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1549 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:34.105036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:34.106088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:34.115337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:34.116090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:34.117110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:34.117850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:34.177719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-265f8c38-a801-4ff8-936a-554474e81f39 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '.version_select at 0x7f2c3ea745e0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:34.252202 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-265f8c38-a801-4ff8-936a-554474e81f39 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1554951403" status: 202 len: 0 microversion: 2.1 time: 0.079856 Jul 20 11:22:34.275633 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2799/5571] 10.222.0.79 () {58 vars in 1283 bytes} [Wed Jul 20 11:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1554951403 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:22:34.301437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c77d2a3d-5c3f-4a8d-b27a-93addd4cebc3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: .version_select at 0x7f2c3e9c51f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1973213884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYCvQ1npH/26eMvOkn+nXzMbo6hfepn05eco+cPaJISqoQOmLD86vrnKF6zmuCdpF6FhTeP7u9pT+TWrf05flzCVJf3Hgby+FNSPjiSIixZShoKE5I/xq2UKsZ29FDZzQ=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:34.332604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c77d2a3d-5c3f-4a8d-b27a-93addd4cebc3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:22:34.342074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c77d2a3d-5c3f-4a8d-b27a-93addd4cebc3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:22:34.354107 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4551465b-c586-4f49-91b7-5608baf29484 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253658 Jul 20 11:22:34.354707 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2773/5572] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:22:34 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:34.402652 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c77d2a3d-5c3f-4a8d-b27a-93addd4cebc3 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.113364 Jul 20 11:22:34.424070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2800/5573] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:22:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:36.712170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-84f9efff-f6d8-452a-b91d-e6861797dbe6 req-81b48182-fe74-4b8d-a51b-9d427f50b780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25730973-2075-4c57-9400-42d968bea5c2", "tag": "67ade7ec-0a1b-4280-a2bc-78279a74dc2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:36.726454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-84f9efff-f6d8-452a-b91d-e6861797dbe6 req-81b48182-fe74-4b8d-a51b-9d427f50b780 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:36.727793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-84f9efff-f6d8-452a-b91d-e6861797dbe6 req-81b48182-fe74-4b8d-a51b-9d427f50b780 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:36.755076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-84f9efff-f6d8-452a-b91d-e6861797dbe6 req-81b48182-fe74-4b8d-a51b-9d427f50b780 service nova] Creating event network-changed:67ade7ec-0a1b-4280-a2bc-78279a74dc2a for instance 25730973-2075-4c57-9400-42d968bea5c2 on n-h2-846219-10 Jul 20 11:22:36.767058 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-84f9efff-f6d8-452a-b91d-e6861797dbe6 req-81b48182-fe74-4b8d-a51b-9d427f50b780 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069138 Jul 20 11:22:36.772105 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2774/5574] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:22:51.357012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-996829580", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "b204d2a2-a372-466a-9674-8daf6ffa504e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1973213884", "security_groups": [{"name": "tempest-secgroup-smoke-581796848"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:51.391697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=88 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:51.394211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:51.403821 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:51.666197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] validate_networks() for [('b204d2a2-a372-466a-9674-8daf6ffa504e', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:22:52.725133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:22:52.725878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:22:52.726035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:22:52.726882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:22:52.727662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:22:52.738511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:52.739231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:52.740203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:52.740650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:52.776027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:22:52.791292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Getting quotas for user 73af3e843b3c4c1a8d933b29cfc20508 and project 8a593b39b87146aeaeb5f515181fd374. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:22:52.816267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:22:52.819860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:22:52.882924 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0ed0991c-ac70-451a-990e-fd6c121be60f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.530349 Jul 20 11:22:52.892268 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2801/5575] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:22:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:22:52.895479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:52.897250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:22:52.909189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4cf63c0e-57bf-4af0-b13f-1e40bfa85777 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:52.909778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4cf63c0e-57bf-4af0-b13f-1e40bfa85777 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:53.131710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4cf63c0e-57bf-4af0-b13f-1e40bfa85777 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:53.168643 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4cf63c0e-57bf-4af0-b13f-1e40bfa85777 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1266 microversion: 2.1 time: 0.274628 Jul 20 11:22:53.180573 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2775/5576] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:52 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:53.411501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "999ecd2f-e959-45a7-9752-a8fa01396953", "device": "/dev/sdb"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:53.412772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:53.425430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:53.427080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:53.429280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:53.443201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:54.193625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a735268e-2f21-40f4-a16f-137aff94aad8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:54.194723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a735268e-2f21-40f4-a16f-137aff94aad8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:54.499812 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-410f087f-2c74-4373-a3fe-b6946458b8e3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "POST /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.093819 Jul 20 11:22:54.528296 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2802/5577] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:22:53 2022] POST /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd/os-volume_attachments => generated 194 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:22:54.615953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a735268e-2f21-40f4-a16f-137aff94aad8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:54.643023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a735268e-2f21-40f4-a16f-137aff94aad8 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1266 microversion: 2.1 time: 0.458709 Jul 20 11:22:54.659056 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2776/5578] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:54 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:55.677345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:55.678279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:55.700303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:55.700669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:55.711494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:55.713564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:56.726617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:56.751157 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e019da5-3a13-4599-8a8c-c8e7e86e141b tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1318 microversion: 2.1 time: 1.079657 Jul 20 11:22:56.755969 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2803/5579] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:55 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1318 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:22:57.773549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:57.774459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:57.797559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:57.798097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:57.798942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:57.799427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:58.465807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:22:58.476839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3cde8081-fa78-4f96-ad38-f7b3cdf94d05 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.707793 Jul 20 11:22:58.477441 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2777/5580] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:57 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:22:59.497608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:22:59.498248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:22:59.521557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:59.522043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:59.522863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:59.523377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:59.654700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b082ac71-74c1-4eca-a5ae-eb8455d03a7d req-8ab40f2a-4a59-4771-ab08-9c0639a51fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77b47e4-0d60-4e0d-839e-bcb4a2d5af69", "tag": "f539621b-508a-4840-8c50-f7354119754d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:22:59.675299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b082ac71-74c1-4eca-a5ae-eb8455d03a7d req-8ab40f2a-4a59-4771-ab08-9c0639a51fe9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:22:59.675745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b082ac71-74c1-4eca-a5ae-eb8455d03a7d req-8ab40f2a-4a59-4771-ab08-9c0639a51fe9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:22:59.747571 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b082ac71-74c1-4eca-a5ae-eb8455d03a7d req-8ab40f2a-4a59-4771-ab08-9c0639a51fe9 service nova] Creating event network-changed:f539621b-508a-4840-8c50-f7354119754d for instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 on n-h2-846219-10 Jul 20 11:22:59.754819 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b082ac71-74c1-4eca-a5ae-eb8455d03a7d req-8ab40f2a-4a59-4771-ab08-9c0639a51fe9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104148 Jul 20 11:22:59.755723 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2778/5581] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:23:00.159847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:00.167874 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03a62097-b191-49d6-8be0-a549b5830ebe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.674375 Jul 20 11:23:00.178144 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2804/5582] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:22:59 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:01.187131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:01.187924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:01.195896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:01.196359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:01.197200 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:01.197796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:01.607293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:01.621766 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-34faac6d-341e-4af6-b91c-010ab8f7e7e0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.438914 Jul 20 11:23:01.650768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2779/5583] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:01 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:02.640402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:02.647719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:02.663262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:02.679986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:02.681136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:02.681744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:02.754291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:02.810422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:03.083525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:03.099638 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-38243843-9a08-4893-8b6b-ccba184fb7ee tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.464082 Jul 20 11:23:03.112282 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2805/5584] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:02 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:04.117109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:04.118138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:04.141732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:04.142682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:04.143713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:04.156444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:04.465057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:04.476978 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85553a42-056d-4c2f-8a49-3e55ef84999a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.363628 Jul 20 11:23:04.478252 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2780/5585] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:04 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:05.494650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:05.496060 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:05.508147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:05.508842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:05.511359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:05.512017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:05.794025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:05.806712 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-385dada0-88e3-4f18-8213-ae49352d9caf tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.316250 Jul 20 11:23:05.819324 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2806/5586] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:05 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:06.798544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:06.824658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:06.825448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:06.843805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:06.845733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:06.846914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:06.848730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:07.129927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-148b7b6f-335c-4ba8-b312-32df45b47c85 req-dbde9cbc-4af5-48cf-9de2-8be06622f8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77b47e4-0d60-4e0d-839e-bcb4a2d5af69", "name": "network-vif-plugged", "status": "completed", "tag": "f539621b-508a-4840-8c50-f7354119754d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:07.161839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-148b7b6f-335c-4ba8-b312-32df45b47c85 req-dbde9cbc-4af5-48cf-9de2-8be06622f8a8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:07.162537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-148b7b6f-335c-4ba8-b312-32df45b47c85 req-dbde9cbc-4af5-48cf-9de2-8be06622f8a8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:07.194174 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-148b7b6f-335c-4ba8-b312-32df45b47c85 req-dbde9cbc-4af5-48cf-9de2-8be06622f8a8 service nova] Creating event network-vif-plugged:f539621b-508a-4840-8c50-f7354119754d for instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 on n-h2-846219-10 Jul 20 11:23:07.202903 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-148b7b6f-335c-4ba8-b312-32df45b47c85 req-dbde9cbc-4af5-48cf-9de2-8be06622f8a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.409430 Jul 20 11:23:07.204304 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2781/5587] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:23:07.238650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:07.266345 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12fdd5e4-a340-4f48-8037-b416c84f952a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.445771 Jul 20 11:23:07.267584 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2807/5588] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:06 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:08.287887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:08.289221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:08.319528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:08.320303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:08.321312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:08.321902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:08.770227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:08.781402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7943545d-49c8-4cb2-82d3-4597dea6a490 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1391 microversion: 2.1 time: 0.497438 Jul 20 11:23:08.798373 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2782/5589] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:08 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1391 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:09.436256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:09.438131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:09.455076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:09.457596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:09.460858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:09.461539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:09.515613 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2729c57a-0118-4ad5-8a68-0718c7f84afa tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/ips" status: 200 len: 146 microversion: 2.1 time: 0.085088 Jul 20 11:23:09.518607 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2808/5590] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:23:09 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:09.803797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:09.804622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:09.823574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:09.833161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:09.845932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:09.848073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:10.473397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:10.483421 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b98ad764-f822-4945-ba74-e29a9dbc434d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1563 microversion: 2.1 time: 0.684238 Jul 20 11:23:10.486815 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2783/5591] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:09 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1563 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:10.501061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:10.502144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:10.514188 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:10.514699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:10.517467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:10.517919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:10.797559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:10.810686 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-39d7c1fc-5cc4-4564-8754-7e0ad65c7605 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1563 microversion: 2.1 time: 0.311433 Jul 20 11:23:10.811326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2809/5592] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:10 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1563 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:12.404732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4213335b-7d35-4fb6-a19b-02ca226638ba"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:12.408479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:12.425104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:12.425618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:12.433663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:12.439068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:12.914076 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-66354143-0407-4e1e-93d8-bee4b2d2303b tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511604 Jul 20 11:23:12.919262 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2784/5593] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:23:12 2022] POST /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:23:14.826345 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:14.827918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:14.848080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-bd8ec699-c5ac-4ab7-b801-3b3bc4c66509 req-279a6667-28d2-42ba-bf33-a2421acce6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77b47e4-0d60-4e0d-839e-bcb4a2d5af69", "tag": "f539621b-508a-4840-8c50-f7354119754d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:14.854528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:14.854984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:14.858568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:14.859062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:14.868648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-bd8ec699-c5ac-4ab7-b801-3b3bc4c66509 req-279a6667-28d2-42ba-bf33-a2421acce6a6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:14.869570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-bd8ec699-c5ac-4ab7-b801-3b3bc4c66509 req-279a6667-28d2-42ba-bf33-a2421acce6a6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:14.901139 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-bd8ec699-c5ac-4ab7-b801-3b3bc4c66509 req-279a6667-28d2-42ba-bf33-a2421acce6a6 service nova] Creating event network-changed:f539621b-508a-4840-8c50-f7354119754d for instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 on n-h2-846219-10 Jul 20 11:23:14.913173 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-bd8ec699-c5ac-4ab7-b801-3b3bc4c66509 req-279a6667-28d2-42ba-bf33-a2421acce6a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070216 Jul 20 11:23:14.919700 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2785/5594] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:15.261679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:15.278499 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a11119d0-5d4b-41c1-b858-a74e65d398dc tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1563 microversion: 2.1 time: 0.448909 Jul 20 11:23:15.281586 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2810/5595] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:14 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1563 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:29.317071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:29.318151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:29.325547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=26 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:29.326205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:29.329400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:29.330002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:29.331028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:29.331755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:29.421469 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35bdf8da-fd5b-42db-a687-0ab3bb34feb0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108033 Jul 20 11:23:29.426785 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2786/5596] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:23:29 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:29.434357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:29.435130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:29.439199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:29.440059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:29.447265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:29.447873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:29.450743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:29.451222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:29.493923 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-399eca47-b78d-4566-99a2-45368a40a9ae tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/4213335b-7d35-4fb6-a19b-02ca226638ba" status: 200 len: 194 microversion: 2.1 time: 0.065253 Jul 20 11:23:29.494905 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2811/5597] 10.222.0.79 () {58 vars in 1412 bytes} [Wed Jul 20 11:23:29 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/4213335b-7d35-4fb6-a19b-02ca226638ba => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:30.705537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:30.706811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:30.723145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:30.724619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:30.726700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:30.728229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:30.850535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lazy-loading 'services' on Instance uuid 3e0ffcff-5b5c-441a-8e9c-739ca98530cd {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:23:30.968149 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4896e6c3-2d51-487f-b6b2-25bdaf715ab2 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd/os-volume_attachments/999ecd2f-e959-45a7-9752-a8fa01396953" status: 202 len: 0 microversion: 2.1 time: 0.264349 Jul 20 11:23:30.984783 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2787/5598] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:23:30 2022] DELETE /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd/os-volume_attachments/999ecd2f-e959-45a7-9752-a8fa01396953 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:23:32.384025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff8277be-5cc7-4cbe-bc6e-75976fa0465d"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:32.385778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:32.395941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:32.399372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:32.400527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:32.401119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:32.859229 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8222fe02-c46b-4267-9ec5-e454962bc59f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "POST /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478186 Jul 20 11:23:32.866271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2812/5599] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:23:32 2022] POST /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:32.975690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:32.977575 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:32.999698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:33.001417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:33.003984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:33.016699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:33.129389 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c051c1c-d55e-4a00-9374-6430598666d5 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69/action" status: 200 len: 24558 microversion: 2.1 time: 0.160049 Jul 20 11:23:33.132797 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2788/5600] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:23:32 2022] POST /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69/action => generated 24558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:23:37.283042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:37.283899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:37.305711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:37.306898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:37.308057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:37.309260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:37.361191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:23:37.511516 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-458895a2-a500-4a35-a0b7-85aec204a6be tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 204 len: 0 microversion: 2.1 time: 0.232813 Jul 20 11:23:37.514352 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2813/5601] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:23:37 2022] DELETE /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:23:37.526466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:37.527951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:37.545655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:37.546516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:37.548599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:37.551640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:38.210875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:38.224723 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b40eca8-3006-43d5-aa1f-45a24d13bec7 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1514 microversion: 2.1 time: 0.705532 Jul 20 11:23:38.225294 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2789/5602] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:37 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1514 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:23:39.242374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:39.243198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:39.254583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:39.265559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:39.266765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:39.267231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:39.540120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:39.552788 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e2743766-8467-4836-b6f7-a9e215f6a517 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 200 len: 1514 microversion: 2.1 time: 0.314173 Jul 20 11:23:39.569232 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2814/5603] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:39 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:39.751578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a391e29e-14ea-4fd8-8373-e816635428a2 req-0ebcbd3b-490f-4d15-8ac3-bbd759c1da2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0ffcff-5b5c-441a-8e9c-739ca98530cd", "name": "network-vif-deleted", "tag": "83366efb-798a-4936-8a31-1bcb64b0b267"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:39.775951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a391e29e-14ea-4fd8-8373-e816635428a2 req-0ebcbd3b-490f-4d15-8ac3-bbd759c1da2c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:39.776949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a391e29e-14ea-4fd8-8373-e816635428a2 req-0ebcbd3b-490f-4d15-8ac3-bbd759c1da2c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:39.805485 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a391e29e-14ea-4fd8-8373-e816635428a2 req-0ebcbd3b-490f-4d15-8ac3-bbd759c1da2c service nova] Creating event network-vif-deleted:83366efb-798a-4936-8a31-1bcb64b0b267 for instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd on n-h2-846219-10 Jul 20 11:23:39.827355 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a391e29e-14ea-4fd8-8373-e816635428a2 req-0ebcbd3b-490f-4d15-8ac3-bbd759c1da2c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084328 Jul 20 11:23:39.828305 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2790/5604] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:40.572805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:40.573434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 3e0ffcff-5b5c-441a-8e9c-739ca98530cd] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:40.584549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:40.585095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:40.593512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:40.593902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:40.626748 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] HTTP exception thrown: Instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd could not be found. Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Request method failure captured: Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd HTTP/1.1 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-UCDqKoZDFoPYre5MVLcEb1QrmwAAfNI6blz-jGgG7Lb8fhuL4MCDjYN4oksAMjZukfNZng2qwgZRE0XmwKg2MYKLQe36jsIAXhE4laWXCgzUcDH5PmJ41SQX20liUUXdueKZ__oVP_qRMd6hv0pBzXDI06rv3M8r1V-lYpwl1MT5A Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ce4ed319abae49b6b567a52f92734360 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2097439866 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ce4ed319abae49b6b567a52f92734360", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ce4ed319abae49b6b567a52f92734360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ce4ed319abae49b6b567a52f92734360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ce4ed319abae49b6b567a52f92734360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesSnapshotTestJSON-2097439866 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ce4ed319abae49b6b567a52f92734360 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2097439866 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesSnapshotTestJSON-2097439866-project Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 843d4fba750b4685bc973b5c3be9a5c3 Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesSnapshotTestJSON-2097439866-project Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd could not be found. Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '3e0ffcff-5b5c-441a-8e9c-739ca98530cd'} Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd could not be found. Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd could not be found. Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:23:40.629891 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd could not be found. Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Returning 404 to user: Instance 3e0ffcff-5b5c-441a-8e9c-739ca98530cd could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:23:40.633925 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27806c1e-12cc-4cb7-8e42-1fd150086aeb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd" status: 404 len: 111 microversion: 2.1 time: 0.063787 Jul 20 11:23:40.639772 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2815/5605] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:40 2022] GET /compute/v2.1/servers/3e0ffcff-5b5c-441a-8e9c-739ca98530cd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:23:43.896178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "478de60b-94fe-4326-bea5-987154e218b6"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:43.897882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:43.914842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:43.928989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:43.929879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:43.930571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:44.089899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:23:44.090541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:23:44.091232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:23:44.091801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:23:44.093259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:23:44.185145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:44.210602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:44.211641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:44.212574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:44.213033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:44.290764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-84afa38f-e734-47a3-91a4-a79aa061f033 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69/action" status: 202 len: 1137 microversion: 2.1 time: 0.397583 Jul 20 11:23:44.305575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2791/5606] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:23:43 2022] POST /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69/action => generated 1137 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 20 11:23:44.311245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:44.312246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:44.324390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:44.328562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:44.329856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:44.331485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:44.677113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:44.693543 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d70e25d9-acd5-4970-b817-b824056e08c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.386086 Jul 20 11:23:44.707349 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2816/5607] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:44 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:45.716392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:45.718767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:45.731241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:45.731912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:45.737181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:45.738996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:46.304933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:46.336787 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d8e8847-5515-4429-aed8-a672636ab39c tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.623435 Jul 20 11:23:46.339973 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2792/5608] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:45 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:23:47.361061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:47.361873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:47.386083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:47.388787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:47.392810 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:47.394383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:47.728483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:47.740233 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97729230-bcde-4093-8d0b-c51faef4b73a tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.385499 Jul 20 11:23:47.741426 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2817/5609] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:47 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:48.758823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:48.759731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:48.768104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:48.768561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:48.769347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:48.769929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.017547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:49.031207 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16b60271-9229-4284-a16d-032a19fab3b4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.273491 Jul 20 11:23:49.031935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2793/5610] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:48 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:49.249027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:49.250209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:49.268221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:49.270386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.271423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:49.273440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.348668 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-608a9ed0-d5a8-4448-98e2-2596318a8b43 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.104455 Jul 20 11:23:49.350775 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2818/5611] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:23:49 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:49.499506 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:49.500175 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:49.512472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:49.512945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.513810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:49.514497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.586480 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d645d8e-bff4-4770-ba2d-24e1b2b31fc1 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/4213335b-7d35-4fb6-a19b-02ca226638ba" status: 200 len: 194 microversion: 2.1 time: 0.091643 Jul 20 11:23:49.587450 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2794/5612] 10.222.0.79 () {58 vars in 1412 bytes} [Wed Jul 20 11:23:49 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/4213335b-7d35-4fb6-a19b-02ca226638ba => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:49.598498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:49.599269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:49.616532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:49.617254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.618085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:49.618538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:49.864354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lazy-loading 'services' on Instance uuid 25730973-2075-4c57-9400-42d968bea5c2 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:23:50.049945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:50.051280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:50.065423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:50.065886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:50.066678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:50.067363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:50.075362 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-65ca34bc-0402-49c9-bdea-305c017c42d0 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/4213335b-7d35-4fb6-a19b-02ca226638ba" status: 202 len: 0 microversion: 2.1 time: 0.481198 Jul 20 11:23:50.076640 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2819/5613] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:23:49 2022] DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/4213335b-7d35-4fb6-a19b-02ca226638ba => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:23:50.364035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:50.375958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-569357f9-2f3e-40f2-87d0-9363124a2877 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.330486 Jul 20 11:23:50.385507 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2795/5614] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:50 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:23:51.397717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:51.397717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:51.417626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:51.418082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:51.418870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:51.419422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:51.722797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:51.733289 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d6ddcbb-56ee-4461-8c60-154e04ec5783 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.342577 Jul 20 11:23:51.740256 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2820/5615] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:51 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:51.856962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1691097477", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "60f995c7-acec-46c9-afe4-bba1e0e54e32"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:51.954903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] validate_networks() for [('60f995c7-acec-46c9-afe4-bba1e0e54e32', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:23:52.658355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:23:52.659053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:23:52.659579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:23:52.659998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:23:52.660607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:23:52.678056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:52.678520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:52.679841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:52.682272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:52.735819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Getting quotas for project ce4ed319abae49b6b567a52f92734360. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:23:52.755118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Getting quotas for user 843d4fba750b4685bc973b5c3be9a5c3 and project ce4ed319abae49b6b567a52f92734360. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:23:52.796080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:23:52.798431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:23:52.972790 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e499fa7c-2f1d-4cf8-b332-6156e26d8dab tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119739 Jul 20 11:23:52.974011 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2796/5616] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:23:52.990505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aefe02e2-d24f-4b85-8f21-96212e5ad209 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:52.991533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aefe02e2-d24f-4b85-8f21-96212e5ad209 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:53.099718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-aefe02e2-d24f-4b85-8f21-96212e5ad209 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:53.108681 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aefe02e2-d24f-4b85-8f21-96212e5ad209 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1219 microversion: 2.1 time: 0.128343 Jul 20 11:23:53.129655 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2797/5617] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:52 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:53.270150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:53.270809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:53.289138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:53.292491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:53.296287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:53.296917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:53.708254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:53.718231 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ce62c0d-2ddb-4efc-854d-7bc5df4cd3c2 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.971577 Jul 20 11:23:53.730314 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2821/5618] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:52 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:54.110071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-30780986", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "17fd196b-14ee-48af-9491-61d9c8a49521"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:54.134686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:54.138092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:54.158215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:54.158776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:54.162011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:54.162590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:54.246827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] validate_networks() for [('17fd196b-14ee-48af-9491-61d9c8a49521', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:23:54.351573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:54.365094 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e70441f6-64de-44b9-85b6-85cdb57300cd tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1215 microversion: 2.1 time: 0.240012 Jul 20 11:23:54.367292 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2822/5619] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:54 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:54.737869 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:54.738832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:54.757508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:54.757981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:54.758917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:54.759413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:54.875427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:23:54.875861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:23:54.876338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:23:54.876752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:23:54.877467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:23:54.911410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:54.916121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:54.917562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:54.918176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:54.942717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Getting quotas for project b2facb9ee33f42fcb27d49c25921a546. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:23:54.952130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Getting quotas for user 3ad42f205fc049c1953e19b05ed6714f and project b2facb9ee33f42fcb27d49c25921a546. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:23:54.971778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:23:54.975332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:23:55.102282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:55.106728 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8acb659-0e99-453b-8608-6ec3523caad1 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420548 Jul 20 11:23:55.119081 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a163e78-14fa-432d-91f0-fcc302ea2b7d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1691 microversion: 2.1 time: 0.385444 Jul 20 11:23:55.120697 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2823/5620] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:54 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1691 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:23:55.129485 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2798/5621] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:23:55.145851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4549bb38-0a33-45af-83cd-bd40c4328f1c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:55.148344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4549bb38-0a33-45af-83cd-bd40c4328f1c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:55.228547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4549bb38-0a33-45af-83cd-bd40c4328f1c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:55.246857 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4549bb38-0a33-45af-83cd-bd40c4328f1c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1213 microversion: 2.1 time: 0.109038 Jul 20 11:23:55.249290 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2824/5622] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:55 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:55.391828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:55.393310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:55.406710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:55.408569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:55.409512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:55.410215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:55.545953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:55.557657 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-539a6115-782e-40ef-87f0-ff733a163d1f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1277 microversion: 2.1 time: 0.171360 Jul 20 11:23:55.568338 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2799/5623] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:55 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:56.141428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:56.142551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:56.154793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:56.155736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:56.156740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:56.158782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:56.195829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:56.265965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:56.266597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:56.285599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:56.287414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:56.289305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:56.292894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:56.485317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:56.499302 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e64ba76-ba67-4530-9dc0-ba32f87ff61d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1265 microversion: 2.1 time: 0.238899 Jul 20 11:23:56.501305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:56.511466 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2800/5624] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:56 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:23:56.521593 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fd3f2db-3613-4aab-8289-217bdebd3043 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1709 microversion: 2.1 time: 0.387871 Jul 20 11:23:56.524366 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2825/5625] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:56 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1709 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:56.576738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:56.577983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:56.585637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:56.586183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:56.587050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:56.587651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:56.801427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:56.821939 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f92e913-57f9-41b6-8545-6f7032cc505a tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.248203 Jul 20 11:23:56.824397 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2801/5626] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:56 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:57.524449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:57.525085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:57.544960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:57.546776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:57.555248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:57.556036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:57.556824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:57.558192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:57.558844 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:57.559490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:57.563084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:57.564110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:57.829290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:57.840640 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6546984f-4718-45ea-8ca6-bbbf2b8bd1c6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1273 microversion: 2.1 time: 0.326512 Jul 20 11:23:57.841270 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2826/5627] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:57 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:57.851711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:57.863232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:57.886626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:57.887852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:57.890773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:57.894867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:57.996968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:58.010336 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f54c4623-8657-4b90-a273-261e2836816f tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1697 microversion: 2.1 time: 0.472791 Jul 20 11:23:58.020763 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2802/5628] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:57 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1697 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:58.037753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:58.038300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:58.053993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.055848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:58.058325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.058807 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:58.098168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:23:58.111490 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-164c5a29-5e79-4611-87fa-b2df40154066 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/ff8277be-5cc7-4cbe-bc6e-75976fa0465d" status: 200 len: 194 microversion: 2.1 time: 0.091652 Jul 20 11:23:58.112681 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2803/5629] 10.222.0.79 () {58 vars in 1412 bytes} [Wed Jul 20 11:23:58 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/ff8277be-5cc7-4cbe-bc6e-75976fa0465d => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:58.122573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:58.123650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:58.130930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.131385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:58.132170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.132781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:58.308739 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lazy-loading 'services' on Instance uuid 25730973-2075-4c57-9400-42d968bea5c2 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:23:58.328416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:58.340009 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2dde6871-b024-4a7d-91a3-20ba34bccbf1 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.495744 Jul 20 11:23:58.340619 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2827/5630] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:57 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:58.348111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-e79f64b9-a207-48da-97c6-12e779df8cf1 req-6a74ea1b-600e-44e9-a2c9-adb48d99ce1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e93b96c-e5c6-435b-95bd-e21d767d4a44", "tag": "471c420a-0fd2-4e6a-b3a1-e11933bc2c96"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:23:58.358121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e79f64b9-a207-48da-97c6-12e779df8cf1 req-6a74ea1b-600e-44e9-a2c9-adb48d99ce1d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.358892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-e79f64b9-a207-48da-97c6-12e779df8cf1 req-6a74ea1b-600e-44e9-a2c9-adb48d99ce1d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:58.374668 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-e79f64b9-a207-48da-97c6-12e779df8cf1 req-6a74ea1b-600e-44e9-a2c9-adb48d99ce1d service nova] Creating event network-changed:471c420a-0fd2-4e6a-b3a1-e11933bc2c96 for instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 on n-h2-846219-10 Jul 20 11:23:58.393064 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-e79f64b9-a207-48da-97c6-12e779df8cf1 req-6a74ea1b-600e-44e9-a2c9-adb48d99ce1d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051183 Jul 20 11:23:58.393693 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2828/5631] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:23:58.437460 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a513c86d-d003-4407-9e2b-8c68ab48fafd tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/ff8277be-5cc7-4cbe-bc6e-75976fa0465d" status: 202 len: 0 microversion: 2.1 time: 0.317259 Jul 20 11:23:58.438355 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2804/5632] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:23:58 2022] DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments/ff8277be-5cc7-4cbe-bc6e-75976fa0465d => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:23:58.860812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:58.862800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:58.880062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.880803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:58.881993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:58.882591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:59.035405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:59.036315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:59.036967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:59.047418 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c0c42f1-f88e-4652-9030-6386eb58598d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1271 microversion: 2.1 time: 0.191540 Jul 20 11:23:59.048249 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2829/5633] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:58 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:23:59.055923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:59.056779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:59.058032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:59.058585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:59.298702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:59.316163 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e9511fc4-85f9-4805-a6ad-5076ab93e2fe tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1682 microversion: 2.1 time: 0.289162 Jul 20 11:23:59.318692 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2805/5634] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:59 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:23:59.360457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:23:59.361191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:23:59.374672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:59.377921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:59.381419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:23:59.383272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:23:59.749130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:23:59.760282 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-107aebc2-2564-4998-8e64-2d132101d25d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.405686 Jul 20 11:23:59.772055 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2830/5635] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:23:59 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:00.066317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:00.067086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:00.070832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:00.106069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:00.108377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:00.112983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:00.115472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:00.143819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c996a264-96ae-4b32-bb74-04f1fb60764d req-f02e0537-fe77-4c37-9cad-af76a119b150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77b47e4-0d60-4e0d-839e-bcb4a2d5af69", "name": "network-vif-plugged", "status": "completed", "tag": "f539621b-508a-4840-8c50-f7354119754d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:00.148686 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:00.156639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c996a264-96ae-4b32-bb74-04f1fb60764d req-f02e0537-fe77-4c37-9cad-af76a119b150 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:00.157090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c996a264-96ae-4b32-bb74-04f1fb60764d req-f02e0537-fe77-4c37-9cad-af76a119b150 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:00.183777 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c996a264-96ae-4b32-bb74-04f1fb60764d req-f02e0537-fe77-4c37-9cad-af76a119b150 service nova] Creating event network-vif-plugged:f539621b-508a-4840-8c50-f7354119754d for instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 on n-h2-846219-10 Jul 20 11:24:00.197055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c996a264-96ae-4b32-bb74-04f1fb60764d req-f02e0537-fe77-4c37-9cad-af76a119b150 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061807 Jul 20 11:24:00.199155 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2831/5636] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:00.333325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:00.343096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-969ee397-c210-4ee8-a61d-80cd001bf36d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.281445 Jul 20 11:24:00.346470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2806/5637] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:00 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:00.781655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:00.782448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:00.807208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:00.807667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:00.808443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:00.808881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:01.112300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:01.124745 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d57fe092-2382-4b6e-bae3-be239c0f950e tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.350317 Jul 20 11:24:01.125358 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2832/5638] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:00 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:01.364012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:01.365338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:01.379237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:01.379949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:01.380896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:01.381495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:01.648726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:01.660169 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3c826082-6615-4bca-97de-823fae6e3323 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.301366 Jul 20 11:24:01.672094 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2807/5639] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:01 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:01.750629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9f8d1639-415f-43ad-b5d4-e15986910080 req-6c24c340-b002-4d3c-87c5-a5918a9cfe4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e53fa21-7922-4af9-8404-630d2d913639", "tag": "5e939e4d-48c2-41f6-b286-fe4b2c3eb083"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:01.771299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9f8d1639-415f-43ad-b5d4-e15986910080 req-6c24c340-b002-4d3c-87c5-a5918a9cfe4a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:01.772239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9f8d1639-415f-43ad-b5d4-e15986910080 req-6c24c340-b002-4d3c-87c5-a5918a9cfe4a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:01.799809 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9f8d1639-415f-43ad-b5d4-e15986910080 req-6c24c340-b002-4d3c-87c5-a5918a9cfe4a service nova] Creating event network-changed:5e939e4d-48c2-41f6-b286-fe4b2c3eb083 for instance 7e53fa21-7922-4af9-8404-630d2d913639 on n-h2-846219-10 Jul 20 11:24:01.817104 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9f8d1639-415f-43ad-b5d4-e15986910080 req-6c24c340-b002-4d3c-87c5-a5918a9cfe4a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070487 Jul 20 11:24:01.818012 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2833/5640] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:02.144024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:02.144647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:02.179950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:02.180487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:02.181354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:02.181868 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:02.541975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:02.555841 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1c5bbed-e1aa-42a8-9f9d-768f26894d46 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.417255 Jul 20 11:24:02.557018 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2808/5641] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:02 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:02.683183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:02.684044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:02.693647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:02.694108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:02.694900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:02.695562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:02.847805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:02.855626 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-299d9f26-5cd9-4553-92f6-97d908da0849 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.177281 Jul 20 11:24:02.856238 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2834/5642] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:02 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:03.582073 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:03.582732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:03.600788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:03.601253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:03.602062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:03.602508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:03.874953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:03.876606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:03.889996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:03.892324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:03.896020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:03.896773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:03.926371 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:03.938876 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fc454a5a-0ff4-44ab-92f6-fa365ee62cdb tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.369131 Jul 20 11:24:03.942034 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2809/5643] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:03 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:04.266958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:04.296107 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec20ad4f-b5e7-4f69-a030-373704467759 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.426650 Jul 20 11:24:04.297211 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2835/5644] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:03 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:04.643428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-240616f6-9a2f-4ffc-9b62-241b99ff69a9 req-51ecc549-c14e-46c2-a1b4-e9582fc2198b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e93b96c-e5c6-435b-95bd-e21d767d4a44", "name": "network-vif-plugged", "status": "completed", "tag": "471c420a-0fd2-4e6a-b3a1-e11933bc2c96"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:04.663440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-240616f6-9a2f-4ffc-9b62-241b99ff69a9 req-51ecc549-c14e-46c2-a1b4-e9582fc2198b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:04.668756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-240616f6-9a2f-4ffc-9b62-241b99ff69a9 req-51ecc549-c14e-46c2-a1b4-e9582fc2198b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:04.695940 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-240616f6-9a2f-4ffc-9b62-241b99ff69a9 req-51ecc549-c14e-46c2-a1b4-e9582fc2198b service nova] Creating event network-vif-plugged:471c420a-0fd2-4e6a-b3a1-e11933bc2c96 for instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 on n-h2-846219-10 Jul 20 11:24:04.702078 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-240616f6-9a2f-4ffc-9b62-241b99ff69a9 req-51ecc549-c14e-46c2-a1b4-e9582fc2198b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062755 Jul 20 11:24:04.703281 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2810/5645] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:04.958690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:04.959986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:04.973115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:04.973498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:04.977166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:04.977726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.142716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:05.153223 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-beb5578c-84f8-48d4-97f1-b6a2f1d5f06f tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1319 microversion: 2.1 time: 0.198377 Jul 20 11:24:05.154663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2836/5646] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:04 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:05.315733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:05.316458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:05.318456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:05.319131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=14 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:05.326177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.326636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.327460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.327907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.486069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:05.495900 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56f53e0d-bf27-441f-95b6-9ff8e26bf82f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.186027 Jul 20 11:24:05.497013 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2811/5647] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:05 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:05.608073 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:05.609494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:05.616594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:05.618826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.619547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.620559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.621268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.652849 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4f51ed53-68a5-4c1e-9c20-2e0c2d92ae90 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049465 Jul 20 11:24:05.654655 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2837/5648] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:24:05 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:24:05.775982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:05.776861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:05.784668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.785121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.785902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.786339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.817296 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2c553782-f3c9-4daa-8984-ee9518a55bcb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045283 Jul 20 11:24:05.817913 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2812/5649] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:24:05 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:24:05.880042 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:05.880541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:05.886554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.887002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.888103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:05.889381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:05.918712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:24:06.055419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4307bc7b-723c-4e2b-973e-3dd947a1225f tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 204 len: 0 microversion: 2.1 time: 0.178798 Jul 20 11:24:06.058628 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2838/5650] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:24:05 2022] DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:24:06.076831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:06.077691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:06.090385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.092083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.100858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.104350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.172072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:06.173133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:06.196640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.197207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.200279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.200802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.448774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:06.450429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:06.460909 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-df31fb07-caae-41e4-aeb4-c7992fe273df tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1674 microversion: 2.1 time: 0.396157 Jul 20 11:24:06.463247 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2813/5651] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:06 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1674 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:06.463436 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aedfb121-0456-4a7c-bb40-15d27b7c2d50 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1508 microversion: 2.1 time: 0.296042 Jul 20 11:24:06.474455 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2839/5652] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:06 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:06.480056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "854537b8-13f6-410b-a0ae-ae2724d0c034", "device": "/dev/sdb"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:06.481410 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:06.488419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.488870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.489628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.490060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.514617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:06.515356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:06.522917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.523530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.524378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.525184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.683558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:06.691825 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de7e99fd-f9d4-469f-af71-868581de375a tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.182262 Jul 20 11:24:06.692608 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2840/5653] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:06 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:24:06.741272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f5261bf6-20f6-4540-8f2c-a275fd90b2a5 req-b4086ea7-9e29-44a2-b3b8-a133371910ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e53fa21-7922-4af9-8404-630d2d913639", "name": "network-vif-plugged", "status": "completed", "tag": "5e939e4d-48c2-41f6-b286-fe4b2c3eb083"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:06.750983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f5261bf6-20f6-4540-8f2c-a275fd90b2a5 req-b4086ea7-9e29-44a2-b3b8-a133371910ec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:06.751468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f5261bf6-20f6-4540-8f2c-a275fd90b2a5 req-b4086ea7-9e29-44a2-b3b8-a133371910ec service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:06.768629 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f5261bf6-20f6-4540-8f2c-a275fd90b2a5 req-b4086ea7-9e29-44a2-b3b8-a133371910ec service nova] Creating event network-vif-plugged:5e939e4d-48c2-41f6-b286-fe4b2c3eb083 for instance 7e53fa21-7922-4af9-8404-630d2d913639 on n-h2-846219-10 Jul 20 11:24:06.775213 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f5261bf6-20f6-4540-8f2c-a275fd90b2a5 req-b4086ea7-9e29-44a2-b3b8-a133371910ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037479 Jul 20 11:24:06.776260 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2841/5654] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:07.484705 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:07.485423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:07.492372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:07.492978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:07.493844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:07.495362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:07.743023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:07.753687 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-982d23c2-6878-4365-9a94-5f519ddf9ceb tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1674 microversion: 2.1 time: 0.274996 Jul 20 11:24:07.757696 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2842/5655] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:07 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1674 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:24:07.772183 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:07.773656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:07.787861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:07.788902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:07.790506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:07.794474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:07.816784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:07.951481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-11c99bab-74b5-4a5f-b271-c91f118b2b34 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "POST /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.474684 Jul 20 11:24:07.953617 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2814/5656] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:24:06 2022] POST /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44/os-volume_attachments => generated 194 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:24:08.023554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:08.031975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a8d1ffa3-70ac-466d-88a3-94d8b9ca898c tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1313 microversion: 2.1 time: 0.272110 Jul 20 11:24:08.032568 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2843/5657] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:07 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:08.778769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:08.779764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:08.792809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:08.793486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:08.794466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:08.795209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:08.863827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:08.872337 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bbec8c2b-b3e0-4eeb-b5c6-166379d02996 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1606 microversion: 2.1 time: 0.100399 Jul 20 11:24:08.873963 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2815/5658] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:08 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:09.050291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:09.050922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:09.076822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.084116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.085447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.089377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.311775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e81c58fc-d77f-452c-8268-185d03f4ad2e req-a73c1bcb-652a-4d62-a411-f38e815162fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25730973-2075-4c57-9400-42d968bea5c2", "name": "network-vif-deleted", "tag": "67ade7ec-0a1b-4280-a2bc-78279a74dc2a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:09.352762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e81c58fc-d77f-452c-8268-185d03f4ad2e req-a73c1bcb-652a-4d62-a411-f38e815162fd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.353563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e81c58fc-d77f-452c-8268-185d03f4ad2e req-a73c1bcb-652a-4d62-a411-f38e815162fd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.398124 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e81c58fc-d77f-452c-8268-185d03f4ad2e req-a73c1bcb-652a-4d62-a411-f38e815162fd service nova] Creating event network-vif-deleted:67ade7ec-0a1b-4280-a2bc-78279a74dc2a for instance 25730973-2075-4c57-9400-42d968bea5c2 on n-h2-846219-10 Jul 20 11:24:09.408256 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e81c58fc-d77f-452c-8268-185d03f4ad2e req-a73c1bcb-652a-4d62-a411-f38e815162fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100632 Jul 20 11:24:09.412477 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2816/5659] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:09.447856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:09.462051 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-20d07728-ef9b-4ee9-998e-94de7e726d91 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1501 microversion: 2.1 time: 0.415535 Jul 20 11:24:09.469757 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2844/5660] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:09 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1501 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:09.486863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:09.487981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:09.497962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.514424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.524703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.525738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.823122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:09.831371 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-43c49cbe-ab77-4fc7-afa5-e41f11e7fa77 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1501 microversion: 2.1 time: 0.349090 Jul 20 11:24:09.833074 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2817/5661] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:09 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:09.853254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:09.854207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:09.866104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.866948 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.868094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.871864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.891595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:09.892476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:09.904255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.905272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.912314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.913118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.984510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lazy-loading 'flavor' on Instance uuid 7e53fa21-7922-4af9-8404-630d2d913639 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:24:09.993303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:09.994401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:09.995372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lazy-loading 'fault' on Instance uuid 25730973-2075-4c57-9400-42d968bea5c2 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:24:10.105720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eca571756cd648a8a8383195dc697b19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8987df57b4c4c71a5070180fc86d794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:10.118811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:10.126724 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d967a32a-3146-4d39-bda5-387cce421079 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 200 len: 1327 microversion: 2.1 time: 0.239312 Jul 20 11:24:10.138257 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2818/5662] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:09 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 1327 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:24:10.165963 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e9dd565-e9d2-421a-a2ca-cae16f2ce90e tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action" status: 202 len: 0 microversion: 2.1 time: 0.318376 Jul 20 11:24:10.167524 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2845/5663] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:24:09 2022] POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:24:10.176767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:10.177675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:10.184204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:10.189244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:10.190353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:10.190949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:10.477612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:10.487185 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02bea5f6-3f25-473a-9158-a60c5c1c9362 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1509 microversion: 2.1 time: 0.314590 Jul 20 11:24:10.498529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2819/5664] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:10 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:11.157452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:11.158410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:11.170687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:11.171779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:11.174954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:11.175654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:11.192310 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] HTTP exception thrown: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Request method failure captured: Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 HTTP/1.1 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-SURQblMd3z0zJq7luA_uAWfY1PYjwa-3jmmBuymfK5oIpVOoU5Nv_4HggHUxzZ8Z_X52UpMUTFMSHitlyrLoGhIdAKQhLeznODIri7eWFkPdw_C0f4wrAFNdFIjkyFuw7Clfxct_-XYqS3WZu2Ddnn0gKmz2SsKB20g3N_FlyoKBQ Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8987df57b4c4c71a5070180fc86d794", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: eca571756cd648a8a8383195dc697b19 Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '25730973-2075-4c57-9400-42d968bea5c2'} Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:11.194242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:11.198488 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:11.199653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Returning 404 to user: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:11.206113 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6beedf21-5fa7-4c44-8f0f-a57c53bce9fe tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 404 len: 111 microversion: 2.1 time: 0.054724 Jul 20 11:24:11.206940 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2846/5665] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:11 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:24:11.215466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6155daa8-7e58-4860-b842-e168f2e43e76 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '.version_select at 0x7f2c3fe389d0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:11.244712 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6155daa8-7e58-4860-b842-e168f2e43e76 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-261598709" status: 202 len: 0 microversion: 2.1 time: 0.032839 Jul 20 11:24:11.245784 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2820/5666] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-261598709 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:24:11.505592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:11.506733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:11.513376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:11.513939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:11.514858 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:11.515368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:11.865499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:11.891066 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-27c827db-eca9-417e-a016-29643e263d28 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1492 microversion: 2.1 time: 0.383901 Jul 20 11:24:11.892233 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2847/5667] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:11 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1492 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:11.909975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:11.911081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:11.918765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:11.920077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:11.921077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:11.921678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:12.085362 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ba3bc0e-60fb-4d27-bfab-3c2f80dbdbe9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action" status: 202 len: 0 microversion: 2.1 time: 0.178900 Jul 20 11:24:12.086664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2821/5668] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:24:11 2022] POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:24:12.095328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:12.096202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:12.110214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:12.111118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:12.111938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:12.112383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:12.519144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:12.527328 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58ba7f19-5523-4c64-8749-3198d18d56b5 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1498 microversion: 2.1 time: 0.436664 Jul 20 11:24:12.527912 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2848/5669] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:12 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1498 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:13.548912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:13.550971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:13.569567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:13.570043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:13.571690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:13.572413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:13.842529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:13.857317 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2173a10-8fea-4245-8148-5ce1b5e8c91f tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1498 microversion: 2.1 time: 0.312609 Jul 20 11:24:13.870364 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2822/5670] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:13 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:14.876460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:14.878644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:14.890906 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:14.891934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:14.895582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:14.896691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:15.108373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:15.117273 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efbcb9bc-3ce5-410a-93c6-6f5c40337507 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1501 microversion: 2.1 time: 0.244846 Jul 20 11:24:15.117880 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2849/5671] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:14 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1501 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:15.134471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:15.135018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:15.143969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:15.144293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:15.145086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:15.145719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:15.187715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lazy-loading 'flavor' on Instance uuid 7e53fa21-7922-4af9-8404-630d2d913639 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:24:15.282975 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f07dc684-d043-4866-9b2c-6027931fa402 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action" status: 202 len: 0 microversion: 2.1 time: 0.152072 Jul 20 11:24:15.284146 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2823/5672] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:24:15 2022] POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:24:15.291940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:15.292566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:15.309236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:15.310496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:15.311485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:15.312086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:15.576923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:15.586008 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6de60278-e88c-4e5e-8863-5f4256bbb1e8 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1509 microversion: 2.1 time: 0.297891 Jul 20 11:24:15.588216 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2850/5673] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:15 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:16.619645 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:16.620908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:16.644236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:16.652788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:16.655479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:16.668242 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:17.022543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:17.047800 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-887d72ea-87ac-44cd-92e5-37ac3146b95d tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1492 microversion: 2.1 time: 0.444448 Jul 20 11:24:17.052857 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2824/5674] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:16 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1492 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:17.072393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:17.073727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:17.083759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:17.084601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:17.085737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:17.086982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:17.218714 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f1b7c07b-e5b8-4024-a909-65d3cd19d880 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action" status: 202 len: 0 microversion: 2.1 time: 0.149234 Jul 20 11:24:17.230644 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2851/5675] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:24:17 2022] POST /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:24:17.242208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:17.243284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:17.252130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:17.275215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:17.279460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:17.282675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:17.708026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:17.721431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fac952ca-3396-4f79-805d-2506fbe856e9 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1498 microversion: 2.1 time: 0.484008 Jul 20 11:24:17.722690 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2825/5676] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:17 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1498 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:18.740128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:18.741535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:18.750476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:18.750938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:18.751744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:18.752343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:18.981091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:18.991975 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9883e0e-bb54-4fb2-b8c0-11f2e3e246db tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1501 microversion: 2.1 time: 0.256329 Jul 20 11:24:18.992853 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2852/5677] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:18 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:19.009863 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:19.010406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:19.017989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:19.018428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:19.019226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:19.019667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:19.052347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:24:19.174106 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8a86420-3c47-4cb1-9831-9575e7361feb tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 204 len: 0 microversion: 2.1 time: 0.167687 Jul 20 11:24:19.178820 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2826/5678] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:24:19 2022] DELETE /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 11:24:19.183817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:19.185523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:19.193962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:19.195976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:19.198553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:19.201253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:19.383079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:19.393428 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-53dbc3f8-cc44-4771-b5ac-9cdec0583590 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1507 microversion: 2.1 time: 0.213434 Jul 20 11:24:19.408646 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2853/5679] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:19 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:20.415243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:20.416644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:20.459786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:20.460604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:20.461592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:20.462368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:20.777072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:20.793526 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b38259bb-c6c1-4521-9d87-b3a66bc1f589 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1507 microversion: 2.1 time: 0.384399 Jul 20 11:24:20.795706 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2827/5680] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:20 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:21.563826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:21.565338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:21.578250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:21.579714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:21.583430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:21.584098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:21.623233 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] HTTP exception thrown: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Request method failure captured: Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 HTTP/1.1 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-SURQblMd3z0zJq7luA_uAWfY1PYjwa-3jmmBuymfK5oIpVOoU5Nv_4HggHUxzZ8Z_X52UpMUTFMSHitlyrLoGhIdAKQhLeznODIri7eWFkPdw_C0f4wrAFNdFIjkyFuw7Clfxct_-XYqS3WZu2Ddnn0gKmz2SsKB20g3N_FlyoKBQ Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8987df57b4c4c71a5070180fc86d794", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: eca571756cd648a8a8383195dc697b19 Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '25730973-2075-4c57-9400-42d968bea5c2'} Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:21.629965 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Returning 404 to user: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c29d4997-bfb8-4b80-829f-aeffee7ba490 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 404 len: 111 microversion: 2.1 time: 0.073014 Jul 20 11:24:21.634084 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2854/5681] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:24:21 2022] DELETE /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:24:21.642573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:21.643206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: 25730973-2075-4c57-9400-42d968bea5c2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:21.658814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:21.659444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:21.660947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:21.661689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:21.698343 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] HTTP exception thrown: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Request method failure captured: Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 HTTP/1.1 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-SURQblMd3z0zJq7luA_uAWfY1PYjwa-3jmmBuymfK5oIpVOoU5Nv_4HggHUxzZ8Z_X52UpMUTFMSHitlyrLoGhIdAKQhLeznODIri7eWFkPdw_C0f4wrAFNdFIjkyFuw7Clfxct_-XYqS3WZu2Ddnn0gKmz2SsKB20g3N_FlyoKBQ Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8987df57b4c4c71a5070180fc86d794", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: eca571756cd648a8a8383195dc697b19 Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '25730973-2075-4c57-9400-42d968bea5c2'} Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:21.703043 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. Jul 20 11:24:21.706819 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:21.708689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Returning 404 to user: Instance 25730973-2075-4c57-9400-42d968bea5c2 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:21.709843 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4d8ea792-57dc-4a95-9832-1a5626ca508d tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2" status: 404 len: 111 microversion: 2.1 time: 0.073122 Jul 20 11:24:21.714654 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2828/5682] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:21 2022] GET /compute/v2.1/servers/25730973-2075-4c57-9400-42d968bea5c2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:24:21.819532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:21.820541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:21.831570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:21.832370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:21.833528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:21.834212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:22.597323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-86d1eceb-7bcd-4b80-bf1f-267e632f1516 req-091cbaf8-5b7d-4566-98a2-864b6e337916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e53fa21-7922-4af9-8404-630d2d913639", "name": "network-vif-deleted", "tag": "5e939e4d-48c2-41f6-b286-fe4b2c3eb083"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:22.621353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-86d1eceb-7bcd-4b80-bf1f-267e632f1516 req-091cbaf8-5b7d-4566-98a2-864b6e337916 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:22.622915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-86d1eceb-7bcd-4b80-bf1f-267e632f1516 req-091cbaf8-5b7d-4566-98a2-864b6e337916 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:22.655565 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-86d1eceb-7bcd-4b80-bf1f-267e632f1516 req-091cbaf8-5b7d-4566-98a2-864b6e337916 service nova] Creating event network-vif-deleted:5e939e4d-48c2-41f6-b286-fe4b2c3eb083 for instance 7e53fa21-7922-4af9-8404-630d2d913639 on n-h2-846219-10 Jul 20 11:24:22.664149 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-86d1eceb-7bcd-4b80-bf1f-267e632f1516 req-091cbaf8-5b7d-4566-98a2-864b6e337916 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073159 Jul 20 11:24:22.665592 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2829/5683] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:24:22.694513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad42f205fc049c1953e19b05ed6714f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2facb9ee33f42fcb27d49c25921a546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:22.707124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec849699-79e2-4eb4-854e-1c11d650c6b6 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 200 len: 1507 microversion: 2.1 time: 0.896965 Jul 20 11:24:22.707863 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2855/5684] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:21 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 1507 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:23.729068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:23.729767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] [instance: 7e53fa21-7922-4af9-8404-630d2d913639] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:23.747691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:23.752565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:23.753120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:23.753576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:23.801157 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] HTTP exception thrown: Instance 7e53fa21-7922-4af9-8404-630d2d913639 could not be found. Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Request method failure captured: Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 HTTP/1.1 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-XGHpIno-GzkxP-wegd_E68Yy_Po8K5eq7v_NdMWNaiDIl6LIGWrSsKk4_vZTZoVykgvsE4t6dR2uSqa6RucQ2IkTYWAMbIBVPS0q-F4SCVKf5ACt4GveBqAlTdfQjNaEWUcNmT7Epnxqi6_aM3BI16dkEGhL4rNmeoVgvZJMQ0r7U Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b2facb9ee33f42fcb27d49c25921a546 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestServerAdvancedOps-1650481844 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b2facb9ee33f42fcb27d49c25921a546", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b2facb9ee33f42fcb27d49c25921a546"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b2facb9ee33f42fcb27d49c25921a546"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b2facb9ee33f42fcb27d49c25921a546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestServerAdvancedOps-1650481844 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b2facb9ee33f42fcb27d49c25921a546 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestServerAdvancedOps-1650481844 Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestServerAdvancedOps-1650481844-project Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 3ad42f205fc049c1953e19b05ed6714f Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestServerAdvancedOps-1650481844-project Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 7e53fa21-7922-4af9-8404-630d2d913639 could not be found. Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '7e53fa21-7922-4af9-8404-630d2d913639'} Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e53fa21-7922-4af9-8404-630d2d913639 could not be found. Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e53fa21-7922-4af9-8404-630d2d913639 could not be found. Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:23.803458 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e53fa21-7922-4af9-8404-630d2d913639 could not be found. Jul 20 11:24:23.807659 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:23.811472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] Returning 404 to user: Instance 7e53fa21-7922-4af9-8404-630d2d913639 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:23.813222 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-513f2c3f-310b-400d-b597-756c43baff25 tempest-TestServerAdvancedOps-1650481844 tempest-TestServerAdvancedOps-1650481844-project] 10.222.0.79 "GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639" status: 404 len: 111 microversion: 2.1 time: 0.090116 Jul 20 11:24:23.818823 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2830/5685] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:23 2022] GET /compute/v2.1/servers/7e53fa21-7922-4af9-8404-630d2d913639 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:24:27.364156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-644aef97-268e-4e4a-8b51-867b4af436cd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'create', calling method: .version_select at 0x7f2c3f85a160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-23343967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBE525Wsy25J2qTinP6zhFb/OkAvTjiWcotfVEV3dF2pO0rPU+Asj3hEoUuXbBTqbBbl+Z/9HNK3lG44tqdPA23joWFiawMPmaiIRXOn/ZadZeEGdN+MDdG+WuRG/ZPY4w=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:27.416587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-644aef97-268e-4e4a-8b51-867b4af436cd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:24:27.440187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-644aef97-268e-4e4a-8b51-867b4af436cd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for user aead2241878446ba9d8b60f9d47aa703 and project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:24:27.504046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-644aef97-268e-4e4a-8b51-867b4af436cd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.148356 Jul 20 11:24:27.505280 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2856/5686] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:24:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:27.623755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:27.625499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:27.643995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:27.644471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:27.646608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:27.647997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:27.758598 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-29de0a9c-38dc-4b56-80b5-a9843070b67d tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "POST /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69/action" status: 200 len: 24561 microversion: 2.1 time: 0.135797 Jul 20 11:24:27.759296 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2831/5687] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:24:27 2022] POST /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69/action => generated 24561 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:24:28.855118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:28.856398 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:28.874734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:28.875222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:28.876096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:28.883983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:28.943408 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] HTTP exception thrown: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Request method failure captured: Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 HTTP/1.1 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-SURQblMd3z0zJq7luA_uAWfY1PYjwa-3jmmBuymfK5oIpVOoU5Nv_4HggHUxzZ8Z_X52UpMUTFMSHitlyrLoGhIdAKQhLeznODIri7eWFkPdw_C0f4wrAFNdFIjkyFuw7Clfxct_-XYqS3WZu2Ddnn0gKmz2SsKB20g3N_FlyoKBQ Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8987df57b4c4c71a5070180fc86d794", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: eca571756cd648a8a8383195dc697b19 Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'c21382d6-2ea0-482b-b9d8-e49488ef0d35'} Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:28.949714 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:28.954331 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:28.980001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Returning 404 to user: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:28.986838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73ac5ff1-db88-414f-93ac-1e7d1dcfd071 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 404 len: 111 microversion: 2.1 time: 0.135767 Jul 20 11:24:28.988137 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2857/5688] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:24:28 2022] DELETE /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:24:28.997714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:28.998544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] [instance: c21382d6-2ea0-482b-b9d8-e49488ef0d35] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:29.047756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:29.049812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:29.062528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:29.079899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:29.142819 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] HTTP exception thrown: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Request method failure captured: Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 HTTP/1.1 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-SURQblMd3z0zJq7luA_uAWfY1PYjwa-3jmmBuymfK5oIpVOoU5Nv_4HggHUxzZ8Z_X52UpMUTFMSHitlyrLoGhIdAKQhLeznODIri7eWFkPdw_C0f4wrAFNdFIjkyFuw7Clfxct_-XYqS3WZu2Ddnn0gKmz2SsKB20g3N_FlyoKBQ Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8987df57b4c4c71a5070180fc86d794", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8987df57b4c4c71a5070180fc86d794"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: b8987df57b4c4c71a5070180fc86d794 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1452375003 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: eca571756cd648a8a8383195dc697b19 Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeTestJSON-1452375003-project Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'c21382d6-2ea0-482b-b9d8-e49488ef0d35'} Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:29.144570 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. Jul 20 11:24:29.148316 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:24:29.177847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] Returning 404 to user: Instance c21382d6-2ea0-482b-b9d8-e49488ef0d35 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:29.186034 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17e8d545-76ae-4488-a33f-1051bc57a865 tempest-AttachVolumeTestJSON-1452375003 tempest-AttachVolumeTestJSON-1452375003-project] 10.222.0.79 "GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35" status: 404 len: 111 microversion: 2.1 time: 0.191433 Jul 20 11:24:29.190846 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2832/5689] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:28 2022] GET /compute/v2.1/servers/c21382d6-2ea0-482b-b9d8-e49488ef0d35 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:24:30.169759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-454255651", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "e6f9a8ed-b252-4b7c-a05f-4d07841b4ad1"}], "key_name": "tempest-TestNetworkBasicOps-23343967", "security_groups": [{"name": "tempest-secgroup-smoke-662571607"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:30.191278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:30.376717 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] validate_networks() for [('e6f9a8ed-b252-4b7c-a05f-4d07841b4ad1', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:24:31.382446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:24:31.383720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:24:31.384611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:24:31.386435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:24:31.389411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:24:31.426574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:31.428954 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:31.432582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:31.433473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:31.509216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:24:31.527105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for user aead2241878446ba9d8b60f9d47aa703 and project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:24:31.550887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:24:31.554281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:24:31.664751 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c14a32ac-86a1-48bb-a655-e77e611ab8bb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.508781 Jul 20 11:24:31.671359 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2858/5690] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:24:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:24:31.689536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-32cbf141-b83d-4fab-9925-4651ced09853 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:31.690178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-32cbf141-b83d-4fab-9925-4651ced09853 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:31.694054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:31.833633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-32cbf141-b83d-4fab-9925-4651ced09853 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:31.842004 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-32cbf141-b83d-4fab-9925-4651ced09853 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1246 microversion: 2.1 time: 0.164687 Jul 20 11:24:31.846091 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2833/5691] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:31 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1246 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:32.867503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:32.868396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:32.886225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:32.886747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:32.887735 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:32.894584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:33.182670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:33.197054 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f79ed2fe-e832-45c0-b706-03f6b1e8f06a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1298 microversion: 2.1 time: 0.337155 Jul 20 11:24:33.209271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2859/5692] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:32 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1298 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:34.222697 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:34.226535 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:34.245644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:34.246110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:34.253274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:34.257493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:34.648558 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:34.659799 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98b479a1-c328-4f4c-8a66-56c1aae434c8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1304 microversion: 2.1 time: 0.447187 Jul 20 11:24:34.669809 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2834/5693] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:34 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1304 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:35.677742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:35.679224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:35.707561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:35.708275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:35.709124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:35.709577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:36.098604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:36.102393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:36.114550 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ab3c65b-911c-4305-9d09-7d539ed6acf4 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 0.440867 Jul 20 11:24:36.122854 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2860/5694] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:35 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:37.139635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:37.140318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:37.175457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:37.176538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:37.177411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:37.177870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:38.114311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a2f4b4a8-9ae0-47b1-b63f-382da5dd0e47 req-23c9b323-4e81-4fb4-a11a-1c875f81ac3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86ac1b8-3460-4a36-a019-2b136791a087", "tag": "8927abaa-c914-4bcf-a031-86430bbbf1fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:38.169461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a2f4b4a8-9ae0-47b1-b63f-382da5dd0e47 req-23c9b323-4e81-4fb4-a11a-1c875f81ac3f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:38.170803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a2f4b4a8-9ae0-47b1-b63f-382da5dd0e47 req-23c9b323-4e81-4fb4-a11a-1c875f81ac3f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:38.236391 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a2f4b4a8-9ae0-47b1-b63f-382da5dd0e47 req-23c9b323-4e81-4fb4-a11a-1c875f81ac3f service nova] Creating event network-changed:8927abaa-c914-4bcf-a031-86430bbbf1fa for instance b86ac1b8-3460-4a36-a019-2b136791a087 on n-h2-846219-10 Jul 20 11:24:38.257769 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a2f4b4a8-9ae0-47b1-b63f-382da5dd0e47 req-23c9b323-4e81-4fb4-a11a-1c875f81ac3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147613 Jul 20 11:24:38.265111 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2861/5695] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:38.284795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:38.300385 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0865b461-ce07-4ccf-a61a-ca11897131a1 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 1.165265 Jul 20 11:24:38.303652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2835/5696] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:37 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:39.326588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:39.327562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:39.343552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:39.351978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:39.353376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:39.354068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:40.359401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:40.378811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-611ea79b-bee4-4baa-816f-93a2831caa6d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 1.059584 Jul 20 11:24:40.379448 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2862/5697] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:39 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:41.353825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:41.355752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:41.370518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bc928a82-e5a6-447a-8a5d-0f866573d0c5 req-32b521cb-df63-46cd-bdb5-d3d7fda5c816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77b47e4-0d60-4e0d-839e-bcb4a2d5af69", "tag": "f539621b-508a-4840-8c50-f7354119754d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:41.375042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.376412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.380871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.383794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.395578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:41.406044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bc928a82-e5a6-447a-8a5d-0f866573d0c5 req-32b521cb-df63-46cd-bdb5-d3d7fda5c816 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.406493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bc928a82-e5a6-447a-8a5d-0f866573d0c5 req-32b521cb-df63-46cd-bdb5-d3d7fda5c816 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.427825 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bc928a82-e5a6-447a-8a5d-0f866573d0c5 req-32b521cb-df63-46cd-bdb5-d3d7fda5c816 service nova] Creating event network-changed:f539621b-508a-4840-8c50-f7354119754d for instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 on n-h2-846219-10 Jul 20 11:24:41.443620 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bc928a82-e5a6-447a-8a5d-0f866573d0c5 req-32b521cb-df63-46cd-bdb5-d3d7fda5c816 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076747 Jul 20 11:24:41.447621 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2863/5698] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:41.462455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:41.466081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:41.476761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:24:41.477352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:41.483096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.483096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.483784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.484255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.554726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:41.709025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-850b2b0c-d02f-4163-97d6-8a354d899bcd tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 204 len: 0 microversion: 2.1 time: 0.361389 Jul 20 11:24:41.709624 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2836/5699] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:24:41 2022] DELETE /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:24:41.720992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:41.721938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:41.740170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.740708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.741627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:41.742095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:41.841766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:24:42.034822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:42.051117 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea15d0a0-586f-46f4-89ae-e06db8490bb6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 0.601860 Jul 20 11:24:42.053153 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2864/5700] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:41 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:42.076301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:42.093977 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2158b3cb-6e00-43cd-a5e3-2414f51de6f0 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1688 microversion: 2.1 time: 0.376239 Jul 20 11:24:42.096194 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2837/5701] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:41 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1688 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:24:43.076794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:43.079312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:43.111991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:43.115327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:43.116320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:43.116791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:43.119241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:43.120448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:43.136120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:43.136957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:43.138274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:43.142454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:43.941146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:43.953358 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1c43565-6c2a-4026-bbaf-926e997b02ec tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1688 microversion: 2.1 time: 0.842794 Jul 20 11:24:43.954632 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2838/5702] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:43 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1688 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:43.966040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:43.972969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:43.982852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:43.983340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:43.984146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:43.984591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:44.174460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lazy-loading 'services' on Instance uuid 8e93b96c-e5c6-435b-95bd-e21d767d4a44 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:24:44.267010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:44.308533 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9fa2e827-aa76-4f93-aa67-ef5489617bc3 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44/os-volume_attachments/854537b8-13f6-410b-a0ae-ae2724d0c034" status: 202 len: 0 microversion: 2.1 time: 0.352420 Jul 20 11:24:44.311989 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4fce0e46-907e-4753-b18f-e68c1a8584c6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 1.242483 Jul 20 11:24:44.318757 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2839/5703] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:24:43 2022] DELETE /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44/os-volume_attachments/854537b8-13f6-410b-a0ae-ae2724d0c034 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:24:44.321723 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2865/5704] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:43 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:44.979812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:44.983334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:45.030210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:45.031700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:45.034649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:45.036860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:45.314606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73af3e843b3c4c1a8d933b29cfc20508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a593b39b87146aeaeb5f515181fd374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:45.350640 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cb3ae2bf-987a-4e09-bb53-b4fb72d14456 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 200 len: 1351 microversion: 2.1 time: 0.381042 Jul 20 11:24:45.351132 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2840/5705] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:44 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 1351 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:45.379547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:45.381362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:45.405130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:45.407432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:45.411938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:45.418264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:45.762367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4d94053f-466d-4979-8877-9ab61fd60ae1 req-80d1d8a6-7c4a-4825-a8cd-91af1e4c51bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77b47e4-0d60-4e0d-839e-bcb4a2d5af69", "name": "network-vif-deleted", "tag": "f539621b-508a-4840-8c50-f7354119754d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:45.806128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4d94053f-466d-4979-8877-9ab61fd60ae1 req-80d1d8a6-7c4a-4825-a8cd-91af1e4c51bc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:45.806971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4d94053f-466d-4979-8877-9ab61fd60ae1 req-80d1d8a6-7c4a-4825-a8cd-91af1e4c51bc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:45.851045 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4d94053f-466d-4979-8877-9ab61fd60ae1 req-80d1d8a6-7c4a-4825-a8cd-91af1e4c51bc service nova] Creating event network-vif-deleted:f539621b-508a-4840-8c50-f7354119754d for instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 on n-h2-846219-10 Jul 20 11:24:45.868878 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4d94053f-466d-4979-8877-9ab61fd60ae1 req-80d1d8a6-7c4a-4825-a8cd-91af1e4c51bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.807455 Jul 20 11:24:45.871120 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2866/5706] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:46.035736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:46.066109 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a9e440d9-0b5e-4dc2-bcf4-0444111cfd2a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 0.708517 Jul 20 11:24:46.066706 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2841/5707] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:45 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:46.368851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:46.372235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] [instance: f77b47e4-0d60-4e0d-839e-bcb4a2d5af69] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:46.392138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:46.394244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:46.396813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:46.398260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:46.437038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] HTTP exception thrown: Instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 could not be found. Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Request method failure captured: Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 HTTP/1.1 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-NsHgD1X9xCH8UswZQ8XuqtrhrxB-IRut7fm28RDiSMw1Pzd_sQ25idIpkeMBx8-UzBC0PftqhOFe4sVzXqymorzT0o6MkFlvC4cYzqx2lJYHP4RNbE-KBjwfr_Y-bgrkHdhfqgDjhndhBbUQm8CCziWKwDog3STtrzu-O8-1UpCHw Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8a593b39b87146aeaeb5f515181fd374", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8a593b39b87146aeaeb5f515181fd374"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8a593b39b87146aeaeb5f515181fd374 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-386194430 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 73af3e843b3c4c1a8d933b29cfc20508 Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestNetworkAdvancedServerOps-386194430-project Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 could not be found. Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f77b47e4-0d60-4e0d-839e-bcb4a2d5af69'} Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 could not be found. Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 could not be found. Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:24:46.445760 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 could not be found. Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Returning 404 to user: Instance f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a2b7b8a7-678c-42b4-8cf2-5168945f4bf4 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69" status: 404 len: 111 microversion: 2.1 time: 0.084214 Jul 20 11:24:46.449806 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2867/5708] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:46 2022] GET /compute/v2.1/servers/f77b47e4-0d60-4e0d-839e-bcb4a2d5af69 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:24:47.083933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:47.084561 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:47.101606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:47.103278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:47.110593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:47.114570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:47.547397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:47.564958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cc9bc780-e5fe-4821-af82-84f35b40bc11 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 0.485557 Jul 20 11:24:47.565562 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2842/5709] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:47 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:48.526815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-52b7282f-51fc-4e8e-a7ac-614656880b66 req-05d98da6-1a15-4406-8732-70d67ccfec16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86ac1b8-3460-4a36-a019-2b136791a087", "name": "network-vif-plugged", "status": "completed", "tag": "8927abaa-c914-4bcf-a031-86430bbbf1fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:48.542367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-52b7282f-51fc-4e8e-a7ac-614656880b66 req-05d98da6-1a15-4406-8732-70d67ccfec16 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:48.551006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-52b7282f-51fc-4e8e-a7ac-614656880b66 req-05d98da6-1a15-4406-8732-70d67ccfec16 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:48.567601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-52b7282f-51fc-4e8e-a7ac-614656880b66 req-05d98da6-1a15-4406-8732-70d67ccfec16 service nova] Creating event network-vif-plugged:8927abaa-c914-4bcf-a031-86430bbbf1fa for instance b86ac1b8-3460-4a36-a019-2b136791a087 on n-h2-846219-10 Jul 20 11:24:48.574399 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-52b7282f-51fc-4e8e-a7ac-614656880b66 req-05d98da6-1a15-4406-8732-70d67ccfec16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051966 Jul 20 11:24:48.586426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:48.588084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:48.612066 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2868/5710] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:48.635223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:48.635679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:48.636647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:48.638714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:49.561277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:49.585297 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ce8127a4-a583-4970-9b5e-ae63ddc2c6a2 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 1.005574 Jul 20 11:24:49.592197 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2843/5711] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:48 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:50.610363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:50.611079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:50.625802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:50.626265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:50.627281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:50.637442 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:51.656774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:51.667331 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d0fae782-9dd5-4486-a2ea-d4a32bf8a84b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1371 microversion: 2.1 time: 1.061965 Jul 20 11:24:51.674948 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2869/5712] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:50 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1371 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:52.345386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6bc3a3cc-706a-4bfe-a926-12825d4928aa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: .version_select at 0x7f2c3f1c4310>, body: {"keypair": {"name": "tempest-keypair-113850532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD2RmKZFS5bwtjKccO+QZJq1zqhwCcNdMgg9AhqQ+YHxaCY6TBCRWqB5q6Dp9OMB4fnkswmO+EyizUhcYjma2VcCFQ3Cqebfh/OjonDtVI1yPO2oOH39yDSVwB6+mJ2cQ=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:52.381112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6bc3a3cc-706a-4bfe-a926-12825d4928aa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:24:52.398507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-6bc3a3cc-706a-4bfe-a926-12825d4928aa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:24:52.444542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6bc3a3cc-706a-4bfe-a926-12825d4928aa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.361190 Jul 20 11:24:52.449845 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2844/5713] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:24:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:52.691697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:52.693167 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:52.714983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:52.716354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:52.717544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:52.718481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:53.188026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:53.209477 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-732d270c-e93a-4288-ac48-633b446983a6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1543 microversion: 2.1 time: 0.520060 Jul 20 11:24:53.214516 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2870/5714] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:52 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1543 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:53.237235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:53.237994 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:53.257945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:53.260190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:53.261198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:53.271618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:54.075754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:54.088842 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4540ec1-7e39-4de0-9922-51080ea66773 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1543 microversion: 2.1 time: 0.857705 Jul 20 11:24:54.089774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2845/5715] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:53 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1543 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:56.079632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:56.080262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:56.092805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:56.093532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:56.094325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:56.094773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:56.209062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:24:56.434811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3561ff0-5c34-44c1-a4ab-7535e93e6593 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 204 len: 0 microversion: 2.1 time: 0.357966 Jul 20 11:24:56.436639 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2871/5716] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:24:56 2022] DELETE /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:24:56.445939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:56.447682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:56.474455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:56.477011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:56.478177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:56.480000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:56.772438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:56.787373 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4581db0-1902-47c8-8f87-8b93301beee0 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1514 microversion: 2.1 time: 0.346067 Jul 20 11:24:56.788376 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2846/5717] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:56 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:57.816407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:57.817197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:57.830977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:57.834418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:57.835419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:57.835986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:58.303477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:24:58.324369 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-07cc3971-8bcb-4c8f-83c5-4d5238d9fe5d tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1514 microversion: 2.1 time: 0.522049 Jul 20 11:24:58.330040 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2872/5718] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:57 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:24:59.346559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:59.347902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:24:59.388401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:59.391691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:59.395777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:24:59.403255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-db501d46-4cb6-4f1a-b1b1-b36b1e6fc4f4 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Action: 'create', calling method: .version_select at 0x7f2c3e4109d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1114380328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcRQrX35U7hSjSxvfuJIvAwCSvrRbWTmW6QUSmPXyQORrrrwIHYDKcQq21T1sVW2f1c1nM7HXBWVgLRh5nCh3AL5uFNs78s/TT16lJC0QoTjfuuQ0BawCRLmCxTXQ9mgw=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:24:59.413833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:24:59.460934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-db501d46-4cb6-4f1a-b1b1-b36b1e6fc4f4 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Getting quotas for project c2b2a455123b47ea82cad5242e9bfd2b. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:24:59.484623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-db501d46-4cb6-4f1a-b1b1-b36b1e6fc4f4 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Getting quotas for user 110886d1a5094ec4a4be4224bf8f0163 and project c2b2a455123b47ea82cad5242e9bfd2b. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:24:59.562402 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-db501d46-4cb6-4f1a-b1b1-b36b1e6fc4f4 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.600617 Jul 20 11:24:59.563296 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2847/5719] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:24:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:24:59.675636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f01ce4b-a5b0-437e-9066-59f7a1138693 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] Calling method '.version_select at 0x7f2c3f205d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:24:59.722273 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f01ce4b-a5b0-437e-9066-59f7a1138693 tempest-TestNetworkAdvancedServerOps-386194430 tempest-TestNetworkAdvancedServerOps-386194430-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1973213884" status: 202 len: 0 microversion: 2.1 time: 0.053046 Jul 20 11:24:59.722690 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2848/5720] 10.222.0.79 () {58 vars in 1283 bytes} [Wed Jul 20 11:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1973213884 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:25:00.026759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '843d4fba750b4685bc973b5c3be9a5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce4ed319abae49b6b567a52f92734360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:00.037361 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31b46bc3-25aa-4cc0-8ff6-ecbb5c3d5690 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 200 len: 1514 microversion: 2.1 time: 0.695874 Jul 20 11:25:00.044395 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2873/5721] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:24:59 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 1514 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:00.203919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-481847d8-4f38-4763-9e89-5dbd53fcc3d6 req-fe15e285-4b4b-4b5b-bdb2-dd17679236f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e93b96c-e5c6-435b-95bd-e21d767d4a44", "name": "network-vif-deleted", "tag": "471c420a-0fd2-4e6a-b3a1-e11933bc2c96"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:00.242260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-481847d8-4f38-4763-9e89-5dbd53fcc3d6 req-fe15e285-4b4b-4b5b-bdb2-dd17679236f0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:00.243850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-481847d8-4f38-4763-9e89-5dbd53fcc3d6 req-fe15e285-4b4b-4b5b-bdb2-dd17679236f0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:00.304504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-481847d8-4f38-4763-9e89-5dbd53fcc3d6 req-fe15e285-4b4b-4b5b-bdb2-dd17679236f0 service nova] Creating event network-vif-deleted:471c420a-0fd2-4e6a-b3a1-e11933bc2c96 for instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 on n-h2-846219-10 Jul 20 11:25:00.320246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-481847d8-4f38-4763-9e89-5dbd53fcc3d6 req-fe15e285-4b4b-4b5b-bdb2-dd17679236f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120344 Jul 20 11:25:00.321123 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2849/5722] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:01.060152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:01.061417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] [instance: 8e93b96c-e5c6-435b-95bd-e21d767d4a44] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:01.071265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:01.081455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:01.082528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:01.084385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:01.091557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:01.135966 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] HTTP exception thrown: Instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 could not be found. Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Request method failure captured: Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 HTTP/1.1 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-UCDqKoZDFoPYre5MVLcEb1QrmwAAfNI6blz-jGgG7Lb8fhuL4MCDjYN4oksAMjZukfNZng2qwgZRE0XmwKg2MYKLQe36jsIAXhE4laWXCgzUcDH5PmJ41SQX20liUUXdueKZ__oVP_qRMd6hv0pBzXDI06rv3M8r1V-lYpwl1MT5A Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: ce4ed319abae49b6b567a52f92734360 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2097439866 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ce4ed319abae49b6b567a52f92734360", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ce4ed319abae49b6b567a52f92734360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ce4ed319abae49b6b567a52f92734360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ce4ed319abae49b6b567a52f92734360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-VolumesSnapshotTestJSON-2097439866 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: ce4ed319abae49b6b567a52f92734360 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2097439866 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-VolumesSnapshotTestJSON-2097439866-project Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 843d4fba750b4685bc973b5c3be9a5c3 Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-VolumesSnapshotTestJSON-2097439866-project Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 could not be found. Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '8e93b96c-e5c6-435b-95bd-e21d767d4a44'} Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 could not be found. Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 could not be found. Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:25:01.145044 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 could not be found. Jul 20 11:25:01.148803 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:25:01.154919 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] Returning 404 to user: Instance 8e93b96c-e5c6-435b-95bd-e21d767d4a44 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:25:01.161687 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a3335d0-c0c1-44f7-bb65-02979a1de984 tempest-VolumesSnapshotTestJSON-2097439866 tempest-VolumesSnapshotTestJSON-2097439866-project] 10.222.0.79 "GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44" status: 404 len: 111 microversion: 2.1 time: 0.102034 Jul 20 11:25:01.163462 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2874/5723] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:01 2022] GET /compute/v2.1/servers/8e93b96c-e5c6-435b-95bd-e21d767d4a44 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:25:01.985463 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-457750679", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9ddebef-2263-4847-bf1c-8851149dd003"}], "security_groups": [{"name": "tempest-securitygroup--140628575"}], "key_name": "tempest-keypair-113850532", "user_data": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:02.007089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:02.354681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] validate_networks() for [('b9ddebef-2263-4847-bf1c-8851149dd003', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:25:02.479102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1122696d-6a59-402d-81b5-e9e69c0554fe req-43a10138-cfd1-456a-855d-0b913e2d0b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86ac1b8-3460-4a36-a019-2b136791a087", "tag": "8927abaa-c914-4bcf-a031-86430bbbf1fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:02.499467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1122696d-6a59-402d-81b5-e9e69c0554fe req-43a10138-cfd1-456a-855d-0b913e2d0b81 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:02.499916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1122696d-6a59-402d-81b5-e9e69c0554fe req-43a10138-cfd1-456a-855d-0b913e2d0b81 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:02.531953 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1122696d-6a59-402d-81b5-e9e69c0554fe req-43a10138-cfd1-456a-855d-0b913e2d0b81 service nova] Creating event network-changed:8927abaa-c914-4bcf-a031-86430bbbf1fa for instance b86ac1b8-3460-4a36-a019-2b136791a087 on n-h2-846219-10 Jul 20 11:25:02.545403 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1122696d-6a59-402d-81b5-e9e69c0554fe req-43a10138-cfd1-456a-855d-0b913e2d0b81 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069905 Jul 20 11:25:02.546378 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2875/5724] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:25:04.235239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-680437006", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1114380328", "security_groups": [{"name": "tempest-secgroup-smoke-479871834"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "722870f9-baf7-4593-83c6-dc85d60f4899"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:04.556897 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] validate_networks() for [('722870f9-baf7-4593-83c6-dc85d60f4899', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:25:04.719411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:25:04.720590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:25:04.721226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:25:04.721790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:25:04.722970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:25:04.742000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:04.743228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:04.744208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:04.745129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:04.770566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:04.777370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:04.810693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:25:04.819120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:25:04.901267 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3080160a-bf2f-45a8-92f8-3e3a052c54da tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.923096 Jul 20 11:25:04.903444 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2850/5725] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:25:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:25:04.913687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bd414e62-e1ba-4941-bc0e-c70de4fb8bb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:04.914750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bd414e62-e1ba-4941-bc0e-c70de4fb8bb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:05.096261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bd414e62-e1ba-4941-bc0e-c70de4fb8bb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:05.111091 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bd414e62-e1ba-4941-bc0e-c70de4fb8bb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1240 microversion: 2.1 time: 0.202091 Jul 20 11:25:05.121725 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2851/5726] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:04 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1240 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:05.564168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Getting quotas for project c2b2a455123b47ea82cad5242e9bfd2b. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:05.579419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Getting quotas for user 110886d1a5094ec4a4be4224bf8f0163 and project c2b2a455123b47ea82cad5242e9bfd2b. Resources: dict_keys(['metadata_items']) {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:05.624011 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:25:05.626663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:25:05.627340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:25:05.628903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:25:05.630808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:25:05.656943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:05.657492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:05.658498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:05.659119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:05.681826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Getting quotas for project c2b2a455123b47ea82cad5242e9bfd2b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:05.689939 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Getting quotas for user 110886d1a5094ec4a4be4224bf8f0163 and project c2b2a455123b47ea82cad5242e9bfd2b. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:05.708617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:25:05.711482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:25:05.824718 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0cb35b41-d6ff-4d70-bb74-3b53f7d50ecb tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.596946 Jul 20 11:25:05.831415 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2876/5727] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:25:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:25:05.837202 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f22b1c9-6361-44bd-9269-d1e83b25fe89 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:05.838085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f22b1c9-6361-44bd-9269-d1e83b25fe89 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:05.963852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f22b1c9-6361-44bd-9269-d1e83b25fe89 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:05.971543 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f22b1c9-6361-44bd-9269-d1e83b25fe89 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1302 microversion: 2.1 time: 0.138582 Jul 20 11:25:05.974486 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2852/5728] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:05 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1302 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:25:06.130587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:06.131468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:06.172210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:06.176623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:06.177540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:06.178001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:06.338019 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:06.373048 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5230d95-8c91-41bd-8175-d2d2c9e80171 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1292 microversion: 2.1 time: 0.244110 Jul 20 11:25:06.377822 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2877/5729] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:06 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1292 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:06.991487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:06.992584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:07.029685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:07.031461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:07.037180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:07.040559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:07.409199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:07.410466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:07.430145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:07.430678 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:07.431545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:07.431999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:07.871255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:07.880798 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c1774a93-ac4a-4401-bdf6-22a88e442ad1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1298 microversion: 2.1 time: 0.482211 Jul 20 11:25:07.881231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:07.892650 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2878/5730] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:07 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1298 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:07.898502 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2774d197-3a59-49b4-a4b8-a05755176c5e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1306 microversion: 2.1 time: 0.911081 Jul 20 11:25:07.900470 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2853/5731] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:06 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1306 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:08.899070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:08.900365 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:08.909402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:08.919801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:08.921233 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:08.941818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:08.942633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:08.943257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:08.945811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:08.946889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:08.947449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:08.947963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:09.134112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:09.146734 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbdd3530-ab4d-4145-b8cb-b892967e39f8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1360 microversion: 2.1 time: 0.232956 Jul 20 11:25:09.148517 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2854/5732] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:08 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1360 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:25:09.177794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:09.200240 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6be47044-5ab6-4867-8119-1ed4522a53f8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1298 microversion: 2.1 time: 0.305654 Jul 20 11:25:09.219903 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2879/5733] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:08 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1298 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:10.179470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:10.180896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:10.191831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:10.192442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:10.193682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:10.194591 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:10.226729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:10.227598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:10.239383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:10.247382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:10.250547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:10.251598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:10.267848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:10.721186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:10.729202 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cb3c90c3-af87-4993-ae5e-2e497b7991af tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.506314 Jul 20 11:25:10.748304 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2880/5734] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:10 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:10.779937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:10.799552 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-27674b23-4160-4dfb-8a96-ae0384f0ebe2 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.631642 Jul 20 11:25:10.819523 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2855/5735] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:10 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:11.766468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:11.767214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:11.787037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:11.787634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:11.788519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:11.789191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:11.826653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:11.827408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:11.850571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:11.854150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:11.862931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:11.863758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:11.882612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:12.626844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:12.635291 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b6cca5b-b742-4784-a915-32d0b0fdaa70 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.873110 Jul 20 11:25:12.639707 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2881/5736] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:11 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:12.647468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-54ede1ca-deb4-4c0e-811f-45ded66a098c req-5206a803-b55b-46fa-8a5e-4969701e745f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993c9382-4ad5-41bb-a002-cde1f9203531", "tag": "6d7ace99-4fb5-44b1-b58c-cea56b7930df"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:12.678753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-54ede1ca-deb4-4c0e-811f-45ded66a098c req-5206a803-b55b-46fa-8a5e-4969701e745f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:12.679447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-54ede1ca-deb4-4c0e-811f-45ded66a098c req-5206a803-b55b-46fa-8a5e-4969701e745f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:12.709647 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-54ede1ca-deb4-4c0e-811f-45ded66a098c req-5206a803-b55b-46fa-8a5e-4969701e745f service nova] Creating event network-changed:6d7ace99-4fb5-44b1-b58c-cea56b7930df for instance 993c9382-4ad5-41bb-a002-cde1f9203531 on n-h2-846219-10 Jul 20 11:25:12.723150 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-54ede1ca-deb4-4c0e-811f-45ded66a098c req-5206a803-b55b-46fa-8a5e-4969701e745f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081953 Jul 20 11:25:12.729831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2882/5737] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:12.750258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:12.759427 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f80d0c03-eebe-4b36-9d85-a918af882582 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.937199 Jul 20 11:25:12.772015 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2856/5738] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:11 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:25:13.659510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:13.660241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:13.683280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:13.683807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:13.688057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:13.688837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:13.792687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:13.793857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:13.811438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:13.812213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:13.816326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:13.817002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:14.439199 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:14.450888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:14.462018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6e6e44c4-8ccf-44fd-a5b8-92c7263e6045 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.676373 Jul 20 11:25:14.463055 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b25a19c6-e779-4235-bf20-c7091c849deb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.809720 Jul 20 11:25:14.463864 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2883/5739] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:13 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:14.469339 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2857/5740] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:13 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:25:14.754116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b3fbe07f-d4c5-47f3-be77-84d85d353e82 req-17636a44-fe46-4e80-a3c9-298f465e47b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a9ebbe-9876-4618-84bb-97d838139530", "tag": "8943cd7b-a360-401e-acfd-da389b056e1d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:14.771408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b3fbe07f-d4c5-47f3-be77-84d85d353e82 req-17636a44-fe46-4e80-a3c9-298f465e47b3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:14.772180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b3fbe07f-d4c5-47f3-be77-84d85d353e82 req-17636a44-fe46-4e80-a3c9-298f465e47b3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:14.804942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b3fbe07f-d4c5-47f3-be77-84d85d353e82 req-17636a44-fe46-4e80-a3c9-298f465e47b3 service nova] Creating event network-changed:8943cd7b-a360-401e-acfd-da389b056e1d for instance f5a9ebbe-9876-4618-84bb-97d838139530 on n-h2-846219-10 Jul 20 11:25:14.812244 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b3fbe07f-d4c5-47f3-be77-84d85d353e82 req-17636a44-fe46-4e80-a3c9-298f465e47b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063278 Jul 20 11:25:14.814669 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2884/5741] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:15.486108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:15.489649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:15.492007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:15.494032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:15.494882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:15.509420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:15.509420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:15.509420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:15.509420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:15.511531 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:15.515939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:15.517329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:15.518136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:15.672762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:15.699934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:15.835108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:15.846431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bafc899f-8d20-40e3-a984-98b22ae02e88 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.368678 Jul 20 11:25:15.858370 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2858/5742] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:15 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:15.888301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:15.900916 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d5764218-0593-4503-9136-b3adbf013799 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.411125 Jul 20 11:25:15.902920 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2885/5743] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:15 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:16.861773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=18 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:16.867120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:16.867681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:16.883280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:16.883280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:16.889000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:16.889467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:16.921505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:16.922656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:16.945689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:16.947566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:16.948347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:16.948917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:17.427673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:17.439545 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f9dd5e7f-1c96-459b-819e-74d77b8fb15d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.578507 Jul 20 11:25:17.440147 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2859/5744] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:16 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:17.531853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:17.533118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:17.545723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:17.548032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:17.550404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:17.551049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:17.650775 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f6713ddb-0be0-42a1-ab1a-2b93dd8b4a50 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087/action" status: 200 len: 24575 microversion: 2.1 time: 0.125061 Jul 20 11:25:17.652290 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2860/5745] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:25:17 2022] POST /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087/action => generated 24575 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 11:25:18.018544 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:18.032187 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b686bdc2-b0b2-40c6-a525-3461360d6c7c tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 1.116075 Jul 20 11:25:18.044660 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2886/5746] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:16 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:18.460050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:18.461718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:18.489320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:18.492770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:18.494003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:18.497341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:19.065745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:19.066436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:19.132037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:19.139754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:19.154021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:19.154602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:19.347751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:19.359016 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2838fd93-e121-4fbe-b15e-d2f825faf228 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.905312 Jul 20 11:25:19.368966 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2861/5747] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:18 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:19.376799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4bfe3ec5-cb1e-4cb7-9a48-a62e437dabdb req-4397fb55-6eac-48ab-8aaf-d7766056caed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993c9382-4ad5-41bb-a002-cde1f9203531", "name": "network-vif-plugged", "status": "completed", "tag": "6d7ace99-4fb5-44b1-b58c-cea56b7930df"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:19.393859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4bfe3ec5-cb1e-4cb7-9a48-a62e437dabdb req-4397fb55-6eac-48ab-8aaf-d7766056caed service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:19.394602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4bfe3ec5-cb1e-4cb7-9a48-a62e437dabdb req-4397fb55-6eac-48ab-8aaf-d7766056caed service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:19.409562 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4bfe3ec5-cb1e-4cb7-9a48-a62e437dabdb req-4397fb55-6eac-48ab-8aaf-d7766056caed service nova] Creating event network-vif-plugged:6d7ace99-4fb5-44b1-b58c-cea56b7930df for instance 993c9382-4ad5-41bb-a002-cde1f9203531 on n-h2-846219-10 Jul 20 11:25:19.418279 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4bfe3ec5-cb1e-4cb7-9a48-a62e437dabdb req-4397fb55-6eac-48ab-8aaf-d7766056caed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046933 Jul 20 11:25:19.420688 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2862/5748] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:19.834874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:19.848605 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0d350ae5-5438-4996-90b2-b7e1f33014ad tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.800320 Jul 20 11:25:19.858989 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2887/5749] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:19 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:20.382794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:20.399621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:20.432196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:20.435777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:20.445939 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:20.462623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:20.821102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:20.836651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-abc2971b-6275-4ded-9ef6-7ffd96a3367b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1365 microversion: 2.1 time: 0.462225 Jul 20 11:25:20.837959 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2863/5750] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:20 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:20.873095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:20.873095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:20.883836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:20.884916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:20.885907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:20.887353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:21.361394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:21.390282 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2d79074a-0d78-4da6-a03e-25f92dcb8d4d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.527999 Jul 20 11:25:21.391538 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2888/5751] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:20 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:21.861950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:21.862602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:21.883624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:21.884077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:21.890854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:21.891353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:22.210397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:22.222602 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b88b48a6-4bca-4983-9f72-11621e59defa tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1555 microversion: 2.1 time: 0.364361 Jul 20 11:25:22.223729 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2864/5752] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:21 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:22.242796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:22.244587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:22.261201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:22.261813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:22.262718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:22.263295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:22.412599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:22.413704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:22.421465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:22.422169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:22.423187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:22.426245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:22.445011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-82ae6e6b-f74b-4e72-9030-bb88ac954ced tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206784 Jul 20 11:25:22.447052 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2889/5753] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:25:22 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:22.967113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:22.975951 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d62abd32-e3e7-4de7-bd8f-714167e2200a tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.570585 Jul 20 11:25:22.982017 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2865/5754] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:22 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:24.001177 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:24.002408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:24.024068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:24.024911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:24.025879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:24.026469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:24.517430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9b45ab36-85dc-4a72-bfb2-232aa41e02f2 req-747fa44c-e38c-47e8-a8da-aa560ac6b36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a9ebbe-9876-4618-84bb-97d838139530", "name": "network-vif-plugged", "status": "completed", "tag": "8943cd7b-a360-401e-acfd-da389b056e1d"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:24.535633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9b45ab36-85dc-4a72-bfb2-232aa41e02f2 req-747fa44c-e38c-47e8-a8da-aa560ac6b36a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:24.536534 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9b45ab36-85dc-4a72-bfb2-232aa41e02f2 req-747fa44c-e38c-47e8-a8da-aa560ac6b36a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:24.560937 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9b45ab36-85dc-4a72-bfb2-232aa41e02f2 req-747fa44c-e38c-47e8-a8da-aa560ac6b36a service nova] Creating event network-vif-plugged:8943cd7b-a360-401e-acfd-da389b056e1d for instance f5a9ebbe-9876-4618-84bb-97d838139530 on n-h2-846219-10 Jul 20 11:25:24.572551 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9b45ab36-85dc-4a72-bfb2-232aa41e02f2 req-747fa44c-e38c-47e8-a8da-aa560ac6b36a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059241 Jul 20 11:25:24.575467 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2866/5755] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:25:24.669951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:24.682575 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03aca84e-c7ab-4ae5-ae81-d214a01fe161 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.684585 Jul 20 11:25:24.690782 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2890/5756] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:23 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:25.103879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-ab142dc3-424d-4a80-8e3f-bac48b35379b req-70eb9a41-033a-4a0c-bb3e-fdd055c7d51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "993c9382-4ad5-41bb-a002-cde1f9203531", "tag": "6d7ace99-4fb5-44b1-b58c-cea56b7930df"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:25.128482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ab142dc3-424d-4a80-8e3f-bac48b35379b req-70eb9a41-033a-4a0c-bb3e-fdd055c7d51d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:25.132499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-ab142dc3-424d-4a80-8e3f-bac48b35379b req-70eb9a41-033a-4a0c-bb3e-fdd055c7d51d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:25.193793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-ab142dc3-424d-4a80-8e3f-bac48b35379b req-70eb9a41-033a-4a0c-bb3e-fdd055c7d51d service nova] Creating event network-changed:6d7ace99-4fb5-44b1-b58c-cea56b7930df for instance 993c9382-4ad5-41bb-a002-cde1f9203531 on n-h2-846219-10 Jul 20 11:25:25.236690 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-ab142dc3-424d-4a80-8e3f-bac48b35379b req-70eb9a41-033a-4a0c-bb3e-fdd055c7d51d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128910 Jul 20 11:25:25.243385 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2867/5757] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:25.710366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:25.710991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:25.722927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:25.723430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:25.724210 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:25.724647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:26.437946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:26.450581 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-820b2059-2a61-44d6-9801-9f84ab832f45 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1427 microversion: 2.1 time: 0.744212 Jul 20 11:25:26.459801 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2891/5758] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:25 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1427 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:27.421280 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d3b40f45-d6a6-4897-aa53-5a8dc1096e94 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:27.422841 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:25:27.422841 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:25:27.424781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b40f45-d6a6-4897-aa53-5a8dc1096e94 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:27.425468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b40f45-d6a6-4897-aa53-5a8dc1096e94 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:27.426616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b40f45-d6a6-4897-aa53-5a8dc1096e94 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:27.427344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3b40f45-d6a6-4897-aa53-5a8dc1096e94 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:27.473251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:27.473875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:27.521554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:27.522028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:27.522839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:27.525784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:27.539544 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d3b40f45-d6a6-4897-aa53-5a8dc1096e94 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.527805 Jul 20 11:25:27.540848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2868/5759] 10.222.0.79 () {58 vars in 1184 bytes} [Wed Jul 20 11:25:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:27.841759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-973197721", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "availability_zone": "nova:n-h2-846219-10", "networks": [{"uuid": "5ef6f07f-c047-4198-ac06-47093726fbdb"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:27.966303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] validate_networks() for [('5ef6f07f-c047-4198-ac06-47093726fbdb', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:25:28.139220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:28.162434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c661d11a-2a9d-4ac3-9c0b-fc41ea59595d tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1607 microversion: 2.1 time: 0.692969 Jul 20 11:25:28.175497 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2892/5760] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:27 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1607 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:28.193147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:28.193802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:28.201224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:28.201971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:28.203023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:28.203749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:28.578874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:28.609008 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7331ab2-cd87-47ef-9c5b-da3b0447d387 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1607 microversion: 2.1 time: 0.431934 Jul 20 11:25:28.622334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2893/5761] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:28 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1607 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:28.632890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:28.634499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:28.656118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:28.656892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:28.657884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:28.660259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:29.368074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:25:29.368685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:25:29.368948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:25:29.369359 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:25:29.369771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:25:29.392494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:29.401235 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-57678570-aa10-45f9-b681-2839ca2ebdfd tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1607 microversion: 2.1 time: 0.777700 Jul 20 11:25:29.402617 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2894/5762] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:28 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1607 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:29.414217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:29.414690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:29.422310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:29.422905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:29.497013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Getting quotas for project 269fc102bf1442beace7010e16dcd400. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:29.511309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Getting quotas for user f5a3c6d7ba0244f3b004da000c92a685 and project 269fc102bf1442beace7010e16dcd400. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:29.554708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:25:29.562142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:25:29.692607 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-479be76c-be0c-4aa6-9339-fc6b62017480 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858442 Jul 20 11:25:29.697199 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2869/5763] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:25:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:25:29.708751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3233d172-7be6-49f4-894f-7ce54f688506 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:29.710141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3233d172-7be6-49f4-894f-7ce54f688506 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:29.809179 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3233d172-7be6-49f4-894f-7ce54f688506 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1328 microversion: 2.1 time: 0.105041 Jul 20 11:25:29.811384 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2895/5764] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:29 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:30.827592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:30.828211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:30.855678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:30.856132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:30.856985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:30.857363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:31.140213 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-080f5447-3969-4f3d-8334-37ecad95988f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1345 microversion: 2.1 time: 0.318055 Jul 20 11:25:31.160968 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2870/5765] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:30 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1345 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:32.164089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:32.165777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:32.179770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:32.188221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:32.189317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:32.189911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:32.401069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fed523bf-f5c0-48c5-95c7-70ff2418b8e4 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1423 microversion: 2.1 time: 0.235750 Jul 20 11:25:32.411597 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2896/5766] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:32 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1423 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:33.418812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:33.419439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:33.422448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:33.440072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:33.444333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:33.445458 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:33.446076 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:33.633163 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad6d53c3-7fcf-442f-abe7-532323494cb3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1423 microversion: 2.1 time: 0.218629 Jul 20 11:25:33.647575 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2871/5767] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:33 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1423 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:33.695444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e89b2bab-cedc-41a1-a11e-f8a5e05979e6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'create', calling method: .version_select at 0x7f2c3e980550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1021083835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWRmK4UD4XZgDmIlmvLclv6Ubp41L0saNtgkqzHdOI/XiHKaX0Rmim1GrXkF4vMof2I0GCXRuy6yBTX+z0YvqOebYngGmLTeOBSlyjx6JxMxUxYGHV07n+C1R0SlcLXTA=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:33.712598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:33.726653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-e89b2bab-cedc-41a1-a11e-f8a5e05979e6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:33.744541 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-e89b2bab-cedc-41a1-a11e-f8a5e05979e6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for user aead2241878446ba9d8b60f9d47aa703 and project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:33.797967 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e89b2bab-cedc-41a1-a11e-f8a5e05979e6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.105870 Jul 20 11:25:33.811778 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2897/5768] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:25:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:34.657103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:34.657507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:34.674820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:34.676559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:34.681622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:34.682454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:35.094612 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9fc42286-a4b5-414c-9887-bd4129643645 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.441643 Jul 20 11:25:35.113473 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2872/5769] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:34 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:35.944327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-0838c29a-43b7-4733-895b-f71a06da3756 req-fb2ccb18-2569-481f-b3d2-c03bc907d427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a9ebbe-9876-4618-84bb-97d838139530", "tag": "8943cd7b-a360-401e-acfd-da389b056e1d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:35.976025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0838c29a-43b7-4733-895b-f71a06da3756 req-fb2ccb18-2569-481f-b3d2-c03bc907d427 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:35.977388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-0838c29a-43b7-4733-895b-f71a06da3756 req-fb2ccb18-2569-481f-b3d2-c03bc907d427 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:36.034420 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-0838c29a-43b7-4733-895b-f71a06da3756 req-fb2ccb18-2569-481f-b3d2-c03bc907d427 service nova] Creating event network-changed:8943cd7b-a360-401e-acfd-da389b056e1d for instance f5a9ebbe-9876-4618-84bb-97d838139530 on n-h2-846219-10 Jul 20 11:25:36.057856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-0838c29a-43b7-4733-895b-f71a06da3756 req-fb2ccb18-2569-481f-b3d2-c03bc907d427 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120563 Jul 20 11:25:36.059002 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2898/5770] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:36.128884 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:36.129509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:36.153409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:36.154322 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:36.177657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:36.178553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:36.394740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1668763519", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "ac7c020f-6bb2-446c-9a7a-cfc2f43ad3bc"}], "key_name": "tempest-TestNetworkBasicOps-1021083835", "security_groups": [{"name": "tempest-secgroup-smoke-1489658903"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:36.750455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] validate_networks() for [('ac7c020f-6bb2-446c-9a7a-cfc2f43ad3bc', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:25:36.766598 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2bab624e-2252-4d54-937a-5b6fa77b3ff7 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.653997 Jul 20 11:25:36.767804 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2873/5771] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:36 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:37.790590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:37.791292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:37.809097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:37.809975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:37.811148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:37.819393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:38.782822 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79300613-aa82-42b5-a0c5-347cef22329c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 1.002107 Jul 20 11:25:38.796095 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2874/5772] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:37 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:38.809308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-cad3a47c-3b3f-471f-8722-4984b08bf55d req-d45d9cab-422f-40e1-a19a-4fa8c6259a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3dedab7-9152-441f-9757-5f5a34f77680", "tag": "8edfc549-0c78-4112-a431-d5136346e0bb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:38.831702 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cad3a47c-3b3f-471f-8722-4984b08bf55d req-d45d9cab-422f-40e1-a19a-4fa8c6259a0b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:38.832156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-cad3a47c-3b3f-471f-8722-4984b08bf55d req-d45d9cab-422f-40e1-a19a-4fa8c6259a0b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:38.863570 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-cad3a47c-3b3f-471f-8722-4984b08bf55d req-d45d9cab-422f-40e1-a19a-4fa8c6259a0b service nova] Creating event network-changed:8edfc549-0c78-4112-a431-d5136346e0bb for instance b3dedab7-9152-441f-9757-5f5a34f77680 on n-h2-846219-10 Jul 20 11:25:38.877295 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-cad3a47c-3b3f-471f-8722-4984b08bf55d req-d45d9cab-422f-40e1-a19a-4fa8c6259a0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078809 Jul 20 11:25:38.883120 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2875/5773] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:39.140359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:25:39.140852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:25:39.142322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:25:39.142909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:25:39.143556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:25:39.154633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:39.155300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:39.156426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:39.157088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:39.210495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:39.219131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for user aead2241878446ba9d8b60f9d47aa703 and project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:39.235077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:25:39.238089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:25:39.290343 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f7b1c0aa-7e4c-45b6-92cd-0a2161d9d4ff tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.905676 Jul 20 11:25:39.303114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58fc1814-3c8b-4aa3-9a44-2b67982d6a22 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:39.304404 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-58fc1814-3c8b-4aa3-9a44-2b67982d6a22 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:39.310973 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2899/5774] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:25:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:25:39.407224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-58fc1814-3c8b-4aa3-9a44-2b67982d6a22 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:39.416576 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58fc1814-3c8b-4aa3-9a44-2b67982d6a22 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1249 microversion: 2.1 time: 0.117809 Jul 20 11:25:39.431302 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2876/5775] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:39 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1249 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:39.801914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:39.802802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:39.810709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:39.811362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:39.812433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:39.813743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:39.977385 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d28517c-e458-4254-a1a9-57b5f4c98723 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.179278 Jul 20 11:25:39.978268 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2900/5776] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:39 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:40.436113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:40.436675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:40.438687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:40.475581 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:40.476306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:40.477327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:40.478728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:40.692850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:40.717883 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ceb3d075-4724-4aa4-be2f-33bd6cb7a763 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1253 microversion: 2.1 time: 0.286585 Jul 20 11:25:40.725422 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2877/5777] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:40 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1253 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:40.994032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:40.995657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:41.003977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:41.008516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:41.009860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:41.010870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:41.022020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:41.491285 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cfd93aff-78a0-48b9-b0f6-2b05bcf83975 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.500351 Jul 20 11:25:41.492338 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2901/5778] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:40 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:41.746910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:41.748182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:41.756530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:41.757248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:41.758234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:41.758826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:41.764515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:41.864138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:41.874826 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c902f76e-b8db-4d2b-a928-29863aab0ef5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1307 microversion: 2.1 time: 0.134299 Jul 20 11:25:41.885376 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2878/5779] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:41 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:42.512336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:42.513550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:42.524476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:42.525395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:42.526374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:42.526982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:42.848778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8bc8c36e-5f09-4f23-b633-b113aaf93b77 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.342105 Jul 20 11:25:42.849715 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2902/5780] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:42 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:42.894042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:42.894678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:42.910459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:42.911137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:42.911740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:42.912350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:43.154372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:43.168039 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c19afbd3-b9bc-49ec-9124-9c547b8b6f71 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1375 microversion: 2.1 time: 0.278874 Jul 20 11:25:43.168713 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2879/5781] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:42 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1375 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:43.865888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:43.866593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:43.877771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:43.878620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:43.882730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:43.883460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:44.101845 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-92d900fe-47a6-43a9-8b45-f6aed9c8dc06 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.239574 Jul 20 11:25:44.102940 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2903/5782] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:43 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:44.220187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:44.221334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:44.232518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7b468bb3-80ea-4d20-91f5-c14e977be16c req-8c4bf09a-ce76-44b3-a642-951655eb1af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4801b7d-afc1-4146-8425-cd8700bc48da", "tag": "de3db1b5-e6ba-4359-bf58-cab87ff9137e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:44.249126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7b468bb3-80ea-4d20-91f5-c14e977be16c req-8c4bf09a-ce76-44b3-a642-951655eb1af9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:44.261208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7b468bb3-80ea-4d20-91f5-c14e977be16c req-8c4bf09a-ce76-44b3-a642-951655eb1af9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:44.288060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:44.288363 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7b468bb3-80ea-4d20-91f5-c14e977be16c req-8c4bf09a-ce76-44b3-a642-951655eb1af9 service nova] Creating event network-changed:de3db1b5-e6ba-4359-bf58-cab87ff9137e for instance f4801b7d-afc1-4146-8425-cd8700bc48da on n-h2-846219-10 Jul 20 11:25:44.288852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:44.291423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:44.293484 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:44.305398 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7b468bb3-80ea-4d20-91f5-c14e977be16c req-8c4bf09a-ce76-44b3-a642-951655eb1af9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077825 Jul 20 11:25:44.306266 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2904/5783] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:44.639765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:44.685428 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58015e14-ce05-4fd5-8fd3-a610dc993299 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1375 microversion: 2.1 time: 0.502874 Jul 20 11:25:44.699375 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2880/5784] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:44 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1375 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:45.108519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-58cfbfba-b6ac-4fe2-b58f-0759998ef0b4 req-84aae916-c8fa-49d7-b2d8-d56e592551eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dedab7-9152-441f-9757-5f5a34f77680", "name": "network-vif-plugged", "status": "completed", "tag": "8edfc549-0c78-4112-a431-d5136346e0bb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:45.120951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:45.121578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:45.133244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:45.133701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:45.134477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:45.138913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:45.144269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-58cfbfba-b6ac-4fe2-b58f-0759998ef0b4 req-84aae916-c8fa-49d7-b2d8-d56e592551eb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:45.146373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-58cfbfba-b6ac-4fe2-b58f-0759998ef0b4 req-84aae916-c8fa-49d7-b2d8-d56e592551eb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:45.178507 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-58cfbfba-b6ac-4fe2-b58f-0759998ef0b4 req-84aae916-c8fa-49d7-b2d8-d56e592551eb service nova] Creating event network-vif-plugged:8edfc549-0c78-4112-a431-d5136346e0bb for instance b3dedab7-9152-441f-9757-5f5a34f77680 on n-h2-846219-10 Jul 20 11:25:45.193707 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-58cfbfba-b6ac-4fe2-b58f-0759998ef0b4 req-84aae916-c8fa-49d7-b2d8-d56e592551eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090085 Jul 20 11:25:45.195223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2905/5785] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:25:45.336506 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4cdaa93e-9323-4711-b8f4-28f8107d452e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.220603 Jul 20 11:25:45.337745 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2881/5786] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:45 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:25:45.703387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:45.704173 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:45.710913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:45.711950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:45.713037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:45.713792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:45.895124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:45.904053 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d00e38c-e4ed-4241-a2d7-dd83e6e30211 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1375 microversion: 2.1 time: 0.205011 Jul 20 11:25:45.904653 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2906/5787] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:45 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1375 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:46.354608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:46.356388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:46.365858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:46.366592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:46.367825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:46.368557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:46.622612 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a8441f72-4b13-40eb-8df6-fd8834dba5b5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1465 microversion: 2.1 time: 0.272389 Jul 20 11:25:46.633338 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2882/5788] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:46 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1465 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:46.928327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:46.930627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:46.951425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:46.952317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:46.953515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:46.954182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:47.274530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:47.287451 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-299beadc-116d-4a71-96b2-1102b5cd169a tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1375 microversion: 2.1 time: 0.368587 Jul 20 11:25:47.292480 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2907/5789] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:46 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1375 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:47.640620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:47.641431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:47.648578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:47.649040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:47.649862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:47.650310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:47.790378 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58d4ccbf-ce36-4839-bfa7-7bc39953dcc5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1649 microversion: 2.1 time: 0.153854 Jul 20 11:25:47.792392 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2883/5790] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:47 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1649 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:47.808254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:47.808963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:47.815507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:47.815963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:47.817086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:47.817696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:47.953255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5082aadd-fef4-4062-a8af-11b0a6d73756 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1649 microversion: 2.1 time: 0.149581 Jul 20 11:25:47.953915 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2908/5791] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:47 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1649 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:47.970271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:47.970894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:47.977377 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:47.977828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:47.978644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:47.979035 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:48.138501 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d026386-4f5a-4308-b0d2-8e172a830809 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1649 microversion: 2.1 time: 0.172506 Jul 20 11:25:48.139333 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2884/5792] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:47 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1649 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:48.282024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-979694879", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "availability_zone": "nova:n-h1-846219-10", "networks": [{"uuid": "5ef6f07f-c047-4198-ac06-47093726fbdb"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:48.306018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:48.306924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:48.314916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:48.315775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:48.321560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:48.327141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:48.367274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] validate_networks() for [('5ef6f07f-c047-4198-ac06-47093726fbdb', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:25:48.585598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:48.604365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ae37b99e-505b-425b-8d09-ff7ccefa8a4d tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1375 microversion: 2.1 time: 0.302054 Jul 20 11:25:48.606083 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2885/5793] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:48 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1375 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:25:48.880512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:25:48.881313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:25:48.884091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:25:48.884091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:25:48.884553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:25:48.897809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:48.898266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:48.899086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:48.899590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:48.949746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Getting quotas for project 269fc102bf1442beace7010e16dcd400. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:48.957376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Getting quotas for user f5a3c6d7ba0244f3b004da000c92a685 and project 269fc102bf1442beace7010e16dcd400. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:49.004307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:25:49.007860 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:25:49.124133 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-19189057-bec2-4663-b8a7-b10e7fa60467 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845932 Jul 20 11:25:49.126877 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2909/5794] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:25:49.139385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-79ccf13d-1987-4bab-932c-73538a9aac74 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:49.140680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-79ccf13d-1987-4bab-932c-73538a9aac74 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:49.234117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7494dfa2-6f8a-43ec-8e57-aa78c96fec75 req-597a8e11-acd3-4e3c-a873-74316b4f2d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4801b7d-afc1-4146-8425-cd8700bc48da", "name": "network-vif-plugged", "status": "completed", "tag": "de3db1b5-e6ba-4359-bf58-cab87ff9137e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:49.244113 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-79ccf13d-1987-4bab-932c-73538a9aac74 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1328 microversion: 2.1 time: 0.110680 Jul 20 11:25:49.245411 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2886/5795] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:49 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:49.253494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7494dfa2-6f8a-43ec-8e57-aa78c96fec75 req-597a8e11-acd3-4e3c-a873-74316b4f2d9c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:49.253967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7494dfa2-6f8a-43ec-8e57-aa78c96fec75 req-597a8e11-acd3-4e3c-a873-74316b4f2d9c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:49.272999 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7494dfa2-6f8a-43ec-8e57-aa78c96fec75 req-597a8e11-acd3-4e3c-a873-74316b4f2d9c service nova] Creating event network-vif-plugged:de3db1b5-e6ba-4359-bf58-cab87ff9137e for instance f4801b7d-afc1-4146-8425-cd8700bc48da on n-h2-846219-10 Jul 20 11:25:49.286246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7494dfa2-6f8a-43ec-8e57-aa78c96fec75 req-597a8e11-acd3-4e3c-a873-74316b4f2d9c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057651 Jul 20 11:25:49.287070 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2910/5796] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:49.623466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:49.624165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:49.632679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:49.633584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:49.634570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:49.635977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:49.889914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:49.906920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-acb4d0fd-dc04-43c4-97fd-8c0125473d94 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1375 microversion: 2.1 time: 0.288750 Jul 20 11:25:49.913732 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2887/5797] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:49 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1375 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:50.264997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:50.272683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:50.287362 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:50.292798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:50.293663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:50.294176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:50.805135 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8851d5d3-3142-44b0-bd43-0d0fbdf38065 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1417 microversion: 2.1 time: 0.544880 Jul 20 11:25:50.805736 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2911/5798] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:50 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1417 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:50.932030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:50.933127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:50.941747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:50.941747 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:50.947536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:50.948738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:51.451857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:51.469669 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e652a8f3-1997-4c57-8e58-0dc5be7f240b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1547 microversion: 2.1 time: 0.541317 Jul 20 11:25:51.470797 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2888/5799] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:50 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1547 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:51.487871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:51.488630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:51.501374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:51.502208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:51.503339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:51.504030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:51.755840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:25:51.766260 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c8ab0965-dc99-4aee-a48c-1e1769e327db tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1547 microversion: 2.1 time: 0.283281 Jul 20 11:25:51.772097 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2912/5800] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:51 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1547 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:51.825213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:51.826089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:51.838848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:51.839435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:51.841482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:51.844339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:52.034187 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-be0b43e4-af1f-4e05-98e6-f64c5011c374 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.214111 Jul 20 11:25:52.036701 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2889/5801] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:51 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:52.614940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-38f9a93e-b1ed-45d8-8d0e-1e7d68b3dd94 req-fdfce7a5-3bcb-4b4f-b165-a7dfb345505c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8462123-bf4e-41a1-b79b-2af4f2e45540", "tag": "400e02cf-f2c7-4514-af4d-8e530ac8c95f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:52.632514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-38f9a93e-b1ed-45d8-8d0e-1e7d68b3dd94 req-fdfce7a5-3bcb-4b4f-b165-a7dfb345505c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:52.633557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-38f9a93e-b1ed-45d8-8d0e-1e7d68b3dd94 req-fdfce7a5-3bcb-4b4f-b165-a7dfb345505c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:52.660599 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-38f9a93e-b1ed-45d8-8d0e-1e7d68b3dd94 req-fdfce7a5-3bcb-4b4f-b165-a7dfb345505c service nova] Creating event network-changed:400e02cf-f2c7-4514-af4d-8e530ac8c95f for instance a8462123-bf4e-41a1-b79b-2af4f2e45540 on n-h1-846219-10 Jul 20 11:25:52.673689 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-38f9a93e-b1ed-45d8-8d0e-1e7d68b3dd94 req-fdfce7a5-3bcb-4b4f-b165-a7dfb345505c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065185 Jul 20 11:25:52.677025 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2913/5802] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:53.054363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:53.065637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:53.094573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:53.095332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:53.097286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:53.097883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:53.361916 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a10f3aa-02f9-40e2-91bc-a47d937dcac3 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.311705 Jul 20 11:25:53.362848 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2890/5803] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:53 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:54.382947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:54.383832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:54.403198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:54.403831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:54.404823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:54.405421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:54.566778 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3087caaf-1048-4884-8ba6-82a9e29e5818 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.188982 Jul 20 11:25:54.578071 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2914/5804] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:54 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:55.585483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:55.587390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:55.605031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:55.607858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:55.609059 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:55.611616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:55.804751 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9c3cdc97-5128-452c-99f4-872a0342896c tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.220055 Jul 20 11:25:55.804751 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2891/5805] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:55 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:56.819343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:56.820529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:56.851016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:56.851865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:56.855993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:56.856614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:57.066431 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-31d9a282-c33f-4edb-bf65-a67d548d1b07 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.250742 Jul 20 11:25:57.067078 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2915/5806] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:56 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:58.084647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:58.085251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:58.094317 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:58.095019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:58.096273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:58.096891 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:58.342721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e65d7a63-08f2-4eba-a616-465f9c022922 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.261915 Jul 20 11:25:58.344790 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2892/5807] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:58 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:58.911439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:58.981592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=18 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:59.094596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-40557ad5-2518-4e21-8a4d-13a71f290b6a req-28c30d6b-a6dd-470c-977d-3997839dae91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8462123-bf4e-41a1-b79b-2af4f2e45540", "name": "network-vif-plugged", "status": "completed", "tag": "400e02cf-f2c7-4514-af4d-8e530ac8c95f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:59.110492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-40557ad5-2518-4e21-8a4d-13a71f290b6a req-28c30d6b-a6dd-470c-977d-3997839dae91 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:59.111319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-40557ad5-2518-4e21-8a4d-13a71f290b6a req-28c30d6b-a6dd-470c-977d-3997839dae91 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:59.126397 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-40557ad5-2518-4e21-8a4d-13a71f290b6a req-28c30d6b-a6dd-470c-977d-3997839dae91 service nova] Creating event network-vif-plugged:400e02cf-f2c7-4514-af4d-8e530ac8c95f for instance a8462123-bf4e-41a1-b79b-2af4f2e45540 on n-h1-846219-10 Jul 20 11:25:59.133387 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-40557ad5-2518-4e21-8a4d-13a71f290b6a req-28c30d6b-a6dd-470c-977d-3997839dae91 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045910 Jul 20 11:25:59.134935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2893/5808] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:59.201306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90e387f9-e2ee-4b6f-b0ec-cccb884b4f65 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Action: 'create', calling method: .version_select at 0x7f2c3eaa7790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2100027535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdEYJyCuLqF2i5an4uv+E5hSS/ifpM+sPZNNwnPLz6RXVYXiSxKF1L/lHvw7RwiDYSEklNsmABZZ18dp2UvZFkc4R3vRPNR7dC6rvGOQpQ8wRWvehl+rw9Qa9+wJ9tEBA=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:25:59.240791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-90e387f9-e2ee-4b6f-b0ec-cccb884b4f65 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Getting quotas for project efb06e44c7eb4162954af057f35100b4. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:25:59.247714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-90e387f9-e2ee-4b6f-b0ec-cccb884b4f65 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Getting quotas for user 5645e229a525480ea53a81c20feaf916 and project efb06e44c7eb4162954af057f35100b4. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:25:59.288927 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90e387f9-e2ee-4b6f-b0ec-cccb884b4f65 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.390249 Jul 20 11:25:59.293988 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2916/5809] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:25:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:25:59.359021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:25:59.365372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:59.366101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:59.380257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:59.380720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:59.381509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:59.381960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:59.621819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:25:59.624003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:25:59.645381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f1603c5d-628a-4e40-87ce-8b78b8045314 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.288110 Jul 20 11:25:59.649747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:59.650434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:59.652462 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2894/5810] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:25:59 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:25:59.660491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:25:59.661273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:25:59.694621 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4d1b70bf-8a83-456a-ba06-d6924665d8d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/ips" status: 200 len: 149 microversion: 2.1 time: 0.084387 Jul 20 11:25:59.695848 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2917/5811] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:25:59 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:26:00.669648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:00.671932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:00.683722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:00.684532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:00.685960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:00.686619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:00.851533 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-47218fc1-9d02-4e1a-ac91-d94188d3e6a8 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1465 microversion: 2.1 time: 0.186131 Jul 20 11:26:00.862618 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2895/5812] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:00 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:01.869332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:01.870522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:01.877892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:01.878568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:01.879591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:01.880180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.046413 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a80bd6d5-c915-4912-a165-cabed0bc0af5 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1649 microversion: 2.1 time: 0.180622 Jul 20 11:26:02.047240 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2918/5813] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:01 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1649 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:02.065373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:02.066547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:02.090814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.092133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.093831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.095613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.114930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=100 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:02.223753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2310f4f-871c-46d9-ab96-3ea27a16295e"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:02.225807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:02.234849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.235354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.236131 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.237563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.333666 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a12ce45-756f-4044-bad9-538d5147fb44 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1649 microversion: 2.1 time: 0.273052 Jul 20 11:26:02.336817 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2896/5814] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:02 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1649 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:02.355583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:02.356248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:02.363772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.365819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.367108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.367823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.636144 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ad5bbe2-aa8a-4c9b-870e-a47a1daeae6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1649 microversion: 2.1 time: 0.284995 Jul 20 11:26:02.648010 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2897/5815] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:02 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1649 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:02.654214 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:02.654953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:02.663550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.664467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.665555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.666779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.703455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:26:02.715648 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b804bc1d-0dda-4432-9273-3983f083fceb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497928 Jul 20 11:26:02.725950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2919/5816] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:26:02 2022] POST /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:02.842096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cbbaf417-3661-48c2-b391-38717a422efe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 204 len: 0 microversion: 2.1 time: 0.192315 Jul 20 11:26:02.846336 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2898/5817] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:26:02 2022] DELETE /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:26:02.855012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:02.855784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:02.876676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.877274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:02.877907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:02.878352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:03.208438 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12350afd-413b-481b-a502-ef8b4692bfa9 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1655 microversion: 2.1 time: 0.347114 Jul 20 11:26:03.222495 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2920/5818] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:02 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1655 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:04.233365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:04.234086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:04.245778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:04.258179 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:04.258647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:04.259486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:04.260585 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:04.544889 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-73fc62da-e98b-4994-aefe-5b34cfbaec5f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1655 microversion: 2.1 time: 0.319849 Jul 20 11:26:04.546280 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2899/5819] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:04 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1655 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:05.562172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:05.563476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:05.567162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:05.586708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:05.589710 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:05.590781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:05.591681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:05.654960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:05.689593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f5caa460-6fe9-45a6-aa00-d9d9ab12bf77 req-50ff2613-1721-4de4-9797-2ec940a60ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8462123-bf4e-41a1-b79b-2af4f2e45540", "name": "network-vif-deleted", "tag": "400e02cf-f2c7-4514-af4d-8e530ac8c95f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:05.720466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f5caa460-6fe9-45a6-aa00-d9d9ab12bf77 req-50ff2613-1721-4de4-9797-2ec940a60ac0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:05.723829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f5caa460-6fe9-45a6-aa00-d9d9ab12bf77 req-50ff2613-1721-4de4-9797-2ec940a60ac0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:05.763978 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5548b273-d780-489b-84d7-3408f7e6d30f tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 200 len: 1613 microversion: 2.1 time: 0.204393 Jul 20 11:26:05.764357 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2921/5820] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:05 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 1613 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:05.774096 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f5caa460-6fe9-45a6-aa00-d9d9ab12bf77 req-50ff2613-1721-4de4-9797-2ec940a60ac0 service nova] Creating event network-vif-deleted:400e02cf-f2c7-4514-af4d-8e530ac8c95f for instance a8462123-bf4e-41a1-b79b-2af4f2e45540 on n-h1-846219-10 Jul 20 11:26:05.787150 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f5caa460-6fe9-45a6-aa00-d9d9ab12bf77 req-50ff2613-1721-4de4-9797-2ec940a60ac0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100455 Jul 20 11:26:05.788983 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2900/5821] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:06.781839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:06.782455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: a8462123-bf4e-41a1-b79b-2af4f2e45540] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:06.794631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:06.799781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:06.800855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:06.801458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:06.840220 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] HTTP exception thrown: Instance a8462123-bf4e-41a1-b79b-2af4f2e45540 could not be found. Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Request method failure captured: Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 HTTP/1.1 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-YmhExohoxJGOiQSCcYozZKO_uD2v-qOpgxHFumv0zAk2_G7vzkTIQ5uK7EqdXpE3u0SXtrmjjGX_DM70XYoYERCg0NN0ChWfZ7amGUL-WN7BkX5tjRHus86BnWj0P8I8bJAyCwkbhnBzDMszkR-ycjGiLKj6KjaHs44vV-vXPNIjc Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 269fc102bf1442beace7010e16dcd400 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestServerMultinode-484515765 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_269fc102bf1442beace7010e16dcd400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/269fc102bf1442beace7010e16dcd400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/269fc102bf1442beace7010e16dcd400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/269fc102bf1442beace7010e16dcd400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestServerMultinode-484515765 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 269fc102bf1442beace7010e16dcd400 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestServerMultinode-484515765 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestServerMultinode-484515765-project-admin Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f5a3c6d7ba0244f3b004da000c92a685 Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestServerMultinode-484515765-project-admin Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance a8462123-bf4e-41a1-b79b-2af4f2e45540 could not be found. Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a8462123-bf4e-41a1-b79b-2af4f2e45540'} Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8462123-bf4e-41a1-b79b-2af4f2e45540 could not be found. Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8462123-bf4e-41a1-b79b-2af4f2e45540 could not be found. Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:06.847301 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8462123-bf4e-41a1-b79b-2af4f2e45540 could not be found. Jul 20 11:26:06.852126 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:06.852950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Returning 404 to user: Instance a8462123-bf4e-41a1-b79b-2af4f2e45540 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:26:06.854512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e9a698d9-bca7-4c8a-bc27-2e4905aa6f65 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540" status: 404 len: 111 microversion: 2.1 time: 0.076002 Jul 20 11:26:06.855235 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2922/5822] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:06 2022] GET /compute/v2.1/servers/a8462123-bf4e-41a1-b79b-2af4f2e45540 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:26:06.872001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:06.873440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:06.890237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:06.890842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:06.893786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:06.895438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:06.963323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:26:07.171332 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65731e8d-fd2e-4067-9f0d-e95129f3ccfe tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 204 len: 0 microversion: 2.1 time: 0.310221 Jul 20 11:26:07.171935 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2901/5823] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:26:06 2022] DELETE /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:26:07.180832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:07.181470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:07.197346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:07.197850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:07.198841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:07.199328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:07.460073 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-410fb34c-6d2f-4b11-9af9-c43b6e40cc6e tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1655 microversion: 2.1 time: 0.283366 Jul 20 11:26:07.462371 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2923/5824] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:07 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1655 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:07.962430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1828060069-access_point-1946319509", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "2aed93ff-e1f3-4603-9752-c8a56508476d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2100027535", "security_groups": [{"name": "tempest-secgroup_access--659658135"}, {"name": "tempest-secgroup_general--915368150"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:08.212898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] validate_networks() for [('2aed93ff-e1f3-4603-9752-c8a56508476d', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:26:08.489539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:08.490633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:08.514058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:08.515207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:08.516163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:08.519576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:09.029642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e8dfa3d-b52a-4473-8cdd-5aad255fdf84 tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1655 microversion: 2.1 time: 0.553275 Jul 20 11:26:09.031156 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2924/5825] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:08 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1655 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:09.459004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:26:09.459661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:26:09.460533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:26:09.461244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:26:09.461816 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:26:09.481918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:09.483732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:09.486673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:09.487505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:09.534553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Getting quotas for project efb06e44c7eb4162954af057f35100b4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:26:09.546361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Getting quotas for user 5645e229a525480ea53a81c20feaf916 and project efb06e44c7eb4162954af057f35100b4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:26:09.582738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:26:09.585986 n-d-846219-10 devstack@n-api.service[125886]: WARNING nova.utils [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1828060069-access_point-1946319509 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1828060069-ac Jul 20 11:26:09.590302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:26:09.685132 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a14007dc-3fbd-4752-be68-e3ce1c4a184d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.720831 Jul 20 11:26:09.692564 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2902/5826] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:26:07 2022] POST /compute/v2.1/servers => generated 456 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:26:09.704952 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-72f5a580-4a59-4249-bac5-e44c576b1440 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:09.706878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-72f5a580-4a59-4249-bac5-e44c576b1440 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:09.727494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:10.042889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-72f5a580-4a59-4249-bac5-e44c576b1440 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:10.055136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:10.056282 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-72f5a580-4a59-4249-bac5-e44c576b1440 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1295 microversion: 2.1 time: 0.354832 Jul 20 11:26:10.058288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:10.062802 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2925/5827] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:09 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1295 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:10.085584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:10.086159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:10.090196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:10.090669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:10.108687 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f5faf3b3-d91c-4aa2-9e23-10fc1ef53442 req-dfd1bae5-4387-4921-a36c-b9aa06997922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3dedab7-9152-441f-9757-5f5a34f77680", "name": "network-vif-deleted", "tag": "8edfc549-0c78-4112-a431-d5136346e0bb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:10.187280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f5faf3b3-d91c-4aa2-9e23-10fc1ef53442 req-dfd1bae5-4387-4921-a36c-b9aa06997922 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:10.190759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f5faf3b3-d91c-4aa2-9e23-10fc1ef53442 req-dfd1bae5-4387-4921-a36c-b9aa06997922 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:10.219378 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f5faf3b3-d91c-4aa2-9e23-10fc1ef53442 req-dfd1bae5-4387-4921-a36c-b9aa06997922 service nova] Creating event network-vif-deleted:8edfc549-0c78-4112-a431-d5136346e0bb for instance b3dedab7-9152-441f-9757-5f5a34f77680 on n-h2-846219-10 Jul 20 11:26:10.239852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f5faf3b3-d91c-4aa2-9e23-10fc1ef53442 req-dfd1bae5-4387-4921-a36c-b9aa06997922 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154387 Jul 20 11:26:10.242525 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2926/5828] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:10.921330 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44e9c800-bdb7-4d51-90f4-e62b7848a21a tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 200 len: 1613 microversion: 2.1 time: 0.875956 Jul 20 11:26:10.922589 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2903/5829] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:10 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 1613 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:11.103536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:11.105336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:11.124535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:11.128026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:11.133994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:11.134457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:11.287397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:11.297647 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e703f1ad-2fb0-49a6-8974-9ce4472a83e8 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1299 microversion: 2.1 time: 0.220012 Jul 20 11:26:11.298518 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2927/5830] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:11 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:11.450944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:11.464768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:11.498667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:11.501470 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:11.506756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:11.508017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:11.561784 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7bbdb707-7a25-443f-9f4f-d92be400872e tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.117086 Jul 20 11:26:11.562391 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2904/5831] 10.222.0.79 () {58 vars in 1292 bytes} [Wed Jul 20 11:26:11 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530/os-server-password => generated 116 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:11.942262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:11.942863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] [instance: b3dedab7-9152-441f-9757-5f5a34f77680] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:11.958340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:11.958807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:11.968024 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:11.969236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:12.003300 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] HTTP exception thrown: Instance b3dedab7-9152-441f-9757-5f5a34f77680 could not be found. Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Request method failure captured: Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 HTTP/1.1 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-YmhExohoxJGOiQSCcYozZKO_uD2v-qOpgxHFumv0zAk2_G7vzkTIQ5uK7EqdXpE3u0SXtrmjjGX_DM70XYoYERCg0NN0ChWfZ7amGUL-WN7BkX5tjRHus86BnWj0P8I8bJAyCwkbhnBzDMszkR-ycjGiLKj6KjaHs44vV-vXPNIjc Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 269fc102bf1442beace7010e16dcd400 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestServerMultinode-484515765 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_269fc102bf1442beace7010e16dcd400", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/269fc102bf1442beace7010e16dcd400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/269fc102bf1442beace7010e16dcd400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/269fc102bf1442beace7010e16dcd400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestServerMultinode-484515765 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 269fc102bf1442beace7010e16dcd400 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestServerMultinode-484515765 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestServerMultinode-484515765-project-admin Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f5a3c6d7ba0244f3b004da000c92a685 Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestServerMultinode-484515765-project-admin Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance b3dedab7-9152-441f-9757-5f5a34f77680 could not be found. Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'b3dedab7-9152-441f-9757-5f5a34f77680'} Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3dedab7-9152-441f-9757-5f5a34f77680 could not be found. Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3dedab7-9152-441f-9757-5f5a34f77680 could not be found. Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:12.008749 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3dedab7-9152-441f-9757-5f5a34f77680 could not be found. Jul 20 11:26:12.014242 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:26:12.017934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] Returning 404 to user: Instance b3dedab7-9152-441f-9757-5f5a34f77680 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:26:12.018827 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2a70bdac-7fe7-45ca-87d9-fe0147c14b7b tempest-TestServerMultinode-484515765 tempest-TestServerMultinode-484515765-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680" status: 404 len: 111 microversion: 2.1 time: 0.080509 Jul 20 11:26:12.026746 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2928/5832] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:11 2022] GET /compute/v2.1/servers/b3dedab7-9152-441f-9757-5f5a34f77680 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:26:12.315592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:12.316352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:12.325782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:12.327682 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:12.330298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:12.330826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:12.454551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:12.467860 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95a22103-5b67-4382-9846-3b506be987a0 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1353 microversion: 2.1 time: 0.155727 Jul 20 11:26:12.469566 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2905/5833] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:12 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:13.492798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:13.493645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:13.503951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:13.504560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:13.506217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:13.506781 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:13.805873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0d67a973-ca08-4849-a8fc-fc6b81b27c79 req-a7633516-1319-4c78-ba55-829d0c9c3c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e00be0e-67c3-4166-a0c4-c1aa91c09e73", "tag": "f6706c0e-074a-43d2-9038-bfaf91189ba1"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:13.820230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:13.829725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0d67a973-ca08-4849-a8fc-fc6b81b27c79 req-a7633516-1319-4c78-ba55-829d0c9c3c58 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:13.830674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0d67a973-ca08-4849-a8fc-fc6b81b27c79 req-a7633516-1319-4c78-ba55-829d0c9c3c58 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:13.850931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca1575a1-13f1-4c51-b1e3-1f79ba4936c4 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 0.361696 Jul 20 11:26:13.854952 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2929/5834] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:13 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:13.862516 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0d67a973-ca08-4849-a8fc-fc6b81b27c79 req-a7633516-1319-4c78-ba55-829d0c9c3c58 service nova] Creating event network-changed:f6706c0e-074a-43d2-9038-bfaf91189ba1 for instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 on n-h1-846219-10 Jul 20 11:26:13.876039 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0d67a973-ca08-4849-a8fc-fc6b81b27c79 req-a7633516-1319-4c78-ba55-829d0c9c3c58 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075450 Jul 20 11:26:13.877129 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2906/5835] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:14.870022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:14.870629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:14.880427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:14.880809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:14.881769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:14.882361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:15.201771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:15.217453 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2fdb8ac4-fa03-4fe8-b27a-d6d99280a7dc tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 0.351114 Jul 20 11:26:15.219692 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2930/5836] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:14 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:16.249496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:16.250237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:16.261701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:16.262454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:16.263625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:16.264400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:16.468129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:16.479929 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d518a401-c26e-4603-8578-67334f536a26 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 0.236189 Jul 20 11:26:16.481421 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2907/5837] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:16 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:17.502733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:17.503470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:17.512072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:17.512836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:17.513823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:17.515636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:17.741825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:17.750329 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-229863f6-b4ff-4902-a0f4-a2156264f3f5 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 0.256908 Jul 20 11:26:17.751349 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2931/5838] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:17 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:18.449784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7bd89b0-de55-43b5-94d1-42383f7f14b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: .version_select at 0x7f2c3f4a2040>, body: {"keypair": {"name": "tempest-keypair-518782720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQz3M7HVh5LU3f5qB3SyU7NmaarJrr8DvI72M0e5t8Z6Bl7TXCV7I3ut+0EkPepFo+ReO5QlcuxSvCog5+l83iyoTqkioaFsGW4YrJ2mONzETvrc3OZgJT/kH5l/10LjQ=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:18.468911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c7bd89b0-de55-43b5-94d1-42383f7f14b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:26:18.476040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-c7bd89b0-de55-43b5-94d1-42383f7f14b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:26:18.506370 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7bd89b0-de55-43b5-94d1-42383f7f14b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060850 Jul 20 11:26:18.506996 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2908/5839] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:26:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:18.770841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:18.771558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:18.780961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:18.781922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:18.783086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:18.783784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:19.178501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:19.193039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2aa42f77-0eb2-4f8c-9e30-8d1c74390f25 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 0.423829 Jul 20 11:26:19.193039 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2932/5840] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:18 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:20.207811 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:20.212523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:20.213338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:20.230614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:20.230987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:20.244960 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:20.245452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:20.702380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:20.711105 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6253b57-1a1d-479f-b359-18adfdd19d31 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 0.504764 Jul 20 11:26:20.712699 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2909/5841] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:20 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:21.260208 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bbed97d0-de33-4eaa-9500-72dd01e8c910 req-89ea862f-d3d9-4a91-84f3-520ac25080bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e00be0e-67c3-4166-a0c4-c1aa91c09e73", "name": "network-vif-plugged", "status": "completed", "tag": "f6706c0e-074a-43d2-9038-bfaf91189ba1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:21.265747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:21.284203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bbed97d0-de33-4eaa-9500-72dd01e8c910 req-89ea862f-d3d9-4a91-84f3-520ac25080bd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.284648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bbed97d0-de33-4eaa-9500-72dd01e8c910 req-89ea862f-d3d9-4a91-84f3-520ac25080bd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.296935 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bbed97d0-de33-4eaa-9500-72dd01e8c910 req-89ea862f-d3d9-4a91-84f3-520ac25080bd service nova] Creating event network-vif-plugged:f6706c0e-074a-43d2-9038-bfaf91189ba1 for instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 on n-h1-846219-10 Jul 20 11:26:21.302593 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bbed97d0-de33-4eaa-9500-72dd01e8c910 req-89ea862f-d3d9-4a91-84f3-520ac25080bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048340 Jul 20 11:26:21.303627 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2933/5842] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:21.539925 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:21.549644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:21.574779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.575687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.577601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.578687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.612872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:26:21.732829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:21.733699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:21.748574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.752076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.754176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.756082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.793197 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fb3199aa-9dfd-48db-a49e-d98118e23c43 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 204 len: 0 microversion: 2.1 time: 0.257346 Jul 20 11:26:21.797432 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2910/5843] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:26:21 2022] DELETE /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:26:21.808355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:21.812050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:21.829063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.829636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.830676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:21.831390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:21.872122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:22.846372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:22.856178 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bee9204e-3b05-4242-9e3d-8936fe011718 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1471 microversion: 2.1 time: 1.130342 Jul 20 11:26:22.858432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2934/5844] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:21 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1471 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:22.977905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:22.996214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c474cfc0-e59a-4b2b-8c31-2baf59259b61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1553 microversion: 2.1 time: 1.197178 Jul 20 11:26:23.011564 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2911/5845] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:21 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1553 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:23.212634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1873672064", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9ddebef-2263-4847-bf1c-8851149dd003"}], "security_groups": [{"name": "tempest-securitygroup--1114695180"}], "key_name": "tempest-keypair-518782720", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:23.518031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] validate_networks() for [('b9ddebef-2263-4847-bf1c-8851149dd003', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:26:23.877250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:23.877961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:23.896566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:23.898147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:23.899623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:23.901289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.404692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:24.412935 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b484811-30a2-41fb-965b-aef533d33d08 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1643 microversion: 2.1 time: 0.542775 Jul 20 11:26:24.413527 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2912/5846] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:23 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1643 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:24.419565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:24.420514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:24.430608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.431245 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.432869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.433354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.568333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:24.577006 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b707d2bf-59df-4911-a772-362b9cdab3ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 200 len: 1485 microversion: 2.1 time: 0.162186 Jul 20 11:26:24.577604 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2913/5847] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:24 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 1485 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:24.591487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:24.592110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:24.598421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.598930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.599887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.600337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.865261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:26:24.865879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:26:24.866171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:26:24.866593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:26:24.867032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:26:24.878153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.878646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.879488 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.880088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.904961 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:26:24.911557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:26:24.926765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:26:24.929166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:26:24.953921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:24.966051 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2588518a-8dac-4f89-81cf-6a99fd135d10 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1643 microversion: 2.1 time: 0.378331 Jul 20 11:26:24.966748 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2914/5848] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:24 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1643 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:24.977762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3ab0312f-939a-4375-8ba2-5b4320eded41 req-e09d2ede-b394-4860-9d95-dac36be8568f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4801b7d-afc1-4146-8425-cd8700bc48da", "name": "network-vif-deleted", "tag": "de3db1b5-e6ba-4359-bf58-cab87ff9137e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:24.984638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3ab0312f-939a-4375-8ba2-5b4320eded41 req-e09d2ede-b394-4860-9d95-dac36be8568f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:24.985172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3ab0312f-939a-4375-8ba2-5b4320eded41 req-e09d2ede-b394-4860-9d95-dac36be8568f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:24.988435 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-adeaee91-cb89-4ca9-aa9d-f14861a80ea7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.781359 Jul 20 11:26:24.989445 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2935/5849] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:26:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:26:25.000350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:25.001235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:25.002327 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3ab0312f-939a-4375-8ba2-5b4320eded41 req-e09d2ede-b394-4860-9d95-dac36be8568f service nova] Creating event network-vif-deleted:de3db1b5-e6ba-4359-bf58-cab87ff9137e for instance f4801b7d-afc1-4146-8425-cd8700bc48da on n-h2-846219-10 Jul 20 11:26:25.007801 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3ab0312f-939a-4375-8ba2-5b4320eded41 req-e09d2ede-b394-4860-9d95-dac36be8568f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039515 Jul 20 11:26:25.008881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2915/5850] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:25.013050 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:25.013513 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:25.014296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:25.014832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:25.015805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-956286e1-4ed8-408e-8afa-d5f1ad8edb9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:25.016770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-956286e1-4ed8-408e-8afa-d5f1ad8edb9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:25.131882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-956286e1-4ed8-408e-8afa-d5f1ad8edb9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:25.146939 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-956286e1-4ed8-408e-8afa-d5f1ad8edb9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1241 microversion: 2.1 time: 0.136559 Jul 20 11:26:25.147580 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2916/5851] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:25 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:25.593815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:25.595435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: f4801b7d-afc1-4146-8425-cd8700bc48da] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:25.599469 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eaa81068-c969-4a2f-97b9-c163b505a581 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1796 microversion: 2.1 time: 0.608606 Jul 20 11:26:25.602314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:25.602512 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2936/5852] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:24 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1796 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:25.603864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:25.605070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:25.605829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:25.632678 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] HTTP exception thrown: Instance f4801b7d-afc1-4146-8425-cd8700bc48da could not be found. Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Request method failure captured: Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da HTTP/1.1 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-XelKELCXNXnh1Npp41qTNrFpQrJn5Q-ifyralogtNy95T7v1ELNQuT6hi-PF4k4Xq4GiKEQpEW_653y7fJLq2dt7kVKyGqm2pHkyUsgRnWR7hJPJLeKY8DpxkjWaG6Z1Vcg9inNhkQX75lMVwI5SECTzar9iVDxXk6bxplwXxevmI Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 7991a1d8c73c45b69b7c4b7e6f949bed Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestNetworkBasicOps-821012630 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7991a1d8c73c45b69b7c4b7e6f949bed", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestNetworkBasicOps-821012630 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 7991a1d8c73c45b69b7c4b7e6f949bed Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestNetworkBasicOps-821012630 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestNetworkBasicOps-821012630-project Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: aead2241878446ba9d8b60f9d47aa703 Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestNetworkBasicOps-821012630-project Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f4801b7d-afc1-4146-8425-cd8700bc48da could not be found. Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f4801b7d-afc1-4146-8425-cd8700bc48da'} Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4801b7d-afc1-4146-8425-cd8700bc48da could not be found. Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4801b7d-afc1-4146-8425-cd8700bc48da could not be found. Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:25.634478 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4801b7d-afc1-4146-8425-cd8700bc48da could not be found. Jul 20 11:26:25.640117 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:25.648455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Returning 404 to user: Instance f4801b7d-afc1-4146-8425-cd8700bc48da could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:26:25.648455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fe18c324-4d52-4386-b9cd-6244a6af0150 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da" status: 404 len: 111 microversion: 2.1 time: 0.053781 Jul 20 11:26:25.648989 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2917/5853] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:25 2022] GET /compute/v2.1/servers/f4801b7d-afc1-4146-8425-cd8700bc48da => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:26:25.928479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-861676fc-a59d-4f08-b769-cbb2adcd48f8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '.version_select at 0x7f2c3e940940>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:25.955232 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-861676fc-a59d-4f08-b769-cbb2adcd48f8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1021083835" status: 202 len: 0 microversion: 2.1 time: 0.031049 Jul 20 11:26:25.956278 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2937/5854] 10.222.0.79 () {58 vars in 1256 bytes} [Wed Jul 20 11:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1021083835 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:26:26.165419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:26.166631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:26.181923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:26.184920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:26.188985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:26.189666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:26.569916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:26.581968 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6d986cc6-2a98-49cb-aff4-112c9a79e2f5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1301 microversion: 2.1 time: 0.420447 Jul 20 11:26:26.584207 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2918/5855] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:26 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1301 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:27.601093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:27.601730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:27.621469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:27.621937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:27.622739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:27.623384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:27.945927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:27.955715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f52ce30d-1654-4841-88a9-8282db6e7112 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1367 microversion: 2.1 time: 0.358308 Jul 20 11:26:27.959861 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2938/5856] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:27 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:28.977469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:28.978150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:28.987852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:28.988589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:28.989913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:28.990669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:29.356689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:29.366881 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a95ea74-6c3f-4471-98c6-27e5e842395b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1367 microversion: 2.1 time: 0.393184 Jul 20 11:26:29.377177 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2919/5857] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:28 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:29.586964 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c0968e27-9f10-424e-a7ad-c1f290ab3241 req-bd0b8209-d819-415d-8167-e7ea75595a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e52b10-d2f0-436a-b658-47485255d80d", "tag": "f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:29.617985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c0968e27-9f10-424e-a7ad-c1f290ab3241 req-bd0b8209-d819-415d-8167-e7ea75595a32 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:29.618459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c0968e27-9f10-424e-a7ad-c1f290ab3241 req-bd0b8209-d819-415d-8167-e7ea75595a32 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:29.657925 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c0968e27-9f10-424e-a7ad-c1f290ab3241 req-bd0b8209-d819-415d-8167-e7ea75595a32 service nova] Creating event network-changed:f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6 for instance e8e52b10-d2f0-436a-b658-47485255d80d on n-h2-846219-10 Jul 20 11:26:29.678387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c0968e27-9f10-424e-a7ad-c1f290ab3241 req-bd0b8209-d819-415d-8167-e7ea75595a32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099302 Jul 20 11:26:29.679450 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2939/5858] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:30.386544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:30.388641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:30.403792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:30.406372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:30.408654 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:30.410238 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:30.525171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-5ff3f8cc-e229-4fc3-87bd-cb3fc7576f3b req-a5530661-395c-486a-a1fb-7148eb43277b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e00be0e-67c3-4166-a0c4-c1aa91c09e73", "tag": "f6706c0e-074a-43d2-9038-bfaf91189ba1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:30.537740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5ff3f8cc-e229-4fc3-87bd-cb3fc7576f3b req-a5530661-395c-486a-a1fb-7148eb43277b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:30.538382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5ff3f8cc-e229-4fc3-87bd-cb3fc7576f3b req-a5530661-395c-486a-a1fb-7148eb43277b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:30.552941 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-5ff3f8cc-e229-4fc3-87bd-cb3fc7576f3b req-a5530661-395c-486a-a1fb-7148eb43277b service nova] Creating event network-changed:f6706c0e-074a-43d2-9038-bfaf91189ba1 for instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 on n-h1-846219-10 Jul 20 11:26:30.564639 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-5ff3f8cc-e229-4fc3-87bd-cb3fc7576f3b req-a5530661-395c-486a-a1fb-7148eb43277b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046404 Jul 20 11:26:30.565707 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2940/5859] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:30.942665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:30.944641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:30.967018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:30.969791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:30.975416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:30.976106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:31.029902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:26:31.126318 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:31.139199 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8437ac56-e98d-42a2-8349-18c6c3ab41e8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1367 microversion: 2.1 time: 0.757783 Jul 20 11:26:31.140879 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2920/5860] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:30 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1367 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:31.228836 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-073ceeb1-415f-4a29-9d09-89a230a9de78 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 204 len: 0 microversion: 2.1 time: 0.293298 Jul 20 11:26:31.230198 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2941/5861] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:26:30 2022] DELETE /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:26:31.238505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:31.239676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:31.247490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:31.248232 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:31.249574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:31.250173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:31.687518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:31.700047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5eabef43-52a9-4c0c-9c43-68d7d5ad0991 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1668 microversion: 2.1 time: 0.465348 Jul 20 11:26:31.700654 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2921/5862] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:31 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1668 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:31.740360 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4660d670-3de6-4188-83bd-0ae675843b57 req-9fd2cb19-a83d-479b-81b9-a2ffc9007018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86ac1b8-3460-4a36-a019-2b136791a087", "tag": "8927abaa-c914-4bcf-a031-86430bbbf1fa"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:31.761244 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4660d670-3de6-4188-83bd-0ae675843b57 req-9fd2cb19-a83d-479b-81b9-a2ffc9007018 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:31.762062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4660d670-3de6-4188-83bd-0ae675843b57 req-9fd2cb19-a83d-479b-81b9-a2ffc9007018 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:31.783502 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4660d670-3de6-4188-83bd-0ae675843b57 req-9fd2cb19-a83d-479b-81b9-a2ffc9007018 service nova] Creating event network-changed:8927abaa-c914-4bcf-a031-86430bbbf1fa for instance b86ac1b8-3460-4a36-a019-2b136791a087 on n-h2-846219-10 Jul 20 11:26:31.803919 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4660d670-3de6-4188-83bd-0ae675843b57 req-9fd2cb19-a83d-479b-81b9-a2ffc9007018 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064534 Jul 20 11:26:31.809228 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2942/5863] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:32.167562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:32.168408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:32.177899 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:32.178854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:32.182395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:32.183352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:32.724087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:32.725547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:32.744095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:32.746549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:32.747591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:32.749187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:32.789226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:33.141228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:33.158085 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8738fe11-2372-42c3-aa60-9035eb1f1d2b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1367 microversion: 2.1 time: 1.004306 Jul 20 11:26:33.186571 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2922/5864] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:32 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1367 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:33.333234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:33.345779 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c37d9796-e55e-4b8c-b594-adbce791fa68 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 200 len: 1668 microversion: 2.1 time: 0.630220 Jul 20 11:26:33.354026 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2943/5865] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:32 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 1668 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:33.429608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1e8cf2ce-c48c-407d-96ad-ffe1031a1c9b req-be7da844-badd-4732-86c3-b3e4f0a926df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86ac1b8-3460-4a36-a019-2b136791a087", "name": "network-vif-deleted", "tag": "8927abaa-c914-4bcf-a031-86430bbbf1fa"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:33.451543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1e8cf2ce-c48c-407d-96ad-ffe1031a1c9b req-be7da844-badd-4732-86c3-b3e4f0a926df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:33.452269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1e8cf2ce-c48c-407d-96ad-ffe1031a1c9b req-be7da844-badd-4732-86c3-b3e4f0a926df service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:33.480466 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1e8cf2ce-c48c-407d-96ad-ffe1031a1c9b req-be7da844-badd-4732-86c3-b3e4f0a926df service nova] Creating event network-vif-deleted:8927abaa-c914-4bcf-a031-86430bbbf1fa for instance b86ac1b8-3460-4a36-a019-2b136791a087 on n-h2-846219-10 Jul 20 11:26:33.497246 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1e8cf2ce-c48c-407d-96ad-ffe1031a1c9b req-be7da844-badd-4732-86c3-b3e4f0a926df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071130 Jul 20 11:26:33.503037 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2923/5866] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:34.183594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:34.184334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:34.194689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:34.195259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:34.196168 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:34.201344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:34.371972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:34.373595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: b86ac1b8-3460-4a36-a019-2b136791a087] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:34.376030 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:34.386411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:34.386862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:34.387671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:34.388115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:34.405735 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] HTTP exception thrown: Instance b86ac1b8-3460-4a36-a019-2b136791a087 could not be found. Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Request method failure captured: Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 HTTP/1.1 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-XelKELCXNXnh1Npp41qTNrFpQrJn5Q-ifyralogtNy95T7v1ELNQuT6hi-PF4k4Xq4GiKEQpEW_653y7fJLq2dt7kVKyGqm2pHkyUsgRnWR7hJPJLeKY8DpxkjWaG6Z1Vcg9inNhkQX75lMVwI5SECTzar9iVDxXk6bxplwXxevmI Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 7991a1d8c73c45b69b7c4b7e6f949bed Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestNetworkBasicOps-821012630 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7991a1d8c73c45b69b7c4b7e6f949bed", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestNetworkBasicOps-821012630 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 7991a1d8c73c45b69b7c4b7e6f949bed Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestNetworkBasicOps-821012630 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestNetworkBasicOps-821012630-project Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: aead2241878446ba9d8b60f9d47aa703 Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestNetworkBasicOps-821012630-project Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance b86ac1b8-3460-4a36-a019-2b136791a087 could not be found. Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'b86ac1b8-3460-4a36-a019-2b136791a087'} Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b86ac1b8-3460-4a36-a019-2b136791a087 could not be found. Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b86ac1b8-3460-4a36-a019-2b136791a087 could not be found. Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:26:34.407499 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b86ac1b8-3460-4a36-a019-2b136791a087 could not be found. Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Returning 404 to user: Instance b86ac1b8-3460-4a36-a019-2b136791a087 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:26:34.412023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1c11967b-d0ad-48f8-bc68-7333a33e2d86 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087" status: 404 len: 111 microversion: 2.1 time: 0.042681 Jul 20 11:26:34.412910 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2924/5867] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:34 2022] GET /compute/v2.1/servers/b86ac1b8-3460-4a36-a019-2b136791a087 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:26:34.541395 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:34.554948 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0e8f01fa-e866-40a8-9169-e2fbd9b810b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1367 microversion: 2.1 time: 0.376472 Jul 20 11:26:34.557720 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2944/5868] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:34 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:34.607656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-51994dd2-58da-4ce3-bf10-f9aa8d728c65 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '.version_select at 0x7f2c3f303d30>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:34.643281 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-51994dd2-58da-4ce3-bf10-f9aa8d728c65 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-23343967" status: 202 len: 0 microversion: 2.1 time: 0.039077 Jul 20 11:26:34.645063 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2925/5869] 10.222.0.79 () {58 vars in 1250 bytes} [Wed Jul 20 11:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-23343967 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:26:35.270270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-ce5d9c9d-a6d1-4722-a508-dce5fed23e4f req-50b3b6f4-0751-4b96-8a59-b43f431ef485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e52b10-d2f0-436a-b658-47485255d80d", "name": "network-vif-plugged", "status": "completed", "tag": "f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:35.287633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:35.289262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:35.297221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ce5d9c9d-a6d1-4722-a508-dce5fed23e4f req-50b3b6f4-0751-4b96-8a59-b43f431ef485 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:35.298100 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-ce5d9c9d-a6d1-4722-a508-dce5fed23e4f req-50b3b6f4-0751-4b96-8a59-b43f431ef485 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:35.317251 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-ce5d9c9d-a6d1-4722-a508-dce5fed23e4f req-50b3b6f4-0751-4b96-8a59-b43f431ef485 service nova] Creating event network-vif-plugged:f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6 for instance e8e52b10-d2f0-436a-b658-47485255d80d on n-h2-846219-10 Jul 20 11:26:35.323487 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-ce5d9c9d-a6d1-4722-a508-dce5fed23e4f req-50b3b6f4-0751-4b96-8a59-b43f431ef485 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058180 Jul 20 11:26:35.324613 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2945/5870] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:35.569896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=12 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:35.575858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:35.576625 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:35.584282 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:35.584864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:35.585877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:35.586521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:35.788349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:35.796855 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0095f18a-a132-4df8-b669-ec135e5968fc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1367 microversion: 2.1 time: 0.227692 Jul 20 11:26:35.798021 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2926/5871] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:35 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:36.817838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:36.818565 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:36.825429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:36.827768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:36.828457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:36.829342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:36.829792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:36.986248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:36.995594 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a33482f0-afd6-4c19-b89e-20d1f1a5e2b5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1556 microversion: 2.1 time: 0.183545 Jul 20 11:26:36.996117 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2946/5872] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:36 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:37.013397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:37.014123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:37.021366 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:37.022168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:37.023103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:37.023819 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:37.110188 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7678f468-fb90-49aa-8ba8-8c41037a2597 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102226 Jul 20 11:26:37.110850 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2927/5873] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:26:37 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:38.658205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9b929f51-eac3-41af-98e7-383d964d3892 req-5190b5b9-0e21-47d4-93a1-50e955011578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e52b10-d2f0-436a-b658-47485255d80d", "tag": "f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:38.678191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9b929f51-eac3-41af-98e7-383d964d3892 req-5190b5b9-0e21-47d4-93a1-50e955011578 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:38.678958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9b929f51-eac3-41af-98e7-383d964d3892 req-5190b5b9-0e21-47d4-93a1-50e955011578 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:38.699038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9b929f51-eac3-41af-98e7-383d964d3892 req-5190b5b9-0e21-47d4-93a1-50e955011578 service nova] Creating event network-changed:f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6 for instance e8e52b10-d2f0-436a-b658-47485255d80d on n-h2-846219-10 Jul 20 11:26:38.709081 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9b929f51-eac3-41af-98e7-383d964d3892 req-5190b5b9-0e21-47d4-93a1-50e955011578 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054955 Jul 20 11:26:38.709792 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2947/5874] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:46.229150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-58d3028a-33f5-4f14-8a45-4ed9ee151316 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'create', calling method: .version_select at 0x7f2c3fd685e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1585048828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTtXcKPtk0EgEPx4cmqWSOuI2jJqNnN++v4HzguuffBaPMeHgTD81DSRPhoTaOc6O61UV4/OFnvTBlvmniZAph+F78UWPhtFrpn8w2nciclh1/5wRur1epeukcSmtxDRg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:46.246388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-58d3028a-33f5-4f14-8a45-4ed9ee151316 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:26:46.253307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-58d3028a-33f5-4f14-8a45-4ed9ee151316 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for user aead2241878446ba9d8b60f9d47aa703 and project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:26:46.283689 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-58d3028a-33f5-4f14-8a45-4ed9ee151316 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.060807 Jul 20 11:26:46.284364 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2928/5875] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:26:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:47.500028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-904407685", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "1118001e-2f27-460e-a5d0-4f1e7f0e8d73"}], "key_name": "tempest-TestNetworkBasicOps-1585048828", "security_groups": [{"name": "tempest-secgroup-smoke-1649532972"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:47.628904 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] validate_networks() for [('1118001e-2f27-460e-a5d0-4f1e7f0e8d73', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:26:48.035536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:26:48.035960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:26:48.036428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:26:48.036838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:26:48.037249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:26:48.047363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:48.047819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:48.048617 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:48.049053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:48.069437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:26:48.075873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Getting quotas for user aead2241878446ba9d8b60f9d47aa703 and project 7991a1d8c73c45b69b7c4b7e6f949bed. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:26:48.089559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:26:48.092000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:26:48.142498 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b4e9d388-7ce2-48fe-ad6e-76a9408868cb tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.648633 Jul 20 11:26:48.143551 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2948/5876] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:26:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 11:26:48.153658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-684e0af1-064b-4365-9854-dc8d69283eb5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:48.154342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-684e0af1-064b-4365-9854-dc8d69283eb5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:48.160350 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=69 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:48.223883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-684e0af1-064b-4365-9854-dc8d69283eb5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:48.232376 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-684e0af1-064b-4365-9854-dc8d69283eb5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1248 microversion: 2.1 time: 0.083173 Jul 20 11:26:48.233675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2929/5877] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:48 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:26:49.250516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:49.251348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:49.260932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:49.261392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:49.262255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:49.262767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:49.332637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:49.340518 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab778aac-9099-467f-873e-0e08a73c31ad tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1308 microversion: 2.1 time: 0.094265 Jul 20 11:26:49.341089 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2949/5878] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:49 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:50.359075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:50.359728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:50.366875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:50.367307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:50.368670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:50.369801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:50.533301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:50.550536 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f428c38-3d05-439e-83ed-0634e2fd0c17 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.195271 Jul 20 11:26:50.551749 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2930/5879] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:50 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:50.722767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-477c8dd9-ae1d-4e4a-a295-b8f8d96ebad1 req-ab7549d8-6f7c-4c32-a74d-9f4568312ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe322d14-e8de-4e12-b6b4-40733070cad2", "tag": "f94529e9-beb2-471e-aab4-987ef6079e79"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:50.735548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-477c8dd9-ae1d-4e4a-a295-b8f8d96ebad1 req-ab7549d8-6f7c-4c32-a74d-9f4568312ad4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:50.736256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-477c8dd9-ae1d-4e4a-a295-b8f8d96ebad1 req-ab7549d8-6f7c-4c32-a74d-9f4568312ad4 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:50.751579 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-477c8dd9-ae1d-4e4a-a295-b8f8d96ebad1 req-ab7549d8-6f7c-4c32-a74d-9f4568312ad4 service nova] Creating event network-changed:f94529e9-beb2-471e-aab4-987ef6079e79 for instance fe322d14-e8de-4e12-b6b4-40733070cad2 on n-h1-846219-10 Jul 20 11:26:50.756931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-477c8dd9-ae1d-4e4a-a295-b8f8d96ebad1 req-ab7549d8-6f7c-4c32-a74d-9f4568312ad4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038180 Jul 20 11:26:50.758200 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2950/5880] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:51.568509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:51.569129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:51.576428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:51.576885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:51.577657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:51.578096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:51.817966 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:51.825836 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60c96e5f-fc71-445c-ab81-69250d436b0f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.261191 Jul 20 11:26:51.826420 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2931/5881] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:51 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:52.844298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:52.845250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:52.851522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:52.851975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:52.853431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:52.853872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:52.986500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:52.994570 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b3dc587-7f4c-453c-ab7e-e261c4fa8f28 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.155441 Jul 20 11:26:52.995150 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2951/5882] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:52 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:54.012127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:54.012651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:54.019698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:54.020146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:54.020913 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:54.021351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:54.157389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:54.165095 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-014a4f09-0edb-46a0-b1d2-d6f2835ba9fd tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.157567 Jul 20 11:26:54.166095 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2932/5883] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:54 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:55.182051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:55.182778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:55.189703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:55.190157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:55.190938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:55.191404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:55.333471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:55.341829 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9a381806-4ba5-4e4a-923b-2e3ed65e6694 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.163877 Jul 20 11:26:55.342428 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2952/5884] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:55 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:56.359384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:56.360009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:56.367156 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:56.367637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:56.368408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:56.368848 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:56.507039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:56.515428 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-38e4e2c2-d24f-414e-b1ae-1adfed69306b tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.159922 Jul 20 11:26:56.516014 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2933/5885] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:56 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:57.208161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-401507de-63ca-4735-9042-a48182f2fd5a req-8532ef43-cf8f-4c50-b693-4322790384b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe322d14-e8de-4e12-b6b4-40733070cad2", "name": "network-vif-plugged", "status": "completed", "tag": "f94529e9-beb2-471e-aab4-987ef6079e79"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:26:57.221334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-401507de-63ca-4735-9042-a48182f2fd5a req-8532ef43-cf8f-4c50-b693-4322790384b8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:57.221806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-401507de-63ca-4735-9042-a48182f2fd5a req-8532ef43-cf8f-4c50-b693-4322790384b8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:57.235269 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-401507de-63ca-4735-9042-a48182f2fd5a req-8532ef43-cf8f-4c50-b693-4322790384b8 service nova] Creating event network-vif-plugged:f94529e9-beb2-471e-aab4-987ef6079e79 for instance fe322d14-e8de-4e12-b6b4-40733070cad2 on n-h1-846219-10 Jul 20 11:26:57.240947 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-401507de-63ca-4735-9042-a48182f2fd5a req-8532ef43-cf8f-4c50-b693-4322790384b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036928 Jul 20 11:26:57.242057 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2953/5886] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:26:57.532220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:57.533564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:57.544658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:57.545114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:57.545896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:57.546523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:57.695041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:57.705148 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3cbb2014-a674-4d34-87f2-272d8633caf0 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.176978 Jul 20 11:26:57.705773 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2934/5887] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:57 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:58.725566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:58.726259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:58.731881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:58.732713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:58.740734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:58.741187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:58.741963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:58.742409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:58.880087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:26:58.888676 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-919cc3c4-46b0-4335-bca3-ae78c6d0d76e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1374 microversion: 2.1 time: 0.164128 Jul 20 11:26:58.889263 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2954/5888] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:58 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:26:59.906549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:26:59.907161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:26:59.909033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:26:59.916657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:59.917116 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:26:59.917901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:26:59.918338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:00.054730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:00.062850 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7eccfdca-0d08-4e07-8ffd-f7ef1a0939fa tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1547 microversion: 2.1 time: 0.160701 Jul 20 11:27:00.063485 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2935/5889] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:26:59 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:00.079243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:00.080470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:00.088000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:00.088461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:00.089236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:00.089675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:00.230673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:00.238343 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-08c6709a-6958-495a-a930-27d802efb5ca tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1547 microversion: 2.1 time: 0.162996 Jul 20 11:27:00.238919 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2955/5890] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:00 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:02.148231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-aed8846f-07d5-42e2-a5f7-4b27cec3429c req-8eca60aa-4aa7-4123-aa29-05f36a2ce2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe322d14-e8de-4e12-b6b4-40733070cad2", "tag": "f94529e9-beb2-471e-aab4-987ef6079e79"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:02.169138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-aed8846f-07d5-42e2-a5f7-4b27cec3429c req-8eca60aa-4aa7-4123-aa29-05f36a2ce2a0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:02.169247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-aed8846f-07d5-42e2-a5f7-4b27cec3429c req-8eca60aa-4aa7-4123-aa29-05f36a2ce2a0 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:02.181978 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-aed8846f-07d5-42e2-a5f7-4b27cec3429c req-8eca60aa-4aa7-4123-aa29-05f36a2ce2a0 service nova] Creating event network-changed:f94529e9-beb2-471e-aab4-987ef6079e79 for instance fe322d14-e8de-4e12-b6b4-40733070cad2 on n-h1-846219-10 Jul 20 11:27:02.187720 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-aed8846f-07d5-42e2-a5f7-4b27cec3429c req-8eca60aa-4aa7-4123-aa29-05f36a2ce2a0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047087 Jul 20 11:27:02.188345 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2936/5891] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:12.707248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:12.707824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:12.710868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:12.711704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=55 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:12.718232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:12.718679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:12.719895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:12.720264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:12.743950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6b81c08-dd82-49af-8cc7-fed92c4e98b7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/ips" status: 200 len: 148 microversion: 2.1 time: 0.040796 Jul 20 11:27:12.744523 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2956/5892] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:27:12 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:12.755466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:12.756218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=38 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:12.761227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2310f4f-871c-46d9-ab96-3ea27a16295e"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:12.762376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:12.771188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:12.771643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:12.772405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:12.772838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:12.863771 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Invalid volume: volume b2310f4f-871c-46d9-ab96-3ea27a16295e is already attached to instances: 993c9382-4ad5-41bb-a002-cde1f9203531 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/os-volume_attachments HTTP/1.1 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 74 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: {"volumeAttachment": {"volumeId": "b2310f4f-871c-46d9-ab96-3ea27a16295e"}} Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid volume: volume b2310f4f-871c-46d9-ab96-3ea27a16295e is already attached to instances: 993c9382-4ad5-41bb-a002-cde1f9203531 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'server_id': 'e8e52b10-d2f0-436a-b658-47485255d80d', 'body': {'volumeAttachment': {'volumeId': 'b2310f4f-871c-46d9-ab96-3ea27a16295e'}}} Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b2310f4f-871c-46d9-ab96-3ea27a16295e is already attached to instances: 993c9382-4ad5-41bb-a002-cde1f9203531 Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:27:12.865548 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b2310f4f-871c-46d9-ab96-3ea27a16295e is already attached to instances: 993c9382-4ad5-41bb-a002-cde1f9203531 Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b2310f4f-871c-46d9-ab96-3ea27a16295e is already attached to instances: 993c9382-4ad5-41bb-a002-cde1f9203531 Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 400 to user: Invalid volume: volume b2310f4f-871c-46d9-ab96-3ea27a16295e is already attached to instances: 993c9382-4ad5-41bb-a002-cde1f9203531 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9605c537-29a7-4cc0-bbe3-891a489b509d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113942 Jul 20 11:27:12.870160 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2937/5893] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:27:12 2022] POST /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:27:12.876527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:12.876957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:12.883194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:12.883668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:12.884484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:12.884911 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:12.912418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:27:12.987949 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e426c31-86db-473e-9b42-15056bfbbd1a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 204 len: 0 microversion: 2.1 time: 0.115618 Jul 20 11:27:12.988577 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2957/5894] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:27:12 2022] DELETE /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:27:12.996990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:12.997666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:13.004699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:13.005152 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:13.006062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:13.006592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:13.141810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:13.149555 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5223702-41bb-4b6c-86fa-f448b6a5b882 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1680 microversion: 2.1 time: 0.156467 Jul 20 11:27:13.150128 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2938/5895] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:12 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:14.168102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:14.168801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:14.176597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:14.177045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:14.177839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:14.178281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:14.342932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:14.351417 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-632d1851-5392-4e99-b03f-9a11f43d5e9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1680 microversion: 2.1 time: 0.187473 Jul 20 11:27:14.352011 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2958/5896] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:14 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:15.369874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:15.370539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:15.378421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:15.378873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:15.379677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:15.380128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:15.470063 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:15.479079 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9234b2d6-627c-4aef-a5c3-6864588f89e4 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 200 len: 1612 microversion: 2.1 time: 0.113163 Jul 20 11:27:15.480121 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2939/5897] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:15 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:15.486006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bc574905-8b15-4367-a8b9-098462c6a5b0 req-d521efb2-877c-46a2-ba1d-325309205d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e52b10-d2f0-436a-b658-47485255d80d", "name": "network-vif-deleted", "tag": "f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:15.515280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bc574905-8b15-4367-a8b9-098462c6a5b0 req-d521efb2-877c-46a2-ba1d-325309205d11 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:15.519299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bc574905-8b15-4367-a8b9-098462c6a5b0 req-d521efb2-877c-46a2-ba1d-325309205d11 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:15.546664 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bc574905-8b15-4367-a8b9-098462c6a5b0 req-d521efb2-877c-46a2-ba1d-325309205d11 service nova] Creating event network-vif-deleted:f75f8d5a-39b4-4cf8-807d-f8d2f2233fb6 for instance e8e52b10-d2f0-436a-b658-47485255d80d on n-h2-846219-10 Jul 20 11:27:15.561158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bc574905-8b15-4367-a8b9-098462c6a5b0 req-d521efb2-877c-46a2-ba1d-325309205d11 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082937 Jul 20 11:27:15.562526 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2959/5898] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:16.497970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:16.498589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:16.506709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:16.507161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:16.508302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:16.508800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:16.524560 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d HTTP/1.1 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e8e52b10-d2f0-436a-b658-47485255d80d'} Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:27:16.526132 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d61e9fb-a248-4e62-ab8f-adb2bef762c3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 404 len: 111 microversion: 2.1 time: 0.033579 Jul 20 11:27:16.531075 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2940/5899] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:16 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:27:16.538436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3c8aa0e1-1a85-429f-8cae-fda6a7aa7fc8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '.version_select at 0x7f2c3f106af0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:16.557691 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3c8aa0e1-1a85-429f-8cae-fda6a7aa7fc8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518782720" status: 202 len: 0 microversion: 2.1 time: 0.024230 Jul 20 11:27:16.558278 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2960/5900] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:27:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518782720 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:27:17.232659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:17.233161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:17.239987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:17.240472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:17.241277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:17.241718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:17.322110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lazy-loading 'services' on Instance uuid 993c9382-4ad5-41bb-a002-cde1f9203531 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:27:17.394268 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-23632dea-30be-49ba-9d44-9805b652e685 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments/b2310f4f-871c-46d9-ab96-3ea27a16295e" status: 202 len: 0 microversion: 2.1 time: 0.165435 Jul 20 11:27:17.394869 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2941/5901] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:27:17 2022] DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments/b2310f4f-871c-46d9-ab96-3ea27a16295e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:27:17.403340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:17.404402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:17.412033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:17.412489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:17.413349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:17.413793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:17.445553 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e298052-8ac5-486b-8e43-d3a7677e7d67 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Jul 20 11:27:17.446125 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2961/5902] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:27:17 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:18.459231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:18.460477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:18.467293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:18.467820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:18.468655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:18.469267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:18.502283 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6606e241-d2da-4c9a-8133-3ed28e88f84d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048984 Jul 20 11:27:18.502852 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2942/5903] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:27:18 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:19.513591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:19.514556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:19.522876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:19.523377 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:19.524157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:19.524805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:19.556773 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ccce64b7-57ee-40de-a372-1bbcd4d2686a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047301 Jul 20 11:27:19.557626 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2962/5904] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:27:19 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:20.568515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:20.569382 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:20.576571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:20.577023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:20.577784 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:20.578231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:20.609235 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0076c72a-fe9f-4909-9ae2-6711ae7f1f27 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Jul 20 11:27:20.610645 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2943/5905] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:27:20 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:27:21.622189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:21.623160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:21.630062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:21.630515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:21.631311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:21.631749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:21.662650 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4c8ff85e-b272-468d-97ad-924218f39aa0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Jul 20 11:27:21.663259 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2963/5906] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:27:21 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:22.674765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:22.675722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:22.682707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:22.683154 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:22.683952 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:22.684385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:22.714708 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-937abddb-3c29-422d-8430-0b509614d986 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044457 Jul 20 11:27:22.715291 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2944/5907] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:27:22 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:27:22.773701 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:22.774207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:22.781234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:22.781774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:22.782530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:22.782966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:22.807603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:27:22.881403 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-216104e2-b0e7-44e3-93d0-6381bad41202 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 204 len: 0 microversion: 2.1 time: 0.111242 Jul 20 11:27:22.882022 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2964/5908] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:27:22 2022] DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:27:22.890235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:22.891582 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:22.897881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:22.898332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:22.899101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:22.899567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:23.034071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:23.041674 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5b42d51-7f17-49d6-b740-95fbc1df0879 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1679 microversion: 2.1 time: 0.155367 Jul 20 11:27:23.042255 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2945/5909] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:22 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:24.060291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:24.061001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:24.068752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:24.069203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:24.069978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:24.070450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:24.211268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:24.219006 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-02173cdc-fedf-4292-992f-5247a3c15d33 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1679 microversion: 2.1 time: 0.163002 Jul 20 11:27:24.220381 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2965/5910] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:24 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:25.186329 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-9f79491c-d62e-4288-a0e5-9bdd0ad716e2 req-d621a774-29af-46b4-abe8-515278a369c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "993c9382-4ad5-41bb-a002-cde1f9203531", "name": "network-vif-deleted", "tag": "6d7ace99-4fb5-44b1-b58c-cea56b7930df"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:25.197713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9f79491c-d62e-4288-a0e5-9bdd0ad716e2 req-d621a774-29af-46b4-abe8-515278a369c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:25.200451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-9f79491c-d62e-4288-a0e5-9bdd0ad716e2 req-d621a774-29af-46b4-abe8-515278a369c7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:25.214586 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-9f79491c-d62e-4288-a0e5-9bdd0ad716e2 req-d621a774-29af-46b4-abe8-515278a369c7 service nova] Creating event network-vif-deleted:6d7ace99-4fb5-44b1-b58c-cea56b7930df for instance 993c9382-4ad5-41bb-a002-cde1f9203531 on n-h2-846219-10 Jul 20 11:27:25.221109 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-9f79491c-d62e-4288-a0e5-9bdd0ad716e2 req-d621a774-29af-46b4-abe8-515278a369c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040689 Jul 20 11:27:25.222464 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2946/5911] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:25.238185 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:25.239580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:25.255207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:25.256010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:25.257053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:25.257709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:25.349028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:25.365951 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7eebd067-bafd-44b8-9796-ab403a23b2c7 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 200 len: 1325 microversion: 2.1 time: 0.132088 Jul 20 11:27:25.367000 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2966/5912] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:25 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 1325 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:26.384711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:26.385424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:26.392805 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:26.393263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:26.394045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:26.394488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:26.410248 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 HTTP/1.1 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '993c9382-4ad5-41bb-a002-cde1f9203531'} Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:27:26.411973 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-514bfd8d-2dc4-4734-8398-0ec879a22138 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 404 len: 111 microversion: 2.1 time: 0.033973 Jul 20 11:27:26.416666 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2947/5913] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:26 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:27:26.422785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fab93569-fe90-4216-9118-3d630cb8709b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '.version_select at 0x7f2c3fee2700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:26.442932 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fab93569-fe90-4216-9118-3d630cb8709b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113850532" status: 202 len: 0 microversion: 2.1 time: 0.024082 Jul 20 11:27:26.443576 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2967/5914] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113850532 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:27:27.078559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-606c86f4-9795-47d4-a48a-03dc8cb22bce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: .version_select at 0x7f2c3ee3e8b0>, body: {"keypair": {"name": "tempest-keypair-1100828388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzqi4ZrCRHpY/KXqLaniBtsZcxGMsKjpcZE+FBCpvqtV+LxSuXJ3ikG1WJBQ4lfCEgbI5zP6IEAuJvpumr16gwA/c9NY6GL7JnegxR6PMo9fq/NNERyA2snLVwnmzmNfg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:27.093748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-606c86f4-9795-47d4-a48a-03dc8cb22bce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:27:27.099728 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-606c86f4-9795-47d4-a48a-03dc8cb22bce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:27:27.123762 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-606c86f4-9795-47d4-a48a-03dc8cb22bce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049243 Jul 20 11:27:27.124371 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2948/5915] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:27:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:28.421412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2075327861", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9ddebef-2263-4847-bf1c-8851149dd003"}], "security_groups": [{"name": "tempest-securitygroup--360295668"}], "key_name": "tempest-keypair-1100828388", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:28.524636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] validate_networks() for [('b9ddebef-2263-4847-bf1c-8851149dd003', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:27:28.901158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:27:28.901599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:27:28.902082 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:27:28.902543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:27:28.902975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:27:28.912172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:28.912632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:28.913449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:28.913896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:28.930878 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:27:28.936206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:27:28.949353 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:27:28.951681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:27:28.997728 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8b3478c5-25a9-4c03-bdf7-1d47d0ba0d63 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.581520 Jul 20 11:27:29.001316 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2968/5916] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:27:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:27:29.014457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9cf86cb3-3c0b-4cbe-9a54-c029ad8609e2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:29.015490 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9cf86cb3-3c0b-4cbe-9a54-c029ad8609e2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:29.073333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9cf86cb3-3c0b-4cbe-9a54-c029ad8609e2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:29.080999 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9cf86cb3-3c0b-4cbe-9a54-c029ad8609e2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1242 microversion: 2.1 time: 0.071527 Jul 20 11:27:29.081616 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2949/5917] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:29 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:30.100009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:30.100767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:30.108616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:30.109070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:30.111629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:30.112099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:30.191499 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:30.200684 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1984722b-3956-4de1-99a5-f5e45f8b55ee tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1300 microversion: 2.1 time: 0.106714 Jul 20 11:27:30.201277 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2969/5918] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:30 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:31.218524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:31.220396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:31.227858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:31.228690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:31.229552 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:31.230383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:31.349936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-1a9f44ed-3094-4490-b9a8-67ce63f207a2 req-ed6af5a1-281e-4a30-a947-e35d08bfe7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4ed53e-94e7-406a-bff2-f2b936b86469", "tag": "636aa65b-48b6-404e-821b-4b54c067a5ff"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:31.361057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1a9f44ed-3094-4490-b9a8-67ce63f207a2 req-ed6af5a1-281e-4a30-a947-e35d08bfe7a3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:31.361504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-1a9f44ed-3094-4490-b9a8-67ce63f207a2 req-ed6af5a1-281e-4a30-a947-e35d08bfe7a3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:31.385375 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-1a9f44ed-3094-4490-b9a8-67ce63f207a2 req-ed6af5a1-281e-4a30-a947-e35d08bfe7a3 service nova] Creating event network-changed:636aa65b-48b6-404e-821b-4b54c067a5ff for instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 on n-h2-846219-10 Jul 20 11:27:31.392233 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-1a9f44ed-3094-4490-b9a8-67ce63f207a2 req-ed6af5a1-281e-4a30-a947-e35d08bfe7a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047963 Jul 20 11:27:31.392961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2970/5919] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:31.513186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:31.522506 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dd61c539-8034-45a3-a616-e16874610983 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1367 microversion: 2.1 time: 0.308360 Jul 20 11:27:31.523297 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2950/5920] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:31 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:32.541044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:32.541755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:32.548296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:32.548751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:32.549522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:32.549967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:32.681567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:32.689643 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-55e437b6-4903-4396-9d91-26d29027efb1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1367 microversion: 2.1 time: 0.153723 Jul 20 11:27:32.690244 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2971/5921] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:32 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:33.707137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:33.707708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:33.715496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:33.715948 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:33.716731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:33.717166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:33.862454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:33.870069 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-392a0ef8-6500-48f2-a2bc-5191b8e04b0b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1367 microversion: 2.1 time: 0.168039 Jul 20 11:27:33.870650 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2951/5922] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:33 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:34.888220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:34.888840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:34.896570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:34.897027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:34.897806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:34.898253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:35.032087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:35.039559 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-73a46063-758e-4165-8095-4bc9b9491ce0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1367 microversion: 2.1 time: 0.155216 Jul 20 11:27:35.040136 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2972/5923] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:34 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:35.363609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-09e47af6-3625-4768-adcc-e5d72b11e7cb req-45e19911-f817-4a66-bded-0c62a47df3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4ed53e-94e7-406a-bff2-f2b936b86469", "name": "network-vif-plugged", "status": "completed", "tag": "636aa65b-48b6-404e-821b-4b54c067a5ff"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:35.372550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-09e47af6-3625-4768-adcc-e5d72b11e7cb req-45e19911-f817-4a66-bded-0c62a47df3b8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:35.372976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-09e47af6-3625-4768-adcc-e5d72b11e7cb req-45e19911-f817-4a66-bded-0c62a47df3b8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:35.384707 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-09e47af6-3625-4768-adcc-e5d72b11e7cb req-45e19911-f817-4a66-bded-0c62a47df3b8 service nova] Creating event network-vif-plugged:636aa65b-48b6-404e-821b-4b54c067a5ff for instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 on n-h2-846219-10 Jul 20 11:27:35.389793 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-09e47af6-3625-4768-adcc-e5d72b11e7cb req-45e19911-f817-4a66-bded-0c62a47df3b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Jul 20 11:27:35.390410 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2952/5924] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:36.056989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:36.057640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:36.065237 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:36.065698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:36.066482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:36.066925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:36.085739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:36.204228 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:36.211989 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8d3d74d-4ca6-48e3-9ebf-fc478abd5bf9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1367 microversion: 2.1 time: 0.158955 Jul 20 11:27:36.212568 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2973/5925] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:36 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:27:37.231130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:37.231871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:37.238882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:37.239396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:37.240165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:37.240606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:37.372341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:27:37.381839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d394a4e-6706-442c-a23a-b6ddd8117bdf tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1556 microversion: 2.1 time: 0.155890 Jul 20 11:27:37.382409 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2953/5926] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:27:37 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:27:37.397751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:27:37.398279 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:37.405202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:37.405653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:37.406453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:37.406976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:37.489045 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4a0a34d9-0d4a-4b86-abf8-e506939ac225 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095038 Jul 20 11:27:37.489671 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2974/5927] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:27:37 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:38.549620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4107384c-643a-4a36-96f3-f9cc80e81882 req-a37045cf-0c59-431b-a1f9-f7cde3e8f184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4ed53e-94e7-406a-bff2-f2b936b86469", "tag": "636aa65b-48b6-404e-821b-4b54c067a5ff"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:38.558754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4107384c-643a-4a36-96f3-f9cc80e81882 req-a37045cf-0c59-431b-a1f9-f7cde3e8f184 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:38.559304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4107384c-643a-4a36-96f3-f9cc80e81882 req-a37045cf-0c59-431b-a1f9-f7cde3e8f184 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:38.571779 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4107384c-643a-4a36-96f3-f9cc80e81882 req-a37045cf-0c59-431b-a1f9-f7cde3e8f184 service nova] Creating event network-changed:636aa65b-48b6-404e-821b-4b54c067a5ff for instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 on n-h2-846219-10 Jul 20 11:27:38.576921 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4107384c-643a-4a36-96f3-f9cc80e81882 req-a37045cf-0c59-431b-a1f9-f7cde3e8f184 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Jul 20 11:27:38.577652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2954/5928] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:27:41.460226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:41.460912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:27:41.465495 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:27:41.466615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:27:41.474020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:41.474466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:41.475248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:27:41.475682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:27:41.544698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-968277ab-0069-41ac-9355-89df1be7821e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2/action" status: 200 len: 24569 microversion: 2.1 time: 0.085840 Jul 20 11:27:41.545529 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2975/5929] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:27:41 2022] POST /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2/action => generated 24569 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:28:03.820411 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:03.822969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:03.823664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:03.829102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2062815192", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "57dd0b9d-b925-4dd5-b0d9-dc6a093360dd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2100027535", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4e00be0e-67c3-4166-a0c4-c1aa91c09e73"]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:03.896373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] validate_networks() for [('57dd0b9d-b925-4dd5-b0d9-dc6a093360dd', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:28:04.439750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:28:04.440401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:28:04.441749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:28:04.442544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:28:04.442979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:28:04.457752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:04.458210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:04.459007 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:04.459473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:04.487365 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Getting quotas for project efb06e44c7eb4162954af057f35100b4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:28:04.495958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Getting quotas for user 5645e229a525480ea53a81c20feaf916 and project efb06e44c7eb4162954af057f35100b4. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:28:04.517008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:28:04.520313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:28:04.583188 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f7a0df3-9416-4960-9c5a-037b1b0a940d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.763214 Jul 20 11:28:04.584259 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2955/5930] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:28:03 2022] POST /compute/v2.1/servers => generated 361 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:28:04.605657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf083b7b-9879-48f6-bb39-b30f87762f72 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:04.607280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf083b7b-9879-48f6-bb39-b30f87762f72 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:04.621181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:04.627455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:04.728218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf083b7b-9879-48f6-bb39-b30f87762f72 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:04.739864 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf083b7b-9879-48f6-bb39-b30f87762f72 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1242 microversion: 2.1 time: 0.148946 Jul 20 11:28:04.751935 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2976/5931] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:04 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:05.760283 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:05.760901 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:05.767406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:05.767862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:05.768709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:05.769378 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:05.839390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:05.848585 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-78dbcd43-4581-43a6-a9be-1f004da35046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1294 microversion: 2.1 time: 0.093523 Jul 20 11:28:05.849537 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2956/5932] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:05 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:28:06.866791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:06.867685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:06.881579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:06.882738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:06.883789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:06.884389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:07.010855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:07.019569 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f0fdab8-2539-4052-8f16-39d94eb4fb1d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1300 microversion: 2.1 time: 0.157269 Jul 20 11:28:07.020163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2977/5933] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:06 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:07.548196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-08183c45-0e98-424f-ba19-6a0fb3fdab0d req-e181bf2a-4159-4be4-99c7-1ecb76f93b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30792a41-072c-44e2-9637-e1bcf7ba3a26", "tag": "8fc562e1-827b-4a33-879b-087e0949629a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:07.565638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-08183c45-0e98-424f-ba19-6a0fb3fdab0d req-e181bf2a-4159-4be4-99c7-1ecb76f93b71 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:07.566074 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-08183c45-0e98-424f-ba19-6a0fb3fdab0d req-e181bf2a-4159-4be4-99c7-1ecb76f93b71 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:07.580532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-08183c45-0e98-424f-ba19-6a0fb3fdab0d req-e181bf2a-4159-4be4-99c7-1ecb76f93b71 service nova] Creating event network-changed:8fc562e1-827b-4a33-879b-087e0949629a for instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 on n-h2-846219-10 Jul 20 11:28:07.586586 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-08183c45-0e98-424f-ba19-6a0fb3fdab0d req-e181bf2a-4159-4be4-99c7-1ecb76f93b71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042229 Jul 20 11:28:07.587753 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2957/5934] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:08.038451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:08.039064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:08.046084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:08.046528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:08.047328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:08.047793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:08.136651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:08.145161 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1e147d21-e907-4131-9df3-032136c4849c tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1300 microversion: 2.1 time: 0.111407 Jul 20 11:28:08.145660 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2978/5935] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:08 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:28:09.163160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:09.163941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:09.171970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:09.172342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:09.173313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:09.173751 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:09.303495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:09.312373 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8f4d4432-ad59-4529-bc13-b6f6f4c60191 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1300 microversion: 2.1 time: 0.154653 Jul 20 11:28:09.313121 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2958/5936] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:09 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:10.332158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:10.332756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:10.339891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:10.340339 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:10.341101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:10.341535 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:10.425638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:10.433166 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a3d0e092-4454-45f3-ba4c-aa7ea4ee6b86 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1300 microversion: 2.1 time: 0.105997 Jul 20 11:28:10.433731 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2979/5937] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:10 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:28:11.451008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:11.451547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:11.460841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:11.460841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:11.461107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:11.461462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:11.547197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:11.555196 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8ae62ff2-66a6-4860-ad49-2bba5a5fad11 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1300 microversion: 2.1 time: 0.108270 Jul 20 11:28:11.555771 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2959/5938] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:11 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:11.756923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-bdaae3b7-8c21-4ff1-91c5-5dc048bf0ded req-6209231a-423b-475f-b6a4-25f26ac74d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30792a41-072c-44e2-9637-e1bcf7ba3a26", "name": "network-vif-plugged", "status": "completed", "tag": "8fc562e1-827b-4a33-879b-087e0949629a"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:11.765196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bdaae3b7-8c21-4ff1-91c5-5dc048bf0ded req-6209231a-423b-475f-b6a4-25f26ac74d73 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:11.765719 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-bdaae3b7-8c21-4ff1-91c5-5dc048bf0ded req-6209231a-423b-475f-b6a4-25f26ac74d73 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:11.776702 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-bdaae3b7-8c21-4ff1-91c5-5dc048bf0ded req-6209231a-423b-475f-b6a4-25f26ac74d73 service nova] Creating event network-vif-plugged:8fc562e1-827b-4a33-879b-087e0949629a for instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 on n-h2-846219-10 Jul 20 11:28:11.781575 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-bdaae3b7-8c21-4ff1-91c5-5dc048bf0ded req-6209231a-423b-475f-b6a4-25f26ac74d73 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164658 Jul 20 11:28:11.782162 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2980/5939] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:12.571549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:12.572160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:12.579142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:12.579621 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:12.580380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:12.581393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:12.665103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:12.672686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c8440903-f5ea-46fc-bb2d-371290cec981 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1300 microversion: 2.1 time: 0.105082 Jul 20 11:28:12.673250 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2960/5940] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:12 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:13.452642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:13.453172 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:13.459733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.460182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.460946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.461386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.486660 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-63a176c8-b10c-4b03-b8a4-2c9669af1607 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/ips" status: 200 len: 148 microversion: 2.1 time: 0.039205 Jul 20 11:28:13.488284 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2981/5941] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:28:13 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:28:13.689252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:13.690640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:13.703425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.704015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.704908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.705431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.807860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:13.815828 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b2dc987a-c8e2-4091-a141-983c8494229d tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1473 microversion: 2.1 time: 0.130462 Jul 20 11:28:13.816632 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2961/5942] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:13 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1473 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:13.833577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:13.834195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:13.840969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.841416 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.842180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.842612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.931753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:13.939866 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a806bd9c-95cf-4b5b-94ae-5ff75c5c41c2 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1473 microversion: 2.1 time: 0.111680 Jul 20 11:28:13.940552 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2982/5943] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:13 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1473 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:28:13.956239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:13.957267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:13.963573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.964216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:13.964997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:13.965445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.055989 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c796ced-a8b5-4d09-b40d-fa926b588ca2 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1626 microversion: 2.1 time: 0.104149 Jul 20 11:28:14.056595 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2962/5944] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:13 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1626 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:14.072062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:14.072783 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:14.079195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.079673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.080487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.081478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.246153 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eb30e1d3-413c-4f17-bbee-1101049cd664 tempest-TestSecurityGroupsBasicOps-1131793814 tempest-TestSecurityGroupsBasicOps-1131793814-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1914 microversion: 2.1 time: 0.177718 Jul 20 11:28:14.247317 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2983/5945] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:14 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1914 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:14.306304 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:14.306798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:14.313086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.313577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.314342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.315464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.341917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:28:14.430814 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f2ddb935-b0f9-4222-a05d-ba656f660edb tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 204 len: 0 microversion: 2.1 time: 0.128082 Jul 20 11:28:14.438297 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2963/5946] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:28:14 2022] DELETE /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:28:14.447247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:14.448573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:14.456262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.457014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.457624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.458137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.558406 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:14.567069 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-503779d6-43d7-4aa3-a22b-837076d9f7ba tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1479 microversion: 2.1 time: 0.123906 Jul 20 11:28:14.567845 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2984/5947] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:14 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1479 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:14.812990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4980d6cd-1093-4053-a0be-5b67865886d8"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:14.814155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:14.816666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:14.817338 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:14.824725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.825180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:14.825955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:14.826393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:15.585053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:15.585768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:15.588013 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:15.595192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:15.595917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:15.596708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:15.597239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:15.605000 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-64d3c4d0-013e-418f-9164-aa9bf7bdb4e5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796189 Jul 20 11:28:15.605891 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2964/5948] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:28:14 2022] POST /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:28:15.689069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:15.697748 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aea28c6a-ebad-40b9-972b-e4d4dabd0046 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 200 len: 1479 microversion: 2.1 time: 0.116691 Jul 20 11:28:15.698338 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2985/5949] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:15 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 1479 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:28:16.225219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-dae69bdf-a311-4569-bf4e-aac66c8287ec req-547c7a0c-3871-453b-bdfc-518215509d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30792a41-072c-44e2-9637-e1bcf7ba3a26", "name": "network-vif-deleted", "tag": "8fc562e1-827b-4a33-879b-087e0949629a"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:16.235254 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-dae69bdf-a311-4569-bf4e-aac66c8287ec req-547c7a0c-3871-453b-bdfc-518215509d2a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:16.235634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-dae69bdf-a311-4569-bf4e-aac66c8287ec req-547c7a0c-3871-453b-bdfc-518215509d2a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:16.248953 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-dae69bdf-a311-4569-bf4e-aac66c8287ec req-547c7a0c-3871-453b-bdfc-518215509d2a service nova] Creating event network-vif-deleted:8fc562e1-827b-4a33-879b-087e0949629a for instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 on n-h2-846219-10 Jul 20 11:28:16.255558 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-dae69bdf-a311-4569-bf4e-aac66c8287ec req-547c7a0c-3871-453b-bdfc-518215509d2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036028 Jul 20 11:28:16.256787 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2965/5950] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:16.714169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:16.715009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 30792a41-072c-44e2-9637-e1bcf7ba3a26] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:16.723387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:16.723838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:16.724607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:16.727132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:16.745840 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] HTTP exception thrown: Instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 could not be found. Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Request method failure captured: Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 HTTP/1.1 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-ZFqEjd0lZbzyGRR03LNnSgsRs8Ywt4CuaEFGWTVQxHcU1nicQCAh2rOP6rLIZGL8laxcggL7xHX9E3OvqNBHLUqJhPi0fFnUIRXxjsqCcdig6k-pC9iyf0J9lqY1TemeomuLqmNveShwaWJLfU-Bb2xm8mJ_8VtvpOO0BhbysGNX8 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: efb06e44c7eb4162954af057f35100b4 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1828060069 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efb06e44c7eb4162954af057f35100b4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efb06e44c7eb4162954af057f35100b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efb06e44c7eb4162954af057f35100b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efb06e44c7eb4162954af057f35100b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1828060069 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: efb06e44c7eb4162954af057f35100b4 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1828060069 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestSecurityGroupsBasicOps-1828060069-project Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 5645e229a525480ea53a81c20feaf916 Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1828060069-project Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 could not be found. Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '30792a41-072c-44e2-9637-e1bcf7ba3a26'} Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 could not be found. Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 could not be found. Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:16.747553 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 could not be found. Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Returning 404 to user: Instance 30792a41-072c-44e2-9637-e1bcf7ba3a26 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5a161d7d-3d08-4d71-8338-9320b371cd35 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26" status: 404 len: 111 microversion: 2.1 time: 0.038909 Jul 20 11:28:16.753271 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2986/5951] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:16 2022] GET /compute/v2.1/servers/30792a41-072c-44e2-9637-e1bcf7ba3a26 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:28:21.232790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:21.233359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2e482a88-bb61-4a43-99d6-c7e310dda4c8 req-0750eb14-4d14-46bb-bcf2-88961751e54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e00be0e-67c3-4166-a0c4-c1aa91c09e73", "tag": "f6706c0e-074a-43d2-9038-bfaf91189ba1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:21.233737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:21.241927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:21.242607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:21.243416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:21.243684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2e482a88-bb61-4a43-99d6-c7e310dda4c8 req-0750eb14-4d14-46bb-bcf2-88961751e54a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:21.244003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:21.244334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2e482a88-bb61-4a43-99d6-c7e310dda4c8 req-0750eb14-4d14-46bb-bcf2-88961751e54a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:21.256494 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2e482a88-bb61-4a43-99d6-c7e310dda4c8 req-0750eb14-4d14-46bb-bcf2-88961751e54a service nova] Creating event network-changed:f6706c0e-074a-43d2-9038-bfaf91189ba1 for instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 on n-h1-846219-10 Jul 20 11:28:21.261637 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2e482a88-bb61-4a43-99d6-c7e310dda4c8 req-0750eb14-4d14-46bb-bcf2-88961751e54a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032041 Jul 20 11:28:21.262363 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2987/5952] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:28:21.273425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:28:21.367142 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-630e944c-086b-41bc-b0b8-b0781ef8b839 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 204 len: 0 microversion: 2.1 time: 0.139447 Jul 20 11:28:21.368544 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2966/5953] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:28:21 2022] DELETE /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:28:21.378103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:21.379462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:21.386026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:21.386748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:21.387638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:21.388427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:21.539773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:21.548046 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1ac693b-46bd-4b0b-a94f-51f118eb094a tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1767 microversion: 2.1 time: 0.174946 Jul 20 11:28:21.548660 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2988/5954] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:21 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1767 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:22.567407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:22.568115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:22.575036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:22.575528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:22.576421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:22.576866 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:22.730720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:22.739404 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e10294c5-4266-42db-91a4-38ca05f11135 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1767 microversion: 2.1 time: 0.177081 Jul 20 11:28:22.740073 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2967/5955] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:22 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1767 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:23.616696 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a2bea7ab-53ec-45f6-bc64-ad564514f604 req-ffb59119-b6a5-48ff-a570-ca83aac0a177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e00be0e-67c3-4166-a0c4-c1aa91c09e73", "name": "network-vif-deleted", "tag": "f6706c0e-074a-43d2-9038-bfaf91189ba1"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:23.625002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a2bea7ab-53ec-45f6-bc64-ad564514f604 req-ffb59119-b6a5-48ff-a570-ca83aac0a177 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:23.625454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a2bea7ab-53ec-45f6-bc64-ad564514f604 req-ffb59119-b6a5-48ff-a570-ca83aac0a177 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:23.637976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a2bea7ab-53ec-45f6-bc64-ad564514f604 req-ffb59119-b6a5-48ff-a570-ca83aac0a177 service nova] Creating event network-vif-deleted:f6706c0e-074a-43d2-9038-bfaf91189ba1 for instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 on n-h1-846219-10 Jul 20 11:28:23.642868 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a2bea7ab-53ec-45f6-bc64-ad564514f604 req-ffb59119-b6a5-48ff-a570-ca83aac0a177 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096406 Jul 20 11:28:23.643834 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2989/5956] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:23.757267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:23.757790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:23.764803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:23.765258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:23.766027 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:23.766472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:23.800686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:23.801299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:23.801852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lazy-loading 'fault' on Instance uuid 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:28:23.804686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:23.845909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e229a525480ea53a81c20feaf916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb06e44c7eb4162954af057f35100b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:23.854448 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8b2a3041-fbe0-42d9-b3f8-a2bb1572926e tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 200 len: 1385 microversion: 2.1 time: 0.101849 Jul 20 11:28:23.855046 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2968/5957] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:23 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 1385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:24.874049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:24.874769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] [instance: 4e00be0e-67c3-4166-a0c4-c1aa91c09e73] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:24.881893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:24.882351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:24.883122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:24.883650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:24.897685 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] HTTP exception thrown: Instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 could not be found. Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Request method failure captured: Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 HTTP/1.1 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-ZFqEjd0lZbzyGRR03LNnSgsRs8Ywt4CuaEFGWTVQxHcU1nicQCAh2rOP6rLIZGL8laxcggL7xHX9E3OvqNBHLUqJhPi0fFnUIRXxjsqCcdig6k-pC9iyf0J9lqY1TemeomuLqmNveShwaWJLfU-Bb2xm8mJ_8VtvpOO0BhbysGNX8 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: efb06e44c7eb4162954af057f35100b4 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1828060069 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_efb06e44c7eb4162954af057f35100b4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efb06e44c7eb4162954af057f35100b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/efb06e44c7eb4162954af057f35100b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/efb06e44c7eb4162954af057f35100b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1828060069 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: efb06e44c7eb4162954af057f35100b4 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1828060069 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestSecurityGroupsBasicOps-1828060069-project Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 5645e229a525480ea53a81c20feaf916 Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1828060069-project Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 could not be found. Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '4e00be0e-67c3-4166-a0c4-c1aa91c09e73'} Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 could not be found. Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 could not be found. Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:24.899659 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 could not be found. Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Returning 404 to user: Instance 4e00be0e-67c3-4166-a0c4-c1aa91c09e73 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-21ec2a99-8d1e-400c-a05a-6fefc2104bda tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73" status: 404 len: 111 microversion: 2.1 time: 0.032060 Jul 20 11:28:24.904215 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2990/5958] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:24 2022] GET /compute/v2.1/servers/4e00be0e-67c3-4166-a0c4-c1aa91c09e73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:28:27.503496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4980d6cd-1093-4053-a0be-5b67865886d8"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:27.504647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:27.515500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:27.516229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:27.517009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:27.517674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:27.616449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Invalid volume: volume 4980d6cd-1093-4053-a0be-5b67865886d8 is already attached to instances: 1b4ed53e-94e7-406a-bff2-f2b936b86469 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments HTTP/1.1 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 74 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: {"volumeAttachment": {"volumeId": "4980d6cd-1093-4053-a0be-5b67865886d8"}} Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: exception: Invalid volume: volume 4980d6cd-1093-4053-a0be-5b67865886d8 is already attached to instances: 1b4ed53e-94e7-406a-bff2-f2b936b86469 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'server_id': '1b4ed53e-94e7-406a-bff2-f2b936b86469', 'body': {'volumeAttachment': {'volumeId': '4980d6cd-1093-4053-a0be-5b67865886d8'}}} Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4980d6cd-1093-4053-a0be-5b67865886d8 is already attached to instances: 1b4ed53e-94e7-406a-bff2-f2b936b86469 Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:28:27.618638 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4980d6cd-1093-4053-a0be-5b67865886d8 is already attached to instances: 1b4ed53e-94e7-406a-bff2-f2b936b86469 Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4980d6cd-1093-4053-a0be-5b67865886d8 is already attached to instances: 1b4ed53e-94e7-406a-bff2-f2b936b86469 Jul 20 11:28:27.622399 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:27.625401 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 400 to user: Invalid volume: volume 4980d6cd-1093-4053-a0be-5b67865886d8 is already attached to instances: 1b4ed53e-94e7-406a-bff2-f2b936b86469 {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:27.626568 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-29045acf-6b2d-496f-93aa-053a2ffa0e44 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127972 Jul 20 11:28:27.628408 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2969/5959] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:28:27 2022] POST /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 11:28:27.704620 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:27.706357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:27.714575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:27.715356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:27.716316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:27.716927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:27.841803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lazy-loading 'services' on Instance uuid 1b4ed53e-94e7-406a-bff2-f2b936b86469 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:28:27.932404 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d1c500e1-d022-4d15-8a1a-8e29040d53cd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments/4980d6cd-1093-4053-a0be-5b67865886d8" status: 202 len: 0 microversion: 2.1 time: 0.230053 Jul 20 11:28:27.937055 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2991/5960] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:28:27 2022] DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments/4980d6cd-1093-4053-a0be-5b67865886d8 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:28:27.947047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:27.948070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:27.957264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:27.957774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:27.958824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:27.959334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:27.994647 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-259fb9e8-2b8f-4790-b791-9bb65a5d53c1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055545 Jul 20 11:28:27.998510 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2970/5961] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:28:27 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:28.626366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-89ad3de7-db08-49db-85de-7fd203dd5936 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] Calling method '.version_select at 0x7f2c3f9f2c10>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:28.649681 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-89ad3de7-db08-49db-85de-7fd203dd5936 tempest-TestSecurityGroupsBasicOps-1828060069 tempest-TestSecurityGroupsBasicOps-1828060069-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2100027535" status: 202 len: 0 microversion: 2.1 time: 0.027581 Jul 20 11:28:28.650379 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2992/5962] 10.222.0.79 () {58 vars in 1277 bytes} [Wed Jul 20 11:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2100027535 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:28:29.006995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:29.008252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:29.015746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:29.016287 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:29.017139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:29.018229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:29.051251 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3573fe52-0081-4503-b519-58c2e9441c32 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Jul 20 11:28:29.052249 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2971/5963] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:28:29 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:30.020695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:30.022092 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:30.029723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:30.030251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:30.031325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:30.031767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:30.062602 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:30.063779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:30.079266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:30.079742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:30.083427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:30.083887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:30.119943 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0fb4023-3387-4c3e-8f60-d714d872f102 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061439 Jul 20 11:28:30.120543 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2972/5964] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:28:30 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:30.120958 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a9ebc155-48d8-4e51-9d69-c4ae1ce85d61 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "POST /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2/action" status: 200 len: 32640 microversion: 2.1 time: 0.105470 Jul 20 11:28:30.128423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2993/5965] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:28:30 2022] POST /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2/action => generated 32640 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 11:28:31.132924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:31.133869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:31.140810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.141270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.142052 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.143406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.180315 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e245551c-bbdc-46b0-baec-2b474f3c9b9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051702 Jul 20 11:28:31.180899 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2973/5966] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:28:31 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:31.232980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:31.234189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:31.234630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-79ff6ae0-4b67-4b12-a4c2-b79cd9073b96 req-6aa7cfb2-ac4f-40ad-8f51-abbdc1f80707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe322d14-e8de-4e12-b6b4-40733070cad2", "tag": "f94529e9-beb2-471e-aab4-987ef6079e79"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:31.242960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.243702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.244653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.245223 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-79ff6ae0-4b67-4b12-a4c2-b79cd9073b96 req-6aa7cfb2-ac4f-40ad-8f51-abbdc1f80707 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.245411 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.245883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-79ff6ae0-4b67-4b12-a4c2-b79cd9073b96 req-6aa7cfb2-ac4f-40ad-8f51-abbdc1f80707 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.264651 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-79ff6ae0-4b67-4b12-a4c2-b79cd9073b96 req-6aa7cfb2-ac4f-40ad-8f51-abbdc1f80707 service nova] Creating event network-changed:f94529e9-beb2-471e-aab4-987ef6079e79 for instance fe322d14-e8de-4e12-b6b4-40733070cad2 on n-h1-846219-10 Jul 20 11:28:31.274347 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-79ff6ae0-4b67-4b12-a4c2-b79cd9073b96 req-6aa7cfb2-ac4f-40ad-8f51-abbdc1f80707 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044088 Jul 20 11:28:31.274612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:28:31.276348 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2974/5967] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:31.375088 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a269edfb-fd80-4a9d-a64d-dae44495f6c5 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 204 len: 0 microversion: 2.1 time: 0.142918 Jul 20 11:28:31.376306 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2994/5968] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:28:31 2022] DELETE /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:28:31.386314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:31.387033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:31.394474 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.394924 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.395750 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:31.396822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:31.549496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:31.557316 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c92f918-4977-4552-9ba2-a2e72b7cb451 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1672 microversion: 2.1 time: 0.175357 Jul 20 11:28:31.557897 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2975/5969] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:31 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:32.193636 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:32.194600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:32.203927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:32.204385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:32.205367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:32.205680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:32.240803 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-dedd7d44-ab3c-4b35-9689-2dd2a03f4cbd tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052424 Jul 20 11:28:32.241760 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2995/5970] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:28:32 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:32.575708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:32.576967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:32.584951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:32.585652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:32.586565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:32.587022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:32.727578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:32.742053 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4eae165c-7c01-4463-a43b-1a18e0101fa6 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1672 microversion: 2.1 time: 0.170258 Jul 20 11:28:32.754492 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2976/5971] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:32 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:33.253310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:33.254505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:33.261526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.261976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.262750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.263254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.267133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:33.295419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a73ff5b1-ee20-498b-8b0e-f184774d71fe tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046787 Jul 20 11:28:33.295999 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2996/5972] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:28:33 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 11:28:33.358269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:33.358851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:33.366045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.366577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.367444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.367954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.394107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:28:33.481975 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-86d46c1f-7f80-4a76-b7dd-e457370e1899 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 204 len: 0 microversion: 2.1 time: 0.127327 Jul 20 11:28:33.482767 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2977/5973] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:28:33 2022] DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:28:33.491739 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:33.492354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:33.498378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.498823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.499767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.500201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.576701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c194dbf2-d55b-4cc0-8014-b6675e25f6f9 req-f56e744b-b932-4b58-b5aa-18c5eba21916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe322d14-e8de-4e12-b6b4-40733070cad2", "name": "network-vif-deleted", "tag": "f94529e9-beb2-471e-aab4-987ef6079e79"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:33.586270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c194dbf2-d55b-4cc0-8014-b6675e25f6f9 req-f56e744b-b932-4b58-b5aa-18c5eba21916 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.586722 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c194dbf2-d55b-4cc0-8014-b6675e25f6f9 req-f56e744b-b932-4b58-b5aa-18c5eba21916 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.603897 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c194dbf2-d55b-4cc0-8014-b6675e25f6f9 req-f56e744b-b932-4b58-b5aa-18c5eba21916 service nova] Creating event network-vif-deleted:f94529e9-beb2-471e-aab4-987ef6079e79 for instance fe322d14-e8de-4e12-b6b4-40733070cad2 on n-h1-846219-10 Jul 20 11:28:33.610969 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c194dbf2-d55b-4cc0-8014-b6675e25f6f9 req-f56e744b-b932-4b58-b5aa-18c5eba21916 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038460 Jul 20 11:28:33.612859 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2978/5974] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:33.651853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:33.662433 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c23ac503-8c3c-4aa8-baf2-b19dada9824c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1680 microversion: 2.1 time: 0.174272 Jul 20 11:28:33.663082 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2997/5975] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:33 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:33.762178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:33.762889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:33.771714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.772334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.773118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.773556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.809907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:33.810264 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:33.810717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lazy-loading 'fault' on Instance uuid fe322d14-e8de-4e12-b6b4-40733070cad2 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:28:33.860062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aead2241878446ba9d8b60f9d47aa703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7991a1d8c73c45b69b7c4b7e6f949bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:33.868895 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9fee41fb-1a17-4086-a05e-c02e0bc09fc8 tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 200 len: 1338 microversion: 2.1 time: 0.111043 Jul 20 11:28:33.869504 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2979/5976] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:33 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:34.680072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:34.680807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:34.687811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:34.688268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:34.689030 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:34.690211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:34.822733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:34.831442 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1827bb72-3b76-471e-90ce-bd2675c7edcc tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1680 microversion: 2.1 time: 0.155285 Jul 20 11:28:34.832014 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2998/5977] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:34 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:34.886011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:34.886627 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] [instance: fe322d14-e8de-4e12-b6b4-40733070cad2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:34.889473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:34.896061 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:34.896520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:34.897300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:34.897742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:34.913431 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] HTTP exception thrown: Instance fe322d14-e8de-4e12-b6b4-40733070cad2 could not be found. Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Request method failure captured: Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 HTTP/1.1 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-XelKELCXNXnh1Npp41qTNrFpQrJn5Q-ifyralogtNy95T7v1ELNQuT6hi-PF4k4Xq4GiKEQpEW_653y7fJLq2dt7kVKyGqm2pHkyUsgRnWR7hJPJLeKY8DpxkjWaG6Z1Vcg9inNhkQX75lMVwI5SECTzar9iVDxXk6bxplwXxevmI Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 7991a1d8c73c45b69b7c4b7e6f949bed Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestNetworkBasicOps-821012630 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_7991a1d8c73c45b69b7c4b7e6f949bed", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/7991a1d8c73c45b69b7c4b7e6f949bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestNetworkBasicOps-821012630 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 7991a1d8c73c45b69b7c4b7e6f949bed Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestNetworkBasicOps-821012630 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestNetworkBasicOps-821012630-project Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: aead2241878446ba9d8b60f9d47aa703 Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestNetworkBasicOps-821012630-project Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance fe322d14-e8de-4e12-b6b4-40733070cad2 could not be found. Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'fe322d14-e8de-4e12-b6b4-40733070cad2'} Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe322d14-e8de-4e12-b6b4-40733070cad2 could not be found. Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe322d14-e8de-4e12-b6b4-40733070cad2 could not be found. Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:34.915139 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe322d14-e8de-4e12-b6b4-40733070cad2 could not be found. Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Returning 404 to user: Instance fe322d14-e8de-4e12-b6b4-40733070cad2 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dadc6341-dbc0-4ac7-bb08-683a80291c3e tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2" status: 404 len: 111 microversion: 2.1 time: 0.034516 Jul 20 11:28:34.919309 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2980/5978] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:34 2022] GET /compute/v2.1/servers/fe322d14-e8de-4e12-b6b4-40733070cad2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:28:35.090354 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ad4dc014-4b9d-4600-b1d9-8bfea15ec15f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] Calling method '.version_select at 0x7f2c50d2b1f0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:35.102643 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:35.120387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ad4dc014-4b9d-4600-b1d9-8bfea15ec15f tempest-TestNetworkBasicOps-821012630 tempest-TestNetworkBasicOps-821012630-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1585048828" status: 202 len: 0 microversion: 2.1 time: 0.033638 Jul 20 11:28:35.121263 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 2999/5979] 10.222.0.79 () {58 vars in 1256 bytes} [Wed Jul 20 11:28:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1585048828 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:28:35.835832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-bd5b5787-d53a-4f02-ba35-3a2cc1e88426 req-8dcf8406-e695-453d-a26d-d4d85a638e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4ed53e-94e7-406a-bff2-f2b936b86469", "name": "network-vif-deleted", "tag": "636aa65b-48b6-404e-821b-4b54c067a5ff"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:35.854076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:35.855129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:35.855878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-bd5b5787-d53a-4f02-ba35-3a2cc1e88426 req-8dcf8406-e695-453d-a26d-d4d85a638e45 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:35.856492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-bd5b5787-d53a-4f02-ba35-3a2cc1e88426 req-8dcf8406-e695-453d-a26d-d4d85a638e45 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:35.872201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:35.872780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:35.873834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:35.874397 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-bd5b5787-d53a-4f02-ba35-3a2cc1e88426 req-8dcf8406-e695-453d-a26d-d4d85a638e45 service nova] Creating event network-vif-deleted:636aa65b-48b6-404e-821b-4b54c067a5ff for instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 on n-h2-846219-10 Jul 20 11:28:35.878264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:35.881764 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-bd5b5787-d53a-4f02-ba35-3a2cc1e88426 req-8dcf8406-e695-453d-a26d-d4d85a638e45 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049580 Jul 20 11:28:35.882421 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2981/5980] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:36.011426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:36.021534 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8f791775-9c35-4774-863d-d03494f72d99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 200 len: 1327 microversion: 2.1 time: 0.176153 Jul 20 11:28:36.022139 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3000/5981] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:35 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 1327 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:37.039931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:37.040831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:37.055890 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:37.056772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:37.059095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:37.059764 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:37.090226 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 HTTP/1.1 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '1b4ed53e-94e7-406a-bff2-f2b936b86469'} Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:28:37.092726 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:28:37.099449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3a22948b-476c-494d-9966-2a3a2703b307 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 404 len: 111 microversion: 2.1 time: 0.059655 Jul 20 11:28:37.101381 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2982/5982] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:37 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:28:37.106282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-48b48a4c-669f-48ad-b31e-1125b739ef9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '.version_select at 0x7f2c3e849700>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:37.127162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-48b48a4c-669f-48ad-b31e-1125b739ef9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100828388" status: 202 len: 0 microversion: 2.1 time: 0.024616 Jul 20 11:28:37.128091 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3001/5983] 10.222.0.79 () {58 vars in 1220 bytes} [Wed Jul 20 11:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100828388 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:28:37.909678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ec9c7a27-cc49-437f-a469-b84e45161cf6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: .version_select at 0x7f2c3f85d4c0>, body: {"keypair": {"name": "tempest-keypair-646041910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hV4vmubkjn4n4pm9S6GcNpgTKo58SzzNSoi717XbwIlGl+ALQBgS8INT6nRMcGdrbG/sXXUj/6kvU+ZyatWzTDlM1d3nFFWHglkghsN6FJ42fEJQyfTMRE9yKMG7/TQ=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:37.927522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ec9c7a27-cc49-437f-a469-b84e45161cf6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:28:37.934120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ec9c7a27-cc49-437f-a469-b84e45161cf6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:28:37.964695 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ec9c7a27-cc49-437f-a469-b84e45161cf6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059873 Jul 20 11:28:37.965317 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2983/5984] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:28:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:39.858409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-385734030", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9ddebef-2263-4847-bf1c-8851149dd003"}], "security_groups": [{"name": "tempest-securitygroup--479680955"}], "key_name": "tempest-keypair-646041910", "user_data": "}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:39.985727 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] validate_networks() for [('b9ddebef-2263-4847-bf1c-8851149dd003', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:28:40.404072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:28:40.404615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:28:40.405211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:28:40.405726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:28:40.406850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:28:40.415986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:40.416376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:40.417175 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:40.417738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:40.435743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:28:40.441929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Getting quotas for user 8adb9b9d187e40e2b3bc0a3476156651 and project 0910a06f7def447091ec9b1417130117. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:28:40.454630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:28:40.457089 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:28:40.508471 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6eb2f04e-3e63-41d2-90d5-b72f2ddb3799 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.655400 Jul 20 11:28:40.509141 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3002/5985] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:28:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:28:40.521908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-438157a5-e397-45e4-8d22-1ea6b636feb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:40.522624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-438157a5-e397-45e4-8d22-1ea6b636feb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:40.588578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-438157a5-e397-45e4-8d22-1ea6b636feb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:40.599456 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-438157a5-e397-45e4-8d22-1ea6b636feb8 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1240 microversion: 2.1 time: 0.083309 Jul 20 11:28:40.600481 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2984/5986] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:40 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:41.624760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:41.625430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:41.635298 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:41.635811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:41.636589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:41.637029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:41.729291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:41.740464 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe4999ad-3c6e-4c99-b80c-b0f9f7efc648 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1310 microversion: 2.1 time: 0.120032 Jul 20 11:28:41.747216 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3003/5987] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:41 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1310 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:42.758908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:42.759663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:42.766686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:42.767920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:42.768710 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:42.769148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:42.845009 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:42.855133 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a7e8f521-935c-41d0-b636-4cb20fc161fb tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1298 microversion: 2.1 time: 0.099353 Jul 20 11:28:42.856270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2985/5988] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:42 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:43.875419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:43.876071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:43.885255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:43.885712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:43.886519 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:43.886966 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:44.029147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:44.037760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d88f74b-6a53-44f0-a337-8d7891cf7a9f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.166572 Jul 20 11:28:44.038359 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3004/5989] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:43 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:44.586801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-55425db0-125f-47fe-ad6b-045d41957b7d req-3e5aa8b2-f204-401f-93cd-180567da6617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d39073-0a8b-47ca-bc22-c40e33e95b39", "tag": "07f5f8dd-bd5e-42f1-9988-a4490a11ee10"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:44.603896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-55425db0-125f-47fe-ad6b-045d41957b7d req-3e5aa8b2-f204-401f-93cd-180567da6617 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:44.604589 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-55425db0-125f-47fe-ad6b-045d41957b7d req-3e5aa8b2-f204-401f-93cd-180567da6617 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:44.618773 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-55425db0-125f-47fe-ad6b-045d41957b7d req-3e5aa8b2-f204-401f-93cd-180567da6617 service nova] Creating event network-changed:07f5f8dd-bd5e-42f1-9988-a4490a11ee10 for instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 on n-h1-846219-10 Jul 20 11:28:44.625957 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-55425db0-125f-47fe-ad6b-045d41957b7d req-3e5aa8b2-f204-401f-93cd-180567da6617 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045763 Jul 20 11:28:44.627803 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2986/5990] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:45.055523 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:45.056912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:45.065689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:45.066562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:45.067573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:45.068174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:45.295633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:45.304484 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33c06ef6-c03b-4d50-a3a1-c15e57f41df5 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.253002 Jul 20 11:28:45.305190 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3005/5991] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:45 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:46.323902 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:46.324614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:46.335754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:46.336208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:46.336987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:46.337423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:46.534781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:46.544442 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a129ec05-21e3-4bc1-96ac-1d29aa301577 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.225455 Jul 20 11:28:46.545457 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2987/5992] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:46 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:47.562031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:47.562929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:47.572181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:47.572920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:47.574032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:47.574479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:47.733641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:47.742575 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-038a97bf-6059-4f8f-8c5d-7380016ad655 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.184259 Jul 20 11:28:47.747217 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3006/5993] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:47 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:48.760823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:48.761740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:48.774158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:48.775224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:48.776272 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:48.776926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:48.938417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:48.947955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-60d95193-e38f-4cd1-ae27-2e9954e1779f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.191612 Jul 20 11:28:48.958819 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2988/5994] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:48 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:49.972480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:49.973792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:50.006951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:50.008294 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:50.010215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:50.011803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:50.299594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:50.311211 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bc3a35df-8d5a-4c76-b06d-ced0b8a4e09a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.348537 Jul 20 11:28:50.312018 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3007/5995] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:49 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:51.330936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:51.331618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:51.338219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:51.340886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:51.341606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:51.342397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:51.342835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:51.349081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:51.798520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:51.809577 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e7669c6-54a7-4c64-9558-dfb71ca2ded3 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.483757 Jul 20 11:28:51.810178 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2989/5996] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:51 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:28:52.118980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-dc2f0f17-0353-440b-b3b9-967605726d5b req-d7793258-5127-4339-ae30-fae839c67585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d39073-0a8b-47ca-bc22-c40e33e95b39", "name": "network-vif-plugged", "status": "completed", "tag": "07f5f8dd-bd5e-42f1-9988-a4490a11ee10"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:52.129482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:52.132870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:28:52.139566 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-dc2f0f17-0353-440b-b3b9-967605726d5b req-d7793258-5127-4339-ae30-fae839c67585 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:52.140364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-dc2f0f17-0353-440b-b3b9-967605726d5b req-d7793258-5127-4339-ae30-fae839c67585 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:52.154873 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-dc2f0f17-0353-440b-b3b9-967605726d5b req-d7793258-5127-4339-ae30-fae839c67585 service nova] Creating event network-vif-plugged:07f5f8dd-bd5e-42f1-9988-a4490a11ee10 for instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 on n-h1-846219-10 Jul 20 11:28:52.161735 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-dc2f0f17-0353-440b-b3b9-967605726d5b req-d7793258-5127-4339-ae30-fae839c67585 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046862 Jul 20 11:28:52.162974 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3008/5997] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:28:52.827008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:52.827665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:52.836117 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:52.836583 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:52.837424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:52.837864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:53.006019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:53.014300 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c48091da-8a22-4595-bc12-e5c99805f119 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1365 microversion: 2.1 time: 0.191364 Jul 20 11:28:53.015565 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2990/5998] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:52 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:54.035601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:54.036993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:54.043955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:54.044436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:54.045303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:54.045826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:54.225382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:54.239018 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e78cd009-be99-4cfa-b1f0-34e481d3f03d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1554 microversion: 2.1 time: 0.208943 Jul 20 11:28:54.243604 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3009/5999] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:54 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:54.260390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:54.261313 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:54.270314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:54.270713 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:54.273190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:54.273841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:54.415552 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6286ddcd-669b-4f41-9088-25afa8d28d3b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160494 Jul 20 11:28:54.416315 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2991/6000] 10.222.0.79 () {58 vars in 1274 bytes} [Wed Jul 20 11:28:54 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:54.723776 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1847674342", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ee6dc315-a28f-479e-b8c4-60ec389b3af6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:54.808190 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:28:55.281529 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:28:55.283047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:28:55.285568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:28:55.287076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:28:55.287162 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:28:55.328467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:55.333490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:55.334896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:55.335532 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:55.362811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:28:55.368455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:28:55.450025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:28:55.452085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee6dc315-a28f-479e-b8c4-60ec389b3af6',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:28:55.618595 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe234eea-e545-4cd0-a5c8-5d1f60c3ce24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907125 Jul 20 11:28:55.619295 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3010/6001] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:28:55.630835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e29da20c-1c98-4495-8ca8-c239daa45c4d req-a9792cf0-994a-46f4-bb03-7d81007d03cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d39073-0a8b-47ca-bc22-c40e33e95b39", "tag": "07f5f8dd-bd5e-42f1-9988-a4490a11ee10"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:55.631432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e694e406-f816-488f-8cb8-657be0d7f783 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:55.631981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e694e406-f816-488f-8cb8-657be0d7f783 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:55.642019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e29da20c-1c98-4495-8ca8-c239daa45c4d req-a9792cf0-994a-46f4-bb03-7d81007d03cc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:55.643376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e29da20c-1c98-4495-8ca8-c239daa45c4d req-a9792cf0-994a-46f4-bb03-7d81007d03cc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:55.656101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e29da20c-1c98-4495-8ca8-c239daa45c4d req-a9792cf0-994a-46f4-bb03-7d81007d03cc service nova] Creating event network-changed:07f5f8dd-bd5e-42f1-9988-a4490a11ee10 for instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 on n-h1-846219-10 Jul 20 11:28:55.661381 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e29da20c-1c98-4495-8ca8-c239daa45c4d req-a9792cf0-994a-46f4-bb03-7d81007d03cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Jul 20 11:28:55.665675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2992/6002] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:55.747633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e694e406-f816-488f-8cb8-657be0d7f783 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:55.756279 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e694e406-f816-488f-8cb8-657be0d7f783 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1057 microversion: 2.1 time: 0.130425 Jul 20 11:28:55.757162 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3011/6003] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:55 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1057 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:56.775495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:56.776197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:56.783700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:56.784168 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:56.784958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:56.785498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:56.862755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:56.870908 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7d262171-baa2-40b4-ad28-fc13b9ac229b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1155 microversion: 2.1 time: 0.100314 Jul 20 11:28:56.871798 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2993/6004] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:56 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:57.888673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:57.889533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:57.904465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:57.904923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:57.905725 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:57.906166 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:58.194738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:58.205759 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e682b968-c34f-4177-b3e4-43f48186a817 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1215 microversion: 2.1 time: 0.321044 Jul 20 11:28:58.206940 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3012/6005] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:57 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:28:58.652919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-fbd33807-d749-4c0a-abca-27d10950d053 req-01ad5d73-e3f0-4282-9b89-7d4dc7689ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c035a542-5199-4a2d-ac7a-081b442d51e6", "tag": "143a4f0b-68b9-47ae-ab43-ca084d636a00"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:28:58.669494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fbd33807-d749-4c0a-abca-27d10950d053 req-01ad5d73-e3f0-4282-9b89-7d4dc7689ca5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:58.670036 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-fbd33807-d749-4c0a-abca-27d10950d053 req-01ad5d73-e3f0-4282-9b89-7d4dc7689ca5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:58.690486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-fbd33807-d749-4c0a-abca-27d10950d053 req-01ad5d73-e3f0-4282-9b89-7d4dc7689ca5 service nova] Creating event network-changed:143a4f0b-68b9-47ae-ab43-ca084d636a00 for instance c035a542-5199-4a2d-ac7a-081b442d51e6 on n-h2-846219-10 Jul 20 11:28:58.695837 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-fbd33807-d749-4c0a-abca-27d10950d053 req-01ad5d73-e3f0-4282-9b89-7d4dc7689ca5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051245 Jul 20 11:28:58.697034 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2994/6006] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:28:59.226085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:28:59.226835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:28:59.233673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:59.234246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:59.235281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:28:59.235976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:28:59.459842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:28:59.467838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-10f551ce-1e67-46aa-8564-27dc996a400a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1215 microversion: 2.1 time: 0.246990 Jul 20 11:28:59.468909 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3013/6007] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:28:59 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:00.487426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:00.488026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:00.494691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:00.495144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:00.495985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:00.496427 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:00.657869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:00.666075 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5fd1f5e9-bfb0-4f84-84ff-19353c650398 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1215 microversion: 2.1 time: 0.185145 Jul 20 11:29:00.666675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2995/6008] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:00 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:01.683403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:01.684049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:01.691194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:01.691658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:01.692438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:01.692877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:01.827396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:01.836081 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9852a0bf-5678-43ba-9f09-7eae0444babe tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1215 microversion: 2.1 time: 0.156555 Jul 20 11:29:01.836666 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3014/6009] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:01 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:02.854050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:02.854958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:02.862397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:02.862860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:02.863711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:02.864159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:02.994436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:03.002722 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b54893ad-5027-4644-80fc-1a0134b62ce0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.152812 Jul 20 11:29:03.003369 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2996/6010] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:02 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:04.020557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:04.021176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:04.028194 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:04.028650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:04.029417 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:04.029857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:04.032587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=83 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:04.169253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:04.177640 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f8cd6021-380a-449d-9b57-a5903bfd01ef tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.161612 Jul 20 11:29:04.178222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3015/6011] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:04 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:05.195093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:05.195741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:05.198541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:05.204860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:05.205342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:05.206114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:05.206550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:05.340799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:05.349729 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-59ad00b4-193b-40a2-8cfd-99ac7e334c77 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.158531 Jul 20 11:29:05.350358 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2997/6012] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:05 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:06.367148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:06.367709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:06.370469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:06.371341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=8 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:06.372226 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:06.379594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:06.380115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:06.380905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:06.381349 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:06.529256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:06.537628 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cfa4f4dd-eb3c-4e9a-bc11-fee3040e2fbf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.174511 Jul 20 11:29:06.538216 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3016/6013] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:06 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:07.554846 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:07.556416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:07.563748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:07.564442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:07.565336 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:07.565873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:07.700576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:07.708588 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5bf1642b-8574-4c5d-b4bb-f99c218ae166 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.157607 Jul 20 11:29:07.709173 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2998/6014] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:07 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:08.726085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:08.726950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:08.734491 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:08.735840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:08.736662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:08.737114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:08.872756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:08.883506 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cc28ed83-291b-4658-b380-ea46b9531bb2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.161389 Jul 20 11:29:08.884114 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3017/6015] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:08 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:09.901081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:09.901703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:09.911734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:09.912250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:09.913048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:09.913495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:10.058608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:10.067313 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d82e306-8e1d-4a48-8773-890982af1194 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.170197 Jul 20 11:29:10.067909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 2999/6016] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:09 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:11.083993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:11.084614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:11.091669 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:11.092119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:11.092885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:11.093583 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:11.228967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:11.237124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-afdfd3d7-662b-42f0-8515-b4f28276b5c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.156993 Jul 20 11:29:11.237687 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3018/6017] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:11 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:11.972706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-57700d07-b33b-4d09-b86b-4dca1ec267d2 req-a3f7265d-e585-41de-af52-73de3e83fd62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c035a542-5199-4a2d-ac7a-081b442d51e6", "name": "network-vif-plugged", "status": "completed", "tag": "143a4f0b-68b9-47ae-ab43-ca084d636a00"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:29:11.983676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-57700d07-b33b-4d09-b86b-4dca1ec267d2 req-a3f7265d-e585-41de-af52-73de3e83fd62 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:11.984197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-57700d07-b33b-4d09-b86b-4dca1ec267d2 req-a3f7265d-e585-41de-af52-73de3e83fd62 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:11.996863 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-57700d07-b33b-4d09-b86b-4dca1ec267d2 req-a3f7265d-e585-41de-af52-73de3e83fd62 service nova] Creating event network-vif-plugged:143a4f0b-68b9-47ae-ab43-ca084d636a00 for instance c035a542-5199-4a2d-ac7a-081b442d51e6 on n-h2-846219-10 Jul 20 11:29:12.002390 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-57700d07-b33b-4d09-b86b-4dca1ec267d2 req-a3f7265d-e585-41de-af52-73de3e83fd62 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034871 Jul 20 11:29:12.003002 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3000/6018] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:29:12.253833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:12.254447 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:12.261766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:12.262212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:12.262989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:12.263451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:12.402205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:12.410316 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2393eab8-43e5-4cfd-9d07-85ef6c59b245 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1203 microversion: 2.1 time: 0.160390 Jul 20 11:29:12.410837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3019/6019] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:12 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:13.429671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:13.430285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:13.436787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:13.437243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:13.438570 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:13.439011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:13.598959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:13.608151 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-30843655-91e6-4a0c-a025-6438cce4d02c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1391 microversion: 2.1 time: 0.183781 Jul 20 11:29:13.608741 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3001/6020] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:13 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:13.630105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:13.631950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:13.639271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:13.639796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:13.640573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:13.642195 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:13.801607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:13.809557 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b0819172-d6e8-4d64-9019-3baf5707dc34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1391 microversion: 2.1 time: 0.186778 Jul 20 11:29:13.810150 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3020/6021] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:13 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:13.826754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:13.827548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:13.834479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:13.834941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:13.835763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:13.836221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:13.988109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:13.996907 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4070377f-c33e-4379-8b01-c687a64d5cb1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1391 microversion: 2.1 time: 0.174415 Jul 20 11:29:13.997822 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3002/6022] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:13 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:14.014596 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:14.015096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:14.025828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:14.026418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:14.027236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:14.027708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:14.058645 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:29:14.147942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f2b68e69-f2cf-4ec3-84a4-d4440929452a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 204 len: 0 microversion: 2.1 time: 0.136636 Jul 20 11:29:14.148165 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3021/6023] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:29:14 2022] DELETE /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:29:14.157624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:14.158847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:14.165412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:14.165624 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:14.166417 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:14.166857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:14.327355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:14.335457 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09224d86-78cd-4cf4-9b5c-1224f36c1ff0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1397 microversion: 2.1 time: 0.182612 Jul 20 11:29:14.336039 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3003/6024] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:14 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1397 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:29:15.354171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:15.354881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:15.362081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:15.362534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:15.363352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:15.363798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:15.498068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:15.506298 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3442dcab-9bcc-4c7d-b9dc-c37ba4d8b16b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1397 microversion: 2.1 time: 0.156392 Jul 20 11:29:15.506888 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3022/6025] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:15 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1397 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:16.327885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-49402526-350c-4cfd-9a6f-2dd7fe8898a2 req-a7110036-c052-4469-8e94-f47c76d36e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c035a542-5199-4a2d-ac7a-081b442d51e6", "name": "network-vif-deleted", "tag": "143a4f0b-68b9-47ae-ab43-ca084d636a00"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:29:16.338077 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-49402526-350c-4cfd-9a6f-2dd7fe8898a2 req-a7110036-c052-4469-8e94-f47c76d36e40 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:16.338525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-49402526-350c-4cfd-9a6f-2dd7fe8898a2 req-a7110036-c052-4469-8e94-f47c76d36e40 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:16.351316 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-49402526-350c-4cfd-9a6f-2dd7fe8898a2 req-a7110036-c052-4469-8e94-f47c76d36e40 service nova] Creating event network-vif-deleted:143a4f0b-68b9-47ae-ab43-ca084d636a00 for instance c035a542-5199-4a2d-ac7a-081b442d51e6 on n-h2-846219-10 Jul 20 11:29:16.356851 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-49402526-350c-4cfd-9a6f-2dd7fe8898a2 req-a7110036-c052-4469-8e94-f47c76d36e40 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Jul 20 11:29:16.357471 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3004/6026] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:29:16.523801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:16.524553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:16.533269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:16.533269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:16.533808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:16.534204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:16.597774 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:16.606141 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1092e7e1-cebd-4598-8104-920be5ad6006 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1188 microversion: 2.1 time: 0.086073 Jul 20 11:29:16.606734 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3023/6027] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:16 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:17.625253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:17.626080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:17.632526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:17.632982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:17.633740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:17.634176 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:17.696982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:17.705223 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fc963bab-d110-443f-9a8c-d8d3ae9561f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1188 microversion: 2.1 time: 0.085176 Jul 20 11:29:17.705796 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3005/6028] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:17 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:18.723001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:18.723668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:18.730887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:18.731373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:18.732163 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:18.732604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:18.801327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:18.809179 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-691124f0-752c-4c7b-9dec-fc656dc82ab5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1188 microversion: 2.1 time: 0.091036 Jul 20 11:29:18.809767 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3024/6029] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:18 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:19.827692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:19.828818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:19.836033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:19.836486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:19.837273 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:19.837717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:19.901439 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:19.910621 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9ab1a97b-0b7d-4ae7-95f8-48c54e6ce37d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 200 len: 1188 microversion: 2.1 time: 0.087280 Jul 20 11:29:19.911230 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3006/6030] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:19 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:20.928567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:20.929209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: c035a542-5199-4a2d-ac7a-081b442d51e6] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:20.936106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:20.936548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:20.937303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:20.937737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:20.952538 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance c035a542-5199-4a2d-ac7a-081b442d51e6 could not be found. Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 HTTP/1.1 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance c035a542-5199-4a2d-ac7a-081b442d51e6 could not be found. Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'c035a542-5199-4a2d-ac7a-081b442d51e6'} Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c035a542-5199-4a2d-ac7a-081b442d51e6 could not be found. Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c035a542-5199-4a2d-ac7a-081b442d51e6 could not be found. Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:29:20.954872 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c035a542-5199-4a2d-ac7a-081b442d51e6 could not be found. Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance c035a542-5199-4a2d-ac7a-081b442d51e6 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9af5ce91-48a4-4ca0-9c08-3d54c5f9db47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6" status: 404 len: 111 microversion: 2.1 time: 0.032198 Jul 20 11:29:20.960149 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3025/6031] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:20 2022] GET /compute/v2.1/servers/c035a542-5199-4a2d-ac7a-081b442d51e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:29:41.859631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1326477078", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "40a0cae5-78f4-4644-ac82-707068b1f611", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:29:41.868170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=19 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:41.868842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=88 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:41.952145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:29:42.316915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:29:42.317347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:29:42.317861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:29:42.318274 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:29:42.318692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:29:42.328122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:42.328577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:42.329387 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:42.329832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:42.350462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:29:42.356025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:29:42.369937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:29:42.372004 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='40a0cae5-78f4-4644-ac82-707068b1f611',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:29:42.444368 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ea481698-2832-4adc-ae1f-ec3095cd5d0f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588980 Jul 20 11:29:42.445036 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3007/6032] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:29:42.455299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-95690d54-c59b-47e8-ad7d-d6a637bbebaf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:42.456025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-95690d54-c59b-47e8-ad7d-d6a637bbebaf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:42.460351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:42.461846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:42.519506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-95690d54-c59b-47e8-ad7d-d6a637bbebaf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:42.526158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-95690d54-c59b-47e8-ad7d-d6a637bbebaf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1057 microversion: 2.1 time: 0.074979 Jul 20 11:29:42.526723 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3026/6033] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:42 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:43.545275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:43.546008 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:43.553641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:43.554279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:43.555257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:43.555794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:43.627978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:43.635530 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-45d07995-8084-419f-9ea1-8c595a8c1b79 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1127 microversion: 2.1 time: 0.095604 Jul 20 11:29:43.636113 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3008/6034] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:43 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1127 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:44.653980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:44.655359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:44.665804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:44.666650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:44.667987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:44.668796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:44.848084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:44.859752 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2493ef04-40d8-4bfe-9f06-80c648174154 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.208978 Jul 20 11:29:44.873727 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3027/6035] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:44 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:44.879351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-feb1b4cc-555a-4277-a6b4-1e21f02d58a4 req-a55dacba-4da6-4955-b11d-b0c6222b16d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906f63cf-893f-47ed-86cf-8812cd6d8bc7", "tag": "677ff3e9-1a6d-4465-ba6e-8784f57d12c9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:29:44.893842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-feb1b4cc-555a-4277-a6b4-1e21f02d58a4 req-a55dacba-4da6-4955-b11d-b0c6222b16d1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:44.894588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-feb1b4cc-555a-4277-a6b4-1e21f02d58a4 req-a55dacba-4da6-4955-b11d-b0c6222b16d1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:44.908369 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-feb1b4cc-555a-4277-a6b4-1e21f02d58a4 req-a55dacba-4da6-4955-b11d-b0c6222b16d1 service nova] Creating event network-changed:677ff3e9-1a6d-4465-ba6e-8784f57d12c9 for instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 on n-h1-846219-10 Jul 20 11:29:44.913239 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-feb1b4cc-555a-4277-a6b4-1e21f02d58a4 req-a55dacba-4da6-4955-b11d-b0c6222b16d1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039091 Jul 20 11:29:44.913857 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3009/6036] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:29:45.889938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:45.890578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:45.898014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:45.898470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:45.899431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:45.899713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:46.055563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:46.067815 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cf8ad133-3234-4657-92eb-75312684f4e6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.181743 Jul 20 11:29:46.068398 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3028/6037] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:45 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:47.087097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:47.087850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:47.100107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:47.100707 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:47.101276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:47.101679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:47.276473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:47.286382 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b9211d4c-6513-4c90-bb37-d29eca601697 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.205041 Jul 20 11:29:47.286978 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3010/6038] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:47 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:48.309754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:48.310668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:48.325424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:48.326479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:48.328414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:48.328999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:48.530973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:48.540080 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-db44a30f-2587-438c-9cd2-f7b5c9378378 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.238538 Jul 20 11:29:48.540961 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3029/6039] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:48 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:49.560688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:49.561472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:49.570205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:49.571110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:49.572405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:49.573395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:49.746895 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:49.756961 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ce220d8a-1cbe-405d-aba7-15cb377f39ae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.201889 Jul 20 11:29:49.766781 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3011/6040] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:49 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:50.774224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:50.775505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:50.782862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:50.783341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:50.784389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:50.784830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:50.924257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:50.932877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1324ecfd-397c-4548-b740-7106b6bfc237 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.162633 Jul 20 11:29:50.933780 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3030/6041] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:50 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:51.950312 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:51.950927 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:51.958883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:51.959372 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:51.960141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:51.960574 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:52.091133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:52.099507 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-262eff7c-cd48-4396-b522-e763af393cff tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.152990 Jul 20 11:29:52.100094 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3012/6042] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:51 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:53.116907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:53.117524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:53.120387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:53.127039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:53.127521 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:53.128300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:53.128744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:53.272426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:53.280213 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c94d71e0-d56c-4ace-947f-d890d70c209c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.167199 Jul 20 11:29:53.280837 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3031/6043] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:53 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:54.298209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:54.298835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:54.304197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:54.304889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:29:54.308100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:54.308787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:54.309744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:54.310192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:54.448124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:54.459234 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f0133b4-0ba8-4165-856a-6e4530f2e8c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.165205 Jul 20 11:29:54.460196 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3013/6044] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:54 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:55.477233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:55.478257 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:55.486518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:55.486980 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:55.487949 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:55.488543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:55.718947 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:55.727841 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8baea7fd-bcbc-42b0-bdf6-61bf02a2f3f9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.254267 Jul 20 11:29:55.738097 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3032/6045] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:55 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:56.745292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:56.745982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:56.753793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:56.754255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:56.755045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:56.755519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:56.896856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:56.904575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-db0a5fdc-25d4-46e6-a5a5-82440e62ed20 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.163238 Jul 20 11:29:56.905714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3014/6046] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:56 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:57.922288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:57.922912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:57.930328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:57.930791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:57.931665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:57.932111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:58.097938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:58.107858 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e390b33-330b-480c-ba66-90de746f6949 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1169 microversion: 2.1 time: 0.189429 Jul 20 11:29:58.108841 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3033/6047] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:57 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:29:59.126201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:29:59.126873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:29:59.133762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:59.134210 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:59.134963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:29:59.135430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:29:59.271221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:29:59.278750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-95892f46-cb05-4793-9a18-f421c0ad11c5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.157166 Jul 20 11:29:59.279353 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3015/6048] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:29:59 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:00.297874 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:00.298494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:00.305579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:00.307231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:00.307231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:00.307478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:00.469907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:00.483893 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6642b342-7926-450e-8266-f1ab625f9a3f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.189022 Jul 20 11:30:00.484713 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3034/6049] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:00 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:01.503779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:01.504332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:01.511395 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:01.511842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:01.512606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:01.513037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:01.649790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:01.658018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c9d84143-8e42-40d7-a203-56666f06b239 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.158102 Jul 20 11:30:01.658625 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3016/6050] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:01 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:02.675799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:02.676423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:02.683716 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:02.684170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:02.684989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:02.685428 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:02.829104 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:02.837202 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-350a70b4-6f26-41ab-9a0d-d811ae03d9f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.165324 Jul 20 11:30:02.837799 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3035/6051] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:02 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:03.854804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:03.855497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:03.862508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:03.862962 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:03.863771 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:03.864209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:03.998293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:04.006580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e0f599a-2058-480d-9a6e-9fc799deeb21 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.155899 Jul 20 11:30:04.007389 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3017/6052] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:03 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:05.023943 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:05.024563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:05.032234 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:05.032679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:05.033436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:05.033873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:05.162618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:05.170255 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bdb3817e-0ca7-4867-9434-2d0550a49409 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.150195 Jul 20 11:30:05.170840 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3036/6053] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:05 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:06.187448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:06.188072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:06.195109 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:06.195592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:06.196357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:06.196798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:06.332164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:06.339658 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16baee24-6dd7-412c-95ff-e99fc21665e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.156214 Jul 20 11:30:06.340239 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3018/6054] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:06 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:07.357453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:07.358078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:07.365682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:07.366143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:07.366917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:07.367399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:07.499543 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:07.507138 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9c8c092-1c8f-42fd-8739-61f27f3d3a63 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.153643 Jul 20 11:30:07.507737 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3037/6055] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:07 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:08.524275 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:08.524732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:08.532550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:08.533000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:08.533776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:08.534211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:08.675972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:08.683871 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8e4b5192-f15c-4232-ba00-797ef67720e3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.163828 Jul 20 11:30:08.684387 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3019/6056] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:08 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:09.701582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:09.702233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:09.709401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:09.709856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:09.710625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:09.711068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:09.844901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:09.852811 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44aabab4-0098-43e9-aa60-5beb9167c509 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.155165 Jul 20 11:30:09.853392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3038/6057] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:09 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:10.451190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d5443f95-eec0-4b0a-9e14-889cd6f7bcec req-dd90cc19-5d24-4b3d-8020-d7d8fe32bfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906f63cf-893f-47ed-86cf-8812cd6d8bc7", "name": "network-vif-plugged", "status": "completed", "tag": "677ff3e9-1a6d-4465-ba6e-8784f57d12c9"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:10.461082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d5443f95-eec0-4b0a-9e14-889cd6f7bcec req-dd90cc19-5d24-4b3d-8020-d7d8fe32bfb7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:10.461526 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d5443f95-eec0-4b0a-9e14-889cd6f7bcec req-dd90cc19-5d24-4b3d-8020-d7d8fe32bfb7 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:10.477232 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d5443f95-eec0-4b0a-9e14-889cd6f7bcec req-dd90cc19-5d24-4b3d-8020-d7d8fe32bfb7 service nova] Creating event network-vif-plugged:677ff3e9-1a6d-4465-ba6e-8784f57d12c9 for instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 on n-h1-846219-10 Jul 20 11:30:10.483300 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d5443f95-eec0-4b0a-9e14-889cd6f7bcec req-dd90cc19-5d24-4b3d-8020-d7d8fe32bfb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035498 Jul 20 11:30:10.484664 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3020/6058] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:30:10.870542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:10.871316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:10.878303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:10.878761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:10.879561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:10.880002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:11.016789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:11.024482 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6370a88e-2ff5-4b01-af35-df539886a276 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.157915 Jul 20 11:30:11.025073 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3039/6059] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:10 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:12.043354 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:12.043970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:12.045981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:12.052353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:12.052818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:12.053595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:12.054093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:12.057653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=73 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:12.216094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:12.225315 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2b69b94e-e06f-41ec-a692-8757f228b986 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1203 microversion: 2.1 time: 0.187109 Jul 20 11:30:12.225907 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3021/6060] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:12 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1203 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:13.243638 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:13.244256 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:13.247000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=31 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:13.252098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.252549 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.253323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.253758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.258470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=79 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:13.392799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:13.400667 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a5e1c0d8-7382-46fb-acc0-57253149e945 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1390 microversion: 2.1 time: 0.161091 Jul 20 11:30:13.401248 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3040/6061] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:13 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:13.417174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:13.417789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:13.425448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.425905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.426762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.427219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.563408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:13.571291 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-795a02f2-8c3b-4b33-85d0-6931b41d9820 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1390 microversion: 2.1 time: 0.157987 Jul 20 11:30:13.571888 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3022/6062] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:13 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:13.587386 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:13.588012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:13.595657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.596112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.596921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.597369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.729113 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:13.737699 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-95c3be60-556b-4d4f-b214-2581c5aea8f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1390 microversion: 2.1 time: 0.154237 Jul 20 11:30:13.738288 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3041/6063] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:13 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:13.807088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:13.807618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:13.813982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.814433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.815215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.815723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.841079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:30:13.921667 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-71ac88bd-5467-4b20-95e2-106937a46f43 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 204 len: 0 microversion: 2.1 time: 0.118106 Jul 20 11:30:13.922372 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3023/6064] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:13 2022] DELETE /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:30:13.931303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:13.931857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:13.938080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.938522 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:13.939309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:13.939745 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:14.072637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:14.081455 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8089a855-5182-4cd3-8462-e08535175dd9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1396 microversion: 2.1 time: 0.154078 Jul 20 11:30:14.082040 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3042/6065] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:13 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1396 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:15.102905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:15.103976 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:15.113053 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:15.113508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:15.114282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:15.114723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:15.226099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:15.226765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:15.238222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:15.238867 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:15.239684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:15.240298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:15.254609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:15.262472 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-99242607-4ddf-4c6d-8491-77201b9d7d86 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1396 microversion: 2.1 time: 0.164478 Jul 20 11:30:15.263063 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3043/6066] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:15 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:30:15.268104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:30:15.348780 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04d5a7ee-9027-4725-84f4-e4e4026b2952 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 204 len: 0 microversion: 2.1 time: 0.321640 Jul 20 11:30:15.349652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3024/6067] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:15 2022] DELETE /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:30:15.357838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:15.358479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:15.364601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:15.365052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:15.365816 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:15.366258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:15.501526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:15.509053 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e67ac74-16d2-4e8b-ad44-cb8c0faa55c8 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1732 microversion: 2.1 time: 0.155254 Jul 20 11:30:15.509634 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3044/6068] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:15 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:16.289572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:16.290327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:16.312690 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:16.313184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:16.314218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:16.314873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:16.341756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-8d827562-9237-4d24-a3a1-aa79a3818d59 req-bc6ec4d9-18ef-4339-b2fc-f4eaa745e95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906f63cf-893f-47ed-86cf-8812cd6d8bc7", "name": "network-vif-deleted", "tag": "677ff3e9-1a6d-4465-ba6e-8784f57d12c9"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:16.353197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8d827562-9237-4d24-a3a1-aa79a3818d59 req-bc6ec4d9-18ef-4339-b2fc-f4eaa745e95f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:16.353647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-8d827562-9237-4d24-a3a1-aa79a3818d59 req-bc6ec4d9-18ef-4339-b2fc-f4eaa745e95f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:16.366574 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-8d827562-9237-4d24-a3a1-aa79a3818d59 req-bc6ec4d9-18ef-4339-b2fc-f4eaa745e95f service nova] Creating event network-vif-deleted:677ff3e9-1a6d-4465-ba6e-8784f57d12c9 for instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 on n-h1-846219-10 Jul 20 11:30:16.378707 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-8d827562-9237-4d24-a3a1-aa79a3818d59 req-bc6ec4d9-18ef-4339-b2fc-f4eaa745e95f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040489 Jul 20 11:30:16.382609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3045/6069] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:30:16.420356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:16.429787 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4e110c3b-3390-418f-ac0c-39f5543ca3e5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1354 microversion: 2.1 time: 0.149287 Jul 20 11:30:16.430374 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3025/6070] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:16 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:16.526893 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:16.527720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:16.535277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:16.535985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:16.536936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:16.537376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:16.789141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:16.798432 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-576e2c36-5557-4dff-a36f-29a53eeb3402 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1732 microversion: 2.1 time: 0.275669 Jul 20 11:30:16.799025 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3046/6071] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:16 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:17.447870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:17.448546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:17.461995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:17.465804 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:17.466950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:17.468749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:17.583905 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-835cdb81-9459-40c0-9120-5c583ee48625 req-42fcfa35-1ab6-40a0-8509-37a4dac9739c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a9ebbe-9876-4618-84bb-97d838139530", "name": "network-vif-deleted", "tag": "8943cd7b-a360-401e-acfd-da389b056e1d"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:17.594916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-835cdb81-9459-40c0-9120-5c583ee48625 req-42fcfa35-1ab6-40a0-8509-37a4dac9739c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:17.595882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-835cdb81-9459-40c0-9120-5c583ee48625 req-42fcfa35-1ab6-40a0-8509-37a4dac9739c service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:17.614230 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:17.619485 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-835cdb81-9459-40c0-9120-5c583ee48625 req-42fcfa35-1ab6-40a0-8509-37a4dac9739c service nova] Creating event network-vif-deleted:8943cd7b-a360-401e-acfd-da389b056e1d for instance f5a9ebbe-9876-4618-84bb-97d838139530 on n-h2-846219-10 Jul 20 11:30:17.625797 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0d2af3f-ac91-4976-9da3-26b236e9214b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1188 microversion: 2.1 time: 0.181873 Jul 20 11:30:17.631930 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3026/6072] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:17 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1188 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:17.634182 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-835cdb81-9459-40c0-9120-5c583ee48625 req-42fcfa35-1ab6-40a0-8509-37a4dac9739c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163761 Jul 20 11:30:17.637169 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3047/6073] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:30:17.816530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:17.817151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:17.824031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:17.824497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:17.825642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:17.826091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:17.867787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:17.868341 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:17.868803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lazy-loading 'fault' on Instance uuid f5a9ebbe-9876-4618-84bb-97d838139530 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:30:17.931406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '110886d1a5094ec4a4be4224bf8f0163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2b2a455123b47ea82cad5242e9bfd2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:17.939972 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-18ab9005-aa2b-4cc2-8815-2f9b9805c225 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 200 len: 1388 microversion: 2.1 time: 0.128060 Jul 20 11:30:17.949944 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3027/6074] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:17 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 1388 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:18.647452 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:18.648412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:18.659346 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:18.659880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:18.660799 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:18.661212 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:18.738186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:18.746039 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aab2fb81-7ddc-471e-bd62-f60b20ec8fab tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1188 microversion: 2.1 time: 0.102967 Jul 20 11:30:18.746627 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3048/6075] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:18 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:18.957249 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:18.957869 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:18.965802 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:18.966266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:18.967043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:18.967511 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:18.981904 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] HTTP exception thrown: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Request method failure captured: Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 HTTP/1.1 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-X4qfmUsaL2vMTjebh03nmIUefMSvQCm5ki7vojuqHx9NBD9HRaFpeJpVNcdA4nN_eZ717uNsOdstrVdFb8T04IxHogTndJqmch0STWS8-xGBKKcnqqdCr6HSDhG4bDCpFuMu6zRhNseDI105ujwHFpH9OMTLhvC8qxvgSQcsG7aE0 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c2b2a455123b47ea82cad5242e9bfd2b Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestServerBasicOps-588240159 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c2b2a455123b47ea82cad5242e9bfd2b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestServerBasicOps-588240159 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c2b2a455123b47ea82cad5242e9bfd2b Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestServerBasicOps-588240159 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestServerBasicOps-588240159-project Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 110886d1a5094ec4a4be4224bf8f0163 Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestServerBasicOps-588240159-project Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f5a9ebbe-9876-4618-84bb-97d838139530'} Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:18.983687 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Returning 404 to user: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:18.988740 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9645aee7-d367-4d80-bc99-d0263fbf6896 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 404 len: 111 microversion: 2.1 time: 0.032357 Jul 20 11:30:18.989480 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3028/6076] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:18 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:19.458870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:19.459509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:19.465720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:19.466174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:19.466942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:19.467419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:19.482060 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] HTTP exception thrown: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Request method failure captured: Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 HTTP/1.1 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-X4qfmUsaL2vMTjebh03nmIUefMSvQCm5ki7vojuqHx9NBD9HRaFpeJpVNcdA4nN_eZ717uNsOdstrVdFb8T04IxHogTndJqmch0STWS8-xGBKKcnqqdCr6HSDhG4bDCpFuMu6zRhNseDI105ujwHFpH9OMTLhvC8qxvgSQcsG7aE0 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c2b2a455123b47ea82cad5242e9bfd2b Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestServerBasicOps-588240159 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c2b2a455123b47ea82cad5242e9bfd2b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestServerBasicOps-588240159 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c2b2a455123b47ea82cad5242e9bfd2b Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestServerBasicOps-588240159 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestServerBasicOps-588240159-project Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 110886d1a5094ec4a4be4224bf8f0163 Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestServerBasicOps-588240159-project Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f5a9ebbe-9876-4618-84bb-97d838139530'} Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:19.484489 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Returning 404 to user: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3cdc45dd-f8bf-4c12-8f76-fca025e47bf5 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 404 len: 111 microversion: 2.1 time: 0.031256 Jul 20 11:30:19.489137 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3049/6077] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:19 2022] DELETE /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:19.494655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:19.495310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] [instance: f5a9ebbe-9876-4618-84bb-97d838139530] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:19.501620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:19.502081 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:19.502857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:19.503353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:19.517189 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] HTTP exception thrown: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Request method failure captured: Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 HTTP/1.1 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-X4qfmUsaL2vMTjebh03nmIUefMSvQCm5ki7vojuqHx9NBD9HRaFpeJpVNcdA4nN_eZ717uNsOdstrVdFb8T04IxHogTndJqmch0STWS8-xGBKKcnqqdCr6HSDhG4bDCpFuMu6zRhNseDI105ujwHFpH9OMTLhvC8qxvgSQcsG7aE0 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c2b2a455123b47ea82cad5242e9bfd2b Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestServerBasicOps-588240159 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c2b2a455123b47ea82cad5242e9bfd2b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c2b2a455123b47ea82cad5242e9bfd2b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestServerBasicOps-588240159 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c2b2a455123b47ea82cad5242e9bfd2b Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestServerBasicOps-588240159 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestServerBasicOps-588240159-project Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 110886d1a5094ec4a4be4224bf8f0163 Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestServerBasicOps-588240159-project Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f5a9ebbe-9876-4618-84bb-97d838139530'} Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:19.518737 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Returning 404 to user: Instance f5a9ebbe-9876-4618-84bb-97d838139530 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:19.523464 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7a0d6499-486d-4cef-a1e2-243ff5d0d984 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530" status: 404 len: 111 microversion: 2.1 time: 0.029455 Jul 20 11:30:19.524110 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3029/6078] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:19 2022] GET /compute/v2.1/servers/f5a9ebbe-9876-4618-84bb-97d838139530 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:19.691407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03017aba-7b6e-40f7-8459-13c5d73985c4 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] Calling method '.version_select at 0x7f2c3e712b80>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:19.721996 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03017aba-7b6e-40f7-8459-13c5d73985c4 tempest-TestServerBasicOps-588240159 tempest-TestServerBasicOps-588240159-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1114380328" status: 202 len: 0 microversion: 2.1 time: 0.034670 Jul 20 11:30:19.722582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3050/6079] 10.222.0.79 () {58 vars in 1253 bytes} [Wed Jul 20 11:30:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1114380328 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:30:19.763141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:19.763796 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:19.771067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:19.771831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:19.772635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:19.773178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:19.840149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:19.850056 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d6d8e4c3-d0af-4073-9688-d5e9aa2fe5dc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1188 microversion: 2.1 time: 0.090793 Jul 20 11:30:19.851008 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3030/6080] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:19 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:20.868951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:20.869578 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:20.876825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:20.877436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:20.878213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:20.878708 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:20.971363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:20.981429 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-45578c7b-b4a0-41ce-9e74-4c9bc16daee4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 200 len: 1188 microversion: 2.1 time: 0.118453 Jul 20 11:30:20.982580 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3051/6081] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:20 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 1188 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:22.000900 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:22.001712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:22.012805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:22.019436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:22.020711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:22.021171 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:22.057852 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 HTTP/1.1 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '906f63cf-893f-47ed-86cf-8812cd6d8bc7'} Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:22.059890 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:22.067443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:22.069266 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e2fc0f38-c072-4e68-8b26-cb506a37d27f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 404 len: 111 microversion: 2.1 time: 0.072339 Jul 20 11:30:22.070026 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3052/6082] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:21 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:22.170107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:22.171790 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:22.179905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:22.182489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:22.184166 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:22.184979 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:22.217244 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-64f49970-27e1-45c7-b58d-a604e37d8352 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/ips" status: 200 len: 148 microversion: 2.1 time: 0.262722 Jul 20 11:30:22.219920 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3031/6083] 10.222.0.79 () {58 vars in 1247 bytes} [Wed Jul 20 11:30:21 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/ips => generated 148 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:24.243612 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:24.244133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:24.251391 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:24.251931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:24.252806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:24.253318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:24.281639 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 HTTP/1.1 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '906f63cf-893f-47ed-86cf-8812cd6d8bc7'} Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:24.285098 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:24.288935 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-921748fd-b09a-426a-a4ac-199ef2bbcd6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 404 len: 111 microversion: 2.1 time: 0.047720 Jul 20 11:30:24.293061 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3053/6084] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:24 2022] DELETE /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:24.298208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:24.298838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 906f63cf-893f-47ed-86cf-8812cd6d8bc7] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:24.308107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:24.308761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:24.310335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:24.310975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:24.333213 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 HTTP/1.1 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '906f63cf-893f-47ed-86cf-8812cd6d8bc7'} Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:24.335129 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. Jul 20 11:30:24.339833 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:24.343851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance 906f63cf-893f-47ed-86cf-8812cd6d8bc7 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:24.344941 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9805a3fe-d3f0-4062-bcb4-c5c209e98c48 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7" status: 404 len: 111 microversion: 2.1 time: 0.050846 Jul 20 11:30:24.345720 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3032/6085] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:24 2022] GET /compute/v2.1/servers/906f63cf-893f-47ed-86cf-8812cd6d8bc7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:24.732466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20af1d9c-0368-4f68-9d68-12ebb1f5f8ba"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:24.734363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:24.740802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:24.741608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:24.742021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:24.742460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:25.137008 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e7fdad38-2d52-40bf-be55-19abf30b6eac tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "POST /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407889 Jul 20 11:30:25.142815 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3054/6086] 10.222.0.79 () {60 vars in 1322 bytes} [Wed Jul 20 11:30:24 2022] POST /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:37.511854 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:37.513885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:37.522548 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:37.523649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:37.525646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:37.526572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:37.527709 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:37.528578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:37.657172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lazy-loading 'services' on Instance uuid 88d39073-0a8b-47ca-bc22-c40e33e95b39 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:30:37.791582 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2555b48b-0068-4a24-aef3-da42ad2ffad0 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments/20af1d9c-0368-4f68-9d68-12ebb1f5f8ba" status: 202 len: 0 microversion: 2.1 time: 0.283189 Jul 20 11:30:37.798607 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3033/6087] 10.222.0.79 () {58 vars in 1415 bytes} [Wed Jul 20 11:30:37 2022] DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments/20af1d9c-0368-4f68-9d68-12ebb1f5f8ba => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:30:37.804631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:37.812300 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:30:37.824979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:37.826086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:37.838489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:37.839020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:37.840056 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:37.840658 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:37.936424 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c2180c76-1041-4cd5-a041-153a765044d6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132478 Jul 20 11:30:37.941408 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3055/6088] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:37 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:38.952381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:38.953507 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:38.980865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:38.983988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:38.991466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:38.991944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:39.092984 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-02633f7b-5a0b-4151-9fa5-3ab17241850b tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146893 Jul 20 11:30:39.106457 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3034/6089] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:38 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:40.112591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:40.113538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:40.126857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:40.143997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:40.144852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:40.145290 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:40.222106 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12f98fba-20ea-4b75-9279-5fec9e97f9ce tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113632 Jul 20 11:30:40.224831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3056/6090] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:40 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:41.236663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:41.237779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:41.254419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:41.258193 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:41.259220 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:41.259765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:41.351541 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-25b9a341-296b-4e45-9098-751c6a496d51 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119274 Jul 20 11:30:41.357650 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3035/6091] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:41 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:42.365741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:42.367252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:42.383619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:42.384080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:42.384868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:42.385310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:42.462696 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1923688b-93ee-4d27-b47a-ae96234922a6 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101584 Jul 20 11:30:42.475272 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3057/6092] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:42 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:43.482143 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:43.484335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:43.495279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:43.496565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:43.497817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:43.498646 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:43.548449 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d50f31a-3e66-4e9b-86f4-e155648b4dd9 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070331 Jul 20 11:30:43.553082 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3036/6093] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:43 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:44.569466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:44.572231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:44.607153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:44.608161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:44.611350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:44.612815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:44.694704 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef23be28-6605-42b2-bf6a-4314663a2c57 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134342 Jul 20 11:30:44.695326 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3058/6094] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:44 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:30:45.706684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:45.707641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:45.714958 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:45.715753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:45.717297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:45.718005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:45.751957 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6a94701f-7a5c-4133-a538-90eb8d75e831 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049645 Jul 20 11:30:45.752871 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3037/6095] 10.222.0.79 () {58 vars in 1301 bytes} [Wed Jul 20 11:30:45 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 11:30:45.832221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:45.835556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:45.858261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:45.859479 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:45.860552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:45.861150 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:45.901568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:30:46.003891 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a59f30c-b750-4483-b01a-77ee2f6b5d1d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 204 len: 0 microversion: 2.1 time: 0.175103 Jul 20 11:30:46.006200 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3059/6096] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:45 2022] DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:30:46.020352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:46.021733 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:46.028542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:46.029567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:46.030413 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:46.032683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:46.192487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:46.203693 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8d616724-a00d-4a8c-8daa-cef68c13235d tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1678 microversion: 2.1 time: 0.192544 Jul 20 11:30:46.204289 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3038/6097] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:46 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:47.222023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:47.222772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:47.229823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:47.230274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:47.231600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:47.232225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:47.390410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:47.400186 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-95d1649b-e187-45d8-814a-a460bff02868 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1678 microversion: 2.1 time: 0.182673 Jul 20 11:30:47.400778 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3060/6098] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:47 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:48.421648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:48.423190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:48.433656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:48.447525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:48.452368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:48.453101 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:48.595579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8adb9b9d187e40e2b3bc0a3476156651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910a06f7def447091ec9b1417130117', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:48.603941 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-deb84344-dfcd-4a02-b820-87472f60c34e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 200 len: 1611 microversion: 2.1 time: 0.187584 Jul 20 11:30:48.606583 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3039/6099] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:48 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 1611 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:48.939656 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-9659b6fd-ca28-4223-9cf5-6cd9729b0d3f req-ced1141f-9d6c-4eed-a6e6-ffd575d7806a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d39073-0a8b-47ca-bc22-c40e33e95b39", "name": "network-vif-deleted", "tag": "07f5f8dd-bd5e-42f1-9988-a4490a11ee10"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:48.954984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9659b6fd-ca28-4223-9cf5-6cd9729b0d3f req-ced1141f-9d6c-4eed-a6e6-ffd575d7806a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:48.955456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-9659b6fd-ca28-4223-9cf5-6cd9729b0d3f req-ced1141f-9d6c-4eed-a6e6-ffd575d7806a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:48.974130 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-9659b6fd-ca28-4223-9cf5-6cd9729b0d3f req-ced1141f-9d6c-4eed-a6e6-ffd575d7806a service nova] Creating event network-vif-deleted:07f5f8dd-bd5e-42f1-9988-a4490a11ee10 for instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 on n-h1-846219-10 Jul 20 11:30:48.988103 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-9659b6fd-ca28-4223-9cf5-6cd9729b0d3f req-ced1141f-9d6c-4eed-a6e6-ffd575d7806a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051437 Jul 20 11:30:48.990192 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3061/6100] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:30:49.622069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:49.623363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:49.636898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:49.637643 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:49.638830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:49.639510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:49.669147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 HTTP/1.1 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '88d39073-0a8b-47ca-bc22-c40e33e95b39'} Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:49.675190 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:49.680182 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:49.682421 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:49.686755 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-07c718e9-5aa6-419f-9d29-8c0be71a4c7e tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 404 len: 111 microversion: 2.1 time: 0.068716 Jul 20 11:30:49.688365 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3040/6101] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:49 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:49.697483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-18460dad-407e-4366-95e1-67f3d7cd5e6c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '.version_select at 0x7f2c50d84a60>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:49.723438 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-18460dad-407e-4366-95e1-67f3d7cd5e6c tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646041910" status: 202 len: 0 microversion: 2.1 time: 0.029997 Jul 20 11:30:49.724056 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3062/6102] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:30:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646041910 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:30:53.835032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:53.836015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:53.847889 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:53.848704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:53.849943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:53.850716 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:53.873658 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 HTTP/1.1 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '88d39073-0a8b-47ca-bc22-c40e33e95b39'} Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:53.875745 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:53.880359 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:53.882521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:53.883839 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9d7e90a0-c1f0-4415-9694-53c0067d3be2 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 404 len: 111 microversion: 2.1 time: 0.052824 Jul 20 11:30:53.887367 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3041/6103] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:53 2022] DELETE /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:53.894217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:53.895633 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 88d39073-0a8b-47ca-bc22-c40e33e95b39] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:53.953655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:53.956675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:53.957916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:53.961865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:54.009319 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 HTTP/1.1 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '88d39073-0a8b-47ca-bc22-c40e33e95b39'} Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:54.012631 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. Jul 20 11:30:54.018007 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:54.022600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 88d39073-0a8b-47ca-bc22-c40e33e95b39 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:54.023679 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0fe56241-6df0-4b9c-889f-bbcba684e114 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39" status: 404 len: 111 microversion: 2.1 time: 0.134964 Jul 20 11:30:54.025742 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3063/6104] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:53 2022] GET /compute/v2.1/servers/88d39073-0a8b-47ca-bc22-c40e33e95b39 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:55.315970 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1562679292", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e0a252fa-276a-4c05-a5fe-08ae5c86396e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:55.608916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:30:56.156289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:30:56.156940 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:30:56.157594 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:30:56.158178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:30:56.158769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:30:56.170080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:56.171029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:56.172562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:56.173201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:56.196189 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:30:56.203459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:30:56.280543 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:30:56.283813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0a252fa-276a-4c05-a5fe-08ae5c86396e',volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:30:56.453835 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-900f1169-341c-46d8-a3e6-f2e4a2b4a3b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141675 Jul 20 11:30:56.456844 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3042/6105] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:30:56.465412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-515843fe-248b-4725-ba73-069b00f03848 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:56.467748 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-515843fe-248b-4725-ba73-069b00f03848 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:56.653170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-515843fe-248b-4725-ba73-069b00f03848 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:56.662967 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-515843fe-248b-4725-ba73-069b00f03848 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1071 microversion: 2.1 time: 0.201540 Jul 20 11:30:56.672763 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3064/6106] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:56 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1071 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:57.341644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:57.342687 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:57.349137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.349590 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.350557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.351005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.366291 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 HTTP/1.1 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '1b4ed53e-94e7-406a-bff2-f2b936b86469'} Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:57.368174 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-80035082-9777-4588-a517-b9b2622d556f tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 404 len: 111 microversion: 2.1 time: 0.032995 Jul 20 11:30:57.374047 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3043/6107] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:57 2022] DELETE /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:57.381631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:57.382385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 1b4ed53e-94e7-406a-bff2-f2b936b86469] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:57.390591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.391464 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.392350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.392891 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.408741 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 HTTP/1.1 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '1b4ed53e-94e7-406a-bff2-f2b936b86469'} Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.410511 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 1b4ed53e-94e7-406a-bff2-f2b936b86469 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-971bc3aa-f956-4e3e-944c-c54d806bf34a tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469" status: 404 len: 111 microversion: 2.1 time: 0.035631 Jul 20 11:30:57.415015 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3065/6108] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:57 2022] GET /compute/v2.1/servers/1b4ed53e-94e7-406a-bff2-f2b936b86469 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:57.421368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:57.421878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:57.428379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.428853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.429635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.430082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.449350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d HTTP/1.1 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e8e52b10-d2f0-436a-b658-47485255d80d'} Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:57.451522 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:57.458580 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b07e50f2-7493-467e-815c-af1e552ee7d1 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 404 len: 111 microversion: 2.1 time: 0.036300 Jul 20 11:30:57.462404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:57.462404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: e8e52b10-d2f0-436a-b658-47485255d80d] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:57.467542 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3044/6109] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:30:57 2022] DELETE /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:57.469914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.470274 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.470817 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.471314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.486780 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d HTTP/1.1 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'e8e52b10-d2f0-436a-b658-47485255d80d'} Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:30:57.488313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance e8e52b10-d2f0-436a-b658-47485255d80d could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:30:57.492836 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-811f7eb0-b164-4887-b815-0045a33f9e99 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d" status: 404 len: 111 microversion: 2.1 time: 0.032107 Jul 20 11:30:57.503010 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3066/6110] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:57 2022] GET /compute/v2.1/servers/e8e52b10-d2f0-436a-b658-47485255d80d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:30:57.685493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:57.686441 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:57.699069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.699564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.702711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:57.705042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:57.800984 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:57.813147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1232596d-ac38-49c1-a747-86f337a6359c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1187 microversion: 2.1 time: 0.135919 Jul 20 11:30:57.820129 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3045/6111] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:57 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:58.830318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:30:58.831118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:30:58.849663 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:58.851603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:58.853778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:58.854434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:59.047066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:30:59.056733 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3ea79678-262e-4203-883b-f1a1a863ecd1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1229 microversion: 2.1 time: 0.228917 Jul 20 11:30:59.057747 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3067/6112] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:30:58 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1229 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:30:59.583907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4eb801df-a514-4faa-b7ae-a7070e199d15 req-b1ad2489-3898-47ff-b8d1-ef90c334f41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e9f301-c4bf-4f7e-a477-51b5ea18be18", "tag": "be465c68-ec81-493e-a701-2591ac12306e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:30:59.613147 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4eb801df-a514-4faa-b7ae-a7070e199d15 req-b1ad2489-3898-47ff-b8d1-ef90c334f41e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:30:59.613872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4eb801df-a514-4faa-b7ae-a7070e199d15 req-b1ad2489-3898-47ff-b8d1-ef90c334f41e service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:30:59.631782 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4eb801df-a514-4faa-b7ae-a7070e199d15 req-b1ad2489-3898-47ff-b8d1-ef90c334f41e service nova] Creating event network-changed:be465c68-ec81-493e-a701-2591ac12306e for instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 on n-h1-846219-10 Jul 20 11:30:59.641804 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4eb801df-a514-4faa-b7ae-a7070e199d15 req-b1ad2489-3898-47ff-b8d1-ef90c334f41e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061696 Jul 20 11:30:59.643050 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3046/6113] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:31:00.074642 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:00.077115 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:00.090268 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:00.091091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:00.092510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:00.092957 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:00.351086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:00.366332 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e631b9ef-afbe-4639-8bc8-0728ecb019ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1229 microversion: 2.1 time: 0.296220 Jul 20 11:31:00.373660 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3068/6114] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:00 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1229 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:01.390686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:01.391587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:01.399290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:01.399892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:01.400795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:01.401343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:01.566943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:01.578416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-af523721-9496-4c1b-888a-169b66dc35e7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1229 microversion: 2.1 time: 0.192206 Jul 20 11:31:01.591241 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3047/6115] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:01 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1229 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:02.011306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:02.012460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:02.032770 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:02.033383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:02.034221 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:02.040329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:02.065011 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 HTTP/1.1 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '993c9382-4ad5-41bb-a002-cde1f9203531'} Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:31:02.066616 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:31:02.072454 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eff594c6-b90d-4912-ac41-97ce48eb4349 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 404 len: 111 microversion: 2.1 time: 0.063224 Jul 20 11:31:02.077434 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3069/6116] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:31:02 2022] DELETE /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:31:02.080822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:02.081459 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] [instance: 993c9382-4ad5-41bb-a002-cde1f9203531] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:02.091593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:02.092680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:02.096587 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:02.097215 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:02.112981 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] HTTP exception thrown: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Request method failure captured: Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 HTTP/1.1 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-YDEXpxCWVtc45j1qvRgLlboRyAWuJYbMhz4irAn9sTq6sot5OyPikZPWgmWDypOkb3maLqiUkzGbBeic97U_OJL97q1gDqDBxUIvI3WJ0QhsBl-gG-cPk6SQSpo6pQcInJcXqP88_-dkb8FcQfhSMnKN5rwH887EMd_x2mV5cyElA Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0910a06f7def447091ec9b1417130117", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0910a06f7def447091ec9b1417130117"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0910a06f7def447091ec9b1417130117"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 0910a06f7def447091ec9b1417130117 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1091570872 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 8adb9b9d187e40e2b3bc0a3476156651 Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-AttachVolumeNegativeTest-1091570872-project Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '993c9382-4ad5-41bb-a002-cde1f9203531'} Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:31:02.115303 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. Jul 20 11:31:02.119954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:31:02.121108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] Returning 404 to user: Instance 993c9382-4ad5-41bb-a002-cde1f9203531 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:31:02.122808 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f0b2768a-9cb1-4ff1-8157-7f585bd6ea17 tempest-AttachVolumeNegativeTest-1091570872 tempest-AttachVolumeNegativeTest-1091570872-project] 10.222.0.79 "GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531" status: 404 len: 111 microversion: 2.1 time: 0.046663 Jul 20 11:31:02.124175 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3048/6117] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:02 2022] GET /compute/v2.1/servers/993c9382-4ad5-41bb-a002-cde1f9203531 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:31:02.599462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:02.600095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:02.611857 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:02.612318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:02.614486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:02.614955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:03.042086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:03.070402 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3fd38ecc-8278-40ad-b536-ad2600a01b82 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1229 microversion: 2.1 time: 0.475855 Jul 20 11:31:03.078380 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3070/6118] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:02 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1229 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:04.099327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:04.108301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:04.119730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:04.120218 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:04.121104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:04.121545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:04.398874 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:04.408147 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-85eca3da-7d3f-4346-a920-61f978abde40 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1229 microversion: 2.1 time: 0.316038 Jul 20 11:31:04.408832 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3049/6119] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:04 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1229 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:05.426341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:05.426972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:05.433866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:05.434337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:05.435289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:05.435742 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:05.586853 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:05.596655 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4dbf08e2-5eaa-44a1-933e-c38c522fe692 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.174200 Jul 20 11:31:05.607334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3071/6120] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:05 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:06.615609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:06.616773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:06.634446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:06.637017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:06.644335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:06.645776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:06.647374 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:06.648488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:06.848212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:06.858051 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-31b528ab-ce51-4894-92e6-febd8983440d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.247891 Jul 20 11:31:06.859128 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3050/6121] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:06 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:07.876660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:07.877282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:07.880291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:07.881143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:07.887507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:07.887963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:07.888944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:07.889378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:07.910032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:08.044664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:08.053002 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-eff7e726-240f-4003-88a6-e66f2d448dfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.181368 Jul 20 11:31:08.053871 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3072/6122] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:07 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:09.072651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:09.073303 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:09.080141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:09.082560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:09.083241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:09.084124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:09.084689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:09.092405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:09.252967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:09.262069 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-55970d66-6694-4d14-8ba8-7a6975f36ac4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.195508 Jul 20 11:31:09.272737 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3051/6123] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:09 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:10.281245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:10.281960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:10.289999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:10.290732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:10.291923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:10.293160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:10.484235 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:10.493095 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7076e19b-f56c-4c1f-b00e-ce34bd966737 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.216943 Jul 20 11:31:10.501392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3073/6124] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:10 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:11.512598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:11.513549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:11.521853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:11.522316 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:11.523134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:11.523896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:11.683717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:11.692080 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c84c3cff-7797-47ea-a160-a9f95abbc936 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.184173 Jul 20 11:31:11.692658 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3052/6125] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:11 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:12.709103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:12.710505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:12.724059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:12.724852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:12.727159 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:12.727846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:12.910930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:12.929021 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a7d4f4a-9bce-4d91-b047-c8b965b49102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.224409 Jul 20 11:31:12.929616 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3074/6126] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:12 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:13.946618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:13.947229 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:13.956241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:13.956695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:13.958326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:13.958928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:14.146517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:14.161907 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-da0d3baa-b6e4-419f-97e7-634710e38424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.213265 Jul 20 11:31:14.162982 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3053/6127] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:13 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:14.846577 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-921a1288-fa6a-48de-90d2-1a378db20f65 req-fb7f3508-1186-4c84-85da-d822ae2d1989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e9f301-c4bf-4f7e-a477-51b5ea18be18", "name": "network-vif-plugged", "status": "completed", "tag": "be465c68-ec81-493e-a701-2591ac12306e"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:31:14.859343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-921a1288-fa6a-48de-90d2-1a378db20f65 req-fb7f3508-1186-4c84-85da-d822ae2d1989 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:14.859796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-921a1288-fa6a-48de-90d2-1a378db20f65 req-fb7f3508-1186-4c84-85da-d822ae2d1989 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:14.881384 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-921a1288-fa6a-48de-90d2-1a378db20f65 req-fb7f3508-1186-4c84-85da-d822ae2d1989 service nova] Creating event network-vif-plugged:be465c68-ec81-493e-a701-2591ac12306e for instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 on n-h1-846219-10 Jul 20 11:31:14.889947 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-921a1288-fa6a-48de-90d2-1a378db20f65 req-fb7f3508-1186-4c84-85da-d822ae2d1989 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047391 Jul 20 11:31:14.890864 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3075/6128] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:31:15.181626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:15.183075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:15.193647 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:15.194908 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:15.196184 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:15.196789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:15.355050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:15.365957 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5e3db8ec-0c87-4159-952e-48a04c7d370f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.189641 Jul 20 11:31:15.366626 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3054/6129] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:15 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:16.386007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:16.387328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:16.394963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:16.395680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:16.396563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:16.397126 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:16.617712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:16.630416 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-58e383b2-5d6b-440c-bf5f-937eda2b4395 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1217 microversion: 2.1 time: 0.250190 Jul 20 11:31:16.639245 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3076/6130] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:16 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:17.655950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:17.657255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:17.664765 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:17.665224 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:17.666305 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:17.666755 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:17.818909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:17.827419 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-45897954-7d7f-441c-97bd-cfb72bb769f8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1404 microversion: 2.1 time: 0.175272 Jul 20 11:31:17.828010 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3055/6131] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:17 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:17.844761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:17.845384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:17.852652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:17.853340 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:17.854124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:17.854568 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:18.002881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:18.010583 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fcad88a2-5a1e-44ac-ad88-eec09c928a54 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1404 microversion: 2.1 time: 0.170609 Jul 20 11:31:18.011392 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3077/6132] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:17 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:18.040770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1176820866"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:31:18.041835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:18.049502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:18.049954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:18.050853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:18.051330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:18.179537 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.api [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Attempting to quiesce instance before volume snapshot. Jul 20 11:31:18.242263 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.api [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 20 11:31:18.330347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Creating snapshot from volume e0a252fa-276a-4c05-a5fe-08ae5c86396e. {{(pid=125886) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 20 11:31:19.777275 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4748ab5b-f1ce-44ac-870c-608b51ac348c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18/action" status: 202 len: 0 microversion: 2.1 time: 1.747548 Jul 20 11:31:19.779419 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3056/6133] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:31:18 2022] POST /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18/action => generated 0 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 20 11:31:21.030121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-120577061", "imageRef": "517d7862-7d20-4d5c-821f-5e534aa9ebcb", "flavorRef": "452", "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:31:21.087538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:31:21.611460 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:31:21.612440 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:31:21.613517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:31:21.614044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:31:21.615503 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:31:21.627712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:21.628433 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:21.629625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:21.630081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:21.656441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:31:21.663773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:31:21.680779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:31:21.683731 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6d043c54-4fa5-444e-a97c-4ea2be089c1b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:31:21.772354 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca00f793-0d25-4ea7-ac46-2efabd4203ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747025 Jul 20 11:31:21.773423 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3078/6134] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:31:21.785748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c7698ebc-20a0-4413-a5f6-bf3ddcf42640 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:21.787614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c7698ebc-20a0-4413-a5f6-bf3ddcf42640 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:21.860333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c7698ebc-20a0-4413-a5f6-bf3ddcf42640 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:21.868795 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c7698ebc-20a0-4413-a5f6-bf3ddcf42640 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1229 microversion: 2.1 time: 0.087923 Jul 20 11:31:21.879402 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3057/6135] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:21 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:22.886732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:22.887457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:22.906364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:22.913258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:22.914130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:22.914788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:23.072372 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:23.086419 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-213b2253-b5a2-43ba-bc04-6f691108af41 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1299 microversion: 2.1 time: 0.204159 Jul 20 11:31:23.087438 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3079/6136] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:22 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:31:24.107064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:24.108694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:24.134658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:24.135783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:24.139742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:24.142609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:24.409285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:24.425350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8da995f1-f062-47ea-9184-8dadac3c8ae5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.324224 Jul 20 11:31:24.438037 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3058/6137] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:24 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:25.446468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:25.450912 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:25.465872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-02954b0e-6e8f-48af-b5c3-4360bd04a012 req-fda74a4b-fb14-49c2-ba9c-3b7ffadbdfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02ba70c-ff34-454c-bd00-6a5d17afccd5", "tag": "47ecad0c-98e2-4369-97ce-a5a6d9de7452"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:31:25.481800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:25.486668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:25.488871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:25.489668 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:25.490102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-02954b0e-6e8f-48af-b5c3-4360bd04a012 req-fda74a4b-fb14-49c2-ba9c-3b7ffadbdfc2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:25.490614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-02954b0e-6e8f-48af-b5c3-4360bd04a012 req-fda74a4b-fb14-49c2-ba9c-3b7ffadbdfc2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:25.529443 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-02954b0e-6e8f-48af-b5c3-4360bd04a012 req-fda74a4b-fb14-49c2-ba9c-3b7ffadbdfc2 service nova] Creating event network-changed:47ecad0c-98e2-4369-97ce-a5a6d9de7452 for instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 on n-h2-846219-10 Jul 20 11:31:25.536882 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-02954b0e-6e8f-48af-b5c3-4360bd04a012 req-fda74a4b-fb14-49c2-ba9c-3b7ffadbdfc2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074985 Jul 20 11:31:25.547478 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3059/6138] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:31:25.930273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:25.939931 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3065b2f-4e31-4e35-80e4-8466c72cbd34 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.498610 Jul 20 11:31:25.944056 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3080/6139] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:25 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:26.962915 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:26.963700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:26.977677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:26.978549 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:26.978936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:26.979469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:27.256085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:27.267502 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7548608a-bd9c-4219-8070-623c2f2d5389 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.309752 Jul 20 11:31:27.268687 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3060/6140] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:26 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:28.292229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:28.293574 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:28.301435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:28.302136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:28.302992 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:28.304438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:28.510997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:28.521870 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5420aa14-3b38-4770-b5b6-58269b1c48fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.234374 Jul 20 11:31:28.533641 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3081/6141] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:28 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:29.545213 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:29.546519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:29.553995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:29.554738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:29.555793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:29.556608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:29.765113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:29.774730 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1208368f-658c-4570-9e31-0326e720d112 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.235467 Jul 20 11:31:29.776435 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3061/6142] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:29 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:31:30.799116 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:30.800613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:30.811834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:30.812934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:30.814364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:30.815044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:31.064660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:31.080313 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d3f80dd-5d40-40df-b7b8-e0c0a22edaae tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.288759 Jul 20 11:31:31.091322 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3082/6143] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:30 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:32.103398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:32.104780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:32.112920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:32.114757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:32.115593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:32.116834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:32.118033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:32.408695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:32.420554 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffa39075-e21d-4645-bd6b-81bfcd7b5508 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.322136 Jul 20 11:31:32.423791 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3062/6144] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:32 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:33.453576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:33.456737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:33.462123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:33.463481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:33.469338 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:33.470021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:33.471041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:33.471796 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:33.667043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:33.676012 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5b5864af-816f-41f4-9742-b4ed309dfcb0 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.237962 Jul 20 11:31:33.676592 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3083/6145] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:33 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:34.694015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:34.694653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:34.701998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:34.702469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:34.703306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:34.703766 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:34.861462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:34.871575 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-77a72046-a71f-4a9e-9ea1-ee3f26bb221d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.180975 Jul 20 11:31:34.883400 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3063/6146] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:34 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:35.889632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:35.890249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:35.897628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:35.898445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:35.899580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:35.900533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:36.085198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:36.093856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ab5e86e2-73ba-41cf-9cf1-ac3b846dc424 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.208838 Jul 20 11:31:36.103529 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3084/6147] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:35 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:37.112788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:37.113328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:37.124945 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:37.126595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:37.128965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:37.130199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:37.320565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:37.333194 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b8ce42b-d1e3-48c0-b9fa-5ab519f19f58 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.224666 Jul 20 11:31:37.334541 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3064/6148] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:37 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:38.352184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:38.356326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:38.366818 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:38.369471 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:38.370435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:38.371883 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:38.372680 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:38.399264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=70 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:38.556987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:38.568940 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-130537ab-27fc-4a7b-8aae-d871e47c5ef4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.220888 Jul 20 11:31:38.569906 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3085/6149] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:38 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:39.592907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:39.593610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:39.603368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=30 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:39.606351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:39.606825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:39.608018 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:39.609281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:39.619462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:31:39.812525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:39.821025 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a6428246-84ab-4788-86bf-218b08644ee9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.236647 Jul 20 11:31:39.822171 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3065/6150] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:39 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:40.843101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:40.844744 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:40.856456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:40.857815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:40.858846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:40.859999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:41.075459 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:41.086856 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51a2e864-452c-4405-96f4-1b7a0350d6a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1341 microversion: 2.1 time: 0.249971 Jul 20 11:31:41.087779 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3086/6151] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:40 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1341 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:42.107472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:42.108403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:42.116478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:42.117319 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:42.118362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:42.119105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:42.299990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:42.311686 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c40e2548-e48d-49f5-801e-a6e3ea16d79f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.208844 Jul 20 11:31:42.312388 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3066/6152] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:42 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:43.335557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:43.336483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:43.345009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:43.346263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:43.347548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:43.348259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:43.512734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:43.524760 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-065aac71-27f1-4bd8-b9b5-5da603123796 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.197586 Jul 20 11:31:43.527582 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3087/6153] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:43 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:44.545931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:44.546841 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:44.554021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:44.554502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:44.555324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:44.555785 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:44.705340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:44.714773 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b5a00611-4639-4392-930d-39e3076fc94b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.175100 Jul 20 11:31:44.715902 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3067/6154] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:44 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:45.735401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:45.736026 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:45.744118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:45.744616 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:45.745624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:45.746145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:45.915016 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:45.925972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1f434f76-8b06-4d93-b314-94385dacb859 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.197055 Jul 20 11:31:45.927217 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3088/6155] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:45 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:46.945706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:46.948835 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:46.961781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:46.962240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:46.963026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:46.968482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:47.160617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:47.170607 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0662148a-97f2-48a0-b87f-2682fe922e5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.229468 Jul 20 11:31:47.171454 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3068/6156] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:46 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:48.191075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:48.192341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:48.202561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:48.203069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:48.204218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:48.205371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:48.385648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:48.396502 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50f4226f-97f4-4332-809f-5fb64cd03d9a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.211161 Jul 20 11:31:48.409019 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3089/6157] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:48 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:49.417937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:49.419206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:49.427086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:49.427576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:49.428559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:49.429006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:49.585440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:49.596475 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0a77b369-5fe6-41a7-bd2f-d184f5e62e52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.183216 Jul 20 11:31:49.597069 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3069/6158] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:49 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:50.616693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:50.618251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:50.627078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:50.627628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:50.629062 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:50.629553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:50.708393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4a710030-b8dd-4a5f-bb37-116bcd0afe52 req-aabd9410-b927-48e4-b38c-57bd85a59d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02ba70c-ff34-454c-bd00-6a5d17afccd5", "name": "network-vif-plugged", "status": "completed", "tag": "47ecad0c-98e2-4369-97ce-a5a6d9de7452"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:31:50.723759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4a710030-b8dd-4a5f-bb37-116bcd0afe52 req-aabd9410-b927-48e4-b38c-57bd85a59d41 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:50.726191 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4a710030-b8dd-4a5f-bb37-116bcd0afe52 req-aabd9410-b927-48e4-b38c-57bd85a59d41 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:50.746834 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4a710030-b8dd-4a5f-bb37-116bcd0afe52 req-aabd9410-b927-48e4-b38c-57bd85a59d41 service nova] Creating event network-vif-plugged:47ecad0c-98e2-4369-97ce-a5a6d9de7452 for instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 on n-h2-846219-10 Jul 20 11:31:50.753361 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4a710030-b8dd-4a5f-bb37-116bcd0afe52 req-aabd9410-b927-48e4-b38c-57bd85a59d41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050987 Jul 20 11:31:50.754455 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3070/6159] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:31:50.839925 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:50.850772 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-97b4028b-9e6f-4faf-acaf-62363931f905 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.238101 Jul 20 11:31:50.852308 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3090/6160] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:50 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:51.869172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:51.870055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:51.877436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:51.878023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:51.878929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:51.879521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:52.031829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:52.041148 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a69bc30a-4945-4d7e-94a1-82e50bdd49d9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1375 microversion: 2.1 time: 0.176097 Jul 20 11:31:52.042755 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3071/6161] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:51 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:53.060477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:53.061119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:53.070387 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.070847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.071654 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.072147 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.237944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:53.246959 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-51b67a4a-b12e-461c-a52f-aa30b3b2d696 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1563 microversion: 2.1 time: 0.191875 Jul 20 11:31:53.255256 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3091/6162] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:53 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1563 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:53.269110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:53.270138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:53.278186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.278779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.279717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.280248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.487834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:53.498838 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a4072a2b-b56e-42ca-a51a-f0007fd16713 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1563 microversion: 2.1 time: 0.237177 Jul 20 11:31:53.500136 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3072/6163] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:53 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:53.583558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:53.584293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:53.592463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.592924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.593777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.594139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.624005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:31:53.715302 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cfd3de86-d6bb-4dcf-afc3-ddc74926dcac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 204 len: 0 microversion: 2.1 time: 0.135385 Jul 20 11:31:53.716559 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3092/6164] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:31:53 2022] DELETE /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:31:53.725724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:53.726432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:53.736930 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.737753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.738793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:53.739263 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:53.919127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:53.928163 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-990fbf4b-fa56-4932-afc1-8f850769b3ca tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1569 microversion: 2.1 time: 0.206874 Jul 20 11:31:53.929911 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3073/6165] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:53 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:54.947511 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:54.949709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:54.957197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:54.957871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:54.959225 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:54.960328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:55.124068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:55.133253 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-aa50a4ef-70f5-482e-bcb2-037329c31206 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1569 microversion: 2.1 time: 0.190025 Jul 20 11:31:55.134206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3093/6166] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:54 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:55.843497 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-7fdfe1b5-fff1-4b1b-a98e-82eeb1872d93 req-38dad5aa-904c-4711-9355-3aea1e362f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02ba70c-ff34-454c-bd00-6a5d17afccd5", "name": "network-vif-deleted", "tag": "47ecad0c-98e2-4369-97ce-a5a6d9de7452"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:31:55.869194 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7fdfe1b5-fff1-4b1b-a98e-82eeb1872d93 req-38dad5aa-904c-4711-9355-3aea1e362f58 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:55.870212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-7fdfe1b5-fff1-4b1b-a98e-82eeb1872d93 req-38dad5aa-904c-4711-9355-3aea1e362f58 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:55.896730 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-7fdfe1b5-fff1-4b1b-a98e-82eeb1872d93 req-38dad5aa-904c-4711-9355-3aea1e362f58 service nova] Creating event network-vif-deleted:47ecad0c-98e2-4369-97ce-a5a6d9de7452 for instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 on n-h2-846219-10 Jul 20 11:31:55.912641 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-7fdfe1b5-fff1-4b1b-a98e-82eeb1872d93 req-38dad5aa-904c-4711-9355-3aea1e362f58 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074353 Jul 20 11:31:55.916524 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3074/6167] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:31:56.151741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:56.152646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:56.175552 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:56.176302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:56.177486 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:56.178366 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:56.282793 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:56.297591 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-584fed3c-52db-4b86-bc01-83f4e3518a9c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1360 microversion: 2.1 time: 0.150122 Jul 20 11:31:56.300336 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3094/6168] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:56 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:57.320331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:57.321071 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:57.341681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:57.342445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:57.350346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:57.351038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:57.458705 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:57.469018 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c3da9967-e2ec-48d7-9b9b-4db81be0a249 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1360 microversion: 2.1 time: 0.154319 Jul 20 11:31:57.483342 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3075/6169] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:57 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:58.487958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:58.489133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:58.497293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:58.497942 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:58.500361 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:58.501143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:58.590524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:58.613294 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-25277192-e98e-4d5d-b3d9-4167a70e64d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1360 microversion: 2.1 time: 0.129092 Jul 20 11:31:58.614787 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3095/6170] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:58 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1360 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:31:59.631678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:31:59.633452 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:31:59.643968 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:59.644545 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:59.645457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:31:59.646038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:31:59.734050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:31:59.746731 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8af8531b-6d22-46e0-8579-d1e1892e3bb7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1360 microversion: 2.1 time: 0.117776 Jul 20 11:31:59.747906 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3076/6171] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:31:59 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1360 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:00.764962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:00.766215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:00.774227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:00.774910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:00.777251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:00.777864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:00.889888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:00.906851 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b270e77e-f35b-49da-853e-2872e55b44bf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1360 microversion: 2.1 time: 0.146327 Jul 20 11:32:00.908085 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3096/6172] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:00 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:01.925478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:01.927454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:01.936995 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:01.937698 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:01.938674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:01.939308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:02.016667 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:02.018412 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:02.019803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lazy-loading 'fault' on Instance uuid f02ba70c-ff34-454c-bd00-6a5d17afccd5 {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:32:02.152691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:02.164721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-98184864-5ca4-4579-a95f-2177a3a1996d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 200 len: 1319 microversion: 2.1 time: 0.242408 Jul 20 11:32:02.168298 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3077/6173] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:01 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:03.189741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:03.190937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:03.199057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:03.199812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:03.200778 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:03.201374 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:03.217082 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 HTTP/1.1 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f02ba70c-ff34-454c-bd00-6a5d17afccd5'} Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:03.219602 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:03.224788 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:03.235767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:32:03.236663 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-115d0e4a-24a7-49f5-8a95-b2c36b13f46b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 404 len: 111 microversion: 2.1 time: 0.050790 Jul 20 11:32:03.237248 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3097/6174] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:03 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:32:08.739737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:08.740855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:08.753897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:08.754928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:08.756500 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:08.760847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:08.811199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:32:08.973877 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b94ac7b-0785-4c31-84fd-3099570e3eb4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 204 len: 0 microversion: 2.1 time: 0.238203 Jul 20 11:32:08.975206 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3078/6175] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:32:08 2022] DELETE /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:32:08.984726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:08.985528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:08.990087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:09.000637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:09.001051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:09.001791 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:09.004840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:09.009187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:09.311597 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:09.321093 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a789703-2efe-4309-8126-af885a455b4e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1410 microversion: 2.1 time: 0.340894 Jul 20 11:32:09.332072 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3098/6176] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:08 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1410 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:10.340783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:10.341516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:10.344977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:10.353723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:10.360777 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:10.361491 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:10.362020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:10.367616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:10.639727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:10.664199 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-088cb420-0625-4162-8322-b7adceb1c7da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1410 microversion: 2.1 time: 0.328619 Jul 20 11:32:10.670401 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3079/6177] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:10 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1410 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:11.687489 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:11.688831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:11.701649 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:11.702443 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:11.703337 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:11.704782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:11.770013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-234bfe9b-e1bb-4e8e-b63a-072eb193a94d req-1c93978b-290e-4a2d-81cb-5503a8821175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e9f301-c4bf-4f7e-a477-51b5ea18be18", "name": "network-vif-deleted", "tag": "be465c68-ec81-493e-a701-2591ac12306e"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:32:11.783211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:11.792386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-234bfe9b-e1bb-4e8e-b63a-072eb193a94d req-1c93978b-290e-4a2d-81cb-5503a8821175 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:11.792791 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-234bfe9b-e1bb-4e8e-b63a-072eb193a94d req-1c93978b-290e-4a2d-81cb-5503a8821175 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:11.793085 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3c5f96d3-1f3f-4c3a-8bf8-53dd7f6ec7ac tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1368 microversion: 2.1 time: 0.110143 Jul 20 11:32:11.794209 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3099/6178] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:11 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:11.810370 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-234bfe9b-e1bb-4e8e-b63a-072eb193a94d req-1c93978b-290e-4a2d-81cb-5503a8821175 service nova] Creating event network-vif-deleted:be465c68-ec81-493e-a701-2591ac12306e for instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 on n-h1-846219-10 Jul 20 11:32:11.825532 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-234bfe9b-e1bb-4e8e-b63a-072eb193a94d req-1c93978b-290e-4a2d-81cb-5503a8821175 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069091 Jul 20 11:32:11.826870 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3080/6179] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:32:12.810676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:12.813057 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:12.821289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:12.823205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:12.824373 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:12.825158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:13.123990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:13.133040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f6b9b7e4-42ea-4164-8eb1-b04cd0f65250 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1202 microversion: 2.1 time: 0.326729 Jul 20 11:32:13.134209 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3100/6180] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:12 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1202 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:14.153842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:14.155434 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:14.162714 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:14.164038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:14.165227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:14.167125 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:14.271873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:14.281879 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9a64c306-8fa9-4f42-a7a1-dcfdee0ad59a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1202 microversion: 2.1 time: 0.133629 Jul 20 11:32:14.285032 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3081/6181] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:14 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1202 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:15.298282 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:15.298898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:15.312639 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:15.313095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:15.313898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:15.314326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:15.479012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:15.488657 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c09b19f3-179a-4f13-9216-b9bc6035e0f6 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1202 microversion: 2.1 time: 0.194496 Jul 20 11:32:15.495222 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3101/6182] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:15 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:16.511965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:16.515205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:16.527557 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:16.534252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:16.535087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:16.535576 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:16.674040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:16.684259 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-56052aaa-18de-4335-b34d-9a5534fb6ca9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 200 len: 1202 microversion: 2.1 time: 0.181660 Jul 20 11:32:16.691336 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3082/6183] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:16 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:17.706114 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:17.707351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:17.715303 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:17.715786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:17.717305 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:17.717769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:17.742087 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 HTTP/1.1 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a6e9f301-c4bf-4f7e-a477-51b5ea18be18'} Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:17.745313 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:17.749391 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:17.750626 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:32:17.751705 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fa4f87e1-b353-40fc-a59e-ebc6808a8684 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 404 len: 111 microversion: 2.1 time: 0.049473 Jul 20 11:32:17.755828 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3102/6184] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:17 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:32:20.988277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:20.988885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:21.002419 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.004786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.008269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.008773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.043318 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 HTTP/1.1 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f02ba70c-ff34-454c-bd00-6a5d17afccd5'} Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:32:21.045183 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.049198 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.051662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:32:21.052961 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad4abd6f-5e70-4086-a6cc-7dd71ec036a8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 404 len: 111 microversion: 2.1 time: 0.068922 Jul 20 11:32:21.057762 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3083/6185] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:32:20 2022] DELETE /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:32:21.064667 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:21.065302 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: f02ba70c-ff34-454c-bd00-6a5d17afccd5] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:21.077230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.077862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.078732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.079186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.095333 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 HTTP/1.1 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f02ba70c-ff34-454c-bd00-6a5d17afccd5'} Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.097364 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. Jul 20 11:32:21.102173 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.114133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance f02ba70c-ff34-454c-bd00-6a5d17afccd5 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:32:21.115382 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-791a66f9-91be-458c-8e64-4ef70ebd69b9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5" status: 404 len: 111 microversion: 2.1 time: 0.055961 Jul 20 11:32:21.117829 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3103/6186] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:21 2022] GET /compute/v2.1/servers/f02ba70c-ff34-454c-bd00-6a5d17afccd5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:32:21.780011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:21.781250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:21.789489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.790302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.792033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.792668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.814170 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: request: DELETE /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 HTTP/1.1 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a6e9f301-c4bf-4f7e-a477-51b5ea18be18'} Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:32:21.816169 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:32:21.821097 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0ae13441-3e4c-49e8-a307-78608c4c10fd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 404 len: 111 microversion: 2.1 time: 0.046054 Jul 20 11:32:21.823959 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3084/6187] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:32:21 2022] DELETE /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:32:21.832239 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:21.832856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: a6e9f301-c4bf-4f7e-a477-51b5ea18be18] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:21.840424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.840879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.841662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:21.842357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:21.859351 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 HTTP/1.1 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a6e9f301-c4bf-4f7e-a477-51b5ea18be18'} Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:32:21.861097 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance a6e9f301-c4bf-4f7e-a477-51b5ea18be18 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:32:21.865198 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5e5f0618-7324-4db9-b6c8-9e4fd642ad27 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18" status: 404 len: 111 microversion: 2.1 time: 0.034267 Jul 20 11:32:21.877027 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3104/6188] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:21 2022] GET /compute/v2.1/servers/a6e9f301-c4bf-4f7e-a477-51b5ea18be18 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:32:21.980123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b1c26d98-029d-4859-bb5c-b4e571cebd24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: .version_select at 0x7f2c3fb20af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-181214265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8x8IBTaojGvJMG9+zhJ2cNCx+txUZjIbIshtqcapNHXxKVgwxOdHnEgDy9EFeey0VhXZjB1Vhbah6B/6gsoJedWu6Z0KLKrNALWuLH7Qjfg+o4s+aqWeDidp2VDA6hzg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:32:22.009870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-b1c26d98-029d-4859-bb5c-b4e571cebd24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:32:22.031681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-b1c26d98-029d-4859-bb5c-b4e571cebd24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:32:22.097972 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b1c26d98-029d-4859-bb5c-b4e571cebd24 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.121652 Jul 20 11:32:22.099467 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3085/6189] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:32:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:32:45.748666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702158606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-181214265", "security_groups": [{"name": "tempest-secgroup-smoke-1926341752"}], "block_device_mapping_v2": [{"uuid": "5c9bf808-ba56-4d32-b724-f332b86a30b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:32:45.763317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=13 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:45.764895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=29 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:45.938918 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:32:46.551789 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:32:46.552601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:32:46.553180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:32:46.553670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:32:46.554401 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:32:46.574220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:46.582408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:46.583614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:46.584071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:46.626117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:32:46.633901 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:32:46.712841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:32:46.715430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c9bf808-ba56-4d32-b724-f332b86a30b4',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:32:46.896035 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e049bfa-2718-4959-abda-404b7a7a9a1e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.151283 Jul 20 11:32:46.899687 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3105/6190] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:32:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:32:46.912794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b9b4f52-9f61-47f9-9548-2fdf2eaf618b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:46.913676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b9b4f52-9f61-47f9-9548-2fdf2eaf618b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:46.923253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=23 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:46.924102 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:46.924788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:47.029685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b9b4f52-9f61-47f9-9548-2fdf2eaf618b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:47.039189 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b9b4f52-9f61-47f9-9548-2fdf2eaf618b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1093 microversion: 2.1 time: 0.132784 Jul 20 11:32:47.053973 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3086/6191] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:46 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1093 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:32:48.060258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:48.060956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:48.068283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:48.069285 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:48.070201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:48.071357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:48.179431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:48.197071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe278366-261c-4538-a6e5-f9545b816b52 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1191 microversion: 2.1 time: 0.142412 Jul 20 11:32:48.198686 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3106/6192] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:48 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1191 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:49.222997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:49.225825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:49.246170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:49.246648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:49.252604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:49.253060 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:50.534473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:50.547983 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6e62a981-ada0-4342-9432-1a07c861212e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 1.337342 Jul 20 11:32:50.559549 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3087/6193] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:49 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:51.409528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-14d8fbea-26ea-4b5e-8035-eae87fbc87f5 req-7da6dc06-b65d-47a3-8389-e6ea63c2634d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08c9c71-2e32-45c8-8c16-ceefd49aa926", "tag": "c02d6026-3ee9-4b94-a236-63e8798fbf45"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:32:51.433928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-14d8fbea-26ea-4b5e-8035-eae87fbc87f5 req-7da6dc06-b65d-47a3-8389-e6ea63c2634d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:51.435466 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-14d8fbea-26ea-4b5e-8035-eae87fbc87f5 req-7da6dc06-b65d-47a3-8389-e6ea63c2634d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:51.472926 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-14d8fbea-26ea-4b5e-8035-eae87fbc87f5 req-7da6dc06-b65d-47a3-8389-e6ea63c2634d service nova] Creating event network-changed:c02d6026-3ee9-4b94-a236-63e8798fbf45 for instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 on n-h1-846219-10 Jul 20 11:32:51.486702 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-14d8fbea-26ea-4b5e-8035-eae87fbc87f5 req-7da6dc06-b65d-47a3-8389-e6ea63c2634d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083801 Jul 20 11:32:51.488213 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3107/6194] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:32:51.565898 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:51.566762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:51.579971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:51.584362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:51.591436 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:51.594124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:52.182622 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:52.201384 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d3fd2b86-269d-49dc-a4dd-67208b2ad5fa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 0.633238 Jul 20 11:32:52.202633 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3088/6195] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:51 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:53.224651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:53.224651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:53.267920 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:53.268421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:53.269261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:53.280615 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:53.628335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:53.641491 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-559fa5cb-452d-4750-bffe-e7c4ef745c84 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 0.425236 Jul 20 11:32:53.642599 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3108/6196] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:53 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:54.658538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:54.659742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:54.668757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:54.669420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:54.670974 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:54.671666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:54.945356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:54.957125 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5fafbe1d-7573-4f6b-84d2-5e93b57cd9b1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 0.302582 Jul 20 11:32:54.971270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3089/6197] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:54 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:55.980275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:55.981482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:56.000414 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:56.001096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:56.003913 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:56.004356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:56.333545 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:56.359541 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-54b38f39-6a3e-4454-985b-bfc7236be3db tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 0.379788 Jul 20 11:32:56.362404 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3109/6198] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:55 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:57.380112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:57.381519 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:57.386433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:57.393078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:57.393864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:57.394878 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:57.395743 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:57.640892 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:57.649644 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0f4370ae-f614-407d-9713-a02b946d7e1c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 0.275269 Jul 20 11:32:57.659795 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3090/6199] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:57 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:32:58.669711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:32:58.670399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:32:58.690457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:58.691276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:32:58.699094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:58.699581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:58.705381 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:32:58.707655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:32:58.966049 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:32:58.979231 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3bf9d1f2-d50a-4233-9b4f-53ab4662944a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1277 microversion: 2.1 time: 0.316581 Jul 20 11:32:58.981381 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3110/6200] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:58 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1277 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:00.000949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:00.002917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:00.012251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:00.012720 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:00.013614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:00.014064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:00.189349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:00.200623 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4b254581-eda6-4859-af4e-e214f9d03a81 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.205005 Jul 20 11:33:00.202602 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3091/6201] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:32:59 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:01.226734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:01.228140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:01.252041 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:01.255120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:01.255974 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:01.267932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:01.479650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:01.489442 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-789c275c-a29d-4541-b540-585b15d5cc6d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.271423 Jul 20 11:33:01.490046 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3111/6202] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:01 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:02.506999 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:02.508659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:02.536729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:02.537257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:02.538146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:02.543196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:02.849054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:02.861340 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7521bf9d-895b-4a19-934f-4021a3901222 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.357333 Jul 20 11:33:02.862550 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3092/6203] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:02 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:03.549805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5721cb44-553a-4ce3-a483-24cc6e4ecc3f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Action: 'create', calling method: .version_select at 0x7f2c3fc92550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-849436437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgD1wQkKsWePVyi1VA/ND9aRuOXf/FQvhOp2wDkjFIq0tRwteWGgNgjQ/m8yUkMQByj/sbiwlBc5feVXGIhCm3knDkRFT/Q6AG++qc+rbBzwPfoD8jYonzlAJkUgUk3rg=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:03.574001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5721cb44-553a-4ce3-a483-24cc6e4ecc3f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Getting quotas for project 18e01854f2304f2fa96e6de4dfa32e89. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:33:03.580214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-5721cb44-553a-4ce3-a483-24cc6e4ecc3f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Getting quotas for user 6e0e1cc7eb474986b5ec3e43977d4789 and project 18e01854f2304f2fa96e6de4dfa32e89. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:33:03.623590 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5721cb44-553a-4ce3-a483-24cc6e4ecc3f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.079408 Jul 20 11:33:03.654677 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3112/6204] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:33:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:03.878820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:03.879658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:03.902617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:03.903112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:03.910288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:03.911661 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:04.204827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:04.214948 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d14ff7b4-ace9-4e23-9bc6-061521103598 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.339987 Jul 20 11:33:04.216008 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3093/6205] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:03 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:05.075321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-92859392", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6849f51e-fe36-4104-bf9c-3ff7d004ba86", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-849436437", "security_groups": [{"name": "tempest-secgroup-smoke-1137610300"}], "networks": [{"uuid": "3c785159-b7bb-44f0-9623-64b70298f238"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:05.233244 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:05.234029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:05.237646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] validate_networks() for [('3c785159-b7bb-44f0-9623-64b70298f238', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:33:05.241616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:05.242524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:05.243541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:05.244155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:05.600640 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:05.609249 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-64f4022f-e8db-4d36-a39a-02769e2fadeb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.380136 Jul 20 11:33:05.619064 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3094/6206] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:05 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:33:06.048277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:33:06.048697 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:33:06.049169 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:33:06.049575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:33:06.049987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:33:06.059525 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:06.059973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:06.060767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:06.061206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:06.079582 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Getting quotas for project 18e01854f2304f2fa96e6de4dfa32e89. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:33:06.084850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Getting quotas for user 6e0e1cc7eb474986b5ec3e43977d4789 and project 18e01854f2304f2fa96e6de4dfa32e89. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:33:06.144953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:33:06.147051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6849f51e-fe36-4104-bf9c-3ff7d004ba86',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:33:06.289301 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b58633aa-b156-4432-a4bf-7b946de2abb7 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.219647 Jul 20 11:33:06.290259 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3113/6207] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:33:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:33:06.300800 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1ad2c66b-9341-4386-a2f6-d0292a5c7597 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:06.301357 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1ad2c66b-9341-4386-a2f6-d0292a5c7597 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:06.408034 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1ad2c66b-9341-4386-a2f6-d0292a5c7597 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:06.431733 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1ad2c66b-9341-4386-a2f6-d0292a5c7597 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1096 microversion: 2.1 time: 0.134960 Jul 20 11:33:06.432697 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3095/6208] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:06 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1096 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:06.625944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:06.626567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:06.634014 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:06.634528 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:06.635262 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:06.635702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:06.919611 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:06.928474 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d65aa26d-f2e5-42ca-a7c5-a84cb06e6f0b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.306495 Jul 20 11:33:06.929736 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3114/6209] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:06 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:07.457002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:07.461609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:07.471745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:07.472905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:07.473880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:07.474775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:07.780596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:07.789812 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ffc29d49-9a96-40eb-a521-57c86686d75d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1202 microversion: 2.1 time: 0.344076 Jul 20 11:33:07.790768 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3096/6210] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:07 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1202 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:07.948439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:07.949390 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:07.957709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:07.958309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:07.959247 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:07.960028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:08.584882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:08.596792 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6303b925-fa49-4c04-9194-466884a30500 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.653484 Jul 20 11:33:08.597475 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3115/6211] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:07 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:08.811351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:08.812696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:08.823241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:08.823947 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:08.825062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:08.825679 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:08.937564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:08.946609 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b6c783f6-7a93-47ab-b915-6205e503ff42 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1212 microversion: 2.1 time: 0.141585 Jul 20 11:33:08.948211 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3097/6212] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:08 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1212 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:09.615003 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:09.616850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:09.625315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:09.626025 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:09.626979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:09.628397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:09.955118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:09.965252 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-638b5542-77f8-469f-8c1e-8417aab45228 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.355610 Jul 20 11:33:09.965793 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:09.966428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:09.971517 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3116/6213] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:09 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:09.984370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:09.994209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:09.995252 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:09.997536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:10.265424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:10.277870 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ce169ebb-ff90-410b-a3ff-4bfc65c65ade tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1280 microversion: 2.1 time: 0.313637 Jul 20 11:33:10.280362 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3098/6214] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:09 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:10.359023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b8057e0c-4138-4c0c-bb65-1ec9448fd86d req-38ff6869-0c98-43f8-88aa-e2fd1f781eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:10.379946 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b8057e0c-4138-4c0c-bb65-1ec9448fd86d req-38ff6869-0c98-43f8-88aa-e2fd1f781eb1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:10.380579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b8057e0c-4138-4c0c-bb65-1ec9448fd86d req-38ff6869-0c98-43f8-88aa-e2fd1f781eb1 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:10.400612 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b8057e0c-4138-4c0c-bb65-1ec9448fd86d req-38ff6869-0c98-43f8-88aa-e2fd1f781eb1 service nova] Creating event network-changed:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:33:10.407929 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b8057e0c-4138-4c0c-bb65-1ec9448fd86d req-38ff6869-0c98-43f8-88aa-e2fd1f781eb1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052593 Jul 20 11:33:10.408823 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3117/6215] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:10.998390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:10.999493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:11.012987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:11.013462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:11.014405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:11.017612 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:11.296777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:11.298309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:11.305310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:11.306055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:11.307043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:11.307679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:11.466306 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:11.484498 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8565f5da-3b22-4b81-bc41-36cbe81c6123 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.490410 Jul 20 11:33:11.486504 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3099/6216] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:10 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:11.665659 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:11.680499 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b6281b86-ce72-43ea-9c8f-3b1990f207c1 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1280 microversion: 2.1 time: 0.388775 Jul 20 11:33:11.682398 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3118/6217] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:11 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1280 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:33:12.182368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-964d8705-7ed4-436b-8df5-20a1c5ddacb5 req-d89e1f73-2cdc-43e9-a0fd-812c9525b4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08c9c71-2e32-45c8-8c16-ceefd49aa926", "name": "network-vif-plugged", "status": "completed", "tag": "c02d6026-3ee9-4b94-a236-63e8798fbf45"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:12.196396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-964d8705-7ed4-436b-8df5-20a1c5ddacb5 req-d89e1f73-2cdc-43e9-a0fd-812c9525b4d5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.198339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-964d8705-7ed4-436b-8df5-20a1c5ddacb5 req-d89e1f73-2cdc-43e9-a0fd-812c9525b4d5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.214479 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-964d8705-7ed4-436b-8df5-20a1c5ddacb5 req-d89e1f73-2cdc-43e9-a0fd-812c9525b4d5 service nova] Creating event network-vif-plugged:c02d6026-3ee9-4b94-a236-63e8798fbf45 for instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 on n-h1-846219-10 Jul 20 11:33:12.222612 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-964d8705-7ed4-436b-8df5-20a1c5ddacb5 req-d89e1f73-2cdc-43e9-a0fd-812c9525b4d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259170 Jul 20 11:33:12.224245 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3100/6218] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:12.502485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:12.503107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:12.511929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.512468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.513309 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.513758 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.655879 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:12.664759 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b1d76c89-153c-4704-8a05-d64ef01e3efb tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.165959 Jul 20 11:33:12.665351 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3119/6219] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:12 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:12.698498 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:12.699253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:12.709026 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.711424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.715124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:12.715852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:12.899562 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:12.911721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5666cdea-5936-46e5-a7b4-0c65cfed6ea5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1280 microversion: 2.1 time: 0.214340 Jul 20 11:33:12.912591 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3101/6220] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:12 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:13.682324 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:13.682971 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:13.689924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:13.690371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:13.691135 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:13.691595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:13.829832 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:13.838110 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ece83003-e935-43a2-97d1-508a4a34b0ce tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1265 microversion: 2.1 time: 0.160492 Jul 20 11:33:13.838686 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3120/6221] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:13 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:13.930609 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:13.932031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:13.940823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:13.941290 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:13.942084 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:13.942539 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:14.129376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:14.145171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6963693b-a0d0-46ae-b9cb-a6e307c3f97b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.215748 Jul 20 11:33:14.146313 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3102/6222] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:13 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:14.856243 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:14.856868 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:14.863866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:14.864310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:14.865084 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:14.865524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:15.009269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:15.017838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-52d93865-5290-4370-bab5-5f19b9eb1cf1 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1453 microversion: 2.1 time: 0.165346 Jul 20 11:33:15.018753 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3121/6223] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:14 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:15.035015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:15.035853 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:15.057136 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:15.057606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:15.058415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:15.058871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:15.165785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:15.167017 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:15.175204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:15.177700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:15.179450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:15.180291 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:15.270267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:15.280605 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-76246ba0-b6be-4358-87a2-1afa0ffb4066 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1453 microversion: 2.1 time: 0.249445 Jul 20 11:33:15.281769 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3103/6224] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:15 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:15.397850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:15.408129 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-bfc6f086-b295-43d0-8e98-1cca71d82fd5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.249013 Jul 20 11:33:15.409009 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3122/6225] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:15 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:16.425926 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:16.426533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:16.436367 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:16.438670 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:16.439362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:16.440566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:16.441019 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:16.735983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:16.745264 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1239649d-8741-4d09-8217-49abc33b8856 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.323166 Jul 20 11:33:16.755952 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3104/6226] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:16 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:17.493703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-7645c4d7-689b-44e5-9bfa-9d0c0f513e9f req-db77230e-89f9-4e7b-b782-bc2ef965aa59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08c9c71-2e32-45c8-8c16-ceefd49aa926", "tag": "c02d6026-3ee9-4b94-a236-63e8798fbf45"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:17.498405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:17.499609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=10 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:17.500533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:17.512344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7645c4d7-689b-44e5-9bfa-9d0c0f513e9f req-db77230e-89f9-4e7b-b782-bc2ef965aa59 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:17.512792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-7645c4d7-689b-44e5-9bfa-9d0c0f513e9f req-db77230e-89f9-4e7b-b782-bc2ef965aa59 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:17.518766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=87 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:17.531655 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-7645c4d7-689b-44e5-9bfa-9d0c0f513e9f req-db77230e-89f9-4e7b-b782-bc2ef965aa59 service nova] Creating event network-changed:c02d6026-3ee9-4b94-a236-63e8798fbf45 for instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 on n-h1-846219-10 Jul 20 11:33:17.537766 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-7645c4d7-689b-44e5-9bfa-9d0c0f513e9f req-db77230e-89f9-4e7b-b782-bc2ef965aa59 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047806 Jul 20 11:33:17.539955 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3123/6227] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:17.764812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:17.765445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:17.768652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=43 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:17.775631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:17.776090 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:17.777510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:17.778333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:17.789782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:17.943826 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:17.953204 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0b8fe223-538a-46b8-a2af-7e7c133aff2f tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.192868 Jul 20 11:33:17.954048 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3105/6228] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:17 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:18.974826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:18.975811 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:18.987036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:18.989133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:18.990118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:18.990585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:19.142607 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:19.152054 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7c775d55-071c-43c9-a8ad-98300d001112 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.184353 Jul 20 11:33:19.152662 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3124/6229] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:18 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:20.171761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:20.173025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:20.181226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:20.181692 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:20.182541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:20.182996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:20.329037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:20.339489 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2544eae1-c343-47f5-96b2-a79ef1531b0b tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.172360 Jul 20 11:33:20.340379 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3106/6230] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:20 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:21.357154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:21.358323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:21.365275 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:21.365771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:21.367090 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:21.367573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:21.536064 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:21.545141 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec46e2bc-e0fd-4e28-89e1-d949f0f3c7d5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.192279 Jul 20 11:33:21.545721 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3125/6231] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:21 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:22.562896 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:22.563676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:22.571408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:22.571959 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:22.572753 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:22.573206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:22.716362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:22.724486 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-44aa5ddb-7e9a-4b13-920f-6d39afc87a60 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.165500 Jul 20 11:33:22.725129 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3107/6232] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:22 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:23.090344 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b6f26773-ad39-411c-9972-8abd7f3d00f3 req-0fd97310-f074-4d9d-9b9b-e90e03c3eaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "name": "network-vif-plugged", "status": "completed", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:23.102508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b6f26773-ad39-411c-9972-8abd7f3d00f3 req-0fd97310-f074-4d9d-9b9b-e90e03c3eaeb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:23.103330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b6f26773-ad39-411c-9972-8abd7f3d00f3 req-0fd97310-f074-4d9d-9b9b-e90e03c3eaeb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:23.118257 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b6f26773-ad39-411c-9972-8abd7f3d00f3 req-0fd97310-f074-4d9d-9b9b-e90e03c3eaeb service nova] Creating event network-vif-plugged:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:33:23.123743 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b6f26773-ad39-411c-9972-8abd7f3d00f3 req-0fd97310-f074-4d9d-9b9b-e90e03c3eaeb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038892 Jul 20 11:33:23.125417 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3126/6233] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:23.742111 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:23.742772 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:23.749909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:23.750379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:23.751190 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:23.751666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:23.895610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:23.904163 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7c25707b-c727-47c3-a8e8-5051baad366d tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1268 microversion: 2.1 time: 0.166124 Jul 20 11:33:23.904828 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3108/6234] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:23 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:24.923864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:24.924828 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:24.932375 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:24.932834 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:24.933614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:24.934063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:25.103848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:25.112718 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fd299435-1bc1-47ed-bc32-81118a1c3e40 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1456 microversion: 2.1 time: 0.194280 Jul 20 11:33:25.113296 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3127/6235] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:24 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1456 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:25.130205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:25.130992 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:25.140653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:25.140653 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:25.141883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:25.142444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:25.303641 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:25.312750 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-09c67366-4bc1-4f94-9e34-9871f8298c88 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1456 microversion: 2.1 time: 0.186901 Jul 20 11:33:25.314004 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3109/6236] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:25 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1456 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:27.619866 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b2fb037c-2e3d-417b-9ae9-78f995a9b2b9 req-020e2339-19ee-48e0-a328-f50065408d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:27.630619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b2fb037c-2e3d-417b-9ae9-78f995a9b2b9 req-020e2339-19ee-48e0-a328-f50065408d15 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:27.631641 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b2fb037c-2e3d-417b-9ae9-78f995a9b2b9 req-020e2339-19ee-48e0-a328-f50065408d15 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:27.645074 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b2fb037c-2e3d-417b-9ae9-78f995a9b2b9 req-020e2339-19ee-48e0-a328-f50065408d15 service nova] Creating event network-changed:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:33:27.652246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b2fb037c-2e3d-417b-9ae9-78f995a9b2b9 req-020e2339-19ee-48e0-a328-f50065408d15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036983 Jul 20 11:33:27.657125 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3128/6237] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:29.513326 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-c6186d9b-053f-4a12-a36d-2f2d39345993 req-5a18cb7c-b861-4249-b67d-9eb7cc59dca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:29.522618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c6186d9b-053f-4a12-a36d-2f2d39345993 req-5a18cb7c-b861-4249-b67d-9eb7cc59dca6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:29.523094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-c6186d9b-053f-4a12-a36d-2f2d39345993 req-5a18cb7c-b861-4249-b67d-9eb7cc59dca6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:29.534723 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-c6186d9b-053f-4a12-a36d-2f2d39345993 req-5a18cb7c-b861-4249-b67d-9eb7cc59dca6 service nova] Creating event network-changed:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:33:29.540974 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-c6186d9b-053f-4a12-a36d-2f2d39345993 req-5a18cb7c-b861-4249-b67d-9eb7cc59dca6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266127 Jul 20 11:33:29.542338 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3110/6238] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:31.558712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-653f6c86-f139-4276-9253-3778f8203670 req-8e422fff-c7e7-4be3-8e05-98ca78a59935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:31.568688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-653f6c86-f139-4276-9253-3778f8203670 req-8e422fff-c7e7-4be3-8e05-98ca78a59935 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:31.569273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-653f6c86-f139-4276-9253-3778f8203670 req-8e422fff-c7e7-4be3-8e05-98ca78a59935 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:31.582304 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-653f6c86-f139-4276-9253-3778f8203670 req-8e422fff-c7e7-4be3-8e05-98ca78a59935 service nova] Creating event network-changed:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:33:31.588156 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-653f6c86-f139-4276-9253-3778f8203670 req-8e422fff-c7e7-4be3-8e05-98ca78a59935 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034791 Jul 20 11:33:31.588807 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3129/6239] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:36.001453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-852379896", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "5204272f-97ff-4320-a8e0-2f9f840e5465"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:36.052032 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] validate_networks() for [('5204272f-97ff-4320-a8e0-2f9f840e5465', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:33:36.433688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:33:36.434129 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:33:36.434803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:33:36.435291 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:33:36.435795 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:33:36.444950 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:36.445442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:36.446257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:36.446703 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:36.463496 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Getting quotas for project 11441e56b3a54e89845565c32f40430d. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:33:36.469100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Getting quotas for user ca18b4006556488787b8d296cdb5df0a and project 11441e56b3a54e89845565c32f40430d. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:33:36.482257 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:33:36.484648 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:33:36.529777 n-d-846219-10 devstack@n-api.service[125886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [aec6e715-45df-4cfb-b089-eb7987ed51dc] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 11:33:37.537536 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [aec6e715-45df-4cfb-b089-eb7987ed51dc] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 32878. Jul 20 11:33:37.542270 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff2ba95b-8743-4b4e-b650-190b717136a8 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667573 Jul 20 11:33:37.542969 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3111/6240] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:33:37.554483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-74cc3c6b-64e0-4eb9-bb8a-69127cb1e1d1 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:37.555157 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-74cc3c6b-64e0-4eb9-bb8a-69127cb1e1d1 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:37.612165 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-74cc3c6b-64e0-4eb9-bb8a-69127cb1e1d1 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:37.620158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-74cc3c6b-64e0-4eb9-bb8a-69127cb1e1d1 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1213 microversion: 2.1 time: 0.070822 Jul 20 11:33:37.620738 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3130/6241] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:37 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:38.638347 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:38.638978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:38.645717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:38.646181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:38.646977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:38.647451 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:38.720307 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:38.728034 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f70330bf-ae55-48ab-a752-45b785af4906 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1283 microversion: 2.1 time: 0.095028 Jul 20 11:33:38.728618 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3112/6242] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:38 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:39.747683 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:39.748359 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:39.756469 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:39.756753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:39.757738 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:39.758328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:39.916456 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:39.926440 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ed5ca3a4-2282-4d9b-9fb5-1cdf9df24ee4 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.184757 Jul 20 11:33:39.927085 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3131/6243] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:39 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:40.058510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-83f01359-b370-4cf2-a67b-d080f8236494 req-1836f699-6bcd-4368-8bfb-6494481d6bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d66f86-84d5-4e5e-a0a8-b81429e8d07e", "tag": "71e370f8-f472-4cc6-8d66-13033779864c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:40.068801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-83f01359-b370-4cf2-a67b-d080f8236494 req-1836f699-6bcd-4368-8bfb-6494481d6bf5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:40.069270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-83f01359-b370-4cf2-a67b-d080f8236494 req-1836f699-6bcd-4368-8bfb-6494481d6bf5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:40.081522 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-83f01359-b370-4cf2-a67b-d080f8236494 req-1836f699-6bcd-4368-8bfb-6494481d6bf5 service nova] Creating event network-changed:71e370f8-f472-4cc6-8d66-13033779864c for instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e on n-h1-846219-10 Jul 20 11:33:40.087419 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-83f01359-b370-4cf2-a67b-d080f8236494 req-1836f699-6bcd-4368-8bfb-6494481d6bf5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Jul 20 11:33:40.088215 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3113/6244] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:40.943475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:40.944134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:40.951756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:40.952255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:40.953093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:40.953587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:41.110539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:41.119448 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-67a3a181-9136-419e-8742-cb1f9dfc448a tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.179831 Jul 20 11:33:41.120195 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3132/6245] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:40 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:42.138400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:42.139108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:42.145601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:42.146056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:42.146824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:42.147297 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:42.301079 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:42.308887 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf523e50-60a0-4fec-9e22-7d35edc56bc0 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.176054 Jul 20 11:33:42.310115 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3114/6246] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:42 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:43.326839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:43.327557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:43.335999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:43.335999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:43.336670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:43.336825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:43.487066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:43.496108 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b5f5748-ca6f-41b6-8316-86882f5e6db3 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.174068 Jul 20 11:33:43.497223 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3133/6247] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:43 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:44.515658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:44.516289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:44.522373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:44.522817 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:44.523629 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:44.524078 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:44.666159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:44.674175 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-99aaf845-867b-4b16-97f0-6ebbc2558ac9 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.164181 Jul 20 11:33:44.674765 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3115/6248] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:44 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:45.657712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-dba9118b-94c2-4547-af7e-f795065d4d09 req-f887b58c-e515-46ad-a923-0e122472029a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d66f86-84d5-4e5e-a0a8-b81429e8d07e", "name": "network-vif-plugged", "status": "completed", "tag": "71e370f8-f472-4cc6-8d66-13033779864c"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:45.666827 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-dba9118b-94c2-4547-af7e-f795065d4d09 req-f887b58c-e515-46ad-a923-0e122472029a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:45.667475 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-dba9118b-94c2-4547-af7e-f795065d4d09 req-f887b58c-e515-46ad-a923-0e122472029a service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:45.679976 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-dba9118b-94c2-4547-af7e-f795065d4d09 req-f887b58c-e515-46ad-a923-0e122472029a service nova] Creating event network-vif-plugged:71e370f8-f472-4cc6-8d66-13033779864c for instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e on n-h1-846219-10 Jul 20 11:33:45.684948 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-dba9118b-94c2-4547-af7e-f795065d4d09 req-f887b58c-e515-46ad-a923-0e122472029a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Jul 20 11:33:45.685598 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3134/6249] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:45.694158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:45.694842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:45.702066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:45.702533 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:45.703423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:45.703886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:45.843521 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:45.851370 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d216415-71af-4294-bd95-3929008ab2fa tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.161152 Jul 20 11:33:45.851957 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3116/6250] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:45 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:46.870136 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:46.870838 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:46.877825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:46.878323 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:46.879055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:46.879512 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:47.017983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:47.032495 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-616e73d6-71e5-4e3f-8394-aaf135e6c329 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1313 microversion: 2.1 time: 0.167063 Jul 20 11:33:47.033750 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3135/6251] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:46 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:48.054000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:48.054810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:48.056735 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:48.057433 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:48.058973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:48.065828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:48.066301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:48.067112 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:48.067596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:48.071384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=60 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:48.228623 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:48.238020 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-126bc078-68c0-4d4f-8975-58ff5dbdbbdc tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1498 microversion: 2.1 time: 0.187879 Jul 20 11:33:48.238659 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3117/6252] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:48 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:50.583804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:50.584483 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:50.586270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:50.587625 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=28 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:50.594931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:50.595542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:50.596500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:50.597031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:50.601755 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=52 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:33:50.626779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:33:50.712102 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9f709b3a-27d4-4806-bf29-b6dac682338d tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 204 len: 0 microversion: 2.1 time: 0.132323 Jul 20 11:33:50.712972 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3136/6253] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:33:50 2022] DELETE /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:33:50.722428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:50.723104 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:50.731730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:50.732344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:50.733150 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:50.733689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:50.878330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:50.891706 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-75059b3e-6fc0-446e-8ffc-161abe1e2532 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1504 microversion: 2.1 time: 0.173062 Jul 20 11:33:50.892154 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3118/6254] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:50 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:51.911448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:51.912422 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:51.920792 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:51.921254 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:51.922058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:51.922542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:52.073517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:52.083350 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b4cc2c8-a4b0-4592-b3b5-37630920f15b tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1504 microversion: 2.1 time: 0.177113 Jul 20 11:33:52.083975 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3137/6255] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:51 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:52.821095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-0907aabf-a3dc-43ef-9ba0-794cd7d0a9e7 req-9bfebe73-fd20-4a19-941c-53905629a856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d66f86-84d5-4e5e-a0a8-b81429e8d07e", "name": "network-vif-deleted", "tag": "71e370f8-f472-4cc6-8d66-13033779864c"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:52.830563 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0907aabf-a3dc-43ef-9ba0-794cd7d0a9e7 req-9bfebe73-fd20-4a19-941c-53905629a856 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:52.831065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-0907aabf-a3dc-43ef-9ba0-794cd7d0a9e7 req-9bfebe73-fd20-4a19-941c-53905629a856 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:52.842755 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-0907aabf-a3dc-43ef-9ba0-794cd7d0a9e7 req-9bfebe73-fd20-4a19-941c-53905629a856 service nova] Creating event network-vif-deleted:71e370f8-f472-4cc6-8d66-13033779864c for instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e on n-h1-846219-10 Jul 20 11:33:52.848514 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-0907aabf-a3dc-43ef-9ba0-794cd7d0a9e7 req-9bfebe73-fd20-4a19-941c-53905629a856 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030916 Jul 20 11:33:52.849298 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3119/6256] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:53.101518 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:53.102054 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:53.109709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:53.110160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:53.110929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:53.111415 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:53.146280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:53.146769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:53.147255 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lazy-loading 'fault' on Instance uuid e6d66f86-84d5-4e5e-a0a8-b81429e8d07e {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:33:53.202824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca18b4006556488787b8d296cdb5df0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11441e56b3a54e89845565c32f40430d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:53.212149 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b3b614ac-f343-4538-82a1-6af6c84fd389 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 200 len: 1303 microversion: 2.1 time: 0.114523 Jul 20 11:33:53.212957 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3138/6257] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:53 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:33:54.232546 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:54.233333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] [instance: e6d66f86-84d5-4e5e-a0a8-b81429e8d07e] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:54.239742 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:54.240204 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:54.240978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:54.241431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:54.256013 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] HTTP exception thrown: Instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e could not be found. Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Request method failure captured: Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e HTTP/1.1 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-gObGZpxHbz9RLTgW02piP6yuOu4vJU1JzQniiwgGD9qI58g4kj3N7tAZYnI3yKoCNOSxBOaYEI94pbXb7fXI6qXet02-Rn_L2YhuVfFYY9f5TikUHrdJZvGu3vNqTg9IhNcD3psym25F-4U0HHMPnRH-ueZ44jekDun-hWiAHh0Lo Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 11441e56b3a54e89845565c32f40430d Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-VolumesActionsTest-709014683 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11441e56b3a54e89845565c32f40430d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11441e56b3a54e89845565c32f40430d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11441e56b3a54e89845565c32f40430d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11441e56b3a54e89845565c32f40430d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-VolumesActionsTest-709014683 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 11441e56b3a54e89845565c32f40430d Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-VolumesActionsTest-709014683 Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-VolumesActionsTest-709014683-project Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: ca18b4006556488787b8d296cdb5df0a Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-VolumesActionsTest-709014683-project Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e could not be found. Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e6d66f86-84d5-4e5e-a0a8-b81429e8d07e'} Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e could not be found. Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e could not be found. Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:33:54.257665 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e could not be found. Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] Returning 404 to user: Instance e6d66f86-84d5-4e5e-a0a8-b81429e8d07e could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5219394d-62df-4e81-bb1d-5228dfc4c875 tempest-VolumesActionsTest-709014683 tempest-VolumesActionsTest-709014683-project] 10.222.0.79 "GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e" status: 404 len: 111 microversion: 2.1 time: 0.031919 Jul 20 11:33:54.263345 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3120/6258] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:54 2022] GET /compute/v2.1/servers/e6d66f86-84d5-4e5e-a0a8-b81429e8d07e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:33:59.141630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:59.142189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:59.145069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8eeb34b3-cea4-49ef-9381-dc163a7abbb5 req-7c819eb9-9239-40c8-a503-356a2bd3b03b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:33:59.149682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:59.150154 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:59.150950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:59.151427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:59.173234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8eeb34b3-cea4-49ef-9381-dc163a7abbb5 req-7c819eb9-9239-40c8-a503-356a2bd3b03b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:59.173706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8eeb34b3-cea4-49ef-9381-dc163a7abbb5 req-7c819eb9-9239-40c8-a503-356a2bd3b03b service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:59.188171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8eeb34b3-cea4-49ef-9381-dc163a7abbb5 req-7c819eb9-9239-40c8-a503-356a2bd3b03b service nova] Creating event network-changed:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:33:59.194436 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8eeb34b3-cea4-49ef-9381-dc163a7abbb5 req-7c819eb9-9239-40c8-a503-356a2bd3b03b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052794 Jul 20 11:33:59.195248 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3121/6259] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:33:59.207341 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:33:59.314266 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5b90e10b-d00e-4eee-b69b-68d607220945 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 204 len: 0 microversion: 2.1 time: 0.175745 Jul 20 11:33:59.316051 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3139/6260] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:33:59 2022] DELETE /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:33:59.328445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:33:59.328445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:33:59.337091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:59.337573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:59.338780 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:33:59.339508 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:33:59.532774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:33:59.543365 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-19b16c6b-a316-4628-a63f-ae587de2a5c6 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1581 microversion: 2.1 time: 0.221917 Jul 20 11:33:59.544257 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3122/6261] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:33:59 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1581 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:34:00.563330 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:00.564035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:34:00.571367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:00.572107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:00.573027 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:00.573467 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:00.785907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:34:00.794075 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-989379ed-6da0-4dbb-a3d3-eae840a2de05 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1581 microversion: 2.1 time: 0.235294 Jul 20 11:34:00.795410 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3140/6262] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:34:00 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1581 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:34:01.397292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3c556dbc-431b-48c5-87e2-b2fa188d78da req-997a18c7-22fb-4573-aea1-0b5ccb24f0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5681c7c8-91b6-4fa2-81cb-5526b3be061f", "name": "network-vif-deleted", "tag": "10478751-6fb5-4a04-9f48-c9b9ce1cc1cb"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:34:01.406219 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c556dbc-431b-48c5-87e2-b2fa188d78da req-997a18c7-22fb-4573-aea1-0b5ccb24f0ef service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:01.406675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3c556dbc-431b-48c5-87e2-b2fa188d78da req-997a18c7-22fb-4573-aea1-0b5ccb24f0ef service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:01.418936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3c556dbc-431b-48c5-87e2-b2fa188d78da req-997a18c7-22fb-4573-aea1-0b5ccb24f0ef service nova] Creating event network-vif-deleted:10478751-6fb5-4a04-9f48-c9b9ce1cc1cb for instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f on n-h2-846219-10 Jul 20 11:34:01.424291 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3c556dbc-431b-48c5-87e2-b2fa188d78da req-997a18c7-22fb-4573-aea1-0b5ccb24f0ef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Jul 20 11:34:01.424966 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3123/6263] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:34:01.814216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:01.814877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:34:01.826071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:01.827410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:01.831553 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:01.834903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:01.954718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:34:01.965558 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8d0c55df-6e05-4951-85f8-dc5d06bb68e3 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1227 microversion: 2.1 time: 0.156333 Jul 20 11:34:01.968872 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3141/6264] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:34:01 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1227 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:34:02.988466 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:02.990046 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:34:02.997178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:02.997975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:02.999523 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:03.000328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:03.114235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:34:03.122270 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-39e794b1-f0aa-41ba-954f-9f0d17fe53b0 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1227 microversion: 2.1 time: 0.140015 Jul 20 11:34:03.124032 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3124/6265] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:34:02 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1227 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:34:04.142591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:04.144032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:34:04.151409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:04.151962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:04.152803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:04.153431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:04.224091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:34:04.232279 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12f8b7e7-2517-416e-b5d3-7578a43fa6c5 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1227 microversion: 2.1 time: 0.094979 Jul 20 11:34:04.232950 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3142/6266] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:34:04 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1227 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:34:05.250997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:05.259610 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:34:05.268083 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:05.268550 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:05.269353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:05.269809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:05.348075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0e1cc7eb474986b5ec3e43977d4789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18e01854f2304f2fa96e6de4dfa32e89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:34:05.359910 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05c50b10-a94b-47eb-b917-f54c9a912e50 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 200 len: 1227 microversion: 2.1 time: 0.113019 Jul 20 11:34:05.373110 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3125/6267] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:34:05 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 1227 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:34:06.382504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:06.383246 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] [instance: 5681c7c8-91b6-4fa2-81cb-5526b3be061f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:34:06.391953 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:06.392413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:06.393180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:34:06.393623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:34:06.409512 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] HTTP exception thrown: Instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f could not be found. Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Request method failure captured: Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f HTTP/1.1 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-dazVi8YOP9FYh_Y94oqSFGwEiBWyRxNZXyIM74Bn_55TEbSfaGThEvKMH4FxRE84zn6C2bW24E0zzyh5G74Gf4Hu6KUwTjJH9VhW5dYZXDRwaPJAxpWw97w7CVzQsHGnTHoTxTJgeU7HoPbeSw6pRf1qln_G1AkA9h0ArMGesXuFM Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 18e01854f2304f2fa96e6de4dfa32e89 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBackupRestore-1359738554 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18e01854f2304f2fa96e6de4dfa32e89", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18e01854f2304f2fa96e6de4dfa32e89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18e01854f2304f2fa96e6de4dfa32e89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18e01854f2304f2fa96e6de4dfa32e89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBackupRestore-1359738554 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 18e01854f2304f2fa96e6de4dfa32e89 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1359738554 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBackupRestore-1359738554-project Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 6e0e1cc7eb474986b5ec3e43977d4789 Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBackupRestore-1359738554-project Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f could not be found. Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '5681c7c8-91b6-4fa2-81cb-5526b3be061f'} Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f could not be found. Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f could not be found. Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:34:06.411198 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f could not be found. Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Returning 404 to user: Instance 5681c7c8-91b6-4fa2-81cb-5526b3be061f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59c48573-b131-4725-874c-c15545e2b449 tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f" status: 404 len: 111 microversion: 2.1 time: 0.034591 Jul 20 11:34:06.419895 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3143/6268] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:34:06 2022] GET /compute/v2.1/servers/5681c7c8-91b6-4fa2-81cb-5526b3be061f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:34:06.620039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e7c6b71-26fd-4189-8fbe-a4abf8b62acf tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] Calling method '.version_select at 0x7f2c3e1f15e0>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:34:06.643546 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e7c6b71-26fd-4189-8fbe-a4abf8b62acf tempest-TestVolumeBackupRestore-1359738554 tempest-TestVolumeBackupRestore-1359738554-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-849436437" status: 202 len: 0 microversion: 2.1 time: 0.030631 Jul 20 11:34:06.644790 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3126/6269] 10.222.0.79 () {58 vars in 1265 bytes} [Wed Jul 20 11:34:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-849436437 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:35:13.341797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.342653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.558378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:13.558929 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:13.565538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:13.566001 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:13.566771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:13.567321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:13.598749 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:35:13.676942 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-86c5e1c2-1747-4366-9b4d-21b1e7f4d01d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 204 len: 0 microversion: 2.1 time: 0.338021 Jul 20 11:35:13.677680 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3144/6270] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:35:13 2022] DELETE /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:35:13.685085 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=37 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.685865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:13.690127 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:13.690756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:13.700332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:13.700694 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:13.701595 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:13.702054 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:13.836024 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:13.844677 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-100465cf-fc2b-4019-af69-c99f3c83923f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1578 microversion: 2.1 time: 0.162520 Jul 20 11:35:13.845256 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3127/6271] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:13 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:14.863606 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:14.864336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:14.871548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:14.872087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:14.872760 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:14.873203 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:15.013786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:15.021709 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0c99bfab-d723-4281-b1f5-553d2aa2822a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1578 microversion: 2.1 time: 0.162447 Jul 20 11:35:15.022285 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3145/6272] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:14 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:16.040929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:16.041681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:16.055693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:16.056971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:16.058165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:16.058773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:16.132122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:16.140116 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74ec359a-9844-4c0c-a399-47717a15099e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1510 microversion: 2.1 time: 0.104029 Jul 20 11:35:16.141020 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3128/6273] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:16 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1510 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:16.329379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-67b7afad-2f86-4533-b346-10fed3326b36 req-6b2fb072-2bf5-4720-b917-2384bd391d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08c9c71-2e32-45c8-8c16-ceefd49aa926", "name": "network-vif-deleted", "tag": "c02d6026-3ee9-4b94-a236-63e8798fbf45"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:16.339554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-67b7afad-2f86-4533-b346-10fed3326b36 req-6b2fb072-2bf5-4720-b917-2384bd391d27 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:16.341407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-67b7afad-2f86-4533-b346-10fed3326b36 req-6b2fb072-2bf5-4720-b917-2384bd391d27 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:16.356971 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-67b7afad-2f86-4533-b346-10fed3326b36 req-6b2fb072-2bf5-4720-b917-2384bd391d27 service nova] Creating event network-vif-deleted:c02d6026-3ee9-4b94-a236-63e8798fbf45 for instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 on n-h1-846219-10 Jul 20 11:35:16.369385 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-67b7afad-2f86-4533-b346-10fed3326b36 req-6b2fb072-2bf5-4720-b917-2384bd391d27 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043656 Jul 20 11:35:16.370364 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3146/6274] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:17.164373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:17.165122 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:17.175266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:17.175879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:17.176833 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:17.177390 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:17.255345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:17.264721 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd122d02-2044-4d69-a1b0-bb9b1fcd814d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1224 microversion: 2.1 time: 0.110376 Jul 20 11:35:17.274850 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3129/6275] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:17 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:18.285288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:18.286022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:18.294956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:18.295790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:18.296877 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:18.297548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:18.367782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:18.378190 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fd471da9-9321-4bb7-aa69-2dd1ce932a8d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1224 microversion: 2.1 time: 0.099289 Jul 20 11:35:18.380478 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3147/6276] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:18 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:19.395893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:19.396601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:19.404360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:19.404911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:19.405761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:19.406295 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:19.480619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:19.489932 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-29c736ee-24f8-475b-a5dd-c42f04f1c088 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1224 microversion: 2.1 time: 0.097926 Jul 20 11:35:19.490632 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3130/6277] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:19 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:20.509277 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:20.510551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:20.522299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:20.523077 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:20.524314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:20.525182 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:20.612319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:20.623556 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e5857f6a-15f0-4231-8305-e021711f65c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 200 len: 1224 microversion: 2.1 time: 0.117319 Jul 20 11:35:20.625833 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3148/6278] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:20 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:21.644857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:21.645680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:21.653495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:21.653967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:21.654769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:21.655253 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:21.669810 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 HTTP/1.1 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'd08c9c71-2e32-45c8-8c16-ceefd49aa926'} Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:35:21.671527 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a48e9eaa-4d7b-4957-a17b-67b13c289620 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 404 len: 111 microversion: 2.1 time: 0.034460 Jul 20 11:35:21.677774 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3131/6279] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:21 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:35:21.731103 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-7016103", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-181214265", "security_groups": [{"name": "tempest-secgroup-smoke-1926341752"}], "block_device_mapping_v2": [{"uuid": "5c9bf808-ba56-4d32-b724-f332b86a30b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:21.848520 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:35:22.569557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:35:22.569991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:35:22.570473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:35:22.570889 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:35:22.571385 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:35:22.584129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:22.584496 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:22.585222 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:22.587472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:22.618272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:35:22.626133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:35:22.702930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:35:22.705684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c9bf808-ba56-4d32-b724-f332b86a30b4',volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:35:22.866603 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6eb074dc-a780-4398-a2a0-d5f444d262b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.144949 Jul 20 11:35:22.867301 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3149/6280] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:35:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:35:22.878457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0d478874-ec49-48ed-b98a-e2718cffc419 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:22.879931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0d478874-ec49-48ed-b98a-e2718cffc419 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:22.941821 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0d478874-ec49-48ed-b98a-e2718cffc419 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:22.949939 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0d478874-ec49-48ed-b98a-e2718cffc419 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1091 microversion: 2.1 time: 0.075396 Jul 20 11:35:22.950529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3132/6281] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:22 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1091 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:23.968389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:23.969028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:23.975478 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:23.975936 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:23.976714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:23.977156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:24.048986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:24.058060 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c0ffe1b0-51d1-4f38-9af7-8b23012bcc0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1189 microversion: 2.1 time: 0.095175 Jul 20 11:35:24.059606 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3150/6282] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:23 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1189 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:25.076839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:25.078449 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:25.086794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:25.087555 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:25.089626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:25.090738 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:25.350362 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:25.359954 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-192b6078-92e0-4715-a1bd-8287c292808d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1275 microversion: 2.1 time: 0.287762 Jul 20 11:35:25.375260 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3133/6283] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:25 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:26.210080 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-2ed1d750-2474-48ae-b75b-bd54f2dfc744 req-b8aa9fe2-a13c-43c9-aa65-5b5e54986940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18d7c2c-f1be-4695-960f-16766ee82a80", "tag": "c871ea62-1fc0-4535-b195-5bcfac539070"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:26.229218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2ed1d750-2474-48ae-b75b-bd54f2dfc744 req-b8aa9fe2-a13c-43c9-aa65-5b5e54986940 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:26.229673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-2ed1d750-2474-48ae-b75b-bd54f2dfc744 req-b8aa9fe2-a13c-43c9-aa65-5b5e54986940 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:26.258616 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-2ed1d750-2474-48ae-b75b-bd54f2dfc744 req-b8aa9fe2-a13c-43c9-aa65-5b5e54986940 service nova] Creating event network-changed:c871ea62-1fc0-4535-b195-5bcfac539070 for instance e18d7c2c-f1be-4695-960f-16766ee82a80 on n-h1-846219-10 Jul 20 11:35:26.276038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-2ed1d750-2474-48ae-b75b-bd54f2dfc744 req-b8aa9fe2-a13c-43c9-aa65-5b5e54986940 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070515 Jul 20 11:35:26.277043 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3151/6284] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:26.379157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:26.379838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:26.393560 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:26.394031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:26.394861 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:26.395349 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:26.646132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:26.658785 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b692b0d8-5e03-4f70-ab39-5b3c7262e21e tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1275 microversion: 2.1 time: 0.284969 Jul 20 11:35:26.659425 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3134/6285] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:26 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:27.679973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:27.681944 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:27.690211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:27.690670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:27.691490 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:27.692088 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:27.840839 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:27.848981 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-23f81625-195c-4edf-8ff3-5238941f0b5a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1275 microversion: 2.1 time: 0.176106 Jul 20 11:35:27.858460 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3152/6286] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:27 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:28.866160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:28.866704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:28.874098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:28.874569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:28.875407 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:28.875865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:29.024673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:29.035958 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9add8801-c00b-44c3-bd6f-d7e67c1c7a0a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1275 microversion: 2.1 time: 0.173007 Jul 20 11:35:29.036561 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3135/6287] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:28 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:30.053916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:30.054516 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:30.062134 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:30.062589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:30.063861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:30.063861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:30.255589 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:30.267730 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-de120878-4d74-4f00-8a6b-b8042544c68a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1275 microversion: 2.1 time: 0.218000 Jul 20 11:35:30.268847 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3153/6288] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:30 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:31.289513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:31.290141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:31.298000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:31.298467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:31.299300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:31.299954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:31.438346 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:31.446130 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e4c14e1c-a90d-4475-961f-e35d538ae3b5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.160425 Jul 20 11:35:31.446716 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3136/6289] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:31 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:32.463806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:32.464400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:32.472674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:32.473118 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:32.473882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:32.474319 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:32.596808 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:32.613396 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:32.621887 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-490c0100-107f-4745-a54b-ff224de3e1d7 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.161455 Jul 20 11:35:32.622684 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3154/6290] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:32 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:33.612043 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:35:33.612608 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:35:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:35:33.639197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:33.639823 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:33.642206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:33.647831 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:33.648289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:33.649065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:33.649516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:33.799483 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:33.807514 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0013da32-0999-4354-9874-c3fe21e81bfc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.172776 Jul 20 11:35:33.808149 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3137/6291] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:33 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:35:34.824409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:34.825023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:34.826994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:34.833599 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:34.833989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:34.834762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:34.835231 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:34.974022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:34.982346 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-669c0dbe-db63-4d8b-afb1-46cac90146aa tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.162428 Jul 20 11:35:34.983005 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3155/6292] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:34 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:35.999607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:36.000153 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:36.007363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:36.007836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:36.008632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:36.009091 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:36.146967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:36.155657 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ff5b4ed5-551b-4717-af98-1048cbda5795 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.160178 Jul 20 11:35:36.162447 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3138/6293] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:35 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:37.172052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:37.172673 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:37.179628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:37.180081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:37.180852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:37.181293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:37.324454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:37.332387 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fe4b4e30-28ef-4488-a489-37ce0428b115 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.164294 Jul 20 11:35:37.332903 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3156/6294] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:37 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:38.350964 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:38.351882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:38.365813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.366279 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.367066 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:38.367620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:38.508606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:38.522104 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3b1818d1-cc1c-4700-a70b-0d8d6a011587 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.175533 Jul 20 11:35:38.522804 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3139/6295] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:38 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:39.540429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:39.541351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:39.548357 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:39.548804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:39.549564 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:39.549993 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:39.690854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:39.698548 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e214a58f-7225-42e3-9e76-3105124829da tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.162128 Jul 20 11:35:39.699820 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3157/6296] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:39 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:40.265113 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-db59c555-046d-4541-8f34-64f33f3815b8 req-de2d61ca-4a48-48ff-bfe5-84e10e7253eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18d7c2c-f1be-4695-960f-16766ee82a80", "name": "network-vif-plugged", "status": "completed", "tag": "c871ea62-1fc0-4535-b195-5bcfac539070"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:40.276286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-db59c555-046d-4541-8f34-64f33f3815b8 req-de2d61ca-4a48-48ff-bfe5-84e10e7253eb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.276806 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-db59c555-046d-4541-8f34-64f33f3815b8 req-de2d61ca-4a48-48ff-bfe5-84e10e7253eb service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.288513 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-db59c555-046d-4541-8f34-64f33f3815b8 req-de2d61ca-4a48-48ff-bfe5-84e10e7253eb service nova] Creating event network-vif-plugged:c871ea62-1fc0-4535-b195-5bcfac539070 for instance e18d7c2c-f1be-4695-960f-16766ee82a80 on n-h1-846219-10 Jul 20 11:35:40.293743 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-db59c555-046d-4541-8f34-64f33f3815b8 req-de2d61ca-4a48-48ff-bfe5-84e10e7253eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033093 Jul 20 11:35:40.294645 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3140/6297] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:35:40.717111 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:40.717771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:40.724761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.725242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.726007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:40.726454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:40.862476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:40.870234 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fad4edf5-d47f-419b-b53e-3c6d2101bde9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1263 microversion: 2.1 time: 0.158181 Jul 20 11:35:40.871221 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3158/6298] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:40 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:41.889328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:41.890665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:41.899068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.899767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:41.900744 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:41.901420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.055440 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:42.064336 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0dfd1169-6f0e-4ff7-84b7-002f342a7ff5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1450 microversion: 2.1 time: 0.180602 Jul 20 11:35:42.065023 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3141/6299] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:41 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:42.081560 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:35:42.082191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:35:42.090989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:42.091679 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.092465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:42.092914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:42.237724 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:35:42.246000 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ff82bbbb-b162-4331-8424-237904e8f1c8 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1450 microversion: 2.1 time: 0.168401 Jul 20 11:35:42.248272 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3159/6300] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:35:42 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:35:44.123107 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-2c56f3f0-c43e-4509-924a-de3c2e7843c1 req-6c8de18b-a6ee-450f-88cf-35e7f70d7265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18d7c2c-f1be-4695-960f-16766ee82a80", "tag": "c871ea62-1fc0-4535-b195-5bcfac539070"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:35:44.127912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=33 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:44.134505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2c56f3f0-c43e-4509-924a-de3c2e7843c1 req-6c8de18b-a6ee-450f-88cf-35e7f70d7265 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:35:44.134980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-2c56f3f0-c43e-4509-924a-de3c2e7843c1 req-6c8de18b-a6ee-450f-88cf-35e7f70d7265 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:35:44.140450 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=77 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:35:44.151983 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-2c56f3f0-c43e-4509-924a-de3c2e7843c1 req-6c8de18b-a6ee-450f-88cf-35e7f70d7265 service nova] Creating event network-changed:c871ea62-1fc0-4535-b195-5bcfac539070 for instance e18d7c2c-f1be-4695-960f-16766ee82a80 on n-h1-846219-10 Jul 20 11:35:44.157818 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-2c56f3f0-c43e-4509-924a-de3c2e7843c1 req-6c8de18b-a6ee-450f-88cf-35e7f70d7265 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Jul 20 11:35:44.158992 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3142/6301] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:11.489777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:11.490937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:11.615485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c3db2b18-f8d0-46ea-ab6a-649b2b979ca7 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-67585921", "availability_zone": "foo_zone"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:11.617005 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:11.617005 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:36:11.617987 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.aggregate [None req-c3db2b18-f8d0-46ea-ab6a-649b2b979ca7 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Generated uuid a15b7ea7-f05e-4403-9489-09982446bdca for aggregate {{(pid=125885) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 20 11:36:11.646432 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c3db2b18-f8d0-46ea-ab6a-649b2b979ca7 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.161502 Jul 20 11:36:11.647230 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3160/6302] 10.222.0.79 () {60 vars in 1163 bytes} [Wed Jul 20 11:36:11 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:11.659565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f35e8f61-046d-4b00-8fa3-fc2bcc6429b2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:11.661036 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:11.661036 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:36:11.664134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:36:11.687430 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f35e8f61-046d-4b00-8fa3-fc2bcc6429b2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.032403 Jul 20 11:36:11.693195 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3143/6303] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 11:36:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:11.700028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ebcc60b0-4c22-45a8-acfe-f6288b3ebde2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:11.701344 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:11.701344 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:36:11.702747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebcc60b0-4c22-45a8-acfe-f6288b3ebde2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.703220 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebcc60b0-4c22-45a8-acfe-f6288b3ebde2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.704034 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebcc60b0-4c22-45a8-acfe-f6288b3ebde2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.704465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ebcc60b0-4c22-45a8-acfe-f6288b3ebde2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:11.730336 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ebcc60b0-4c22-45a8-acfe-f6288b3ebde2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035787 Jul 20 11:36:11.735220 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3161/6304] 10.222.0.79 () {58 vars in 1175 bytes} [Wed Jul 20 11:36:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:11.741216 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2e09e436-dcd6-43eb-b543-723488697142 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:11.742225 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:11.742225 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:36:11.754504 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2e09e436-dcd6-43eb-b543-723488697142 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.016820 Jul 20 11:36:11.757776 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3144/6305] 10.222.0.79 () {58 vars in 1142 bytes} [Wed Jul 20 11:36:11 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:36:11.766413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f915d10a-2b84-4475-99ed-736eceaf639c tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846219-10"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:11.767714 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:11.767714 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:36:11.776474 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f915d10a-2b84-4475-99ed-736eceaf639c tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:11.776963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f915d10a-2b84-4475-99ed-736eceaf639c tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:12.073775 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f915d10a-2b84-4475-99ed-736eceaf639c tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.311237 Jul 20 11:36:12.074394 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3162/6306] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 11:36:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:12.084157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a14c5a5d-9c73-42c0-9af7-1b82c1943e72 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:12.084914 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:12.084914 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:36:12.095020 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a14c5a5d-9c73-42c0-9af7-1b82c1943e72 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014355 Jul 20 11:36:12.095629 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3145/6307] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 11:36:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:12.105999 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59609f92-4b19-4770-82b8-3c17c693ae9f tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1667122489", "availability_zone": "foo_zone"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:12.107532 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:12.107532 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:36:12.155076 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59609f92-4b19-4770-82b8-3c17c693ae9f tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.053206 Jul 20 11:36:12.155728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3163/6308] 10.222.0.79 () {60 vars in 1172 bytes} [Wed Jul 20 11:36:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:12.168429 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a6e990d-de5c-4fa1-b5ae-0b5658126797 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:12.170498 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:12.170498 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:36:12.193092 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a6e990d-de5c-4fa1-b5ae-0b5658126797 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.029543 Jul 20 11:36:12.199794 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3146/6309] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 11:36:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:36:12.205078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a0702b49-63ab-4bc5-8863-d95d21383ade tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:12.205839 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:12.205839 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:36:12.215430 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a0702b49-63ab-4bc5-8863-d95d21383ade tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.014154 Jul 20 11:36:12.216278 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3164/6310] 10.222.0.79 () {58 vars in 1151 bytes} [Wed Jul 20 11:36:12 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:36:12.226381 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-955feca2-0060-4347-b433-6dc68ddecfb2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846219-10"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:36:12.227667 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:12.227667 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:36:12.236663 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-955feca2-0060-4347-b433-6dc68ddecfb2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:36:12.237124 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-955feca2-0060-4347-b433-6dc68ddecfb2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:36:12.423254 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-955feca2-0060-4347-b433-6dc68ddecfb2 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.200557 Jul 20 11:36:12.424119 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3147/6311] 10.222.0.79 () {60 vars in 1193 bytes} [Wed Jul 20 11:36:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:36:12.435740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3451e049-35d0-43e7-9cb7-668bf0055519 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:36:12.436507 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:36:12.436507 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:36:12.458071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3451e049-35d0-43e7-9cb7-668bf0055519 tempest-TestAggregatesBasicOps-502629395 tempest-TestAggregatesBasicOps-502629395-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.027387 Jul 20 11:36:12.458660 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3165/6312] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 11:36:12 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 20 11:37:23.105457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=5 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:23.106240 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:23.110656 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-714120961", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-181214265", "security_groups": [{"name": "tempest-secgroup-smoke-1926341752"}], "block_device_mapping_v2": [{"uuid": "3f65fe71-fa73-4cc3-be66-2fd72d044fe0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f438d0cf-3e46-4dd8-9c2c-646253e9d2a3"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:23.390767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] validate_networks() for [('f438d0cf-3e46-4dd8-9c2c-646253e9d2a3', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:37:24.152207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:37:24.152822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:37:24.153119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:37:24.153551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:37:24.153973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:37:24.163383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:24.163857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:24.164725 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:24.165177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:24.183957 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:37:24.189310 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Getting quotas for user 053e4581bb5d4079a69a276cddee4d16 and project 5bcbbeb1b94348f0aa45f89c25ef1a05. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:37:24.250847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:37:24.253139 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f65fe71-fa73-4cc3-be66-2fd72d044fe0',volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:37:24.381014 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-52ee2be3-2a5e-4191-8582-07de47b80943 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.277553 Jul 20 11:37:24.381677 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3148/6313] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:37:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:37:24.390017 n-d-846219-10 devstack@n-api.service[125885]: ERROR oslo.messaging._drivers.impl_rabbit [-] [180d7a9d-2145-40a2-98b6-3d44b916528f] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 11:37:24.390572 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:24.391383 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:24.392107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:24.397258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5bb4dde7-ec83-49f6-8096-ff3a272f8437 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:24.397882 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5bb4dde7-ec83-49f6-8096-ff3a272f8437 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:24.519507 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5bb4dde7-ec83-49f6-8096-ff3a272f8437 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:24.529281 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5bb4dde7-ec83-49f6-8096-ff3a272f8437 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1093 microversion: 2.1 time: 0.141381 Jul 20 11:37:24.540357 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3166/6314] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:24 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1093 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:25.548444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:25.548931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:25.557824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:25.558909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:25.559955 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:25.560608 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:25.646564 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:25.656636 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1f94ad9c-44aa-4271-a91d-37c67b7f8dcc tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1209 microversion: 2.1 time: 0.112331 Jul 20 11:37:25.658122 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3149/6315] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:25 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:26.674805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:26.675465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:26.689782 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:26.690403 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:26.691296 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:26.692740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:26.696458 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] [180d7a9d-2145-40a2-98b6-3d44b916528f] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 34874. Jul 20 11:37:26.941798 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:26.952903 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-45cf414d-3bb1-49bf-a264-285dc2db97d4 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1277 microversion: 2.1 time: 0.281972 Jul 20 11:37:26.954389 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3167/6316] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:26 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:27.270516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-3ac46fa8-d072-4291-9ed2-c4cb2339e2d5 req-01675871-8193-458f-beb4-4509e68af209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99640ad3-be45-43ca-87ee-45691fd7589b", "tag": "8b1fddd0-4645-442b-8053-68488e48c516"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:27.280389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3ac46fa8-d072-4291-9ed2-c4cb2339e2d5 req-01675871-8193-458f-beb4-4509e68af209 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:27.280855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-3ac46fa8-d072-4291-9ed2-c4cb2339e2d5 req-01675871-8193-458f-beb4-4509e68af209 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:27.295505 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-3ac46fa8-d072-4291-9ed2-c4cb2339e2d5 req-01675871-8193-458f-beb4-4509e68af209 service nova] Creating event network-changed:8b1fddd0-4645-442b-8053-68488e48c516 for instance 99640ad3-be45-43ca-87ee-45691fd7589b on n-h2-846219-10 Jul 20 11:37:27.301010 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-3ac46fa8-d072-4291-9ed2-c4cb2339e2d5 req-01675871-8193-458f-beb4-4509e68af209 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130558 Jul 20 11:37:27.301623 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3150/6317] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:37:27.971979 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:27.972809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:27.980233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:27.980809 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:27.981820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:27.982327 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:28.201950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:28.211132 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-859730cc-0b69-4005-abb2-82efb03e9fa2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1277 microversion: 2.1 time: 0.242241 Jul 20 11:37:28.221024 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3168/6318] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:27 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:29.229370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:29.230089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:29.237370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:29.237837 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:29.238626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:29.239131 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:29.384812 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:29.392773 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ab801da6-c267-4edf-902b-8a32a41ac102 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1277 microversion: 2.1 time: 0.167718 Jul 20 11:37:29.393351 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3151/6319] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:29 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:30.410043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:30.410768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:30.418591 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.419043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.419864 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:30.420306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:30.567801 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:30.576551 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1d8f022a-c019-458a-84e4-2089e8a52d3c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1277 microversion: 2.1 time: 0.170417 Jul 20 11:37:30.577130 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3169/6320] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:30 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:31.595314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:31.595871 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:31.602571 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:31.603029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:31.603830 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:31.604278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:31.735120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:31.743032 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dd3fc957-fce3-4f28-af45-662a7a319f6c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.151863 Jul 20 11:37:31.743670 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3152/6321] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:31 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:32.761139 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:32.761848 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:32.769800 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:32.770426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:32.771378 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:32.771951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:32.923051 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:32.930690 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03e93bfb-542b-456a-8690-3343fbc5c6f5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.174389 Jul 20 11:37:32.931291 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3170/6322] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:32 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:33.949933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:33.950770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:33.958477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:33.958937 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:33.959741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:33.960186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:34.103031 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:34.111066 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3e8a08c9-c51e-431f-acea-d35dc2ad0319 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.166673 Jul 20 11:37:34.111686 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3153/6323] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:33 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:35.128095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:35.128855 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:35.131598 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:35.138074 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.138527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.139329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:35.139762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:35.275117 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:35.282666 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b07aafb1-cc1f-4de8-9781-cc58ceb6ecb5 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.158461 Jul 20 11:37:35.283261 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3171/6324] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:35 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:36.303123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:36.303778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:36.306029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:36.306706 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=6 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:37:36.313688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:36.314151 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:36.314938 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:36.315520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:36.455118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:36.462996 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d2046213-0de0-4e9e-b7e5-7f13c9cf147a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.164849 Jul 20 11:37:36.463638 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3154/6325] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:36 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:37.481241 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:37.481837 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:37.488762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:37.489211 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:37.489965 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:37.490399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:37.626670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:37.634834 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d056eb05-70dc-4d8c-a602-0cbf84725514 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.158475 Jul 20 11:37:37.635436 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3172/6326] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:37 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:38.652409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:38.653103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:38.660114 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:38.660572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:38.661402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:38.661852 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:38.796239 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:38.803870 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-617522b6-b337-48af-a19d-8a9542bd1158 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.156161 Jul 20 11:37:38.804442 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3155/6327] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:38 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:39.821068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:39.821666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:39.828646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:39.829099 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:39.829871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:39.830310 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:39.963400 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:39.971198 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fa3659e-ebb6-4c7b-ad18-f6816c9c8297 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.154213 Jul 20 11:37:39.971774 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3173/6328] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:39 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:40.988284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:40.988864 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:40.996673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:40.997144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:40.997932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:40.998388 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:41.136542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:41.144141 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e945f3d1-8fc6-481e-982e-a023e16e4ddd tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.159857 Jul 20 11:37:41.144714 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3156/6329] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:40 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:42.162093 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:42.162736 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:42.175538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:42.175914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:42.176709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:42.177153 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:42.297462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-46076e7b-ae39-4124-a25f-86212502cfac req-be3a8645-1799-42b3-a0f5-ce05781824c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99640ad3-be45-43ca-87ee-45691fd7589b", "name": "network-vif-plugged", "status": "completed", "tag": "8b1fddd0-4645-442b-8053-68488e48c516"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:42.311121 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-46076e7b-ae39-4124-a25f-86212502cfac req-be3a8645-1799-42b3-a0f5-ce05781824c8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:42.313178 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-46076e7b-ae39-4124-a25f-86212502cfac req-be3a8645-1799-42b3-a0f5-ce05781824c8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:42.327596 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-46076e7b-ae39-4124-a25f-86212502cfac req-be3a8645-1799-42b3-a0f5-ce05781824c8 service nova] Creating event network-vif-plugged:8b1fddd0-4645-442b-8053-68488e48c516 for instance 99640ad3-be45-43ca-87ee-45691fd7589b on n-h2-846219-10 Jul 20 11:37:42.331236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:42.334248 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-46076e7b-ae39-4124-a25f-86212502cfac req-be3a8645-1799-42b3-a0f5-ce05781824c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044521 Jul 20 11:37:42.334871 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3157/6330] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:37:42.340110 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c2c3f0c6-c8fb-480e-9827-dcf79a1ec134 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.181935 Jul 20 11:37:42.340705 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3174/6331] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:42 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:43.358797 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:43.359618 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:43.366877 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:43.367961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:43.368875 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:43.369331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:43.505781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:43.514481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1e176a16-c38e-49b3-8bae-29a6d8e13384 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1265 microversion: 2.1 time: 0.160762 Jul 20 11:37:43.515510 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3158/6332] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:43 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:44.531492 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:44.532105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:44.539219 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:44.539846 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:44.540472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:44.540907 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:44.674526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:44.683402 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6dee1c55-07cc-4efd-9d94-5d8d48c92c1f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1453 microversion: 2.1 time: 0.155944 Jul 20 11:37:44.683980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3175/6333] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:44 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:44.700482 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:37:44.701145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:37:44.708221 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:44.708759 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:44.709537 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:44.709988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:44.845300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:37:44.853605 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1a344a87-1c75-4b6c-9816-4aeb98cd565c tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1453 microversion: 2.1 time: 0.158090 Jul 20 11:37:44.854185 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3159/6334] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:37:44 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:37:46.455083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c5794a6b-7d51-4fb9-ad3c-0a5902dc3808 req-1069602a-107c-442f-90ee-0c9ddd283ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99640ad3-be45-43ca-87ee-45691fd7589b", "tag": "8b1fddd0-4645-442b-8053-68488e48c516"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:37:46.470449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c5794a6b-7d51-4fb9-ad3c-0a5902dc3808 req-1069602a-107c-442f-90ee-0c9ddd283ca5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:37:46.471197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c5794a6b-7d51-4fb9-ad3c-0a5902dc3808 req-1069602a-107c-442f-90ee-0c9ddd283ca5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:37:46.483996 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c5794a6b-7d51-4fb9-ad3c-0a5902dc3808 req-1069602a-107c-442f-90ee-0c9ddd283ca5 service nova] Creating event network-changed:8b1fddd0-4645-442b-8053-68488e48c516 for instance 99640ad3-be45-43ca-87ee-45691fd7589b on n-h2-846219-10 Jul 20 11:37:46.489557 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c5794a6b-7d51-4fb9-ad3c-0a5902dc3808 req-1069602a-107c-442f-90ee-0c9ddd283ca5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040673 Jul 20 11:37:46.490265 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3176/6335] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:38:52.490045 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:38:52.490785 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:38:52.813116 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:38:52.813695 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:38:53.621720 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:38:53.621942 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:39:26.084448 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:26.085327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=60 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:26.087732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=24 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:26.088870 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=56 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:39:26.090206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:26.090718 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:26.096772 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-f9b14260-29c3-4ad9-ada7-198874c15475 req-7b58936c-3204-4244-9bea-9ad02235fdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99640ad3-be45-43ca-87ee-45691fd7589b", "tag": "8b1fddd0-4645-442b-8053-68488e48c516"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:26.098522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:26.099247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:26.100259 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:26.100961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:26.111951 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f9b14260-29c3-4ad9-ada7-198874c15475 req-7b58936c-3204-4244-9bea-9ad02235fdbd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:26.112394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-f9b14260-29c3-4ad9-ada7-198874c15475 req-7b58936c-3204-4244-9bea-9ad02235fdbd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:26.129656 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-f9b14260-29c3-4ad9-ada7-198874c15475 req-7b58936c-3204-4244-9bea-9ad02235fdbd service nova] Creating event network-changed:8b1fddd0-4645-442b-8053-68488e48c516 for instance 99640ad3-be45-43ca-87ee-45691fd7589b on n-h2-846219-10 Jul 20 11:39:26.131798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:39:26.136140 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-f9b14260-29c3-4ad9-ada7-198874c15475 req-7b58936c-3204-4244-9bea-9ad02235fdbd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051116 Jul 20 11:39:26.137609 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3177/6336] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:26.240815 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-078d3db8-4571-437f-b21e-c11367b645c9 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 204 len: 0 microversion: 2.1 time: 0.158294 Jul 20 11:39:26.241901 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3160/6337] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:39:26 2022] DELETE /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:39:26.258287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:26.259000 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:26.266624 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:26.267548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:26.268603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:26.269229 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:26.426935 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:26.434540 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-14e1fe34-ea45-42cf-8823-c9e49ddc4f31 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1577 microversion: 2.1 time: 0.187416 Jul 20 11:39:26.435122 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3178/6338] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:26 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:27.455057 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:27.455810 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:27.462993 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:27.463495 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:27.464284 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:27.464732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:27.634386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:27.642328 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7a4351eb-7986-4654-8cb3-039bcc8dbd42 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1577 microversion: 2.1 time: 0.192699 Jul 20 11:39:27.642905 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3161/6339] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:27 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:28.229823 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-87384193-c561-46b6-8c10-4d4ef71bfe18 req-e24ca90f-8e1e-4fa8-855a-d973be877e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99640ad3-be45-43ca-87ee-45691fd7589b", "name": "network-vif-deleted", "tag": "8b1fddd0-4645-442b-8053-68488e48c516"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:28.239805 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-87384193-c561-46b6-8c10-4d4ef71bfe18 req-e24ca90f-8e1e-4fa8-855a-d973be877e04 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:28.240328 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-87384193-c561-46b6-8c10-4d4ef71bfe18 req-e24ca90f-8e1e-4fa8-855a-d973be877e04 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:28.252840 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-87384193-c561-46b6-8c10-4d4ef71bfe18 req-e24ca90f-8e1e-4fa8-855a-d973be877e04 service nova] Creating event network-vif-deleted:8b1fddd0-4645-442b-8053-68488e48c516 for instance 99640ad3-be45-43ca-87ee-45691fd7589b on n-h2-846219-10 Jul 20 11:39:28.257557 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-87384193-c561-46b6-8c10-4d4ef71bfe18 req-e24ca90f-8e1e-4fa8-855a-d973be877e04 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Jul 20 11:39:28.258163 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3179/6340] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:39:28.660638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:28.661426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:28.668524 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:28.668997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:28.669794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:28.670250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:28.738801 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:28.746615 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-51248d0a-62b8-4a94-9ca9-9bfdff0f8614 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1224 microversion: 2.1 time: 0.090546 Jul 20 11:39:28.747464 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3162/6341] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:28 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:29.765910 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:29.767191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:29.774148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:29.774600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:29.775420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:29.775865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:29.849713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:29.857613 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-50e3593e-0703-4d5f-8238-639096b956d2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1224 microversion: 2.1 time: 0.096870 Jul 20 11:39:29.858207 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3180/6342] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:29 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:30.874773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:30.875487 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:30.882532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:30.883002 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:30.883818 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:30.884277 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:30.947333 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:30.956441 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5c511fda-21be-47cb-92cb-6812915f0996 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1224 microversion: 2.1 time: 0.085528 Jul 20 11:39:30.956955 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3163/6343] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:30 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:31.973308 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:31.973927 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:31.980973 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:31.981408 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:31.982181 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:31.982619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:32.048332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:32.056042 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-90c46384-33bb-4cd3-b25d-ce847fe95b35 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 200 len: 1224 microversion: 2.1 time: 0.086718 Jul 20 11:39:32.056624 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3181/6344] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:31 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:33.074140 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:33.074712 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: 99640ad3-be45-43ca-87ee-45691fd7589b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:33.082514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:33.082973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:33.083779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:33.084228 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:33.098738 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance 99640ad3-be45-43ca-87ee-45691fd7589b could not be found. Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b HTTP/1.1 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 99640ad3-be45-43ca-87ee-45691fd7589b could not be found. Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '99640ad3-be45-43ca-87ee-45691fd7589b'} Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99640ad3-be45-43ca-87ee-45691fd7589b could not be found. Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99640ad3-be45-43ca-87ee-45691fd7589b could not be found. Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:33.100650 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99640ad3-be45-43ca-87ee-45691fd7589b could not be found. Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance 99640ad3-be45-43ca-87ee-45691fd7589b could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6ee000c9-bd3b-4b21-9152-27074ed5321d tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b" status: 404 len: 111 microversion: 2.1 time: 0.032109 Jul 20 11:39:33.106331 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3164/6345] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:33 2022] GET /compute/v2.1/servers/99640ad3-be45-43ca-87ee-45691fd7589b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:39:39.625815 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:39.627621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:39.629361 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-a9c982d4-5f07-4322-b6a0-7b1d24e9fbf0 req-ae2bb10d-b538-4957-b277-05740dea4efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18d7c2c-f1be-4695-960f-16766ee82a80", "tag": "c871ea62-1fc0-4535-b195-5bcfac539070"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:39.635819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:39.636594 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:39.637640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:39.638160 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:39.638774 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9c982d4-5f07-4322-b6a0-7b1d24e9fbf0 req-ae2bb10d-b538-4957-b277-05740dea4efc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:39.639278 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-a9c982d4-5f07-4322-b6a0-7b1d24e9fbf0 req-ae2bb10d-b538-4957-b277-05740dea4efc service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:39.651453 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-a9c982d4-5f07-4322-b6a0-7b1d24e9fbf0 req-ae2bb10d-b538-4957-b277-05740dea4efc service nova] Creating event network-changed:c871ea62-1fc0-4535-b195-5bcfac539070 for instance e18d7c2c-f1be-4695-960f-16766ee82a80 on n-h1-846219-10 Jul 20 11:39:39.657565 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-a9c982d4-5f07-4322-b6a0-7b1d24e9fbf0 req-ae2bb10d-b538-4957-b277-05740dea4efc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033275 Jul 20 11:39:39.659029 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3165/6346] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:39.939548 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:39:40.033781 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f91c6bdb-24e4-4f07-83d7-db297f8d9f6f tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 204 len: 0 microversion: 2.1 time: 0.412223 Jul 20 11:39:40.034550 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3182/6347] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:39:39 2022] DELETE /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:39:40.044358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:40.045489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:40.057236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:40.057723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:40.058569 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:40.059323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:40.210932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:40.219416 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0469b6b4-6684-4a33-9a91-75ff4e26a0cf tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1575 microversion: 2.1 time: 0.180220 Jul 20 11:39:40.220196 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3166/6348] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:40 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:41.238197 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:41.238908 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:41.246538 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:41.246996 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:41.247888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:41.248332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:41.385306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:41.393071 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-80b2a15b-a86c-4123-8429-af198268a6c2 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1456 microversion: 2.1 time: 0.159780 Jul 20 11:39:41.393645 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3183/6349] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:41 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1456 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:42.362053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-f4ded357-3a14-4055-a880-ae90c211adfa req-24f85c37-cf64-4a96-a144-a31dcbabd444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18d7c2c-f1be-4695-960f-16766ee82a80", "name": "network-vif-deleted", "tag": "c871ea62-1fc0-4535-b195-5bcfac539070"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:39:42.370376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f4ded357-3a14-4055-a880-ae90c211adfa req-24f85c37-cf64-4a96-a144-a31dcbabd444 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:42.370843 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-f4ded357-3a14-4055-a880-ae90c211adfa req-24f85c37-cf64-4a96-a144-a31dcbabd444 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:42.382789 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-f4ded357-3a14-4055-a880-ae90c211adfa req-24f85c37-cf64-4a96-a144-a31dcbabd444 service nova] Creating event network-vif-deleted:c871ea62-1fc0-4535-b195-5bcfac539070 for instance e18d7c2c-f1be-4695-960f-16766ee82a80 on n-h1-846219-10 Jul 20 11:39:42.388401 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-f4ded357-3a14-4055-a880-ae90c211adfa req-24f85c37-cf64-4a96-a144-a31dcbabd444 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096658 Jul 20 11:39:42.389004 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3167/6350] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:39:42.410069 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:42.410704 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:42.417989 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:42.418820 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:42.419880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:42.419880 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:42.484660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:42.492951 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6213c587-8476-434c-ad60-d5b6dfb5d7f3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1222 microversion: 2.1 time: 0.086761 Jul 20 11:39:42.493453 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3184/6351] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:42 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:43.511990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:43.512588 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:43.521048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:43.521516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:43.522298 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:43.522745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:43.594674 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:43.602485 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a5227c67-f7dd-48b4-9e3a-0e6a0a50915b tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1222 microversion: 2.1 time: 0.096078 Jul 20 11:39:43.603073 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3168/6352] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:43 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:44.619388 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:44.620151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:44.627461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:44.627914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:44.628681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:44.629122 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:44.693307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:44.701288 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-85c77e07-d2b4-4d6a-b5a8-a3c149cbe773 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1222 microversion: 2.1 time: 0.085849 Jul 20 11:39:44.702358 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3185/6353] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:44 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:45.718460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:45.719093 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:45.726174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:45.726642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:45.727456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:45.727911 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:45.791394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:45.799948 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6efd795a-6003-4af4-9d3c-c3a2091bdd22 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1222 microversion: 2.1 time: 0.085727 Jul 20 11:39:45.800530 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3169/6354] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:45 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:46.818288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:46.819039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:46.826047 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:46.826509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:46.827317 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:46.827768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:46.862281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:46.862741 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:46.863240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.objects.instance [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lazy-loading 'fault' on Instance uuid e18d7c2c-f1be-4695-960f-16766ee82a80 {{(pid=125885) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:39:46.906785 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053e4581bb5d4079a69a276cddee4d16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcbbeb1b94348f0aa45f89c25ef1a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:39:46.914922 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-09b8a497-cefa-4c42-8766-3e2992df4721 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 200 len: 1181 microversion: 2.1 time: 0.101526 Jul 20 11:39:46.915592 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3186/6355] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:46 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 1181 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:39:47.932174 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:47.932803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: e18d7c2c-f1be-4695-960f-16766ee82a80] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:47.940320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:47.940789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:47.941566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:47.942015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:47.955920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance e18d7c2c-f1be-4695-960f-16766ee82a80 could not be found. Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 HTTP/1.1 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance e18d7c2c-f1be-4695-960f-16766ee82a80 could not be found. Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'e18d7c2c-f1be-4695-960f-16766ee82a80'} Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18d7c2c-f1be-4695-960f-16766ee82a80 could not be found. Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18d7c2c-f1be-4695-960f-16766ee82a80 could not be found. Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:47.957567 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18d7c2c-f1be-4695-960f-16766ee82a80 could not be found. Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance e18d7c2c-f1be-4695-960f-16766ee82a80 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21bd2850-b1ce-4910-bb41-921903ccf30a tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80" status: 404 len: 111 microversion: 2.1 time: 0.030742 Jul 20 11:39:47.963455 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3170/6356] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:47 2022] GET /compute/v2.1/servers/e18d7c2c-f1be-4695-960f-16766ee82a80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:39:48.406563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:48.407242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:48.414176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:48.414627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:48.415425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:48.415865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:48.432148 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 HTTP/1.1 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'd08c9c71-2e32-45c8-8c16-ceefd49aa926'} Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:39:48.433807 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5da5efe1-f461-4067-b919-3a0e947091b3 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 404 len: 111 microversion: 2.1 time: 0.032538 Jul 20 11:39:48.439651 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3187/6357] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:39:48 2022] DELETE /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:39:48.444914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:48.445547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] [instance: d08c9c71-2e32-45c8-8c16-ceefd49aa926] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:39:48.451745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:48.452208 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:48.453013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:39:48.453460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:39:48.467678 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] HTTP exception thrown: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Request method failure captured: Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 HTTP/1.1 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-buqLbJFuvWcWaJprv8QYT4R5Twnod2Yd-3QRl09EAHjV-WjKk2aoZTjqSyI0m4ViVK4bOK0wYY5_VeZAYkBxSQ59SAGPWWIc58v-rSCHtHQMfH3KmABBT-YCwIvc10ofB2lFczF2qVU9GZfqxOB0WsUmpzqpIr5gDUuQiYzux3cl0 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bcbbeb1b94348f0aa45f89c25ef1a05", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bcbbeb1b94348f0aa45f89c25ef1a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 5bcbbeb1b94348f0aa45f89c25ef1a05 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-TestVolumeBootPattern-2116749564 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 053e4581bb5d4079a69a276cddee4d16 Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-TestVolumeBootPattern-2116749564-project Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'd08c9c71-2e32-45c8-8c16-ceefd49aa926'} Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:39:48.469197 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Returning 404 to user: Instance d08c9c71-2e32-45c8-8c16-ceefd49aa926 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9b4a6051-ac0f-49ff-b166-459634e33c47 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926" status: 404 len: 111 microversion: 2.1 time: 0.029537 Jul 20 11:39:48.474270 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3171/6358] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:39:48 2022] GET /compute/v2.1/servers/d08c9c71-2e32-45c8-8c16-ceefd49aa926 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:39:51.881350 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9b46a1a6-4ffc-432a-b046-5e122de9a403 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] Calling method '.version_select at 0x7f2c3efef160>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:39:51.915314 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9b46a1a6-4ffc-432a-b046-5e122de9a403 tempest-TestVolumeBootPattern-2116749564 tempest-TestVolumeBootPattern-2116749564-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-181214265" status: 202 len: 0 microversion: 2.1 time: 0.038584 Jul 20 11:39:51.916008 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3188/6359] 10.222.0.79 () {58 vars in 1259 bytes} [Wed Jul 20 11:39:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-181214265 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:40:10.187932 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:10.188814 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:10.305163 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-815921198", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:10.358529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] validate_networks() for None {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:40:10.636255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:40:10.636693 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:40:10.637173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:40:10.637596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:40:10.638042 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:40:10.648342 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:10.648632 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:10.649438 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:10.649917 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:10.668860 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Getting quotas for project 246e636fdfb540a0b05a944e53f31837. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:40:10.674815 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Getting quotas for user 8668c139b23e489d9414f6dc7c95ddf5 and project 246e636fdfb540a0b05a944e53f31837. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:40:10.687515 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:40:10.690617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:40:10.732413 n-d-846219-10 devstack@n-api.service[125886]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [aec6e715-45df-4cfb-b089-eb7987ed51dc] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 11:40:11.739486 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [aec6e715-45df-4cfb-b089-eb7987ed51dc] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35148. Jul 20 11:40:11.743330 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-aee6072e-081b-4c3d-a59c-58777ff518c4 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560442 Jul 20 11:40:11.743983 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3172/6360] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:40:11.752637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:11.753534 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:11.758437 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a6513f48-9182-4804-9757-33868678fa69 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:11.758840 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a6513f48-9182-4804-9757-33868678fa69 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:11.820637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a6513f48-9182-4804-9757-33868678fa69 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:11.827453 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a6513f48-9182-4804-9757-33868678fa69 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1221 microversion: 2.1 time: 0.077127 Jul 20 11:40:11.828021 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3189/6361] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:11 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:12.847037 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cd915b1e-2e49-4ca2-9920-36408c8ca937 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:12.847699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd915b1e-2e49-4ca2-9920-36408c8ca937 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:12.900634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cd915b1e-2e49-4ca2-9920-36408c8ca937 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:12.908207 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cd915b1e-2e49-4ca2-9920-36408c8ca937 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1221 microversion: 2.1 time: 0.066282 Jul 20 11:40:12.908782 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3173/6362] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:12 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:13.925252 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c35662ec-dec9-4649-afee-e86ef3c0ea5c tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:13.925881 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c35662ec-dec9-4649-afee-e86ef3c0ea5c tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:13.983368 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c35662ec-dec9-4649-afee-e86ef3c0ea5c tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:13.992612 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c35662ec-dec9-4649-afee-e86ef3c0ea5c tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1221 microversion: 2.1 time: 0.071657 Jul 20 11:40:13.993259 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3190/6363] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:13 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:15.012886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4055567f-ce1a-4f4e-82f7-c2c370e4f2f3 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:15.013517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4055567f-ce1a-4f4e-82f7-c2c370e4f2f3 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:15.069001 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4055567f-ce1a-4f4e-82f7-c2c370e4f2f3 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:15.076171 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4055567f-ce1a-4f4e-82f7-c2c370e4f2f3 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1221 microversion: 2.1 time: 0.067280 Jul 20 11:40:15.076752 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3174/6364] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:15 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:16.094851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:16.096121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:16.103896 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:16.104348 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:16.105108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:16.105547 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:16.166563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:16.174661 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7cce2c7a-bd19-401c-84a0-d15132b05d37 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1225 microversion: 2.1 time: 0.083668 Jul 20 11:40:16.175269 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3191/6365] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:16 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:17.192067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:17.192678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:17.200635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.201099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.201893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:17.202340 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:17.268584 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:17.276436 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d217abef-b407-40db-88c0-fc7e02cb0195 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1279 microversion: 2.1 time: 0.088726 Jul 20 11:40:17.277029 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3175/6366] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:17 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:18.294086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:18.294682 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:18.302127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:18.302614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:18.303423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:18.303861 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:18.441083 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:18.450563 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-33445271-a3cd-41ef-a425-99b044d188ad tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.160414 Jul 20 11:40:18.451652 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3192/6367] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:18 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:18.666928 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1da8ef67-eff1-4250-b181-95eecd38b89b req-96f9e170-014c-4b74-9992-1e6a4ddc7043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a", "tag": "8ff01a4b-a9cb-4413-b6d4-5ce02a88ea3f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:18.685011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1da8ef67-eff1-4250-b181-95eecd38b89b req-96f9e170-014c-4b74-9992-1e6a4ddc7043 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:18.686580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1da8ef67-eff1-4250-b181-95eecd38b89b req-96f9e170-014c-4b74-9992-1e6a4ddc7043 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:18.700203 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1da8ef67-eff1-4250-b181-95eecd38b89b req-96f9e170-014c-4b74-9992-1e6a4ddc7043 service nova] Creating event network-changed:8ff01a4b-a9cb-4413-b6d4-5ce02a88ea3f for instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a on n-h1-846219-10 Jul 20 11:40:18.705879 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1da8ef67-eff1-4250-b181-95eecd38b89b req-96f9e170-014c-4b74-9992-1e6a4ddc7043 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051852 Jul 20 11:40:18.706869 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3176/6368] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:40:19.469071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:19.469640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:19.477174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:19.477627 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:19.478399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:19.478843 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:19.610329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:19.620312 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-194cb2f5-871d-444e-8f26-8f0f14257b9e tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.155441 Jul 20 11:40:19.620914 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3193/6369] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:19 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:20.640668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:20.641363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:20.648405 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:20.648858 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:20.649637 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:20.650082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:20.666442 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:21.093754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:21.101600 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b4c9faf-b2e4-4069-9b7e-2a1be6e01320 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.466164 Jul 20 11:40:21.102181 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3177/6370] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:20 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:22.118280 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:22.118899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:22.126156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:22.127276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:22.128061 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:22.128514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:22.258429 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:22.266077 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-efd239e7-5acb-491c-95aa-445531a2b6fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.151776 Jul 20 11:40:22.266655 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3194/6371] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:22 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:23.281919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:23.282536 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:23.290435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:23.290894 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:23.291686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:23.292132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:23.427266 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:23.434763 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-21cec85c-a35f-4f4b-adf6-0989cabbf324 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.156763 Jul 20 11:40:23.435358 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3178/6372] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:23 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:24.452619 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:24.453215 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:24.456550 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:24.462505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:24.462969 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:24.463790 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:24.464242 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:24.605454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:24.613024 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8868c0be-4f97-42d8-8429-86d9b3039a73 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.164374 Jul 20 11:40:24.613603 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3195/6373] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:24 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:25.625267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:25.630991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:25.631852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:25.640347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:25.641081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:25.641873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:25.642867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:25.696402 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-8c050c61-0534-4e3a-89d2-842ec55d6ef5 req-a7cb00f0-8104-4743-b129-b3399671e50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a", "name": "network-vif-plugged", "status": "completed", "tag": "8ff01a4b-a9cb-4413-b6d4-5ce02a88ea3f"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:25.719820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8c050c61-0534-4e3a-89d2-842ec55d6ef5 req-a7cb00f0-8104-4743-b129-b3399671e50f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:25.720951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-8c050c61-0534-4e3a-89d2-842ec55d6ef5 req-a7cb00f0-8104-4743-b129-b3399671e50f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:25.733506 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-8c050c61-0534-4e3a-89d2-842ec55d6ef5 req-a7cb00f0-8104-4743-b129-b3399671e50f service nova] Creating event network-vif-plugged:8ff01a4b-a9cb-4413-b6d4-5ce02a88ea3f for instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a on n-h1-846219-10 Jul 20 11:40:25.739356 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-8c050c61-0534-4e3a-89d2-842ec55d6ef5 req-a7cb00f0-8104-4743-b129-b3399671e50f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120867 Jul 20 11:40:25.740373 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3179/6374] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:25.812903 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:25.821572 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f48aa5e4-a67c-4168-86be-3bdf5e5839a9 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.195957 Jul 20 11:40:25.822307 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3196/6375] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:25 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:40:26.839271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:26.840043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:26.847236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:26.847700 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:26.848472 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:26.848914 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:26.989255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:26.996758 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd2b125a-71c8-4bfd-8d75-037dbf898e4a tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1321 microversion: 2.1 time: 0.162565 Jul 20 11:40:26.997335 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3180/6376] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:26 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:28.012985 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.013608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:28.020419 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.020887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.021672 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.022125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.153941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:28.162391 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-04954ea7-33cd-438a-adea-a793f46921bb tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1471 microversion: 2.1 time: 0.153464 Jul 20 11:40:28.162981 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3197/6377] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:28 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:28.231339 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d7ed209b-8dbe-4f73-99d3-9e12531868e3 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Calling method '.version_select at 0x7f2c3e1db550>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.296224 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d7ed209b-8dbe-4f73-99d3-9e12531868e3 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/8ad48540b7534efeaf2f958856d8cabc" status: 200 len: 371 microversion: 2.1 time: 0.118733 Jul 20 11:40:28.296803 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3181/6378] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 11:40:28 2022] GET /compute/v2.1/os-quota-sets/8ad48540b7534efeaf2f958856d8cabc => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:28.307766 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6b89c47c-424a-44dd-8e2b-7bd58d11049d tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-954451257", "id": 1108626669, "os-flavor-access:is_public": "True"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:28.309377 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:40:28.309377 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:40:28.324646 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6b89c47c-424a-44dd-8e2b-7bd58d11049d tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.020659 Jul 20 11:40:28.325252 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3198/6379] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:40:28 2022] POST /compute/v2.1/flavors => generated 437 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:28.336096 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1108626669"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:28.337155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:28.344203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.344665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.345435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.345888 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.431345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2e5361d4dd4c437d88fd182a299f6498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48540b7534efeaf2f958856d8cabc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:28.437684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-954451257 {{(pid=125886) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:40:28.444205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.444665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.445468 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.445916 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.475719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Getting quotas for project 246e636fdfb540a0b05a944e53f31837. Resources: {'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:40:28.480786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Getting quotas for user 8668c139b23e489d9414f6dc7c95ddf5 and project 246e636fdfb540a0b05a944e53f31837. Resources: {'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:40:28.493403 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.compute.api [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] ram quota exceeded for 8ad48540b7534efeaf2f958856d8cabc, tried to resize instance. Jul 20 11:40:28.493952 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Request method failure captured: Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: request: POST /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a/action HTTP/1.1 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 39 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-mamw1_5hAwDuiISoIDGTK31fBwx6b0vJG1AAu_1v8PXgQCURo91OVpOwwyIwD26pRW66LCIC_r2jk3b0kTuk98vZyx4NxjzrJU13qVS8PGzO9B97qUd5KAmfxbbvvQzZiT24noLrBCcFLPHwZXLF4csMMYv_fMH9MzjoyQJbo5KEg Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: 8ad48540b7534efeaf2f958856d8cabc Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-787390409 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,admin,member Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,admin,member Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8ad48540b7534efeaf2f958856d8cabc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ad48540b7534efeaf2f958856d8cabc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ad48540b7534efeaf2f958856d8cabc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8ad48540b7534efeaf2f958856d8cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServersAdminNegativeTestJSON-787390409 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: 8ad48540b7534efeaf2f958856d8cabc Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-787390409 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServersAdminNegativeTestJSON-787390409-project-admin Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 2e5361d4dd4c437d88fd182a299f6498 Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServersAdminNegativeTestJSON-787390409-project-admin Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: {"resize": {"flavorRef": "1108626669"}} Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a', 'body': {'resize': {'flavorRef': '1108626669'}}} Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:40:28.496100 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0f6ae08d-3ebd-4937-bd92-a2d2bad32f97 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a/action" status: 403 len: 118 microversion: 2.1 time: 0.165268 Jul 20 11:40:28.501954 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3182/6380] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:40:28 2022] POST /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a/action => generated 118 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:40:28.506780 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ef037b3a-c86d-46a4-875c-e8eb3c5aee2a tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.507577 n-d-846219-10 devstack@n-api.service[125885]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:40:28.507577 n-d-846219-10 devstack@n-api.service[125885]: warnings.warn(msg) Jul 20 11:40:28.523870 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ef037b3a-c86d-46a4-875c-e8eb3c5aee2a tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1108626669" status: 202 len: 0 microversion: 2.1 time: 0.020816 Jul 20 11:40:28.524376 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3199/6381] 10.222.0.79 () {58 vars in 1160 bytes} [Wed Jul 20 11:40:28 2022] DELETE /compute/v2.1/flavors/1108626669 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 11:40:28.532234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2fd18182-8c32-435c-bf1c-acb3c5a5a678 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.555304 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2fd18182-8c32-435c-bf1c-acb3c5a5a678 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026570 Jul 20 11:40:28.555875 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3183/6382] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 11:40:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:28.572542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8e74a767-6ac7-45e1-887f-46396d0c1bd3 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Calling method '.version_select at 0x7f2c3efabaf0>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.646333 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8e74a767-6ac7-45e1-887f-46396d0c1bd3 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/8ad48540b7534efeaf2f958856d8cabc" status: 200 len: 371 microversion: 2.1 time: 0.077412 Jul 20 11:40:28.646911 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3200/6383] 10.222.0.79 () {58 vars in 1241 bytes} [Wed Jul 20 11:40:28 2022] GET /compute/v2.1/os-quota-sets/8ad48540b7534efeaf2f958856d8cabc => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:28.657258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-1d69539d-1899-451e-87b0-8f75371b02a7 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-796889889", "id": 93855156, "os-flavor-access:is_public": "True"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:28.658468 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:40:28.658468 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:40:28.673955 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-1d69539d-1899-451e-87b0-8f75371b02a7 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.020698 Jul 20 11:40:28.674598 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3184/6384] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:40:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:28.685295 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "93855156"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:28.686579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:28.692730 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.693191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.693972 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.694438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.882666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2e5361d4dd4c437d88fd182a299f6498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad48540b7534efeaf2f958856d8cabc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:28.889318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-796889889 {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:40:28.896608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.897055 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.897854 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:28.898288 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:28.919334 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Getting quotas for project 246e636fdfb540a0b05a944e53f31837. Resources: {'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:40:28.924576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Getting quotas for user 8668c139b23e489d9414f6dc7c95ddf5 and project 246e636fdfb540a0b05a944e53f31837. Resources: {'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:40:28.936749 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] cores quota exceeded for 8ad48540b7534efeaf2f958856d8cabc, tried to resize instance. Jul 20 11:40:28.937550 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Request method failure captured: Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: request: POST /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a/action HTTP/1.1 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 37 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-mamw1_5hAwDuiISoIDGTK31fBwx6b0vJG1AAu_1v8PXgQCURo91OVpOwwyIwD26pRW66LCIC_r2jk3b0kTuk98vZyx4NxjzrJU13qVS8PGzO9B97qUd5KAmfxbbvvQzZiT24noLrBCcFLPHwZXLF4csMMYv_fMH9MzjoyQJbo5KEg Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 8ad48540b7534efeaf2f958856d8cabc Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-787390409 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,admin,member Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,admin,member Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8ad48540b7534efeaf2f958856d8cabc", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ad48540b7534efeaf2f958856d8cabc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8ad48540b7534efeaf2f958856d8cabc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8ad48540b7534efeaf2f958856d8cabc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-787390409 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 8ad48540b7534efeaf2f958856d8cabc Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-787390409 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminNegativeTestJSON-787390409-project-admin Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 2e5361d4dd4c437d88fd182a299f6498 Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-787390409-project-admin Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: {"resize": {"flavorRef": "93855156"}} Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a', 'body': {'resize': {'flavorRef': '93855156'}}} Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:40:28.947559 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d024652d-0860-48a5-a970-64a7e30eb729 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a/action" status: 403 len: 113 microversion: 2.1 time: 0.267690 Jul 20 11:40:28.953038 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3201/6385] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:40:28 2022] POST /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a/action => generated 113 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:40:28.958540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f67ce8c8-82ab-4fbe-b6d5-7d86eb137a98 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:28.959326 n-d-846219-10 devstack@n-api.service[125886]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 11:40:28.959326 n-d-846219-10 devstack@n-api.service[125886]: warnings.warn(msg) Jul 20 11:40:28.976481 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f67ce8c8-82ab-4fbe-b6d5-7d86eb137a98 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/93855156" status: 202 len: 0 microversion: 2.1 time: 0.022102 Jul 20 11:40:28.977071 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3185/6386] 10.222.0.79 () {58 vars in 1154 bytes} [Wed Jul 20 11:40:28 2022] DELETE /compute/v2.1/flavors/93855156 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:40:28.986264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3e96c8b9-c32d-4ba9-afe8-35310d796a84 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:29.007070 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3e96c8b9-c32d-4ba9-afe8-35310d796a84 tempest-ServersAdminNegativeTestJSON-787390409 tempest-ServersAdminNegativeTestJSON-787390409-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024687 Jul 20 11:40:29.007667 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3202/6387] 10.222.0.79 () {58 vars in 1145 bytes} [Wed Jul 20 11:40:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:29.024879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:29.025409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:29.031980 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:29.032379 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:29.033173 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:29.033617 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:29.059476 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:40:29.137770 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-68425101-b205-4285-b679-b3e80b335bfd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 204 len: 0 microversion: 2.1 time: 0.116394 Jul 20 11:40:29.138538 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3186/6388] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:40:29 2022] DELETE /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:40:29.147829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:29.148448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:29.155023 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:29.155514 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:29.156281 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:29.156721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:29.296261 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:29.304040 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-380d49fb-6b65-4207-afbe-90b8f3dca57f tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1477 microversion: 2.1 time: 0.161040 Jul 20 11:40:29.304615 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3203/6389] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:29 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:30.321651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:30.322435 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:30.330211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:30.331209 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:30.332400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:30.332851 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:30.473180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:30.481083 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e6c56f5b-534f-469d-812e-039d1322b4fd tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1477 microversion: 2.1 time: 0.163849 Jul 20 11:40:30.481655 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3187/6390] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:30 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:31.119445 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-5ae9bd53-6887-4325-8c42-05e80ffdd452 req-6dcc96c8-6450-4935-90ec-853f919595a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a", "name": "network-vif-deleted", "tag": "8ff01a4b-a9cb-4413-b6d4-5ce02a88ea3f"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:31.129885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5ae9bd53-6887-4325-8c42-05e80ffdd452 req-6dcc96c8-6450-4935-90ec-853f919595a8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:31.130342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-5ae9bd53-6887-4325-8c42-05e80ffdd452 req-6dcc96c8-6450-4935-90ec-853f919595a8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:31.142460 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-5ae9bd53-6887-4325-8c42-05e80ffdd452 req-6dcc96c8-6450-4935-90ec-853f919595a8 service nova] Creating event network-vif-deleted:8ff01a4b-a9cb-4413-b6d4-5ce02a88ea3f for instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a on n-h1-846219-10 Jul 20 11:40:31.148477 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-5ae9bd53-6887-4325-8c42-05e80ffdd452 req-6dcc96c8-6450-4935-90ec-853f919595a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 Jul 20 11:40:31.149393 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3204/6391] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:31.497673 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:31.498292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:31.505358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:31.505827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:31.506614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:31.507070 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:31.542809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:31.543746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:31.544418 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.objects.instance [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lazy-loading 'fault' on Instance uuid a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a {{(pid=125886) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 11:40:31.597028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8668c139b23e489d9414f6dc7c95ddf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246e636fdfb540a0b05a944e53f31837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:31.605533 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-faeae640-c051-4a54-8e3d-982cb9e64800 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 200 len: 1311 microversion: 2.1 time: 0.111800 Jul 20 11:40:31.606193 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3188/6392] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:31 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:40:32.625045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:32.625787 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] [instance: a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:32.632120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:32.632576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:32.633342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:32.633788 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:32.647832 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] HTTP exception thrown: Instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a could not be found. Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Request method failure captured: Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a HTTP/1.1 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-mZDW7wtOWYBqNFcWs-x1ShjVqp0Dfie5I7j1XuJLvX5ver0qPMNLAm50wNZsN7DQZybfIhzQ2kAWtaWOIcLI0w5sK4_1l6DA3CQ2_dlXMgb9MRJFujP_1vpD5qzJZyKUBk8u5VrdkkPWQR5Y1JbDG9B55eOlPAvONp47Jtmgd8l54 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: 246e636fdfb540a0b05a944e53f31837 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-349588789 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_246e636fdfb540a0b05a944e53f31837", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/246e636fdfb540a0b05a944e53f31837"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/246e636fdfb540a0b05a944e53f31837"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/246e636fdfb540a0b05a944e53f31837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServersAdminNegativeTestJSON-349588789 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: 246e636fdfb540a0b05a944e53f31837 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-349588789 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServersAdminNegativeTestJSON-349588789-project Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 8668c139b23e489d9414f6dc7c95ddf5 Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServersAdminNegativeTestJSON-349588789-project Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a could not be found. Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a'} Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a could not be found. Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a could not be found. Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:40:32.649485 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a could not be found. Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] Returning 404 to user: Instance a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5978d0de-17a9-45c2-8b04-35b41c0c52e8 tempest-ServersAdminNegativeTestJSON-349588789 tempest-ServersAdminNegativeTestJSON-349588789-project] 10.222.0.79 "GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a" status: 404 len: 111 microversion: 2.1 time: 0.031132 Jul 20 11:40:32.655436 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3205/6393] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:32 2022] GET /compute/v2.1/servers/a8bd3bd4-5c72-4cd8-a011-a2b4ea9f663a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:40:38.445053 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:38.465055 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=3 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:38.575383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-652132252", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "27dadab7-30ad-40c7-95fc-80a8f86f8bac"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:38.629492 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] validate_networks() for [('27dadab7-30ad-40c7-95fc-80a8f86f8bac', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:40:39.082203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:40:39.082631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:40:39.083247 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:40:39.083708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:40:39.084162 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:40:39.094158 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:39.094619 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:39.095691 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:39.096145 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:39.114471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Getting quotas for project eccb8dce944e47f99e09524f02c038ad. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:40:39.120416 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Getting quotas for user f453d4a51ab84b70950f730f03c2feb9 and project eccb8dce944e47f99e09524f02c038ad. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:40:39.133651 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:40:39.136029 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:40:39.184051 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83e1e3ca-247b-4185-8b17-573be5f6cca1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745180 Jul 20 11:40:39.189727 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3189/6394] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:40:39.196556 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ac8591ab-1299-4f35-beb5-451f5e932ac2 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:39.197509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ac8591ab-1299-4f35-beb5-451f5e932ac2 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:39.211762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:39.212824 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:39.273803 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ac8591ab-1299-4f35-beb5-451f5e932ac2 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:39.281887 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ac8591ab-1299-4f35-beb5-451f5e932ac2 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1214 microversion: 2.1 time: 0.089536 Jul 20 11:40:39.282461 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3206/6395] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:39 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:40:40.300762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-35eb95d3-8f16-4b93-98a6-b87f329b5de5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:40.301461 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-35eb95d3-8f16-4b93-98a6-b87f329b5de5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:40.303380 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:40.359308 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-35eb95d3-8f16-4b93-98a6-b87f329b5de5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:40.366177 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-35eb95d3-8f16-4b93-98a6-b87f329b5de5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1214 microversion: 2.1 time: 0.070163 Jul 20 11:40:40.366775 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3190/6396] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:40 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:41.383430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7e756d2d-b210-40d3-87a2-3a1aec51d7f5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:41.384068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7e756d2d-b210-40d3-87a2-3a1aec51d7f5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:41.463664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7e756d2d-b210-40d3-87a2-3a1aec51d7f5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:41.472327 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7e756d2d-b210-40d3-87a2-3a1aec51d7f5 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1214 microversion: 2.1 time: 0.092830 Jul 20 11:40:41.473502 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3207/6397] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:41 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:40:42.490094 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-106a4fa3-2ae7-4968-8103-3f66fadd3ed7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:42.490668 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-106a4fa3-2ae7-4968-8103-3f66fadd3ed7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:42.544460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-106a4fa3-2ae7-4968-8103-3f66fadd3ed7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:42.551490 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-106a4fa3-2ae7-4968-8103-3f66fadd3ed7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1214 microversion: 2.1 time: 0.065605 Jul 20 11:40:42.552071 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3191/6398] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:42 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:43.569236 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:43.569885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:43.573087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=65 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:43.573752 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:43.579592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:43.580044 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:43.580814 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:43.581263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:43.644213 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:43.651910 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-9c5d7338-1f67-484b-a249-e4d5ce05d6f6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1218 microversion: 2.1 time: 0.087298 Jul 20 11:40:43.652480 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3208/6399] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:43 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:44.669513 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:44.670146 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:44.678973 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:44.679467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:44.680260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:44.680715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:44.696746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:44.750949 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:44.759661 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-3f59af71-b358-4783-bc56-7259e0e08f71 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1272 microversion: 2.1 time: 0.094007 Jul 20 11:40:44.760253 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3192/6400] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:44 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:45.778293 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:45.778924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:45.786012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:45.786462 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:45.787292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:45.787700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:45.937015 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:45.945972 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d9568150-2f3c-4179-b7e3-f1627270e030 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.171564 Jul 20 11:40:45.946591 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3209/6401] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:45 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:46.041769 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-1e6093c3-af0e-443f-b411-3c40fc309370 req-c0ce6773-6e38-4dff-8ed9-470ea4d761d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f", "tag": "c5d7a140-88c7-4dbb-9f46-1eac6c9cd942"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:46.055302 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1e6093c3-af0e-443f-b411-3c40fc309370 req-c0ce6773-6e38-4dff-8ed9-470ea4d761d3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:46.055770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-1e6093c3-af0e-443f-b411-3c40fc309370 req-c0ce6773-6e38-4dff-8ed9-470ea4d761d3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:46.068380 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-1e6093c3-af0e-443f-b411-3c40fc309370 req-c0ce6773-6e38-4dff-8ed9-470ea4d761d3 service nova] Creating event network-changed:c5d7a140-88c7-4dbb-9f46-1eac6c9cd942 for instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f on n-h1-846219-10 Jul 20 11:40:46.074087 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-1e6093c3-af0e-443f-b411-3c40fc309370 req-c0ce6773-6e38-4dff-8ed9-470ea4d761d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037312 Jul 20 11:40:46.074395 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3193/6402] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:46.963960 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:46.964527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:46.971666 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:46.972216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:46.972991 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:46.973427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:47.104133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:47.111796 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c0208c0b-119e-490f-9e60-57202f78432f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.151923 Jul 20 11:40:47.112372 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3210/6403] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:46 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:48.131633 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:48.132681 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:48.139538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:48.140005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:48.140788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:48.141269 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:48.276715 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:48.284210 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d0483fee-ffde-4ae8-af0f-344bcc277102 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.158034 Jul 20 11:40:48.284783 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3194/6404] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:48 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:49.302575 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:49.303129 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:49.310094 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:49.310542 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:49.311329 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:49.311769 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:49.443248 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:49.450795 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-5f860a71-2073-4e8a-810f-abea28b852c7 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.152932 Jul 20 11:40:49.451401 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3211/6405] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:49 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:50.468909 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:50.469566 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:50.471630 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:50.478206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:50.478678 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:50.479577 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:50.480038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:50.616396 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:50.623912 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-dd0e79b8-0fa2-4544-8f26-a7c9762986c8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.159227 Jul 20 11:40:50.624485 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3195/6406] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:50 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:51.641988 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:51.642614 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:51.645849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=4 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:51.651472 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:51.651932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:51.652711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:51.653161 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:51.799018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:51.807492 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1cb3d714-a82b-437d-81ed-dc9b334fff75 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.169410 Jul 20 11:40:51.808096 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3212/6407] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:51 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:52.825977 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:52.826538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:52.829262 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:40:52.836017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:52.836478 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:52.837258 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:52.837730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:52.968603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:52.976680 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fd5e5bc7-e5ae-46dd-8af8-cb02228322f3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.154870 Jul 20 11:40:52.977262 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3196/6408] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:52 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:53.826984 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-19f2827b-44cb-49d2-8ba2-3c0204856468 req-03142bce-214f-40fb-af3b-057fe0f17ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f", "name": "network-vif-plugged", "status": "completed", "tag": "c5d7a140-88c7-4dbb-9f46-1eac6c9cd942"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:53.837101 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-19f2827b-44cb-49d2-8ba2-3c0204856468 req-03142bce-214f-40fb-af3b-057fe0f17ed3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:53.837631 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-19f2827b-44cb-49d2-8ba2-3c0204856468 req-03142bce-214f-40fb-af3b-057fe0f17ed3 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:53.850586 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-19f2827b-44cb-49d2-8ba2-3c0204856468 req-03142bce-214f-40fb-af3b-057fe0f17ed3 service nova] Creating event network-vif-plugged:c5d7a140-88c7-4dbb-9f46-1eac6c9cd942 for instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f on n-h1-846219-10 Jul 20 11:40:53.855614 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-19f2827b-44cb-49d2-8ba2-3c0204856468 req-03142bce-214f-40fb-af3b-057fe0f17ed3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Jul 20 11:40:53.856218 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3213/6409] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:40:53.993685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:53.994321 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:54.001559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:54.002038 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:54.002839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:54.003330 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:54.142068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:54.151068 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-05d1d5d1-3bc2-49b1-9969-f0f4cf6f995e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.161330 Jul 20 11:40:54.151678 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3197/6410] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:53 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:55.169795 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:55.170508 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:55.177756 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:55.178206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:55.178978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:55.179439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:55.311847 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:55.319712 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e8a66c73-2c82-40fe-8a51-93e27c3a5e9e tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1314 microversion: 2.1 time: 0.155154 Jul 20 11:40:55.320359 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3214/6411] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:55 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:56.337528 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:56.338192 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:56.345457 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:56.345923 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:56.346704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:56.347155 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:56.480425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:56.487991 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e0fc254f-92a6-4bd1-90f2-3c393d016c47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1502 microversion: 2.1 time: 0.155205 Jul 20 11:40:56.488559 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3198/6412] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:56 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:56.505216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:40:56.506204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:56.513186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:56.513646 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:56.514426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:56.514876 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:56.543653 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:56.550480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Old instance type m1.heat2, new instance type m1.heat {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:40:56.556892 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:40:56.557318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:40:56.557794 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:40:56.558207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:40:56.558621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:40:56.622960 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-25b8c64c-d5d6-49ed-a1f0-a35802423e59 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "POST /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f/action" status: 202 len: 0 microversion: 2.1 time: 0.122565 Jul 20 11:40:56.623780 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3215/6413] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:40:56 2022] POST /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:40:56.633172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:56.633839 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:56.639931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:56.640398 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:56.641181 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:56.641634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:56.823614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:56.831214 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a60b8b1b-b2d1-4e71-9e7e-4583d3a67482 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1511 microversion: 2.1 time: 0.203283 Jul 20 11:40:56.831816 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3199/6414] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:56 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:57.850068 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:57.850691 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:57.857209 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:57.857674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:57.858454 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:57.858898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:57.993709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:58.001377 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-cb5aaaac-592f-451d-971a-e25b447250ad tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1511 microversion: 2.1 time: 0.156370 Jul 20 11:40:58.001956 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3216/6415] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:57 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:40:59.018987 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:40:59.019664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:40:59.027226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:59.027717 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:59.028493 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:40:59.028944 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:40:59.162426 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:40:59.170259 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e99cb89d-9f43-44ad-8115-68b0ca0b412f tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.155008 Jul 20 11:40:59.170857 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3200/6416] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:40:59 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:00.188164 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:00.188786 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:00.197133 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:00.197743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:00.198852 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:00.199497 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:00.337423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:00.345434 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-07785d0f-b532-4ce7-8875-e06076704d91 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.161368 Jul 20 11:41:00.346011 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3217/6417] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:00 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:01.362991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:01.364197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:01.370918 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:01.371422 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:01.372201 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:01.372649 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:01.502358 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:01.510659 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-975ca219-a1c9-43c3-817d-79cb78a85004 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.151644 Jul 20 11:41:01.511245 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3201/6418] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:01 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:02.527253 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:02.527797 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:02.534737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:02.535216 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:02.536148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:02.536587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:02.672404 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:02.680836 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-63d07243-9939-4b7b-b1a5-fc89fac57011 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.157593 Jul 20 11:41:02.681422 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3218/6419] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:02 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:03.698325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:03.698951 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:03.705642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:03.706103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:03.706872 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:03.707352 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:03.842688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:03.850296 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-314db6cf-836a-427c-a3d8-93f1a3ca736c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.156014 Jul 20 11:41:03.850880 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3202/6420] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:03 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:41:04.867637 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:04.868191 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:04.875028 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:04.875505 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:04.876264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:04.876699 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:05.010287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:05.017971 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3a9ddbcb-f64f-49d9-af85-ad0051f6c016 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.154452 Jul 20 11:41:05.018550 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3219/6421] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:04 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:06.034364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:06.034997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:06.042023 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:06.042489 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:06.043293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:06.043748 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:06.181447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:06.189122 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f8573b6f-5819-45f0-8c80-5751a0f32f13 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.158777 Jul 20 11:41:06.189697 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3203/6422] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:06 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:07.207224 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:07.207850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:07.215506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:07.215956 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:07.216975 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:07.217410 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:07.349005 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:07.357400 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44942be0-fb29-4324-ae99-925813721364 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.154317 Jul 20 11:41:07.357980 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3220/6423] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:07 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:08.374177 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:08.374836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:08.382309 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:08.382781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:08.383597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:08.384049 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:08.518332 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:08.526753 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b120002d-9665-4016-9512-ca76b7d9f5c9 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.156524 Jul 20 11:41:08.527366 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3204/6424] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:08 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:09.544652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:09.545245 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:09.553424 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:09.553916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:09.554703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:09.555148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:09.688674 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:09.698737 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-223366f3-70bd-40e2-87a1-6a9f596c5c9d tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.158084 Jul 20 11:41:09.699393 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3221/6425] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:09 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:10.715775 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:10.716792 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:10.719666 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=34 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:10.725553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:10.726013 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:10.726883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:10.727364 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:10.860907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:10.869181 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bf684d4c-3363-4194-86f3-8a279fb8c6ea tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.157418 Jul 20 11:41:10.869764 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3205/6426] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:10 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:11.890453 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:11.891112 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:11.898700 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:11.899146 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:11.899931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:11.900376 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:12.037058 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:12.044738 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8c1bc371-74f5-44dc-b2b4-cbf5b9e95243 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.158208 Jul 20 11:41:12.045313 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3222/6427] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:11 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:13.061956 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:13.062522 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:13.070197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:13.070662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:13.071469 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:13.072033 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:13.202099 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:13.209794 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48a08305-6824-4306-a64f-82c7fcd9d4bf tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.151809 Jul 20 11:41:13.210363 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3206/6428] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:13 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:14.227045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:14.227709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:14.230613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=34 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:14.236032 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:14.236485 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:14.237325 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:14.237768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:14.241218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:14.376130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:14.384418 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0e22151-b245-474f-93ad-d288b22e42c1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.161286 Jul 20 11:41:14.385003 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3223/6429] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:14 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:15.405494 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:15.406553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:15.415086 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:15.415518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:15.416296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:15.416745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:15.419573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=86 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:15.572182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:15.580936 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a18b4bf1-d04e-4fca-a3c8-5ca82e1cff5c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.182442 Jul 20 11:41:15.581683 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3207/6430] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:15 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:16.598515 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:16.599581 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:16.606321 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:16.606771 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:16.607569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:16.608012 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:16.740284 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:16.747929 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4b3329ad-039c-4352-a2be-8bd96cb66735 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.153408 Jul 20 11:41:16.748510 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3224/6431] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:16 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:17.765729 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:17.766356 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:17.773919 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:17.774386 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:17.775159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:17.775636 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:17.910087 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:17.918442 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e641a0db-7043-4eed-90b5-b3945ce51ad6 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.156610 Jul 20 11:41:17.919025 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3208/6432] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:17 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:18.935812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:18.936427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:18.943435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:18.945052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:18.945819 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:18.946260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:19.078859 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:19.087305 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-350e9a21-8156-4b2c-8523-ed03331e61f4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.155410 Jul 20 11:41:19.088165 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3225/6433] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:18 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:20.106770 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:20.108762 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:20.113657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:20.114119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:20.114879 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:20.115415 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:20.252198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:20.260325 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-567a2c23-0d78-41d4-a6a9-b7634a49f7e3 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.159274 Jul 20 11:41:20.260903 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3209/6434] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:20 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:21.278123 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:21.278754 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:21.285829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:21.286287 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:21.287059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:21.287530 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:21.422421 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:21.430812 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-679d0004-a049-4efd-bbc7-6df11dfb10ab tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.156669 Jul 20 11:41:21.431433 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3226/6435] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:21 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:22.448631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:22.449205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:22.456118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:22.456579 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:22.457344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:22.457787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:22.590538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:22.598331 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-74408d30-0e79-4c9c-939f-462ce63376d4 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.154122 Jul 20 11:41:22.598909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3210/6436] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:22 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:23.617202 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:23.617753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:23.624721 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:23.625170 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:23.625934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:23.626371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:24.067033 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:24.075763 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3a761611-c852-4941-91a5-6172e5724c04 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.463719 Jul 20 11:41:24.076384 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3227/6437] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:23 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:25.093605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:25.094285 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:25.102400 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:25.102873 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:25.103704 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:25.104160 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:25.242271 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:25.250000 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c02a9e77-adaf-4462-b0bf-0b6c88757de0 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1516 microversion: 2.1 time: 0.160753 Jul 20 11:41:25.250594 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3211/6438] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:25 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:26.268501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:26.269107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:26.276218 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:26.276670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:26.277435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:26.277909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:26.492726 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:26.500714 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-357d3bc4-3e10-4b2e-ad21-d4de6afb3d88 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1515 microversion: 2.1 time: 0.236123 Jul 20 11:41:26.501318 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3228/6439] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:26 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:26.524885 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-5dea9f3f-3636-4aa5-8deb-2455103ef7ae req-e0ad635a-96a6-4b01-a7c2-8a08077c0024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f", "name": "network-vif-unplugged", "status": "completed", "tag": "c5d7a140-88c7-4dbb-9f46-1eac6c9cd942"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:26.535267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5dea9f3f-3636-4aa5-8deb-2455103ef7ae req-e0ad635a-96a6-4b01-a7c2-8a08077c0024 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:26.535857 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-5dea9f3f-3636-4aa5-8deb-2455103ef7ae req-e0ad635a-96a6-4b01-a7c2-8a08077c0024 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:26.548711 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-5dea9f3f-3636-4aa5-8deb-2455103ef7ae req-e0ad635a-96a6-4b01-a7c2-8a08077c0024 service nova] Creating event network-vif-unplugged:c5d7a140-88c7-4dbb-9f46-1eac6c9cd942 for instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f on n-h2-846219-10 Jul 20 11:41:26.555850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-5dea9f3f-3636-4aa5-8deb-2455103ef7ae req-e0ad635a-96a6-4b01-a7c2-8a08077c0024 service nova] Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:41:26.570056 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-5dea9f3f-3636-4aa5-8deb-2455103ef7ae req-e0ad635a-96a6-4b01-a7c2-8a08077c0024 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047325 Jul 20 11:41:26.570842 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3212/6440] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:41:27.518914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:27.519563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:27.527075 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:27.527567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:27.528332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:27.528777 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:27.666482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:27.674471 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2905feb3-b05c-45ca-9135-ea932891c72b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1513 microversion: 2.1 time: 0.159886 Jul 20 11:41:27.675032 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3229/6441] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:27 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:28.587505 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-e126e239-db2a-4939-8375-c16f6898d436 req-699d99fd-2324-4e54-9d4d-32f1b9dd73dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f", "tag": "c5d7a140-88c7-4dbb-9f46-1eac6c9cd942"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:28.596934 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e126e239-db2a-4939-8375-c16f6898d436 req-699d99fd-2324-4e54-9d4d-32f1b9dd73dd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:28.597389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-e126e239-db2a-4939-8375-c16f6898d436 req-699d99fd-2324-4e54-9d4d-32f1b9dd73dd service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:28.609602 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-e126e239-db2a-4939-8375-c16f6898d436 req-699d99fd-2324-4e54-9d4d-32f1b9dd73dd service nova] Creating event network-changed:c5d7a140-88c7-4dbb-9f46-1eac6c9cd942 for instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f on n-h2-846219-10 Jul 20 11:41:28.615188 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-e126e239-db2a-4939-8375-c16f6898d436 req-699d99fd-2324-4e54-9d4d-32f1b9dd73dd service nova] Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:41:28.627321 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-e126e239-db2a-4939-8375-c16f6898d436 req-699d99fd-2324-4e54-9d4d-32f1b9dd73dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043644 Jul 20 11:41:28.627927 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3213/6442] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:28.693963 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:28.695263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:28.702504 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:28.703384 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:28.704184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:28.704685 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:28.927559 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:28.936826 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7102706c-542a-48ab-9640-177e2cc85935 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1513 microversion: 2.1 time: 0.247310 Jul 20 11:41:28.937451 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3230/6443] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:28 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:29.954503 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:29.955236 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:29.962620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:29.963069 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:29.964010 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:29.964516 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:30.102862 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:30.110520 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-643e9b36-3a9f-4a94-a3f0-ec25f9936f39 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1510 microversion: 2.1 time: 0.160493 Jul 20 11:41:30.111102 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3214/6444] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:29 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:30.127434 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:30.127990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:30.134921 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:30.135426 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:30.136204 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:30.136651 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:30.163039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:41:30.219292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Found an unconfirmed migration during delete, id: 16, status: finished Jul 20 11:41:31.792711 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-68d62465-069c-4a23-a37a-7cbfeb84246c tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 204 len: 0 microversion: 2.1 time: 1.668876 Jul 20 11:41:31.794420 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3231/6445] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:41:30 2022] DELETE /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 0 bytes in 1672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:41:31.802737 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:31.803423 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:31.810363 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:31.810829 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:31.811657 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:31.812110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:31.941003 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:31.950041 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7f9acdeb-3dee-4e7b-9e50-453f1a8126b1 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1502 microversion: 2.1 time: 0.151311 Jul 20 11:41:31.950627 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3215/6446] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:31 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:32.968773 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:32.969389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:32.976409 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:32.976863 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:32.978087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:32.978531 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:33.232010 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f453d4a51ab84b70950f730f03c2feb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccb8dce944e47f99e09524f02c038ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:33.240016 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c7661baa-7376-44bb-989d-aa9b2ff411d8 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 200 len: 1502 microversion: 2.1 time: 0.275856 Jul 20 11:41:33.250124 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3232/6447] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:32 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:33.312020 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-b7a4a3bd-9560-4f1c-9bd9-cb92e7e5a56f req-7b4cd07a-32ec-4723-a281-9a9f3cfff3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f", "name": "network-vif-plugged", "status": "completed", "tag": "c5d7a140-88c7-4dbb-9f46-1eac6c9cd942"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:33.326809 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b7a4a3bd-9560-4f1c-9bd9-cb92e7e5a56f req-7b4cd07a-32ec-4723-a281-9a9f3cfff3e8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:33.327292 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-b7a4a3bd-9560-4f1c-9bd9-cb92e7e5a56f req-7b4cd07a-32ec-4723-a281-9a9f3cfff3e8 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:33.341101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-b7a4a3bd-9560-4f1c-9bd9-cb92e7e5a56f req-7b4cd07a-32ec-4723-a281-9a9f3cfff3e8 service nova] Creating event network-vif-plugged:c5d7a140-88c7-4dbb-9f46-1eac6c9cd942 for instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f on n-h2-846219-10 Jul 20 11:41:33.349622 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-b7a4a3bd-9560-4f1c-9bd9-cb92e7e5a56f req-7b4cd07a-32ec-4723-a281-9a9f3cfff3e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041187 Jul 20 11:41:33.350481 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3216/6448] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:33.612482 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-08b78ddd-60ca-4dfe-84aa-0e036439ad16 req-4926b3d6-b7ce-4709-af0f-2ed766b8ad22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f", "name": "network-vif-deleted", "tag": "c5d7a140-88c7-4dbb-9f46-1eac6c9cd942"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:33.622283 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-08b78ddd-60ca-4dfe-84aa-0e036439ad16 req-4926b3d6-b7ce-4709-af0f-2ed766b8ad22 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:33.623107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-08b78ddd-60ca-4dfe-84aa-0e036439ad16 req-4926b3d6-b7ce-4709-af0f-2ed766b8ad22 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:33.638027 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-08b78ddd-60ca-4dfe-84aa-0e036439ad16 req-4926b3d6-b7ce-4709-af0f-2ed766b8ad22 service nova] Creating event network-vif-deleted:c5d7a140-88c7-4dbb-9f46-1eac6c9cd942 for instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f on n-h2-846219-10 Jul 20 11:41:33.643943 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-08b78ddd-60ca-4dfe-84aa-0e036439ad16 req-4926b3d6-b7ce-4709-af0f-2ed766b8ad22 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035261 Jul 20 11:41:33.645206 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3233/6449] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:34.257953 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:34.258658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:34.264990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.265454 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.266226 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.266676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.280454 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] HTTP exception thrown: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Request method failure captured: Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f HTTP/1.1 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-m2y_hQOrVQu55nOgwnDHjEez0JZbfOAbkj8tnx4LymBe1fObvVrJjvXk-_LEDaZbckzBobc2kjk6rkT0x3rKE1ViQrVMMvS-Fpg9u-Np1omMybSGsqj1bFs5VIqh5qwYFAWKplj-wLW7UsPcs_CwYm21348iNtGAR9d5lHZ6yvSDs Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: eccb8dce944e47f99e09524f02c038ad Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eccb8dce944e47f99e09524f02c038ad", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: eccb8dce944e47f99e09524f02c038ad Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersTestJSON-2131442167-project Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: f453d4a51ab84b70950f730f03c2feb9 Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersTestJSON-2131442167-project Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f'} Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:34.282088 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Returning 404 to user: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b51ad4ef-5ff7-4d10-b3b7-e0b53d7aac6b tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 404 len: 111 microversion: 2.1 time: 0.029903 Jul 20 11:41:34.288016 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3217/6450] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:34 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:41:34.302276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:34.302871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:34.309402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.309856 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.310623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.311066 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.324435 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] HTTP exception thrown: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Request method failure captured: Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f HTTP/1.1 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-m2y_hQOrVQu55nOgwnDHjEez0JZbfOAbkj8tnx4LymBe1fObvVrJjvXk-_LEDaZbckzBobc2kjk6rkT0x3rKE1ViQrVMMvS-Fpg9u-Np1omMybSGsqj1bFs5VIqh5qwYFAWKplj-wLW7UsPcs_CwYm21348iNtGAR9d5lHZ6yvSDs Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: eccb8dce944e47f99e09524f02c038ad Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eccb8dce944e47f99e09524f02c038ad", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: eccb8dce944e47f99e09524f02c038ad Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-DeleteServersTestJSON-2131442167-project Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: f453d4a51ab84b70950f730f03c2feb9 Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-DeleteServersTestJSON-2131442167-project Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': 'f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f'} Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:41:34.326149 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Returning 404 to user: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-78360481-90e1-461e-91c1-dbb73b5baa47 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 404 len: 111 microversion: 2.1 time: 0.030350 Jul 20 11:41:34.331916 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3234/6451] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:41:34 2022] DELETE /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:41:34.335971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:34.337123 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] [instance: f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:34.344301 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.344768 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.345541 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:34.345991 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:34.360088 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] HTTP exception thrown: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Request method failure captured: Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f HTTP/1.1 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-m2y_hQOrVQu55nOgwnDHjEez0JZbfOAbkj8tnx4LymBe1fObvVrJjvXk-_LEDaZbckzBobc2kjk6rkT0x3rKE1ViQrVMMvS-Fpg9u-Np1omMybSGsqj1bFs5VIqh5qwYFAWKplj-wLW7UsPcs_CwYm21348iNtGAR9d5lHZ6yvSDs Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: eccb8dce944e47f99e09524f02c038ad Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_eccb8dce944e47f99e09524f02c038ad", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/eccb8dce944e47f99e09524f02c038ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: eccb8dce944e47f99e09524f02c038ad Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-DeleteServersTestJSON-2131442167 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-DeleteServersTestJSON-2131442167-project Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: f453d4a51ab84b70950f730f03c2feb9 Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-DeleteServersTestJSON-2131442167-project Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': 'f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f'} Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:41:34.361626 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] Returning 404 to user: Instance f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17fbc750-097d-4466-b6e6-dcb07ffaf766 tempest-DeleteServersTestJSON-2131442167 tempest-DeleteServersTestJSON-2131442167-project] 10.222.0.79 "GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f" status: 404 len: 111 microversion: 2.1 time: 0.030863 Jul 20 11:41:34.367465 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3218/6452] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:34 2022] GET /compute/v2.1/servers/f1e9b7ef-52f7-44e5-a1da-4e1e8e3ed28f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:41:43.283363 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-247524112", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "e2043ed8-394b-4713-8a1e-7dc6d6e9ae26"}]}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:43.341311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.network.neutron [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] validate_networks() for [('e2043ed8-394b-4713-8a1e-7dc6d6e9ae26', None, None, None, None, None)] {{(pid=125885) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:41:43.750322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:41:43.750746 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:41:43.751249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:41:43.751694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:41:43.752397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:41:43.762270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:43.762723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:43.763584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:43.764021 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:43.781608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Getting quotas for project c697ea2996194bcaa524a1141740d583. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:41:43.786836 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Getting quotas for user 21b09a0a06ee4a0a9d591c587f6b5630 and project c697ea2996194bcaa524a1141740d583. Resources: {'instances', 'ram', 'cores'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:41:43.799923 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Going to run 1 instances... {{(pid=125885) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:41:43.802186 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125885) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:41:43.850581 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4bbc6c0a-5089-45f1-8b03-3dd8fa3108f2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718508 Jul 20 11:41:43.851260 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3235/6453] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:41:43.863540 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-137542a7-da77-4190-a11f-80261c101286 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:43.864170 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-137542a7-da77-4190-a11f-80261c101286 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:43.870119 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=28 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:43.924403 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-137542a7-da77-4190-a11f-80261c101286 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:43.933013 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-137542a7-da77-4190-a11f-80261c101286 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1217 microversion: 2.1 time: 0.074494 Jul 20 11:41:43.933721 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3219/6454] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:43 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:44.957657 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:44.959097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:44.970413 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:44.972526 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:44.973155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:44.974484 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:44.974941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:44.981563 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:45.061554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:45.069950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-709e1116-b8a1-4b98-b77d-11bf0241769b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1275 microversion: 2.1 time: 0.121639 Jul 20 11:41:45.071046 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3236/6455] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:44 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:46.088734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:46.090110 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:46.098943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=55 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:46.105447 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.106235 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.107855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.109635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.388676 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:46.397181 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-520c05ba-6caa-4d94-994a-f46983e54d15 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1317 microversion: 2.1 time: 0.313002 Jul 20 11:41:46.398495 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3220/6456] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:46 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:46.500865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-851f6087-e600-4cc3-823c-d7fbef2db0a6 req-3e91cbcb-9ab5-4065-8425-b81c47ee6112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177bf12-8bad-4d61-bf20-6e13a0be72a2", "tag": "5e29e7fa-9c0d-4155-9a9d-688635a77892"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:46.513579 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-851f6087-e600-4cc3-823c-d7fbef2db0a6 req-3e91cbcb-9ab5-4065-8425-b81c47ee6112 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:46.514402 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-851f6087-e600-4cc3-823c-d7fbef2db0a6 req-3e91cbcb-9ab5-4065-8425-b81c47ee6112 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:46.528202 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-851f6087-e600-4cc3-823c-d7fbef2db0a6 req-3e91cbcb-9ab5-4065-8425-b81c47ee6112 service nova] Creating event network-changed:5e29e7fa-9c0d-4155-9a9d-688635a77892 for instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 on n-h2-846219-10 Jul 20 11:41:46.535377 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-851f6087-e600-4cc3-823c-d7fbef2db0a6 req-3e91cbcb-9ab5-4065-8425-b81c47ee6112 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038077 Jul 20 11:41:46.537017 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3237/6457] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:47.415836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:47.416477 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:47.423731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.424205 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.424990 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:47.425444 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:47.559778 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:47.567324 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-06cf911a-a125-4025-8333-27d5dd91b8f6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1317 microversion: 2.1 time: 0.156221 Jul 20 11:41:47.567916 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3221/6458] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:47 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:48.586435 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:48.587152 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:48.594423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:48.594887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:48.595695 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:48.596144 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:48.732501 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:48.740276 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-28fb687f-c7e2-4052-b3ca-b27234b92d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1317 microversion: 2.1 time: 0.158994 Jul 20 11:41:48.740856 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3238/6459] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:48 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:49.757752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:49.758414 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:49.767149 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:49.767638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:49.768432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:49.768880 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:49.899017 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:49.907529 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-14a5499e-f632-46bf-aaf1-e4ead02d43cd tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1317 microversion: 2.1 time: 0.153752 Jul 20 11:41:49.908103 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3222/6460] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:49 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:50.924831 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:50.925451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:50.933311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.933765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:50.934540 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:50.934982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.064266 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:51.072925 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-03e3fd90-7d82-427f-ae11-f3350e50ce47 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1317 microversion: 2.1 time: 0.151020 Jul 20 11:41:51.073171 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3239/6461] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:50 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:51.437544 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-575926b0-85d7-4e47-95f2-247a0efef627 req-cf9d1c4b-9b2f-45e6-878c-cd1e9e52ca49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2177bf12-8bad-4d61-bf20-6e13a0be72a2", "name": "network-vif-plugged", "status": "completed", "tag": "5e29e7fa-9c0d-4155-9a9d-688635a77892"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:51.447598 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-575926b0-85d7-4e47-95f2-247a0efef627 req-cf9d1c4b-9b2f-45e6-878c-cd1e9e52ca49 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:51.448065 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-575926b0-85d7-4e47-95f2-247a0efef627 req-cf9d1c4b-9b2f-45e6-878c-cd1e9e52ca49 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:51.459586 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-575926b0-85d7-4e47-95f2-247a0efef627 req-cf9d1c4b-9b2f-45e6-878c-cd1e9e52ca49 service nova] Creating event network-vif-plugged:5e29e7fa-9c0d-4155-9a9d-688635a77892 for instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 on n-h2-846219-10 Jul 20 11:41:51.465101 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-575926b0-85d7-4e47-95f2-247a0efef627 req-cf9d1c4b-9b2f-45e6-878c-cd1e9e52ca49 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031275 Jul 20 11:41:51.465777 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3223/6462] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:41:52.090693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:52.091336 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:52.098670 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:52.099120 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.099917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:52.100355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:52.233271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:52.240719 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-fa0341c8-9d8f-460a-a0bf-f9b1b6d29c9f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1317 microversion: 2.1 time: 0.155174 Jul 20 11:41:52.241299 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3240/6463] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:52 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:53.259727 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.260453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.266824 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.267324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.268115 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.268573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.403745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.411864 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-2a310cb3-5573-4c1b-bad0-b27bb44ab7f7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1508 microversion: 2.1 time: 0.157250 Jul 20 11:41:53.412449 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3224/6464] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:41:53.429470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.430087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.437343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.437802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.438621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.439128 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.573389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.580950 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-47308da7-daed-4efc-88a1-fe480b5162b4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1508 microversion: 2.1 time: 0.155520 Jul 20 11:41:53.581526 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3241/6465] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:53.597756 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:53.598900 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.604997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.605460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.606231 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.606680 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.669920 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d7f4744-68ee-4a30-aa06-ae9db4871ef2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "PUT /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1080 microversion: 2.1 time: 0.075854 Jul 20 11:41:53.670489 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3225/6466] 10.222.0.79 () {60 vars in 1255 bytes} [Wed Jul 20 11:41:53 2022] PUT /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1080 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:53.684155 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.684784 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.690962 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.691451 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.692227 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.692675 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.771072 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:53.794898 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=6 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:53.827533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.835161 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ec201652-bd5b-4bb7-b297-d26228126bef tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1506 microversion: 2.1 time: 0.155015 Jul 20 11:41:53.835776 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3242/6467] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:53.851827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:53.852486 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:53.858603 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.859068 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.859883 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:53.860337 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:53.929409 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:41:53.992048 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:53.999945 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-06597ee4-8d48-4e28-9f40-15eeeb5945aa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1506 microversion: 2.1 time: 0.152023 Jul 20 11:41:54.000518 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3226/6468] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:53 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:54.016473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:41:54.017608 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:54.023665 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.024121 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.025618 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.026097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.057343 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.063156 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=125885) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:41:54.069392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:41:54.069850 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image limits 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:41:54.070333 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:41:54.070747 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image pref 0:0:0 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:41:54.071180 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.virt.hardware [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125885) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:41:54.137436 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-36154fb7-83fa-4855-8f39-eddd4fe550a6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2/action" status: 202 len: 0 microversion: 2.1 time: 0.124870 Jul 20 11:41:54.138062 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3243/6469] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:41:54 2022] POST /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:41:54.146881 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:54.147547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:54.155199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.155606 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.156397 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:54.156855 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:54.322688 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:54.330311 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-054c4ecf-243e-4886-a419-a0adbd0c944b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1517 microversion: 2.1 time: 0.187857 Jul 20 11:41:54.330880 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3227/6470] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:54 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:55.350621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:55.351240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:55.358369 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.358825 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.359690 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:55.360132 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:55.494352 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:55.502452 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-17471e98-a0ef-4e6b-9990-b6e91b6cbdc7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1517 microversion: 2.1 time: 0.156790 Jul 20 11:41:55.503042 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3244/6471] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:55 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:56.520293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:56.520905 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:56.527882 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:56.528345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:56.529118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:56.529565 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:56.662453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:56.670821 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e5d391af-b17c-4bc3-8aaf-2d0735646260 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.154492 Jul 20 11:41:56.671447 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3228/6472] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:56 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:57.688097 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:57.688711 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:57.695681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:57.696130 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:57.697826 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:57.698276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:57.833184 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:57.842124 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e820fc94-2c9e-4586-873b-715e09feb1e3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.157921 Jul 20 11:41:57.842728 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3245/6473] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:57 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:41:58.859246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:41:58.859799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:41:58.866763 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:58.867250 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:58.868015 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:41:58.868597 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:41:58.999488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:41:59.006910 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0773ca40-3979-4acb-b415-388ee9586057 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.151767 Jul 20 11:41:59.007518 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3229/6474] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:41:58 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:00.024888 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:00.025493 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:00.032148 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:00.032603 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:00.033367 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:00.033802 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:00.170536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:00.179459 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1fdb3eca-e795-4824-aaf8-b3dbaf11d770 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.158707 Jul 20 11:42:00.180103 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3246/6475] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:00 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:01.197509 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:01.198134 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:01.205012 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:01.205473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:01.206248 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:01.206683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:01.337988 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:01.345716 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b349dd15-e23e-434e-97cc-ae4bedc1d3d4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.152545 Jul 20 11:42:01.346286 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3230/6476] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:01 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:02.362968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:02.363622 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:02.371119 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:02.371644 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:02.372439 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:02.372915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:02.503761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:02.512246 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-30ed4b16-77ab-4e3c-83eb-5e4347bf677d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.153237 Jul 20 11:42:02.512831 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3247/6477] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:02 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:03.529532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:03.530072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:03.536859 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:03.537320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:03.538187 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:03.538631 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:03.674789 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:03.682934 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-83e0153a-4600-4fc2-a147-7e7e41e60b95 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.157429 Jul 20 11:42:03.683543 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3231/6478] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:03 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:04.699634 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:04.700260 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:04.707441 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:04.707841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:04.708609 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:04.709059 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:04.840567 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:04.848519 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2862e2a7-2ecf-461c-baad-46260a67e95d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.153453 Jul 20 11:42:04.849087 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3248/6479] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:04 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:05.865822 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:05.866456 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:05.874180 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:05.874644 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:05.875471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:05.875931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:06.328723 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:06.336379 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6f0ab73b-3104-465c-9be4-1a0a0b535c96 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.474432 Jul 20 11:42:06.337606 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3232/6480] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:05 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:07.354610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:07.355527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:07.362399 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:07.362849 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:07.363652 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:07.364095 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:07.539571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:07.547329 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-e3f53b80-768c-432d-8de9-6f4ce3f5ae18 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.196702 Jul 20 11:42:07.547936 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3249/6481] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:07 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:08.565616 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:08.566185 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:08.573983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:08.574453 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:08.575281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:08.575741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:08.712711 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:08.720626 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4f9bded5-0da2-44c6-a630-85dc27bd0a61 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.159006 Jul 20 11:42:08.721205 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3233/6482] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:08 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:09.737867 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:09.738465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:09.745933 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:09.746379 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:09.747138 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:09.747600 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:09.882232 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:09.890318 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-f0cad673-0fdf-4fb5-9b34-e34a15d89d24 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.156456 Jul 20 11:42:09.890898 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3250/6483] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:09 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:10.908424 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:10.909040 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:10.916963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:10.917420 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:10.918196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:10.918639 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:11.050323 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:11.058950 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-eed618c8-7e32-42e1-84a4-4754a39afeae tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.154448 Jul 20 11:42:11.059556 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3234/6484] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:10 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:12.076806 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:12.077405 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:12.084273 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:12.084734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:12.085509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:12.085955 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:12.219740 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:12.227337 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ce47d157-59c9-48dc-ab37-0af0bda9b829 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.155296 Jul 20 11:42:12.227916 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3251/6485] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:12 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:12.499240 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:42:12.499869 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:42:13.245671 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:13.246328 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:13.253445 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:13.253912 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:13.254672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:13.255118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:13.384836 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:13.393069 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6b0050b1-1266-4557-b194-abc52949ac88 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.151630 Jul 20 11:42:13.393922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3235/6486] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:13 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:42:13.630588 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:42:13.631141 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:42:14.410037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:14.410693 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:14.418035 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:14.418430 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:14.419217 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:14.419664 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:14.424267 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:14.563930 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:14.571731 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-0a34d35a-54de-4a72-bea3-609860f08105 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.165580 Jul 20 11:42:14.572464 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3252/6487] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:14 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:15.588978 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:15.590075 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:15.593056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=36 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:15.598677 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:15.599138 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:15.599942 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:15.600394 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:15.619799 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:15.734547 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:15.742307 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a422f984-a4dd-46b3-8bff-26d7bba351a2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.157329 Jul 20 11:42:15.742881 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3236/6488] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:15 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:16.759480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:16.760276 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:16.763595 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=38 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:16.773196 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:16.773647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:16.774487 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:16.774982 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:16.906506 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:16.914214 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8019a237-144a-403c-b900-81df087fc65e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.158733 Jul 20 11:42:16.914783 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3253/6489] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:16 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:17.931746 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:17.932351 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:17.940141 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.940604 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:17.941369 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:17.941820 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:18.077182 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:18.084300 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-96b6a234-bd23-4daf-a9b3-21f8b3a9c6b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.156754 Jul 20 11:42:18.084867 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3237/6490] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:17 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:19.102065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:19.102632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:19.110714 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:19.111192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:19.112009 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:19.112458 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:19.242393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:19.250955 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ee8281b5-89be-47f8-9a46-5fe122c5510e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.152960 Jul 20 11:42:19.251562 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3254/6491] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:19 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:20.268000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:20.268652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:20.275638 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:20.276098 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:20.277376 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:20.277838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:20.418730 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:20.426542 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b34ccafa-b221-494a-9926-a1ce23995093 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.162457 Jul 20 11:42:20.427119 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3238/6492] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:20 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:21.444423 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:21.444983 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:21.452207 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:21.452662 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:21.453427 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:21.453865 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:21.590127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:21.598078 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-1a5b1e7a-881c-40b4-9fb4-db82613c6381 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.157654 Jul 20 11:42:21.598659 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3255/6493] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:21 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:22.616650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:22.617211 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:22.624865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:22.625324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:22.626089 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:22.626532 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:22.761903 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:22.769487 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e356fcb8-c0cd-4b57-817a-ca6d7ff65f05 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.156884 Jul 20 11:42:22.770134 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3239/6494] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:22 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:23.787438 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:23.788091 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:23.795648 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:23.796102 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:23.796872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:23.797312 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:23.987425 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:23.995043 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-108152fd-0333-4606-993f-7c8267c39944 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.211577 Jul 20 11:42:23.995685 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3256/6495] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:23 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:25.012684 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:25.013324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:25.020289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:25.020761 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:25.021542 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:25.021997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:25.214752 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:25.222683 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d01b18b8-9922-44e1-b128-54a92e13e1c4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.214167 Jul 20 11:42:25.223467 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3240/6496] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:25 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:26.240588 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:26.241240 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:26.248584 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:26.249037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:26.249813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:26.250289 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:26.393420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:26.400990 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-065ba833-02b7-4b4f-8d1d-ee1ec21d73a7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.164351 Jul 20 11:42:26.402090 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3257/6497] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:26 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:27.418430 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:27.419207 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:27.426237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:27.426701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:27.427514 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:27.427965 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:27.558389 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:27.566131 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-758ce5f3-bad9-43bf-9dc2-ec7271cc40ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1522 microversion: 2.1 time: 0.152153 Jul 20 11:42:27.566707 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3241/6498] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:27 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:28.503715 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b320bc95-dc94-4859-862c-cda003636ddb req-c26e4bee-3c05-4272-8b6f-5c9768af814d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2177bf12-8bad-4d61-bf20-6e13a0be72a2", "name": "network-vif-unplugged", "status": "completed", "tag": "5e29e7fa-9c0d-4155-9a9d-688635a77892"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:28.513650 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b320bc95-dc94-4859-862c-cda003636ddb req-c26e4bee-3c05-4272-8b6f-5c9768af814d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:28.514105 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b320bc95-dc94-4859-862c-cda003636ddb req-c26e4bee-3c05-4272-8b6f-5c9768af814d service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:28.526641 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b320bc95-dc94-4859-862c-cda003636ddb req-c26e4bee-3c05-4272-8b6f-5c9768af814d service nova] Creating event network-vif-unplugged:5e29e7fa-9c0d-4155-9a9d-688635a77892 for instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 on n-h1-846219-10 Jul 20 11:42:28.532313 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-b320bc95-dc94-4859-862c-cda003636ddb req-c26e4bee-3c05-4272-8b6f-5c9768af814d service nova] Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:42:28.543307 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b320bc95-dc94-4859-862c-cda003636ddb req-c26e4bee-3c05-4272-8b6f-5c9768af814d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043566 Jul 20 11:42:28.543932 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3258/6499] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:28.583510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:28.584241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:28.592578 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:28.593047 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:28.593840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:28.594288 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:28.756592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:28.767376 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-041c0e94-f218-48a9-9fbc-f157c3e39515 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1521 microversion: 2.1 time: 0.187379 Jul 20 11:42:28.768523 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3242/6500] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:28 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:29.787720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:29.788463 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:29.795269 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:29.795713 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:29.796481 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:29.796922 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:29.932554 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:29.940774 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d2ad3e4c-5e51-484d-a229-cbf1c0a086b6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1519 microversion: 2.1 time: 0.158219 Jul 20 11:42:29.941353 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3259/6501] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:29 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:30.559828 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-eaf557ab-5e6d-4570-ac2d-356958b81006 req-8cf3115c-b101-49bf-8cb3-e331534f2313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2177bf12-8bad-4d61-bf20-6e13a0be72a2", "tag": "5e29e7fa-9c0d-4155-9a9d-688635a77892"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:30.568655 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eaf557ab-5e6d-4570-ac2d-356958b81006 req-8cf3115c-b101-49bf-8cb3-e331534f2313 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.569105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-eaf557ab-5e6d-4570-ac2d-356958b81006 req-8cf3115c-b101-49bf-8cb3-e331534f2313 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:30.580594 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-eaf557ab-5e6d-4570-ac2d-356958b81006 req-8cf3115c-b101-49bf-8cb3-e331534f2313 service nova] Creating event network-changed:5e29e7fa-9c0d-4155-9a9d-688635a77892 for instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 on n-h1-846219-10 Jul 20 11:42:30.585767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-eaf557ab-5e6d-4570-ac2d-356958b81006 req-8cf3115c-b101-49bf-8cb3-e331534f2313 service nova] Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:42:30.597670 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-eaf557ab-5e6d-4570-ac2d-356958b81006 req-8cf3115c-b101-49bf-8cb3-e331534f2313 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042704 Jul 20 11:42:30.598254 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3243/6502] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:30.958078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:30.958938 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:30.967370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.968070 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:30.968899 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:30.969476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:31.171569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:31.179162 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2e63ad89-ea3a-4b31-a741-36f2918276c9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1519 microversion: 2.1 time: 0.225137 Jul 20 11:42:31.179772 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3260/6503] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:30 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:32.199605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:32.200325 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:32.206517 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:32.206983 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:32.207787 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:32.208241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:32.342941 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:32.350700 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-9debf823-b7e6-4665-bdc0-98c740dfeafa tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1519 microversion: 2.1 time: 0.157166 Jul 20 11:42:32.351313 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3244/6504] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:32 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:33.368320 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:33.368926 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:33.377431 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:33.377884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.378647 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:33.379087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.513709 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:33.521373 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d946b94b-95a1-44eb-b790-4f35f0a32ac7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1516 microversion: 2.1 time: 0.157173 Jul 20 11:42:33.521960 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3261/6505] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:33 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:33.537559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:33.538133 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:33.545834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:33.546289 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.547056 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:33.547527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.607142 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-c5b8db40-3d03-4f79-b173-a1be7f476beb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2/action" status: 204 len: 0 microversion: 2.1 time: 0.073370 Jul 20 11:42:33.607794 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3245/6506] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:42:33 2022] POST /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:42:33.616233 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:33.616941 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:33.623418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:33.624039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.624986 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:33.625436 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:33.887761 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:33.895783 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-39eb8715-ac86-42c5-85c7-518550937278 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1516 microversion: 2.1 time: 0.283546 Jul 20 11:42:33.896363 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3262/6507] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:33 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:34.915471 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:34.916286 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:34.923931 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.924406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:34.925197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:34.925652 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:35.067479 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:35.075975 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e429b73e-729f-41b2-a063-17d62aeadaf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1508 microversion: 2.1 time: 0.165991 Jul 20 11:42:35.076565 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3246/6508] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:34 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:35.093143 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:35.093767 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:35.100723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:35.101179 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:35.102251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:35.102393 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:35.236086 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:35.243601 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8a44e127-f432-4789-a305-d3f8052ab62b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1508 microversion: 2.1 time: 0.155182 Jul 20 11:42:35.244182 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3263/6509] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:35 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:35.263360 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-17c246b9-3cdc-439b-931c-b6c0919457c1 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'create', calling method: .version_select at 0x7f2c3e170f70>, body: {"keypair": {"name": "tempest-keypair-866685160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0BEnMbyb1ACJFF7ArCH6JKuIi/R+6sTfqqTtVLoMs4a5fa8De0//WUXgKk66eKiTzxGEUjek6okP0pdZG4O6ezCHDHH/FG/1w9ZkJ4QWuM39h9xoHqOFtpI3OrtPk9Gg=="}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:35.278982 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-17c246b9-3cdc-439b-931c-b6c0919457c1 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Getting quotas for project c697ea2996194bcaa524a1141740d583. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:42:35.284103 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-17c246b9-3cdc-439b-931c-b6c0919457c1 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Getting quotas for user 21b09a0a06ee4a0a9d591c587f6b5630 and project c697ea2996194bcaa524a1141740d583. Resources: {'key_pairs'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:42:35.312603 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-17c246b9-3cdc-439b-931c-b6c0919457c1 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053617 Jul 20 11:42:35.313213 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3247/6510] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:42:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:36.365884 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-4ddff8ea-ec62-4716-a7b7-cfcab51da622 req-b7e9dfc9-dc81-426c-84d2-ff84deb1c5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2177bf12-8bad-4d61-bf20-6e13a0be72a2", "name": "network-vif-plugged", "status": "completed", "tag": "5e29e7fa-9c0d-4155-9a9d-688635a77892"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:36.379887 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4ddff8ea-ec62-4716-a7b7-cfcab51da622 req-b7e9dfc9-dc81-426c-84d2-ff84deb1c5d5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.380468 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-4ddff8ea-ec62-4716-a7b7-cfcab51da622 req-b7e9dfc9-dc81-426c-84d2-ff84deb1c5d5 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.393899 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-4ddff8ea-ec62-4716-a7b7-cfcab51da622 req-b7e9dfc9-dc81-426c-84d2-ff84deb1c5d5 service nova] Creating event network-vif-plugged:5e29e7fa-9c0d-4155-9a9d-688635a77892 for instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 on n-h1-846219-10 Jul 20 11:42:36.399770 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-4ddff8ea-ec62-4716-a7b7-cfcab51da622 req-b7e9dfc9-dc81-426c-84d2-ff84deb1c5d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037815 Jul 20 11:42:36.401334 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3264/6511] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:36.520601 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:36.521237 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:36.528021 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.528480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.529251 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.529696 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.660044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:36.668206 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0c242f7a-ac0d-4b3e-bab2-bc34214dd8ea tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 200 len: 1508 microversion: 2.1 time: 0.152366 Jul 20 11:42:36.668780 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3248/6512] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:36 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:36.684688 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:36.685278 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:36.691539 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.691998 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.692762 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:36.693205 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:36.718813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:42:36.796838 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-259e0171-7e74-4243-82e2-c5a00000d717 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 204 len: 0 microversion: 2.1 time: 0.116037 Jul 20 11:42:36.797432 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3265/6513] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:42:36 2022] DELETE /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:42:36.856592 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-646045559", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "networks": [{"uuid": "e2043ed8-394b-4713-8a1e-7dc6d6e9ae26"}]}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:36.906825 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] validate_networks() for [('e2043ed8-394b-4713-8a1e-7dc6d6e9ae26', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:42:37.331241 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:42:37.331683 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:42:37.332199 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:42:37.332620 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:42:37.333044 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:42:37.343732 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.344198 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.345011 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:37.345462 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:37.362760 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Getting quotas for project c697ea2996194bcaa524a1141740d583. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:42:37.368045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Getting quotas for user 21b09a0a06ee4a0a9d591c587f6b5630 and project c697ea2996194bcaa524a1141740d583. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:42:37.380467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:42:37.382734 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:42:37.426879 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-0784b413-b1c2-49ec-83b4-21b72925fa27 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574741 Jul 20 11:42:37.427492 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3249/6514] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:42:37.438601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-44abf532-761e-42e8-9602-bd9767db8964 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:37.439604 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-44abf532-761e-42e8-9602-bd9767db8964 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:37.504192 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-44abf532-761e-42e8-9602-bd9767db8964 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:37.512862 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-44abf532-761e-42e8-9602-bd9767db8964 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1217 microversion: 2.1 time: 0.078496 Jul 20 11:42:37.513606 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3266/6515] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:37 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:38.531607 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:38.532335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:38.538529 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:38.538989 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:38.539803 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:38.540261 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:38.608196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:38.618207 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-16e7fa2b-5cb7-4e28-8eaf-708f37afc7f5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1269 microversion: 2.1 time: 0.091963 Jul 20 11:42:38.619130 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3250/6516] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:38 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:39.054465 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-d309294b-fbc3-4417-87e7-007513826bf8 req-f9b2de69-d78b-4e2c-ae40-71b76344dee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2177bf12-8bad-4d61-bf20-6e13a0be72a2", "name": "network-vif-deleted", "tag": "5e29e7fa-9c0d-4155-9a9d-688635a77892"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:39.067779 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d309294b-fbc3-4417-87e7-007513826bf8 req-f9b2de69-d78b-4e2c-ae40-71b76344dee2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.068342 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-d309294b-fbc3-4417-87e7-007513826bf8 req-f9b2de69-d78b-4e2c-ae40-71b76344dee2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.081493 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-d309294b-fbc3-4417-87e7-007513826bf8 req-f9b2de69-d78b-4e2c-ae40-71b76344dee2 service nova] Creating event network-vif-deleted:5e29e7fa-9c0d-4155-9a9d-688635a77892 for instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 on n-h1-846219-10 Jul 20 11:42:39.100190 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-d309294b-fbc3-4417-87e7-007513826bf8 req-f9b2de69-d78b-4e2c-ae40-71b76344dee2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049927 Jul 20 11:42:39.101260 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3267/6517] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:39.637425 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:39.638196 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:39.645384 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.645832 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.646628 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:39.647082 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:39.712749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:39.721706 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-47d8ba7e-a823-47e3-8834-9923e9302ad5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1275 microversion: 2.1 time: 0.088706 Jul 20 11:42:39.722297 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3251/6518] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:39 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:40.744258 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:40.744932 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:40.751751 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.752768 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.753914 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:40.754917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:40.894397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:40.902926 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-59e5b635-76b1-425c-8b9c-e9f7469c5e99 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.167369 Jul 20 11:42:40.903545 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3268/6519] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:40 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:41.135161 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-73aee17a-2d1f-4c05-b5c2-8ad93dbec38f req-c9fbac60-9418-4a8e-87c1-d088204863a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02efc29c-932a-46a6-a54a-ac1f01ec8f5b", "tag": "5026825d-76f6-4a0b-a55e-46da09f988ef"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:41.144480 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-73aee17a-2d1f-4c05-b5c2-8ad93dbec38f req-c9fbac60-9418-4a8e-87c1-d088204863a9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.144936 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-73aee17a-2d1f-4c05-b5c2-8ad93dbec38f req-c9fbac60-9418-4a8e-87c1-d088204863a9 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:41.155917 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-73aee17a-2d1f-4c05-b5c2-8ad93dbec38f req-c9fbac60-9418-4a8e-87c1-d088204863a9 service nova] Creating event network-changed:5026825d-76f6-4a0b-a55e-46da09f988ef for instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b on n-h1-846219-10 Jul 20 11:42:41.160788 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-73aee17a-2d1f-4c05-b5c2-8ad93dbec38f req-c9fbac60-9418-4a8e-87c1-d088204863a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029329 Jul 20 11:42:41.161386 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3252/6520] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:41.919765 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:41.920457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:41.927476 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.927931 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:41.928703 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:41.929176 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:42.065576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:42.067934 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:42.075197 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-41311cc1-529f-4fe8-954f-a2f7e8387c6b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.159466 Jul 20 11:42:42.075787 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3269/6521] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:41 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:43.094634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:43.095296 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:43.101605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:43.102064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:43.102838 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:43.103314 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:43.234299 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:43.241760 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-04cb1ddf-7bf8-4ade-bad1-d96a6583e4d0 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.153499 Jul 20 11:42:43.242335 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3253/6522] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:43 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:44.258307 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:44.259007 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:44.268036 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:44.268498 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:44.269316 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:44.269764 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:44.408022 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:44.416567 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-299db428-ac8b-4918-b628-05090af8e821 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.162419 Jul 20 11:42:44.417151 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3270/6523] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:44 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:45.434886 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:45.435481 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:45.442335 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.442788 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.443580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:45.444025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:45.576975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:45.579701 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:45.586627 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-628edeef-b554-4aff-89ca-70caa0dfc904 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.156639 Jul 20 11:42:45.587229 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3254/6524] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:45 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:46.604065 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:46.604729 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:46.612125 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:46.612573 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:46.613389 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:46.613924 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:46.748461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:46.756113 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-047f020a-1265-43e3-8364-1229d5e7288c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.155950 Jul 20 11:42:46.756951 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3271/6525] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:46 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:47.774197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:47.774779 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:47.778320 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:47.779005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell0:SELECT=10 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:47.779897 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:47.787758 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:47.788227 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:47.789022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:47.789754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:47.931105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:47.938962 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-8eef5b60-e98a-48d3-85d9-42f09f774a8b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.169122 Jul 20 11:42:47.939585 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3255/6526] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:47 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:48.428335 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-c14381d7-3e1f-43d2-b296-4550490752bf req-658274b1-d4f2-4696-a59f-96c3dfa5573f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02efc29c-932a-46a6-a54a-ac1f01ec8f5b", "name": "network-vif-plugged", "status": "completed", "tag": "5026825d-76f6-4a0b-a55e-46da09f988ef"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:48.431885 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell0:SELECT=2 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:48.433997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:42:48.444446 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c14381d7-3e1f-43d2-b296-4550490752bf req-658274b1-d4f2-4696-a59f-96c3dfa5573f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.445045 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-c14381d7-3e1f-43d2-b296-4550490752bf req-658274b1-d4f2-4696-a59f-96c3dfa5573f service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.458698 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-c14381d7-3e1f-43d2-b296-4550490752bf req-658274b1-d4f2-4696-a59f-96c3dfa5573f service nova] Creating event network-vif-plugged:5026825d-76f6-4a0b-a55e-46da09f988ef for instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b on n-h1-846219-10 Jul 20 11:42:48.463878 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-c14381d7-3e1f-43d2-b296-4550490752bf req-658274b1-d4f2-4696-a59f-96c3dfa5573f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039452 Jul 20 11:42:48.464810 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3272/6527] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:42:48.955921 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:48.956467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:48.963527 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.963985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:48.965776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:48.966260 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:49.099045 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:49.107840 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-427b622e-5f20-42d7-8c76-9d862df43adf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.155882 Jul 20 11:42:49.108416 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3256/6528] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:48 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:50.127020 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:50.127763 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:50.134081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:50.134527 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:50.135311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:50.135750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:50.272909 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:50.280800 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3b745dc3-0b61-4573-adcd-dbca0f53e5bf tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1317 microversion: 2.1 time: 0.159929 Jul 20 11:42:50.281425 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3273/6529] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:50 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:51.298467 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:51.299106 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:51.305976 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:51.306432 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.307217 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:51.307669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.437206 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.444759 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b754efd5-4069-4dac-a8ec-599801b4727c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1507 microversion: 2.1 time: 0.150198 Jul 20 11:42:51.445435 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3257/6530] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:51 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:51.461380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:51.461994 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:51.469448 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:51.470106 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.470872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:51.471371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.603937 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.612659 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-12bba5cd-5170-42af-8ff6-86d1615d26b5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1507 microversion: 2.1 time: 0.155219 Jul 20 11:42:51.613229 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3274/6531] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:51 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:51.629969 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:42:51.630967 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:51.637120 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:51.637580 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.638345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:51.638782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:51.713028 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:51.719840 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Old instance type m1.heat2, new instance type m1.heat {{(pid=125886) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 20 11:42:51.726022 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:42:51.726695 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:42:51.726933 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:42:51.727488 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:42:51.727910 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:42:52.095285 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-cd49d2e1-edaf-4f6c-b7ef-8fc7e061a1ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b/action" status: 202 len: 0 microversion: 2.1 time: 0.469125 Jul 20 11:42:52.095909 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3258/6532] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:42:51 2022] POST /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:42:52.104048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:52.104890 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:52.111189 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:52.111655 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:52.112533 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:52.113078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:52.273037 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:52.280715 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d52d53b3-322e-41e8-a6cb-1cac95ce460b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1514 microversion: 2.1 time: 0.180584 Jul 20 11:42:52.281301 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3275/6533] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:52 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:53.298963 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:53.299659 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:53.305786 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:53.306243 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:53.307050 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:53.307510 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:53.447064 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:53.456842 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-affaf282-d205-4fec-9267-8c41ec41ebe4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1514 microversion: 2.1 time: 0.162680 Jul 20 11:42:53.457412 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3259/6534] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:53 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:54.474071 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:54.474623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:54.481517 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:54.482473 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:54.483265 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:54.483702 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:54.623322 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:54.630941 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-7d17874d-a346-47cc-a8a5-9beb60999322 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.160940 Jul 20 11:42:54.631558 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3276/6535] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:54 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:55.648586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:55.649343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:55.657128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:55.657596 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:55.658391 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:55.658842 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:55.791731 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:55.799304 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-b94f77bb-3e0c-4f00-b1b9-41227f0f985c tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.154714 Jul 20 11:42:55.799869 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3260/6536] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:55 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:56.817418 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:56.818048 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:56.824873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:56.825347 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:56.826759 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:56.827230 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:56.957412 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:56.965086 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-af1c36cb-8f22-4f11-a7c6-461a6348552b tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.151742 Jul 20 11:42:56.965663 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3277/6537] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:56 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:57.983685 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:57.984348 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:57.991525 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:57.991996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:57.992782 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:57.993234 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:58.125634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:58.133143 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-5d591ae3-8f4b-498e-932e-1e80364665ca tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.153918 Jul 20 11:42:58.133712 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3261/6538] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:57 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:42:59.150593 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:42:59.151250 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:42:59.158681 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:59.159140 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:59.159950 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:42:59.160397 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:42:59.296558 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:42:59.304292 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4b7afe9c-69a7-4059-9bc4-96e5ea30018f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.157946 Jul 20 11:42:59.304869 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3278/6539] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:42:59 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:00.322142 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:00.322783 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:00.330327 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:00.330794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:00.331614 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:00.332067 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:00.469406 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:00.477086 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-bc05e7bc-eb45-47cd-a19e-f38c3b28db29 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.159022 Jul 20 11:43:00.477675 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3262/6540] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:00 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:01.496259 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:01.496829 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:01.504610 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:01.505063 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:01.505830 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:01.506270 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:01.640477 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:01.648098 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3d3cbe29-acbb-4787-ac45-04a008e1e0c6 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.155907 Jul 20 11:43:01.648672 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3279/6541] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:01 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:02.665997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:02.666634 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:02.673092 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:02.673559 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:02.674343 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:02.674798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:02.809408 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:02.817583 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-658538d5-0f00-4d60-b47c-aeb94c2a8c17 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.155727 Jul 20 11:43:02.818157 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3263/6542] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:02 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:03.835842 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:03.836420 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:03.843718 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:03.844174 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:03.844940 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:03.845380 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:03.978145 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:03.986260 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ca5153d2-3e50-4f64-8c84-dfa32cb43713 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.154498 Jul 20 11:43:03.986838 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3280/6543] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:03 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:05.003741 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:05.004300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:05.011455 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.011920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.012708 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:05.013157 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:05.144502 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:05.151963 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-4a36fad3-0228-44a4-a77e-34aafdc03ab5 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.152242 Jul 20 11:43:05.152531 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3264/6544] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:04 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:06.169371 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:06.170743 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:06.178018 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:06.178480 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:06.179299 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:06.179753 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:06.324311 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:06.332621 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-129294e0-f079-44b5-9b48-ca4f8f9d65c8 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.167170 Jul 20 11:43:06.333211 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3281/6545] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:06 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:07.349961 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:07.350593 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:07.358276 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:07.358740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:07.359672 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:07.360130 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:07.491996 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:07.500346 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ed19832f-716b-4065-bc8f-d8ed1ec2d450 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.154318 Jul 20 11:43:07.500922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3265/6546] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:07 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:08.518052 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:08.518613 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:08.525590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.526039 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.526804 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:08.527272 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:08.662079 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:08.669630 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-ea568079-f9f3-4df2-8c85-76661ff59769 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.156224 Jul 20 11:43:08.670362 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3282/6547] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:08 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:09.687856 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:09.688473 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:09.695512 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:09.695975 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:09.696754 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:09.697203 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:09.841041 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:09.848945 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-fdf6452f-2c79-4fe5-81a8-ac9ed8f71045 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.165645 Jul 20 11:43:09.849516 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3266/6548] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:09 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:10.866249 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:10.866873 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:10.874004 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:10.874524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:10.875392 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:10.875835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:11.008750 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:11.016591 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-c7290f1b-7373-49c7-aaec-a9e0bc516081 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.154664 Jul 20 11:43:11.017175 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3283/6549] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:10 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:12.034006 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:12.034689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:12.076164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:12.076164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:12.076164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:12.076164 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:12.185613 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:12.196080 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-88909566-b428-4cdc-9de3-fd750f0eed85 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.166129 Jul 20 11:43:12.196876 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3267/6550] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:12 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:13.214917 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:13.215571 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:13.223684 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.224151 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.225107 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:13.225576 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:13.362915 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:13.370617 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-82b79ade-303c-4f6f-8ee8-fc8a085b01fb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.159657 Jul 20 11:43:13.371217 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3284/6551] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:13 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:14.388736 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:14.389368 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:14.396293 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:14.396757 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:14.397530 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:14.397981 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:14.526943 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:14.536144 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-020fb571-55df-41e2-963d-b919be724028 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.151250 Jul 20 11:43:14.536727 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3268/6552] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:14 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:15.553382 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:15.553977 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:15.561630 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:15.562087 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:15.562862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:15.563862 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:15.566623 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=88 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:15.704871 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:15.712877 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-a991632f-952d-4912-8870-4eca1a79805d tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.163577 Jul 20 11:43:15.713462 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3285/6553] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:15 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:16.729971 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:16.730605 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:16.737920 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.738385 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.739186 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:16.739689 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:16.873642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:16.881350 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f5c5d474-a11b-4392-858d-0e51a4875d30 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.155300 Jul 20 11:43:16.881937 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3269/6554] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:16 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:17.898461 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:17.899076 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:17.906149 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.906601 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:17.907394 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:17.907835 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:18.041822 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:18.049371 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-69fe9d3c-47fb-4230-b210-361e97b8533e tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.154863 Jul 20 11:43:18.049965 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3286/6555] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:17 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:19.067062 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:19.067658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:19.070373 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=34 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:19.076043 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.076553 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.077344 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:19.077813 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:19.081281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:19.213446 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:19.222079 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-65aef21f-d1df-45cd-8866-0ae41124b13f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.160027 Jul 20 11:43:19.222652 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3270/6556] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:19 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:20.239450 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:20.240067 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:20.243407 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=30 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:20.253356 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.254187 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:20.255733 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:20.256551 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:20.397981 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:20.405582 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-b16242f0-09c2-4c35-a960-30c19df9b4a9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1519 microversion: 2.1 time: 0.170095 Jul 20 11:43:20.406166 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3287/6557] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:20 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:21.425455 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:21.426081 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:21.434732 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:21.435629 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:21.436562 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:21.437628 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:21.479665 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-54bf5a69-4093-4156-af01-4c2fbae655e1 req-543079b9-b399-4125-8607-35ff4b7b9bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02efc29c-932a-46a6-a54a-ac1f01ec8f5b", "name": "network-vif-unplugged", "status": "completed", "tag": "5026825d-76f6-4a0b-a55e-46da09f988ef"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:21.490370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-54bf5a69-4093-4156-af01-4c2fbae655e1 req-543079b9-b399-4125-8607-35ff4b7b9bf2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:21.491144 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-54bf5a69-4093-4156-af01-4c2fbae655e1 req-543079b9-b399-4125-8607-35ff4b7b9bf2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:21.503585 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-54bf5a69-4093-4156-af01-4c2fbae655e1 req-543079b9-b399-4125-8607-35ff4b7b9bf2 service nova] Creating event network-vif-unplugged:5026825d-76f6-4a0b-a55e-46da09f988ef for instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b on n-h2-846219-10 Jul 20 11:43:21.510072 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [req-54bf5a69-4093-4156-af01-4c2fbae655e1 req-543079b9-b399-4125-8607-35ff4b7b9bf2 service nova] Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125886) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:43:21.523375 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-54bf5a69-4093-4156-af01-4c2fbae655e1 req-543079b9-b399-4125-8607-35ff4b7b9bf2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170024 Jul 20 11:43:21.524230 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3271/6558] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:21.653351 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:21.661997 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-503de9c6-8d0c-4b5b-a2aa-5b6334ea4cf4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1518 microversion: 2.1 time: 0.242833 Jul 20 11:43:21.662598 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3288/6559] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:21 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 11:43:22.680556 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:22.681222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:22.689520 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.690080 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.690865 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:22.691355 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:22.831599 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:22.839148 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-48c17a15-4c4f-4256-9510-f8b90b462397 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1516 microversion: 2.1 time: 0.162987 Jul 20 11:43:22.839745 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3272/6560] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:22 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:23.538734 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-a50094b6-97a4-4fd4-93fe-b9bba418dcb4 req-5664320f-c78e-4a1c-a9c2-97092c851fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02efc29c-932a-46a6-a54a-ac1f01ec8f5b", "tag": "5026825d-76f6-4a0b-a55e-46da09f988ef"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:23.547872 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a50094b6-97a4-4fd4-93fe-b9bba418dcb4 req-5664320f-c78e-4a1c-a9c2-97092c851fe2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.548318 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-a50094b6-97a4-4fd4-93fe-b9bba418dcb4 req-5664320f-c78e-4a1c-a9c2-97092c851fe2 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:23.560044 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-a50094b6-97a4-4fd4-93fe-b9bba418dcb4 req-5664320f-c78e-4a1c-a9c2-97092c851fe2 service nova] Creating event network-changed:5026825d-76f6-4a0b-a55e-46da09f988ef for instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b on n-h2-846219-10 Jul 20 11:43:23.565457 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [req-a50094b6-97a4-4fd4-93fe-b9bba418dcb4 req-5664320f-c78e-4a1c-a9c2-97092c851fe2 service nova] Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846219-10', 'n-h1-846219-10'} {{(pid=125885) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 20 11:43:23.576158 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-a50094b6-97a4-4fd4-93fe-b9bba418dcb4 req-5664320f-c78e-4a1c-a9c2-97092c851fe2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041709 Jul 20 11:43:23.576761 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3289/6561] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:23.857315 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:23.858000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:23.866267 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.866776 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:23.867635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:23.868108 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:24.054998 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:24.063505 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-e2c73ecf-ddfa-4fc7-88b6-2a9a2c811247 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1516 microversion: 2.1 time: 0.210305 Jul 20 11:43:24.073047 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3273/6562] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:23 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:25.082002 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:25.082632 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.089085 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.089536 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.090315 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.090757 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.234314 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:25.242985 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-059a43b8-e9e0-4b22-89bc-fb5ea896e351 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1513 microversion: 2.1 time: 0.166314 Jul 20 11:43:25.243686 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3290/6563] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:25 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:25.263353 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:25.263929 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.271686 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.272212 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.272972 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.273431 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.333739 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-ad643ee4-344b-4b04-9419-6ae0cc1be095 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "POST /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b/action" status: 204 len: 0 microversion: 2.1 time: 0.074080 Jul 20 11:43:25.334320 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3274/6564] 10.222.0.79 () {60 vars in 1277 bytes} [Wed Jul 20 11:43:25 2022] POST /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:43:25.342851 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:25.343510 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:25.355978 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.356355 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.357141 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:25.357587 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:25.501494 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:25.510530 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-d78337b1-7610-474f-9f03-238897c1a6ec tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1513 microversion: 2.1 time: 0.171840 Jul 20 11:43:25.511291 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3291/6565] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:25 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:26.530334 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:26.531501 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:26.538798 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.539300 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.540095 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:26.540551 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:26.686246 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:26.695023 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-942f36a2-853f-49c7-af3e-0f3a6f85f933 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1513 microversion: 2.1 time: 0.170267 Jul 20 11:43:26.695643 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3275/6566] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:26 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:27.713449 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:27.714078 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:27.721006 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.721470 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:27.722590 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.723271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:27.859967 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:27.871332 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-edf239a3-634b-401e-a0c2-002ff69bf6d2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1505 microversion: 2.1 time: 0.161927 Jul 20 11:43:27.872960 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3292/6567] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:27 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:27.888016 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:27.888745 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:27.896137 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.896699 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:27.897573 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.898118 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:27.980214 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-b4f24314-0a08-4ba9-a312-3b7f04e2414a req-063fa32c-8f45-4203-a95b-3bb518dcb2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02efc29c-932a-46a6-a54a-ac1f01ec8f5b", "name": "network-vif-plugged", "status": "completed", "tag": "5026825d-76f6-4a0b-a55e-46da09f988ef"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:27.989569 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b4f24314-0a08-4ba9-a312-3b7f04e2414a req-063fa32c-8f45-4203-a95b-3bb518dcb2d6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:27.989990 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-b4f24314-0a08-4ba9-a312-3b7f04e2414a req-063fa32c-8f45-4203-a95b-3bb518dcb2d6 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.004615 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-b4f24314-0a08-4ba9-a312-3b7f04e2414a req-063fa32c-8f45-4203-a95b-3bb518dcb2d6 service nova] Creating event network-vif-plugged:5026825d-76f6-4a0b-a55e-46da09f988ef for instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b on n-h2-846219-10 Jul 20 11:43:28.009897 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-b4f24314-0a08-4ba9-a312-3b7f04e2414a req-063fa32c-8f45-4203-a95b-3bb518dcb2d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Jul 20 11:43:28.010695 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3293/6568] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:28.032370 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:28.041456 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-f2d6bbc8-ca09-40f4-afa6-18ee66d53dd7 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1505 microversion: 2.1 time: 0.157058 Jul 20 11:43:28.042052 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3276/6569] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:27 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:28.059432 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.059585 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.067264 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.067720 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.068509 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.068928 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.203557 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:28.211506 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6e6580b4-691f-4322-a5fc-f538da599bfb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1505 microversion: 2.1 time: 0.157105 Jul 20 11:43:28.212090 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3294/6570] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:28 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:28.228255 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.228781 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.234870 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.235383 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.236172 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.236635 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.262159 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Going to try to terminate instance {{(pid=125886) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:43:28.345774 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-7dc31b1d-ad73-4a94-9dce-08f33db536a4 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "DELETE /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 204 len: 0 microversion: 2.1 time: 0.121171 Jul 20 11:43:28.346386 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3277/6571] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:43:28 2022] DELETE /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:43:28.365689 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.366201 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.372444 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.372902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.373676 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.374124 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.399251 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Going to try to terminate instance {{(pid=125885) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 11:43:28.444851 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.compute.api [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Instance is already in deleting state, ignoring this request Jul 20 11:43:28.445620 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-483e120f-554b-4d1f-96d6-a54844db912f tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "DELETE /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 204 len: 0 microversion: 2.1 time: 0.084750 Jul 20 11:43:28.446203 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3295/6572] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:43:28 2022] DELETE /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 11:43:28.454907 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:28.455658 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:28.462669 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.463128 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.464197 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:28.464650 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:28.605105 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:28.612903 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-6e634d11-199c-4815-b182-500b92e05fb9 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1511 microversion: 2.1 time: 0.162338 Jul 20 11:43:28.613478 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3278/6573] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:28 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:29.630370 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:29.630997 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:29.637875 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.638332 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.639108 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:29.639580 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:29.953698 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21b09a0a06ee4a0a9d591c587f6b5630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c697ea2996194bcaa524a1141740d583', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:29.961297 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-8882e2cd-46a0-464a-8969-2c81d84b4ec3 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 200 len: 1511 microversion: 2.1 time: 0.335470 Jul 20 11:43:29.962102 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3296/6574] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:29 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:30.223148 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-4d449f2f-2cbb-4b0f-b306-c16df52fabd9 req-2a6420e5-681f-4165-93d9-f8b5cc391336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02efc29c-932a-46a6-a54a-ac1f01ec8f5b", "name": "network-vif-deleted", "tag": "5026825d-76f6-4a0b-a55e-46da09f988ef"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:30.240893 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4d449f2f-2cbb-4b0f-b306-c16df52fabd9 req-2a6420e5-681f-4165-93d9-f8b5cc391336 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.241834 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-4d449f2f-2cbb-4b0f-b306-c16df52fabd9 req-2a6420e5-681f-4165-93d9-f8b5cc391336 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.255561 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-4d449f2f-2cbb-4b0f-b306-c16df52fabd9 req-2a6420e5-681f-4165-93d9-f8b5cc391336 service nova] Creating event network-vif-deleted:5026825d-76f6-4a0b-a55e-46da09f988ef for instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b on n-h2-846219-10 Jul 20 11:43:30.260735 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-4d449f2f-2cbb-4b0f-b306-c16df52fabd9 req-2a6420e5-681f-4165-93d9-f8b5cc391336 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043900 Jul 20 11:43:30.261529 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3279/6575] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 11:43:30.978031 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:30.978660 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 02efc29c-932a-46a6-a54a-ac1f01ec8f5b] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:30.985737 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.986193 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:30.986968 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:30.987958 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.001276 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] HTTP exception thrown: Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b could not be found. Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Request method failure captured: Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: request: GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b HTTP/1.1 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-n3bso4BJGFSO5VnD1aRxzR-rGJaik6rATjTXM-LzZpRAEg2WOY6bhBGtqQxxhnfdvcD3qYIW2dR9HlctoWlOwU8ZLRKJzKwzxkFdj_ElKHtpyyKBharPP6xkOga6eKN_vfYvcQU0Az9R3OZZ4F7k7bjZ4q0VI3fv7-us1ZflMqaiQ Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c697ea2996194bcaa524a1141740d583 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c697ea2996194bcaa524a1141740d583", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c697ea2996194bcaa524a1141740d583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c697ea2996194bcaa524a1141740d583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c697ea2996194bcaa524a1141740d583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c697ea2996194bcaa524a1141740d583 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerDiskConfigTestJSON-696539449-project Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 21b09a0a06ee4a0a9d591c587f6b5630 Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerDiskConfigTestJSON-696539449-project Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b could not be found. Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '02efc29c-932a-46a6-a54a-ac1f01ec8f5b'} Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b could not be found. Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b could not be found. Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:31.003621 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b could not be found. Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Returning 404 to user: Instance 02efc29c-932a-46a6-a54a-ac1f01ec8f5b could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-3f02e0b3-202c-49d0-81e7-843660085610 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b" status: 404 len: 111 microversion: 2.1 time: 0.031045 Jul 20 11:43:31.007306 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3297/6576] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:30 2022] GET /compute/v2.1/servers/02efc29c-932a-46a6-a54a-ac1f01ec8f5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:43:31.014675 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-a32a6539-3c2b-4755-a140-82030fb3a7e2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '.version_select at 0x7f2c3e450040>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:31.033335 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-a32a6539-3c2b-4755-a140-82030fb3a7e2 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866685160" status: 202 len: 0 microversion: 2.1 time: 0.022924 Jul 20 11:43:31.033922 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3280/6577] 10.222.0.79 () {58 vars in 1217 bytes} [Wed Jul 20 11:43:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866685160 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 11:43:31.649158 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:31.649694 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:31.656043 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.656500 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.657271 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.657712 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.672006 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.wsgi [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] HTTP exception thrown: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Request method failure captured: Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: request: DELETE /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 HTTP/1.1 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Accept: application/json Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Accept-Encoding: identity Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Connection: close Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Content-Length: 0 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Content-Type: application/json Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Host: 10.222.0.79 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: Openstack-System-Scope: None Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Auth-Token: gAAAAABi1-n3bso4BJGFSO5VnD1aRxzR-rGJaik6rATjTXM-LzZpRAEg2WOY6bhBGtqQxxhnfdvcD3qYIW2dR9HlctoWlOwU8ZLRKJzKwzxkFdj_ElKHtpyyKBharPP6xkOga6eKN_vfYvcQU0Az9R3OZZ4F7k7bjZ4q0VI3fv7-us1ZflMqaiQ Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Id: None Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Domain-Name: None Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Identity-Status: Confirmed Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Is-Admin-Project: True Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Id: default Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Domain-Name: Default Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Id: c697ea2996194bcaa524a1141740d583 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Project-Name: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Role: reader,member Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Roles: reader,member Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c697ea2996194bcaa524a1141740d583", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c697ea2996194bcaa524a1141740d583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c697ea2996194bcaa524a1141740d583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c697ea2996194bcaa524a1141740d583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Id: c697ea2996194bcaa524a1141740d583 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-User: tempest-ServerDiskConfigTestJSON-696539449-project Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Id: default Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-User-Domain-Name: Default Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-User-Id: 21b09a0a06ee4a0a9d591c587f6b5630 Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: X-User-Name: tempest-ServerDiskConfigTestJSON-696539449-project Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: method: > Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: exception: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: action_args: {'id': '2177bf12-8bad-4d61-bf20-6e13a0be72a2'} Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:43:31.673561 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Returning 404 to user: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. {{(pid=125885) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-6aae99ed-3ec4-4537-bf3f-edb071c12aeb tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 404 len: 111 microversion: 2.1 time: 0.029746 Jul 20 11:43:31.677833 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3298/6578] 10.222.0.79 () {58 vars in 1238 bytes} [Wed Jul 20 11:43:31 2022] DELETE /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 11:43:31.684906 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:31.685664 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] [instance: 2177bf12-8bad-4d61-bf20-6e13a0be72a2] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:31.692538 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.692997 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.693773 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:31.694222 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:31.707856 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.wsgi [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] HTTP exception thrown: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Request method failure captured: Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: request: GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 HTTP/1.1 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Accept: application/json Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Accept-Encoding: identity Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Connection: close Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Content-Length: 0 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Content-Type: application/json Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Host: 10.222.0.79 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: Openstack-System-Scope: None Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: User-Agent: python-urllib3/1.26.9 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Auth-Token: gAAAAABi1-n3bso4BJGFSO5VnD1aRxzR-rGJaik6rATjTXM-LzZpRAEg2WOY6bhBGtqQxxhnfdvcD3qYIW2dR9HlctoWlOwU8ZLRKJzKwzxkFdj_ElKHtpyyKBharPP6xkOga6eKN_vfYvcQU0Az9R3OZZ4F7k7bjZ4q0VI3fv7-us1ZflMqaiQ Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Id: None Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Domain-Name: None Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Identity-Status: Confirmed Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Is-Admin-Project: True Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Id: default Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Domain-Name: Default Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Id: c697ea2996194bcaa524a1141740d583 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Project-Name: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Role: reader,member Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Roles: reader,member Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c697ea2996194bcaa524a1141740d583", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c697ea2996194bcaa524a1141740d583"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c697ea2996194bcaa524a1141740d583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c697ea2996194bcaa524a1141740d583"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Id: c697ea2996194bcaa524a1141740d583 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-696539449 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-User: tempest-ServerDiskConfigTestJSON-696539449-project Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Id: default Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-User-Domain-Name: Default Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-User-Id: 21b09a0a06ee4a0a9d591c587f6b5630 Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: X-User-Name: tempest-ServerDiskConfigTestJSON-696539449-project Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: method: > Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: exception: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: action_args: {'id': '2177bf12-8bad-4d61-bf20-6e13a0be72a2'} Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 11:43:31.709719 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: ERROR nova.api.openstack.wsgi Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] Returning 404 to user: Instance 2177bf12-8bad-4d61-bf20-6e13a0be72a2 could not be found. {{(pid=125886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-775da008-dc14-4576-a246-ac2384906b92 tempest-ServerDiskConfigTestJSON-696539449 tempest-ServerDiskConfigTestJSON-696539449-project] 10.222.0.79 "GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2" status: 404 len: 111 microversion: 2.1 time: 0.030798 Jul 20 11:43:31.712847 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3281/6579] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:31 2022] GET /compute/v2.1/servers/2177bf12-8bad-4d61-bf20-6e13a0be72a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 11:43:40.084841 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-379af91f-0d76-4a94-8bc3-4c4bf8044381 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Action: 'create', calling method: .version_select at 0x7f2c3e6b8820>, body: {"keypair": {"name": "tempest-keypair-1951577505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuR9DxU2CId1wSUfCw/PzjfXVJvy92EMXkAMzPEFfoktwftV84I9niD+CNTtfJ7Gv/YpFlNlC81uUI9a6lhl2scekmZICQjP1baynaLDzjP+NNKMr1sKIAfVS3cYXV+Yg=="}} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:40.102029 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-379af91f-0d76-4a94-8bc3-4c4bf8044381 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Getting quotas for project a341ebcddf0a4fdd9cc12f66f6407546. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:43:40.108902 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.quota [None req-379af91f-0d76-4a94-8bc3-4c4bf8044381 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Getting quotas for user 7f5b5c995f2442a8bd32f8f00d323098 and project a341ebcddf0a4fdd9cc12f66f6407546. Resources: {'key_pairs'} {{(pid=125885) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:43:40.142508 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-379af91f-0d76-4a94-8bc3-4c4bf8044381 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178430 Jul 20 11:43:40.143254 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3299/6580] 10.222.0.79 () {60 vars in 1158 bytes} [Wed Jul 20 11:43:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:41.905586 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1630118283", "imageRef": "478de60b-94fe-4326-bea5-987154e218b6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd54f459-4e86-4ff5-894c-e5eaa087db04"}], "security_groups": [{"name": "tempest-securitygroup--1897982950"}], "key_name": "tempest-keypair-1951577505", "user_data": "}} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:41.914794 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:41.915749 n-d-846219-10 devstack@n-api.service[125886]: DEBUG dbcounter [-] [125886] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:42.282642 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.network.neutron [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] validate_networks() for [('bd54f459-4e86-4ff5-894c-e5eaa087db04', None, None, None, None, None)] {{(pid=125886) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 11:43:42.675165 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Flavor limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 11:43:42.675740 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Image limits 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 11:43:42.676345 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Flavor pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 11:43:42.676850 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Image pref 0:0:0 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 11:43:42.677518 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.virt.hardware [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125886) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 11:43:42.686572 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:42.687039 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:42.688005 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:42.688460 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:42.705827 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Getting quotas for project a341ebcddf0a4fdd9cc12f66f6407546. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 11:43:42.711281 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.quota [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Getting quotas for user 7f5b5c995f2442a8bd32f8f00d323098 and project a341ebcddf0a4fdd9cc12f66f6407546. Resources: {'instances', 'ram', 'cores'} {{(pid=125886) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 11:43:42.724985 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Going to run 1 instances... {{(pid=125886) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 11:43:42.727324 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] [instance: cc3b8f3b-65a4-4a96-a514-83831e2d4e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='478de60b-94fe-4326-bea5-987154e218b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125886) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 11:43:42.776560 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-d5f3cfca-a214-4408-a471-49a09c65f019 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.875140 Jul 20 11:43:42.777925 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3282/6581] 10.222.0.79 () {60 vars in 1146 bytes} [Wed Jul 20 11:43:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 11:43:42.788206 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-4e6959da-3c3c-46e5-9d5b-23f46ffb5288 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:42.788844 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-4e6959da-3c3c-46e5-9d5b-23f46ffb5288 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] [instance: cc3b8f3b-65a4-4a96-a514-83831e2d4e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:42.792723 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:43.007292 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-4e6959da-3c3c-46e5-9d5b-23f46ffb5288 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5b5c995f2442a8bd32f8f00d323098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341ebcddf0a4fdd9cc12f66f6407546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:43.016708 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-4e6959da-3c3c-46e5-9d5b-23f46ffb5288 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] 10.222.0.79 "GET /compute/v2.1/servers/cc3b8f3b-65a4-4a96-a514-83831e2d4e57" status: 200 len: 1239 microversion: 2.1 time: 0.233282 Jul 20 11:43:43.017638 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3300/6582] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:42 2022] GET /compute/v2.1/servers/cc3b8f3b-65a4-4a96-a514-83831e2d4e57 => generated 1239 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:44.044000 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Calling method '>' {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:44.044662 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.compute.api [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] [instance: cc3b8f3b-65a4-4a96-a514-83831e2d4e57] Fetching instance by UUID {{(pid=125886) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:44.056392 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:44.056887 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:44.057724 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:44.058132 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:44.128428 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.policy [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5b5c995f2442a8bd32f8f00d323098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341ebcddf0a4fdd9cc12f66f6407546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125886) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:44.136398 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [None req-647686d4-97f0-47b5-ab28-d5e51421fde8 tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] 10.222.0.79 "GET /compute/v2.1/servers/cc3b8f3b-65a4-4a96-a514-83831e2d4e57" status: 200 len: 1309 microversion: 2.1 time: 0.105928 Jul 20 11:43:44.137211 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3283/6583] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:44 2022] GET /compute/v2.1/servers/cc3b8f3b-65a4-4a96-a514-83831e2d4e57 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:45.156570 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Calling method '>' {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 11:43:45.157096 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.compute.api [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] [instance: cc3b8f3b-65a4-4a96-a514-83831e2d4e57] Fetching instance by UUID {{(pid=125885) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 11:43:45.165263 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:45.166326 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:45.167127 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:45.167640 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:45.334524 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.policy [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f5b5c995f2442a8bd32f8f00d323098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a341ebcddf0a4fdd9cc12f66f6407546', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125885) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 11:43:45.343488 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [None req-2ad774d4-4667-4947-8fe4-df8860e51d0c tempest-ServerActionsTestJSON-1240617819 tempest-ServerActionsTestJSON-1240617819-project] 10.222.0.79 "GET /compute/v2.1/servers/cc3b8f3b-65a4-4a96-a514-83831e2d4e57" status: 200 len: 1365 microversion: 2.1 time: 0.192398 Jul 20 11:43:45.354060 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3301/6584] 10.222.0.79 () {58 vars in 1235 bytes} [Wed Jul 20 11:43:45 2022] GET /compute/v2.1/servers/cc3b8f3b-65a4-4a96-a514-83831e2d4e57 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 11:43:45.444393 n-d-846219-10 devstack@n-api.service[125886]: DEBUG nova.api.openstack.wsgi [req-d02a085c-d38d-48e9-a30d-20e8c4d8ac00 req-4414a8c0-2212-4b2f-b9c9-f96853dfaf08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3b8f3b-65a4-4a96-a514-83831e2d4e57", "tag": "52a6efbe-4faf-4a9c-abe4-56d74e6c1e42"}]} {{(pid=125886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:45.461025 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d02a085c-d38d-48e9-a30d-20e8c4d8ac00 req-4414a8c0-2212-4b2f-b9c9-f96853dfaf08 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:45.461767 n-d-846219-10 devstack@n-api.service[125886]: DEBUG oslo_concurrency.lockutils [req-d02a085c-d38d-48e9-a30d-20e8c4d8ac00 req-4414a8c0-2212-4b2f-b9c9-f96853dfaf08 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:45.478266 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.compute.server_external_events [req-d02a085c-d38d-48e9-a30d-20e8c4d8ac00 req-4414a8c0-2212-4b2f-b9c9-f96853dfaf08 service nova] Creating event network-changed:52a6efbe-4faf-4a9c-abe4-56d74e6c1e42 for instance cc3b8f3b-65a4-4a96-a514-83831e2d4e57 on n-h1-846219-10 Jul 20 11:43:45.486446 n-d-846219-10 devstack@n-api.service[125886]: INFO nova.api.openstack.requestlog [req-d02a085c-d38d-48e9-a30d-20e8c4d8ac00 req-4414a8c0-2212-4b2f-b9c9-f96853dfaf08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045102 Jul 20 11:43:45.487219 n-d-846219-10 devstack@n-api.service[125886]: [pid: 125886|app: 0|req: 3284/6585] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:43:52.714812 n-d-846219-10 devstack@n-api.service[125885]: DEBUG nova.api.openstack.wsgi [req-04751576-be7e-4e72-934d-192925181376 req-2c2090e4-f5e1-4332-bb2c-2d0de7e81617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3b8f3b-65a4-4a96-a514-83831e2d4e57", "name": "network-vif-plugged", "status": "completed", "tag": "52a6efbe-4faf-4a9c-abe4-56d74e6c1e42"}]} {{(pid=125885) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 11:43:52.719813 n-d-846219-10 devstack@n-api.service[125885]: DEBUG dbcounter [-] [125885] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 11:43:52.727592 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-04751576-be7e-4e72-934d-192925181376 req-2c2090e4-f5e1-4332-bb2c-2d0de7e81617 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 11:43:52.728110 n-d-846219-10 devstack@n-api.service[125885]: DEBUG oslo_concurrency.lockutils [req-04751576-be7e-4e72-934d-192925181376 req-2c2090e4-f5e1-4332-bb2c-2d0de7e81617 service nova] Lock "49960821-bda1-4b33-831a-e91b6414edd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125885) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 11:43:52.743713 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.compute.server_external_events [req-04751576-be7e-4e72-934d-192925181376 req-2c2090e4-f5e1-4332-bb2c-2d0de7e81617 service nova] Creating event network-vif-plugged:52a6efbe-4faf-4a9c-abe4-56d74e6c1e42 for instance cc3b8f3b-65a4-4a96-a514-83831e2d4e57 on n-h1-846219-10 Jul 20 11:43:52.749642 n-d-846219-10 devstack@n-api.service[125885]: INFO nova.api.openstack.requestlog [req-04751576-be7e-4e72-934d-192925181376 req-2c2090e4-f5e1-4332-bb2c-2d0de7e81617 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038433 Jul 20 11:43:52.750289 n-d-846219-10 devstack@n-api.service[125885]: [pid: 125885|app: 0|req: 3302/6586] 10.222.0.79 () {64 vars in 1317 bytes} [Wed Jul 20 11:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 11:47:12.826924 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:47:12.827690 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:48:51.759200 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:48:51.759832 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:48:52.508477 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:48:52.508670 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:48:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:48:52.511146 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:48:52.511872 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:48:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:48:53.643917 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:48:53.644504 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:49:10.366284 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:49:10.366934 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:50:32.836678 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:50:32.837393 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:52:11.768472 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:52:11.769081 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:52:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:52:12.521788 n-d-846219-10 devstack@n-api.service[125886]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:52:12.522288 n-d-846219-10 devstack@n-api.service[125886]: Wed Jul 20 11:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:52:12.558436 n-d-846219-10 devstack@n-api.service[125886]: Traceback (most recent call last): Jul 20 11:52:12.558436 n-d-846219-10 devstack@n-api.service[125886]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 20 11:52:12.558436 n-d-846219-10 devstack@n-api.service[125886]: timer() Jul 20 11:52:12.558835 n-d-846219-10 devstack@n-api.service[125886]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 20 11:52:12.558835 n-d-846219-10 devstack@n-api.service[125886]: cb(*args, **kw) Jul 20 11:52:12.558835 n-d-846219-10 devstack@n-api.service[125886]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 20 11:52:12.558835 n-d-846219-10 devstack@n-api.service[125886]: waiter.switch() Jul 20 11:52:12.558835 n-d-846219-10 devstack@n-api.service[125886]: greenlet.error: cannot switch to a different thread Jul 20 11:52:13.652187 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:52:13.654230 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:52:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 11:52:30.376604 n-d-846219-10 devstack@n-api.service[125885]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 11:52:30.377206 n-d-846219-10 devstack@n-api.service[125885]: Wed Jul 20 11:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!